2023-06-23T18:39:09.067 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T18:39:09.069 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_rishabh@teuthology --verbose --name rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi --archive /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313897 -- /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313897/orig.config.yaml 2023-06-23T18:39:09.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T18:39:09.211 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313897 branch: wip-rishabh-improvements-authmon description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7313897' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-improvements-authmon ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-improvements-authmon sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-improvements-authmon suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi178.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 076bbebc42a14f7d568aaa78eabb0038327bcb23 timestamp: 2023-06-23_17:37:30 tube: smithi user: rishabh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-23T18:39:09.211 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa; will attempt to use it 2023-06-23T18:39:09.212 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa/tasks 2023-06-23T18:39:09.212 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-23T18:39:09.214 INFO:teuthology.task.internal:Checking packages... 2023-06-23T18:39:09.243 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '8627af3e0adcb765a3c249fcc209cba9f4873e1b' 2023-06-23T18:39:09.244 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-23T18:39:09.244 INFO:teuthology.packaging:ref: None 2023-06-23T18:39:09.244 INFO:teuthology.packaging:tag: None 2023-06-23T18:39:09.245 INFO:teuthology.packaging:branch: wip-rishabh-improvements-authmon 2023-06-23T18:39:09.245 INFO:teuthology.packaging:sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:39:09.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-improvements-authmon 2023-06-23T18:39:09.386 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4479.g8627af3e 2023-06-23T18:39:09.387 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-23T18:39:09.393 INFO:teuthology.task.internal:no buildpackages task found 2023-06-23T18:39:09.393 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-23T18:39:09.414 INFO:teuthology.task.internal:Saving configuration 2023-06-23T18:39:09.431 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-23T18:39:09.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T18:39:09.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313897', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:33:48.904057', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-23T18:39:09.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313897', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:33:48.902053', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-23T18:39:09.494 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-23T18:39:09.500 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-23T18:39:09.501 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-23T18:39:09.501 INFO:teuthology.run_tasks:Running task console_log... 2023-06-23T18:39:09.583 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe1a6b6c040>, signals=[15]) 2023-06-23T18:39:09.584 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-23T18:39:09.590 INFO:teuthology.task.internal:Opening connections... 2023-06-23T18:39:09.591 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2023-06-23T18:39:09.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:39:09.662 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2023-06-23T18:39:09.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:39:09.730 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-23T18:39:09.738 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-06-23T18:39:09.758 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-06-23T18:39:09.759 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-06-23T18:39:09.817 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T18:39:09.818 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2023-06-23T18:39:09.818 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-06-23T18:39:09.819 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-06-23T18:39:09.819 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2023-06-23T18:39:09.819 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-06-23T18:39:09.819 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-23T18:39:09.819 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-06-23T18:39:09.819 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-23T18:39:09.819 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T18:39:09.820 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T18:39:09.820 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T18:39:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:39:09.820 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T18:39:09.820 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-23T18:39:09.820 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T18:39:09.821 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-23T18:39:09.821 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-06-23T18:39:09.851 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-06-23T18:39:09.871 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-06-23T18:39:09.872 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-06-23T18:39:09.930 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T18:39:09.930 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2023-06-23T18:39:09.931 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-06-23T18:39:09.931 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-06-23T18:39:09.931 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2023-06-23T18:39:09.931 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-06-23T18:39:09.931 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-23T18:39:09.931 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-06-23T18:39:09.931 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-23T18:39:09.932 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T18:39:09.932 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T18:39:09.932 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T18:39:09.932 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:39:09.932 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T18:39:09.932 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-23T18:39:09.932 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T18:39:09.933 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-23T18:39:09.933 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-06-23T18:39:09.958 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-23T18:39:09.968 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-23T18:39:09.974 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-23T18:39:09.974 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:39:09.976 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:39:09.994 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-23T18:39:10.001 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-23T18:39:10.001 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:39:10.035 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:39:10.062 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-23T18:39:10.122 INFO:teuthology.run_tasks:Running task kernel... 2023-06-23T18:39:10.141 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-06-23T18:39:10.142 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-06-23T18:39:10.142 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-06-23T18:39:10.143 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:39:10.144 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:39:10.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:39:10.162 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-06-23T18:39:10.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:39:10.166 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-06-23T18:39:10.436 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-23T18:39:10.436 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1c622d92b6f18ce44a7c33802686ff61c3c273ab"... 2023-06-23T18:39:10.437 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2023-06-23T18:39:10.441 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-23T18:39:10.442 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1c622d92b6f18ce44a7c33802686ff61c3c273ab"... 2023-06-23T18:39:10.442 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2023-06-23T18:39:10.456 INFO:teuthology.orchestra.run.smithi178.stdout:4.18.0-372.9.1.el8.x86_64 2023-06-23T18:39:10.456 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-23T18:39:10.457 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-23T18:39:10.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum upgrade -y linux-firmware 2023-06-23T18:39:10.461 INFO:teuthology.orchestra.run.smithi136.stdout:4.18.0-372.9.1.el8.x86_64 2023-06-23T18:39:10.461 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-23T18:39:10.462 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-23T18:39:10.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum upgrade -y linux-firmware 2023-06-23T18:39:11.649 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-06-23T18:39:11.649 INFO:teuthology.orchestra.run.smithi136.stdout:Unable to read consumer identity 2023-06-23T18:39:11.733 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-06-23T18:39:11.734 INFO:teuthology.orchestra.run.smithi178.stdout:Unable to read consumer identity 2023-06-23T18:39:15.343 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-23T18:39:15.442 INFO:teuthology.orchestra.run.smithi178.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-06-23T18:39:18.026 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 16 MB 00:02 2023-06-23T18:39:18.052 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 16 MB 00:02 2023-06-23T18:39:21.501 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 608 kB/s | 24 kB 00:00 2023-06-23T18:39:21.510 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 417 kB/s | 24 kB 00:00 2023-06-23T18:39:22.183 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2023-06-23T18:39:22.184 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2023-06-23T18:39:22.184 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2023-06-23T18:39:22.261 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-06-23T18:39:22.262 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-06-23T18:39:22.262 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-06-23T18:39:22.301 INFO:teuthology.task.kernel:Downloading kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.0... 2023-06-23T18:39:22.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-23T18:39:22.383 INFO:teuthology.task.kernel:Downloading kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.1... 2023-06-23T18:39:22.383 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-23T18:39:22.518 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ 2023-06-23T18:39:22.518 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ --input-file=- 2023-06-23T18:39:22.521 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi136.front.sepia.ceph.com to complete... 2023-06-23T18:39:22.526 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ 2023-06-23T18:39:22.526 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ --input-file=- 2023-06-23T18:39:22.528 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi178.front.sepia.ceph.com to complete... 2023-06-23T18:39:44.412 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23 18:39:44 URL:https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm [379883408/379883408] -> "/tmp/kernel.x86_64.rpm" [1] 2023-06-23T18:39:44.413 INFO:teuthology.orchestra.run.smithi178.stderr:FINISHED --2023-06-23 18:39:44-- 2023-06-23T18:39:44.413 INFO:teuthology.orchestra.run.smithi178.stderr:Total wall clock time: 22s 2023-06-23T18:39:44.413 INFO:teuthology.orchestra.run.smithi178.stderr:Downloaded: 1 files, 362M in 22s (16.8 MB/s) 2023-06-23T18:39:44.415 INFO:teuthology.task.kernel:Installing kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.1... 2023-06-23T18:39:44.415 DEBUG:teuthology.orchestra.run.smithi178:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-06-23T18:39:45.995 INFO:teuthology.orchestra.run.smithi178.stdout:Verifying... ######################################## 2023-06-23T18:39:46.052 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing... ######################################## 2023-06-23T18:39:46.152 INFO:teuthology.orchestra.run.smithi178.stdout:Updating / installing... 2023-06-23T18:39:49.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23 18:39:49 URL:https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm [379883408/379883408] -> "/tmp/kernel.x86_64.rpm" [1] 2023-06-23T18:39:49.007 INFO:teuthology.orchestra.run.smithi136.stderr:FINISHED --2023-06-23 18:39:49-- 2023-06-23T18:39:49.008 INFO:teuthology.orchestra.run.smithi136.stderr:Total wall clock time: 26s 2023-06-23T18:39:49.008 INFO:teuthology.orchestra.run.smithi136.stderr:Downloaded: 1 files, 362M in 26s (13.9 MB/s) 2023-06-23T18:39:49.010 INFO:teuthology.task.kernel:Installing kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.0... 2023-06-23T18:39:49.010 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-06-23T18:39:50.645 INFO:teuthology.orchestra.run.smithi136.stdout:Verifying... ######################################## 2023-06-23T18:39:50.717 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing... ######################################## 2023-06-23T18:39:50.804 INFO:teuthology.orchestra.run.smithi136.stdout:Updating / installing... 2023-06-23T18:40:24.193 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-6.4.0_rc5_g1c622d92b6f1-1 ######################################## 2023-06-23T18:40:28.640 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-6.4.0_rc5_g1c622d92b6f1-1 ######################################## 2023-06-23T18:40:47.339 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi178.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-06-23T18:40:47.339 DEBUG:teuthology.orchestra.run.smithi178:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-06-23T18:40:47.367 INFO:teuthology.orchestra.run.smithi178.stdout:/boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:47.368 INFO:teuthology.orchestra.run.smithi178.stdout:/boot/config-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:47.368 INFO:teuthology.orchestra.run.smithi178.stdout:/boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:47.368 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:47.368 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel 2023-06-23T18:40:47.368 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch 2023-06-23T18:40:47.368 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86 2023-06-23T18:40:47.369 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto 2023-06-23T18:40:47.369 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-23T18:40:47.369 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-23T18:40:47.369 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-23T18:40:47.369 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-23T18:40:47.369 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-23T18:40:47.369 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-23T18:40:47.369 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-23T18:40:47.370 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32c-intel.ko 2023-06-23T18:40:47.370 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-23T18:40:47.370 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-23T18:40:47.370 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-23T18:40:47.370 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-23T18:40:47.370 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-23T18:40:47.370 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-23T18:40:47.371 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-23T18:40:47.371 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-23T18:40:47.371 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-23T18:40:47.371 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-23T18:40:47.371 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-23T18:40:47.371 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-23T18:40:47.371 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel 2023-06-23T18:40:47.371 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu 2023-06-23T18:40:47.372 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce 2023-06-23T18:40:47.372 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-23T18:40:47.372 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm 2023-06-23T18:40:47.372 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-23T18:40:47.372 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-23T18:40:47.372 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm.ko 2023-06-23T18:40:47.372 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto 2023-06-23T18:40:47.373 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ansi_cprng.ko 2023-06-23T18:40:47.373 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/anubis.ko 2023-06-23T18:40:47.373 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/arc4.ko 2023-06-23T18:40:47.373 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx 2023-06-23T18:40:47.373 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_memcpy.ko 2023-06-23T18:40:47.373 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_pq.ko 2023-06-23T18:40:47.373 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-23T18:40:47.373 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_tx.ko 2023-06-23T18:40:47.374 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_xor.ko 2023-06-23T18:40:47.374 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/raid6test.ko 2023-06-23T18:40:47.374 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authenc.ko 2023-06-23T18:40:47.374 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authencesn.ko 2023-06-23T18:40:47.374 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blake2b_generic.ko 2023-06-23T18:40:47.374 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_common.ko 2023-06-23T18:40:47.374 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_generic.ko 2023-06-23T18:40:47.375 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/camellia_generic.ko 2023-06-23T18:40:47.375 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast5_generic.ko 2023-06-23T18:40:47.375 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast6_generic.ko 2023-06-23T18:40:47.375 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast_common.ko 2023-06-23T18:40:47.375 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ccm.ko 2023-06-23T18:40:47.375 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cmac.ko 2023-06-23T18:40:47.375 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crc32_generic.ko 2023-06-23T18:40:47.375 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_engine.ko 2023-06-23T18:40:47.376 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_user.ko 2023-06-23T18:40:47.376 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cts.ko 2023-06-23T18:40:47.376 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/des_generic.ko 2023-06-23T18:40:47.376 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/dh_generic.ko 2023-06-23T18:40:47.376 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/echainiv.ko 2023-06-23T18:40:47.376 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/essiv.ko 2023-06-23T18:40:47.376 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/fcrypt.ko 2023-06-23T18:40:47.376 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/khazad.ko 2023-06-23T18:40:47.377 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4.ko 2023-06-23T18:40:47.377 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4hc.ko 2023-06-23T18:40:47.377 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/md4.ko 2023-06-23T18:40:47.377 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/michael_mic.ko 2023-06-23T18:40:47.377 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcbc.ko 2023-06-23T18:40:47.377 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcrypt.ko 2023-06-23T18:40:47.377 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/rmd160.ko 2023-06-23T18:40:47.378 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/seed.ko 2023-06-23T18:40:47.378 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/serpent_generic.ko 2023-06-23T18:40:47.378 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tcrypt.ko 2023-06-23T18:40:47.378 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tea.ko 2023-06-23T18:40:47.378 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_common.ko 2023-06-23T18:40:47.378 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_generic.ko 2023-06-23T18:40:47.378 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/vmac.ko 2023-06-23T18:40:47.378 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/wp512.ko 2023-06-23T18:40:47.379 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xcbc.ko 2023-06-23T18:40:47.379 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xor.ko 2023-06-23T18:40:47.379 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xxhash_generic.ko 2023-06-23T18:40:47.379 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers 2023-06-23T18:40:47.379 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi 2023-06-23T18:40:47.379 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-23T18:40:47.379 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_pad.ko 2023-06-23T18:40:47.379 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/custom_method.ko 2023-06-23T18:40:47.380 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/ec_sys.ko 2023-06-23T18:40:47.380 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/platform_profile.ko 2023-06-23T18:40:47.380 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbs.ko 2023-06-23T18:40:47.380 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbshc.ko 2023-06-23T18:40:47.380 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/video.ko 2023-06-23T18:40:47.380 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata 2023-06-23T18:40:47.380 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/acard-ahci.ko 2023-06-23T18:40:47.381 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ahci_platform.ko 2023-06-23T18:40:47.381 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ata_generic.ko 2023-06-23T18:40:47.381 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/libahci_platform.ko 2023-06-23T18:40:47.381 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_acpi.ko 2023-06-23T18:40:47.381 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ali.ko 2023-06-23T18:40:47.381 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_amd.ko 2023-06-23T18:40:47.381 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_artop.ko 2023-06-23T18:40:47.381 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atiixp.ko 2023-06-23T18:40:47.382 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atp867x.ko 2023-06-23T18:40:47.382 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd640.ko 2023-06-23T18:40:47.382 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd64x.ko 2023-06-23T18:40:47.382 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cypress.ko 2023-06-23T18:40:47.382 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_efar.ko 2023-06-23T18:40:47.382 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt366.ko 2023-06-23T18:40:47.382 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt37x.ko 2023-06-23T18:40:47.382 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-23T18:40:47.383 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-23T18:40:47.383 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it8213.ko 2023-06-23T18:40:47.383 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it821x.ko 2023-06-23T18:40:47.383 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_jmicron.ko 2023-06-23T18:40:47.383 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_marvell.ko 2023-06-23T18:40:47.383 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_mpiix.ko 2023-06-23T18:40:47.383 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_netcell.ko 2023-06-23T18:40:47.383 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ninja32.ko 2023-06-23T18:40:47.384 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87410.ko 2023-06-23T18:40:47.384 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87415.ko 2023-06-23T18:40:47.384 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_oldpiix.ko 2023-06-23T18:40:47.384 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_opti.ko 2023-06-23T18:40:47.384 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_optidma.ko 2023-06-23T18:40:47.384 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pcmcia.ko 2023-06-23T18:40:47.384 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-23T18:40:47.385 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-23T18:40:47.385 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_piccolo.ko 2023-06-23T18:40:47.385 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_rdc.ko 2023-06-23T18:40:47.385 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sch.ko 2023-06-23T18:40:47.385 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_serverworks.ko 2023-06-23T18:40:47.385 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sil680.ko 2023-06-23T18:40:47.385 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sis.ko 2023-06-23T18:40:47.385 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sl82c105.ko 2023-06-23T18:40:47.386 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_triflex.ko 2023-06-23T18:40:47.386 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_via.ko 2023-06-23T18:40:47.386 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pdc_adma.ko 2023-06-23T18:40:47.386 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_inic162x.ko 2023-06-23T18:40:47.386 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_mv.ko 2023-06-23T18:40:47.386 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_nv.ko 2023-06-23T18:40:47.386 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_promise.ko 2023-06-23T18:40:47.386 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_qstor.ko 2023-06-23T18:40:47.387 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil.ko 2023-06-23T18:40:47.387 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil24.ko 2023-06-23T18:40:47.387 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sis.ko 2023-06-23T18:40:47.387 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_svw.ko 2023-06-23T18:40:47.387 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sx4.ko 2023-06-23T18:40:47.387 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_uli.ko 2023-06-23T18:40:47.387 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_via.ko 2023-06-23T18:40:47.387 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_vsc.ko 2023-06-23T18:40:47.388 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay 2023-06-23T18:40:47.388 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay/ks0108.ko 2023-06-23T18:40:47.388 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base 2023-06-23T18:40:47.388 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap 2023-06-23T18:40:47.388 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap/regmap-i2c.ko 2023-06-23T18:40:47.388 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma 2023-06-23T18:40:47.388 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma/bcma.ko 2023-06-23T18:40:47.389 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block 2023-06-23T18:40:47.389 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe 2023-06-23T18:40:47.389 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe/aoe.ko 2023-06-23T18:40:47.389 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/brd.ko 2023-06-23T18:40:47.389 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd 2023-06-23T18:40:47.389 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd/drbd.ko 2023-06-23T18:40:47.389 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/floppy.ko 2023-06-23T18:40:47.389 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/loop.ko 2023-06-23T18:40:47.390 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx 2023-06-23T18:40:47.390 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-23T18:40:47.390 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/nbd.ko 2023-06-23T18:40:47.390 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk 2023-06-23T18:40:47.390 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk/null_blk.ko 2023-06-23T18:40:47.390 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/pktcdvd.ko 2023-06-23T18:40:47.390 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/rbd.ko 2023-06-23T18:40:47.390 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/virtio_blk.ko 2023-06-23T18:40:47.391 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback 2023-06-23T18:40:47.391 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-23T18:40:47.391 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkfront.ko 2023-06-23T18:40:47.391 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram 2023-06-23T18:40:47.391 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram/zram.ko 2023-06-23T18:40:47.391 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char 2023-06-23T18:40:47.391 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hangcheck-timer.ko 2023-06-23T18:40:47.392 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random 2023-06-23T18:40:47.392 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-23T18:40:47.392 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-23T18:40:47.392 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-23T18:40:47.392 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/via-rng.ko 2023-06-23T18:40:47.392 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-23T18:40:47.392 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi 2023-06-23T18:40:47.392 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-23T18:40:47.393 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-23T18:40:47.393 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-23T18:40:47.393 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-23T18:40:47.393 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-23T18:40:47.393 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-23T18:40:47.393 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/lp.ko 2023-06-23T18:40:47.393 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave 2023-06-23T18:40:47.393 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave/mwave.ko 2023-06-23T18:40:47.394 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ppdev.ko 2023-06-23T18:40:47.394 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tlclk.ko 2023-06-23T18:40:47.394 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm 2023-06-23T18:40:47.394 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm.ko 2023-06-23T18:40:47.394 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-23T18:40:47.394 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-23T18:40:47.394 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-23T18:40:47.394 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis.ko 2023-06-23T18:40:47.395 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-06-23T18:40:47.395 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/uv_mmtimer.ko 2023-06-23T18:40:47.395 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/virtio_console.ko 2023-06-23T18:40:47.395 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq 2023-06-23T18:40:47.395 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-06-23T18:40:47.395 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-23T18:40:47.395 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-23T18:40:47.396 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-06-23T18:40:47.396 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/powernow-k8.ko 2023-06-23T18:40:47.396 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-23T18:40:47.396 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto 2023-06-23T18:40:47.396 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp 2023-06-23T18:40:47.396 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-23T18:40:47.396 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp.ko 2023-06-23T18:40:47.396 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel 2023-06-23T18:40:47.397 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat 2023-06-23T18:40:47.397 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common 2023-06-23T18:40:47.397 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-23T18:40:47.397 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-06-23T18:40:47.397 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-23T18:40:47.397 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-aes.ko 2023-06-23T18:40:47.397 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-sha.ko 2023-06-23T18:40:47.397 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio 2023-06-23T18:40:47.398 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-23T18:40:47.398 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca 2023-06-23T18:40:47.398 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca/dca.ko 2023-06-23T18:40:47.398 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq 2023-06-23T18:40:47.398 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-06-23T18:40:47.398 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma 2023-06-23T18:40:47.398 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw 2023-06-23T18:40:47.399 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-23T18:40:47.399 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat 2023-06-23T18:40:47.399 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-23T18:40:47.399 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac 2023-06-23T18:40:47.399 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/amd64_edac.ko 2023-06-23T18:40:47.399 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/e752x_edac.ko 2023-06-23T18:40:47.399 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/edac_mce_amd.ko 2023-06-23T18:40:47.399 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3000_edac.ko 2023-06-23T18:40:47.400 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3200_edac.ko 2023-06-23T18:40:47.400 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5100_edac.ko 2023-06-23T18:40:47.400 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5400_edac.ko 2023-06-23T18:40:47.400 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7300_edac.ko 2023-06-23T18:40:47.400 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7core_edac.ko 2023-06-23T18:40:47.400 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i82975x_edac.ko 2023-06-23T18:40:47.400 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/ie31200_edac.ko 2023-06-23T18:40:47.400 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/sb_edac.ko 2023-06-23T18:40:47.401 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/x38_edac.ko 2023-06-23T18:40:47.401 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware 2023-06-23T18:40:47.401 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/edd.ko 2023-06-23T18:40:47.401 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-23T18:40:47.401 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio 2023-06-23T18:40:47.401 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-ich.ko 2023-06-23T18:40:47.401 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-23T18:40:47.402 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid 2023-06-23T18:40:47.402 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-appleir.ko 2023-06-23T18:40:47.402 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-aureal.ko 2023-06-23T18:40:47.402 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-axff.ko 2023-06-23T18:40:47.402 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-dr.ko 2023-06-23T18:40:47.402 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elecom.ko 2023-06-23T18:40:47.402 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elo.ko 2023-06-23T18:40:47.402 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-emsff.ko 2023-06-23T18:40:47.403 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gaff.ko 2023-06-23T18:40:47.403 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gt683r.ko 2023-06-23T18:40:47.403 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gyration.ko 2023-06-23T18:40:47.403 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-23T18:40:47.403 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-23T18:40:47.403 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtekff.ko 2023-06-23T18:40:47.403 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-hyperv.ko 2023-06-23T18:40:47.404 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-icade.ko 2023-06-23T18:40:47.404 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-keytouch.ko 2023-06-23T18:40:47.404 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-kye.ko 2023-06-23T18:40:47.404 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lcpower.ko 2023-06-23T18:40:47.404 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-led.ko 2023-06-23T18:40:47.404 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lenovo.ko 2023-06-23T18:40:47.404 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-23T18:40:47.404 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-23T18:40:47.405 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-multitouch.ko 2023-06-23T18:40:47.405 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-ortek.ko 2023-06-23T18:40:47.405 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-penmount.ko 2023-06-23T18:40:47.405 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-petalynx.ko 2023-06-23T18:40:47.405 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-picolcd.ko 2023-06-23T18:40:47.405 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-pl.ko 2023-06-23T18:40:47.405 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-plantronics.ko 2023-06-23T18:40:47.405 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-primax.ko 2023-06-23T18:40:47.406 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-rmi.ko 2023-06-23T18:40:47.406 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-23T18:40:47.406 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-common.ko 2023-06-23T18:40:47.406 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-23T18:40:47.406 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-23T18:40:47.406 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-23T18:40:47.406 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-23T18:40:47.407 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-23T18:40:47.407 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-23T18:40:47.407 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-23T18:40:47.407 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-23T18:40:47.407 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-23T18:40:47.407 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat.ko 2023-06-23T18:40:47.407 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-saitek.ko 2023-06-23T18:40:47.407 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-samsung.ko 2023-06-23T18:40:47.408 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-23T18:40:47.408 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sjoy.ko 2023-06-23T18:40:47.408 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sony.ko 2023-06-23T18:40:47.408 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-speedlink.ko 2023-06-23T18:40:47.408 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-steelseries.ko 2023-06-23T18:40:47.408 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sunplus.ko 2023-06-23T18:40:47.408 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-23T18:40:47.409 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tivo.ko 2023-06-23T18:40:47.409 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tmff.ko 2023-06-23T18:40:47.409 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-topseed.ko 2023-06-23T18:40:47.409 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-twinhan.ko 2023-06-23T18:40:47.409 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-uclogic.ko 2023-06-23T18:40:47.409 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-waltop.ko 2023-06-23T18:40:47.409 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-wiimote.ko 2023-06-23T18:40:47.409 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-xinmo.ko 2023-06-23T18:40:47.410 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zpff.ko 2023-06-23T18:40:47.410 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zydacron.ko 2023-06-23T18:40:47.410 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/uhid.ko 2023-06-23T18:40:47.410 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/wacom.ko 2023-06-23T18:40:47.410 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv 2023-06-23T18:40:47.410 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_balloon.ko 2023-06-23T18:40:47.410 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_utils.ko 2023-06-23T18:40:47.410 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_vmbus.ko 2023-06-23T18:40:47.411 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon 2023-06-23T18:40:47.411 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru.ko 2023-06-23T18:40:47.411 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru3.ko 2023-06-23T18:40:47.411 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-23T18:40:47.411 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7414.ko 2023-06-23T18:40:47.411 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7418.ko 2023-06-23T18:40:47.411 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adc128d818.ko 2023-06-23T18:40:47.411 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1025.ko 2023-06-23T18:40:47.412 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1026.ko 2023-06-23T18:40:47.412 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1029.ko 2023-06-23T18:40:47.412 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1031.ko 2023-06-23T18:40:47.412 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm9240.ko 2023-06-23T18:40:47.412 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ads7828.ko 2023-06-23T18:40:47.412 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7410.ko 2023-06-23T18:40:47.412 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7411.ko 2023-06-23T18:40:47.413 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7462.ko 2023-06-23T18:40:47.413 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7470.ko 2023-06-23T18:40:47.413 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7475.ko 2023-06-23T18:40:47.413 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7x10.ko 2023-06-23T18:40:47.413 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/amc6821.ko 2023-06-23T18:40:47.413 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/applesmc.ko 2023-06-23T18:40:47.413 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asb100.ko 2023-06-23T18:40:47.413 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asc7621.ko 2023-06-23T18:40:47.414 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-23T18:40:47.414 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/atxp1.ko 2023-06-23T18:40:47.414 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/coretemp.ko 2023-06-23T18:40:47.414 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-23T18:40:47.414 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dme1737.ko 2023-06-23T18:40:47.414 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds1621.ko 2023-06-23T18:40:47.414 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds620.ko 2023-06-23T18:40:47.414 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc1403.ko 2023-06-23T18:40:47.415 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc6w201.ko 2023-06-23T18:40:47.415 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71805f.ko 2023-06-23T18:40:47.415 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71882fg.ko 2023-06-23T18:40:47.415 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f75375s.ko 2023-06-23T18:40:47.415 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fam15h_power.ko 2023-06-23T18:40:47.415 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fschmd.ko 2023-06-23T18:40:47.415 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g760a.ko 2023-06-23T18:40:47.415 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g762.ko 2023-06-23T18:40:47.416 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl518sm.ko 2023-06-23T18:40:47.416 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl520sm.ko 2023-06-23T18:40:47.416 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-23T18:40:47.416 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5500_temp.ko 2023-06-23T18:40:47.416 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5k_amb.ko 2023-06-23T18:40:47.416 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmaem.ko 2023-06-23T18:40:47.416 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmpex.ko 2023-06-23T18:40:47.417 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina209.ko 2023-06-23T18:40:47.417 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina2xx.ko 2023-06-23T18:40:47.417 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/it87.ko 2023-06-23T18:40:47.417 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k10temp.ko 2023-06-23T18:40:47.417 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k8temp.ko 2023-06-23T18:40:47.417 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lineage-pem.ko 2023-06-23T18:40:47.417 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm63.ko 2023-06-23T18:40:47.417 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm73.ko 2023-06-23T18:40:47.418 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm75.ko 2023-06-23T18:40:47.418 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm77.ko 2023-06-23T18:40:47.418 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm78.ko 2023-06-23T18:40:47.418 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm80.ko 2023-06-23T18:40:47.418 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm83.ko 2023-06-23T18:40:47.418 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm85.ko 2023-06-23T18:40:47.418 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm87.ko 2023-06-23T18:40:47.418 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm90.ko 2023-06-23T18:40:47.419 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm92.ko 2023-06-23T18:40:47.419 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm93.ko 2023-06-23T18:40:47.419 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95234.ko 2023-06-23T18:40:47.419 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95241.ko 2023-06-23T18:40:47.419 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95245.ko 2023-06-23T18:40:47.419 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc2945.ko 2023-06-23T18:40:47.419 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4151.ko 2023-06-23T18:40:47.419 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4215.ko 2023-06-23T18:40:47.420 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4222.ko 2023-06-23T18:40:47.420 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4245.ko 2023-06-23T18:40:47.420 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4260.ko 2023-06-23T18:40:47.420 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4261.ko 2023-06-23T18:40:47.420 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max16065.ko 2023-06-23T18:40:47.420 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1619.ko 2023-06-23T18:40:47.420 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1668.ko 2023-06-23T18:40:47.421 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max197.ko 2023-06-23T18:40:47.421 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6639.ko 2023-06-23T18:40:47.421 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6650.ko 2023-06-23T18:40:47.421 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6697.ko 2023-06-23T18:40:47.421 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/mcp3021.ko 2023-06-23T18:40:47.421 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6683.ko 2023-06-23T18:40:47.421 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775-core.ko 2023-06-23T18:40:47.421 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775.ko 2023-06-23T18:40:47.422 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct7802.ko 2023-06-23T18:40:47.422 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87360.ko 2023-06-23T18:40:47.422 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87427.ko 2023-06-23T18:40:47.422 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pcf8591.ko 2023-06-23T18:40:47.422 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus 2023-06-23T18:40:47.422 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-23T18:40:47.422 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-23T18:40:47.422 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-23T18:40:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-23T18:40:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-23T18:40:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-23T18:40:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-23T18:40:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-23T18:40:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-23T18:40:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-23T18:40:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-23T18:40:47.424 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-23T18:40:47.424 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/powr1220.ko 2023-06-23T18:40:47.424 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5627.ko 2023-06-23T18:40:47.424 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5636.ko 2023-06-23T18:40:47.424 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-23T18:40:47.424 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht15.ko 2023-06-23T18:40:47.425 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht21.ko 2023-06-23T18:40:47.425 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/shtc1.ko 2023-06-23T18:40:47.425 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sis5595.ko 2023-06-23T18:40:47.425 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47b397.ko 2023-06-23T18:40:47.425 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m1.ko 2023-06-23T18:40:47.425 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m192.ko 2023-06-23T18:40:47.425 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/thmc50.ko 2023-06-23T18:40:47.425 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp102.ko 2023-06-23T18:40:47.426 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp103.ko 2023-06-23T18:40:47.426 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp401.ko 2023-06-23T18:40:47.426 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp421.ko 2023-06-23T18:40:47.426 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via-cputemp.ko 2023-06-23T18:40:47.426 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via686a.ko 2023-06-23T18:40:47.441 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt1211.ko 2023-06-23T18:40:47.442 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt8231.ko 2023-06-23T18:40:47.442 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627ehf.ko 2023-06-23T18:40:47.442 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627hf.ko 2023-06-23T18:40:47.442 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83781d.ko 2023-06-23T18:40:47.442 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83791d.ko 2023-06-23T18:40:47.442 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83792d.ko 2023-06-23T18:40:47.443 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83793.ko 2023-06-23T18:40:47.443 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83795.ko 2023-06-23T18:40:47.443 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l785ts.ko 2023-06-23T18:40:47.443 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l786ng.ko 2023-06-23T18:40:47.443 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c 2023-06-23T18:40:47.443 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos 2023-06-23T18:40:47.443 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-23T18:40:47.444 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-23T18:40:47.444 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses 2023-06-23T18:40:47.444 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-23T18:40:47.444 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-23T18:40:47.444 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-23T18:40:47.444 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-23T18:40:47.444 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-23T18:40:47.445 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-23T18:40:47.445 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-23T18:40:47.445 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-23T18:40:47.445 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-23T18:40:47.445 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-23T18:40:47.445 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-23T18:40:47.445 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-23T18:40:47.445 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-23T18:40:47.446 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-23T18:40:47.446 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-23T18:40:47.446 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-23T18:40:47.446 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-23T18:40:47.446 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-23T18:40:47.446 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-23T18:40:47.446 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-23T18:40:47.446 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-23T18:40:47.447 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-23T18:40:47.447 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-23T18:40:47.447 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-dev.ko 2023-06-23T18:40:47.447 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-mux.ko 2023-06-23T18:40:47.447 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-06-23T18:40:47.447 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-smbus.ko 2023-06-23T18:40:47.447 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-stub.ko 2023-06-23T18:40:47.448 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband 2023-06-23T18:40:47.448 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core 2023-06-23T18:40:47.448 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-23T18:40:47.448 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_core.ko 2023-06-23T18:40:47.448 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-23T18:40:47.448 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-23T18:40:47.448 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-23T18:40:47.448 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-23T18:40:47.449 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-23T18:40:47.449 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw 2023-06-23T18:40:47.449 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4 2023-06-23T18:40:47.449 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-23T18:40:47.449 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4 2023-06-23T18:40:47.449 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-23T18:40:47.449 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5 2023-06-23T18:40:47.449 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-23T18:40:47.450 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca 2023-06-23T18:40:47.450 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-23T18:40:47.450 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp 2023-06-23T18:40:47.450 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib 2023-06-23T18:40:47.450 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-23T18:40:47.450 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser 2023-06-23T18:40:47.450 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-23T18:40:47.450 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert 2023-06-23T18:40:47.451 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-23T18:40:47.451 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp 2023-06-23T18:40:47.451 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-23T18:40:47.451 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt 2023-06-23T18:40:47.451 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-23T18:40:47.451 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input 2023-06-23T18:40:47.451 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport 2023-06-23T18:40:47.451 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-23T18:40:47.452 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-23T18:40:47.452 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/gameport.ko 2023-06-23T18:40:47.452 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/lightning.ko 2023-06-23T18:40:47.452 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/ns558.ko 2023-06-23T18:40:47.452 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/joydev.ko 2023-06-23T18:40:47.452 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard 2023-06-23T18:40:47.452 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-23T18:40:47.453 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse 2023-06-23T18:40:47.453 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/appletouch.ko 2023-06-23T18:40:47.453 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/bcm5974.ko 2023-06-23T18:40:47.453 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/cyapatp.ko 2023-06-23T18:40:47.453 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-23T18:40:47.453 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/sermouse.ko 2023-06-23T18:40:47.453 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-23T18:40:47.453 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-23T18:40:47.454 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-23T18:40:47.454 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4 2023-06-23T18:40:47.454 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-23T18:40:47.454 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio 2023-06-23T18:40:47.454 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/altera_ps2.ko 2023-06-23T18:40:47.454 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/arc_ps2.ko 2023-06-23T18:40:47.454 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-23T18:40:47.455 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/serio_raw.ko 2023-06-23T18:40:47.455 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/sparse-keymap.ko 2023-06-23T18:40:47.455 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu 2023-06-23T18:40:47.455 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd 2023-06-23T18:40:47.455 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-23T18:40:47.455 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds 2023-06-23T18:40:47.455 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-blinkm.ko 2023-06-23T18:40:47.455 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lm3530.ko 2023-06-23T18:40:47.456 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lp3944.ko 2023-06-23T18:40:47.456 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-ss4200.ko 2023-06-23T18:40:47.456 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger 2023-06-23T18:40:47.456 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-23T18:40:47.456 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-23T18:40:47.456 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-23T18:40:47.457 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-23T18:40:47.457 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-23T18:40:47.457 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-23T18:40:47.457 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-23T18:40:47.457 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-23T18:40:47.457 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md 2023-06-23T18:40:47.457 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache 2023-06-23T18:40:47.457 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache/bcache.ko 2023-06-23T18:40:47.458 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-bio-prison.ko 2023-06-23T18:40:47.458 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache-smq.ko 2023-06-23T18:40:47.458 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache.ko 2023-06-23T18:40:47.458 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-crypt.ko 2023-06-23T18:40:47.458 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-delay.ko 2023-06-23T18:40:47.458 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-flakey.ko 2023-06-23T18:40:47.458 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-log-userspace.ko 2023-06-23T18:40:47.459 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-multipath.ko 2023-06-23T18:40:47.459 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-queue-length.ko 2023-06-23T18:40:47.459 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-raid.ko 2023-06-23T18:40:47.459 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-round-robin.ko 2023-06-23T18:40:47.459 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-service-time.ko 2023-06-23T18:40:47.459 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-switch.ko 2023-06-23T18:40:47.459 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-thin-pool.ko 2023-06-23T18:40:47.459 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-verity.ko 2023-06-23T18:40:47.460 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/faulty.ko 2023-06-23T18:40:47.460 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/linear.ko 2023-06-23T18:40:47.460 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/multipath.ko 2023-06-23T18:40:47.460 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data 2023-06-23T18:40:47.460 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-23T18:40:47.460 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid0.ko 2023-06-23T18:40:47.460 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid1.ko 2023-06-23T18:40:47.461 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid10.ko 2023-06-23T18:40:47.461 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid456.ko 2023-06-23T18:40:47.461 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message 2023-06-23T18:40:47.461 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion 2023-06-23T18:40:47.461 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptbase.ko 2023-06-23T18:40:47.461 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptctl.ko 2023-06-23T18:40:47.461 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptfc.ko 2023-06-23T18:40:47.461 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptlan.ko 2023-06-23T18:40:47.462 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptsas.ko 2023-06-23T18:40:47.462 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptscsih.ko 2023-06-23T18:40:47.462 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptspi.ko 2023-06-23T18:40:47.462 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd 2023-06-23T18:40:47.462 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_ich.ko 2023-06-23T18:40:47.462 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_sch.ko 2023-06-23T18:40:47.462 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/mfd-core.ko 2023-06-23T18:40:47.462 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/sm501.ko 2023-06-23T18:40:47.463 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/viperboard.ko 2023-06-23T18:40:47.463 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/vx855.ko 2023-06-23T18:40:47.463 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/wl1273-core.ko 2023-06-23T18:40:47.463 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc 2023-06-23T18:40:47.463 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl 2023-06-23T18:40:47.463 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-23T18:40:47.464 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds9802als.ko 2023-06-23T18:40:47.464 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds990x.ko 2023-06-23T18:40:47.464 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/bh1770glc.ko 2023-06-23T18:40:47.464 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710 2023-06-23T18:40:47.464 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710/cb710.ko 2023-06-23T18:40:47.464 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom 2023-06-23T18:40:47.464 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/at24.ko 2023-06-23T18:40:47.465 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-23T18:40:47.465 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-23T18:40:47.465 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/max6875.ko 2023-06-23T18:40:47.465 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/enclosure.ko 2023-06-23T18:40:47.465 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/hpilo.ko 2023-06-23T18:40:47.465 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29003.ko 2023-06-23T18:40:47.465 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29020.ko 2023-06-23T18:40:47.465 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d 2023-06-23T18:40:47.466 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-23T18:40:47.466 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-23T18:40:47.466 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei 2023-06-23T18:40:47.466 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-me.ko 2023-06-23T18:40:47.466 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-txe.ko 2023-06-23T18:40:47.466 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei.ko 2023-06-23T18:40:47.466 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru 2023-06-23T18:40:47.466 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru/gru.ko 2023-06-23T18:40:47.467 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp 2023-06-23T18:40:47.467 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xp.ko 2023-06-23T18:40:47.467 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpc.ko 2023-06-23T18:40:47.467 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-06-23T18:40:47.467 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_7xx1.ko 2023-06-23T18:40:47.467 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_core.ko 2023-06-23T18:40:47.467 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tsl2550.ko 2023-06-23T18:40:47.467 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_balloon.ko 2023-06-23T18:40:47.468 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci 2023-06-23T18:40:47.468 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-23T18:40:47.468 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net 2023-06-23T18:40:47.468 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding 2023-06-23T18:40:47.468 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding/bonding.ko 2023-06-23T18:40:47.468 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa 2023-06-23T18:40:47.468 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53 2023-06-23T18:40:47.468 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-23T18:40:47.469 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-23T18:40:47.469 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-23T18:40:47.469 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx 2023-06-23T18:40:47.469 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-23T18:40:47.469 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dummy.ko 2023-06-23T18:40:47.469 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/eql.ko 2023-06-23T18:40:47.469 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet 2023-06-23T18:40:47.469 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com 2023-06-23T18:40:47.470 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-23T18:40:47.470 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-23T18:40:47.470 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-23T18:40:47.470 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-23T18:40:47.470 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390 2023-06-23T18:40:47.470 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-23T18:40:47.470 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-23T18:40:47.471 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-23T18:40:47.471 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-23T18:40:47.471 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec 2023-06-23T18:40:47.471 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-23T18:40:47.471 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere 2023-06-23T18:40:47.471 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-23T18:40:47.471 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon 2023-06-23T18:40:47.471 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-23T18:40:47.472 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera 2023-06-23T18:40:47.472 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-23T18:40:47.472 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd 2023-06-23T18:40:47.472 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-23T18:40:47.472 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-23T18:40:47.472 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-23T18:40:47.472 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros 2023-06-23T18:40:47.472 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx 2023-06-23T18:40:47.473 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-23T18:40:47.473 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c 2023-06-23T18:40:47.473 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-23T18:40:47.473 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e 2023-06-23T18:40:47.473 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-23T18:40:47.473 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx 2023-06-23T18:40:47.473 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-23T18:40:47.473 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-23T18:40:47.474 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom 2023-06-23T18:40:47.474 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-23T18:40:47.474 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-23T18:40:47.474 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-06-23T18:40:47.474 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-23T18:40:47.474 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-23T18:40:47.474 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet 2023-06-23T18:40:47.474 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-23T18:40:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-23T18:40:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade 2023-06-23T18:40:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna 2023-06-23T18:40:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-23T18:40:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio 2023-06-23T18:40:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb 2023-06-23T18:40:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-23T18:40:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-06-23T18:40:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-23T18:40:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-06-23T18:40:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-23T18:40:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-06-23T18:40:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-23T18:40:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-06-23T18:40:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-23T18:40:47.477 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco 2023-06-23T18:40:47.477 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic 2023-06-23T18:40:47.477 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-23T18:40:47.477 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec 2023-06-23T18:40:47.477 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip 2023-06-23T18:40:47.477 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-23T18:40:47.477 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-23T18:40:47.477 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-23T18:40:47.478 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-23T18:40:47.478 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-23T18:40:47.478 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-23T18:40:47.478 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink 2023-06-23T18:40:47.478 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-23T18:40:47.478 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-23T18:40:47.478 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dnet.ko 2023-06-23T18:40:47.478 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex 2023-06-23T18:40:47.479 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet 2023-06-23T18:40:47.479 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-23T18:40:47.479 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ethoc.ko 2023-06-23T18:40:47.479 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/fealnx.ko 2023-06-23T18:40:47.479 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel 2023-06-23T18:40:47.479 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-23T18:40:47.479 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000 2023-06-23T18:40:47.479 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-23T18:40:47.480 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e 2023-06-23T18:40:47.480 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-23T18:40:47.480 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k 2023-06-23T18:40:47.480 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-23T18:40:47.480 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e 2023-06-23T18:40:47.480 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-23T18:40:47.480 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf 2023-06-23T18:40:47.480 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-23T18:40:47.481 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb 2023-06-23T18:40:47.481 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-23T18:40:47.481 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf 2023-06-23T18:40:47.481 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-23T18:40:47.481 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe 2023-06-23T18:40:47.481 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-23T18:40:47.481 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf 2023-06-23T18:40:47.482 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-23T18:40:47.482 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/jme.ko 2023-06-23T18:40:47.482 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell 2023-06-23T18:40:47.482 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-23T18:40:47.482 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-23T18:40:47.482 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-23T18:40:47.482 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox 2023-06-23T18:40:47.482 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4 2023-06-23T18:40:47.483 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-23T18:40:47.483 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-23T18:40:47.483 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5 2023-06-23T18:40:47.483 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-06-23T18:40:47.483 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-23T18:40:47.483 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel 2023-06-23T18:40:47.483 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-23T18:40:47.483 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom 2023-06-23T18:40:47.484 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge 2023-06-23T18:40:47.484 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-23T18:40:47.484 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi 2023-06-23T18:40:47.484 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-23T18:40:47.484 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-23T18:40:47.484 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion 2023-06-23T18:40:47.484 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-23T18:40:47.485 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia 2023-06-23T18:40:47.485 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-23T18:40:47.485 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines 2023-06-23T18:40:47.485 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-23T18:40:47.485 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-23T18:40:47.485 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic 2023-06-23T18:40:47.485 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen 2023-06-23T18:40:47.485 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-23T18:40:47.486 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-23T18:40:47.486 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-06-23T18:40:47.486 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-23T18:40:47.486 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc 2023-06-23T18:40:47.486 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-23T18:40:47.486 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek 2023-06-23T18:40:47.486 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-23T18:40:47.486 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-23T18:40:47.487 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-23T18:40:47.487 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-23T18:40:47.487 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker 2023-06-23T18:40:47.487 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-06-23T18:40:47.487 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc 2023-06-23T18:40:47.487 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-23T18:40:47.487 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan 2023-06-23T18:40:47.487 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-23T18:40:47.488 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis 2023-06-23T18:40:47.488 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-23T18:40:47.488 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-23T18:40:47.488 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc 2023-06-23T18:40:47.488 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-23T18:40:47.488 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-23T18:40:47.488 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-23T18:40:47.489 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-23T18:40:47.489 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro 2023-06-23T18:40:47.489 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac 2023-06-23T18:40:47.489 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-23T18:40:47.489 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-23T18:40:47.489 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun 2023-06-23T18:40:47.489 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-23T18:40:47.489 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-23T18:40:47.490 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-23T18:40:47.490 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-23T18:40:47.490 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti 2023-06-23T18:40:47.490 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-23T18:40:47.490 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti 2023-06-23T18:40:47.490 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-23T18:40:47.490 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via 2023-06-23T18:40:47.490 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-23T18:40:47.491 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-23T18:40:47.491 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet 2023-06-23T18:40:47.491 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-23T18:40:47.491 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-23T18:40:47.491 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom 2023-06-23T18:40:47.491 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-23T18:40:47.491 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/geneve.ko 2023-06-23T18:40:47.491 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv 2023-06-23T18:40:47.492 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-23T18:40:47.492 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154 2023-06-23T18:40:47.492 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-23T18:40:47.492 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ifb.ko 2023-06-23T18:40:47.492 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan 2023-06-23T18:40:47.492 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-23T18:40:47.492 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvlan.ko 2023-06-23T18:40:47.493 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvtap.ko 2023-06-23T18:40:47.493 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio 2023-06-23T18:40:47.493 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio.ko 2023-06-23T18:40:47.493 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-23T18:40:47.493 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-23T18:40:47.493 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mii.ko 2023-06-23T18:40:47.493 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/net_failover.ko 2023-06-23T18:40:47.493 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/netconsole.ko 2023-06-23T18:40:47.494 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/nlmon.ko 2023-06-23T18:40:47.494 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs 2023-06-23T18:40:47.494 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-23T18:40:47.494 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-23T18:40:47.494 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy 2023-06-23T18:40:47.494 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/amd.ko 2023-06-23T18:40:47.494 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-23T18:40:47.494 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-06-23T18:40:47.495 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-23T18:40:47.495 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm87xx.ko 2023-06-23T18:40:47.495 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/broadcom.ko 2023-06-23T18:40:47.495 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/cicada.ko 2023-06-23T18:40:47.495 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/davicom.ko 2023-06-23T18:40:47.495 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/dp83640.ko 2023-06-23T18:40:47.495 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/et1011c.ko 2023-06-23T18:40:47.495 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/icplus.ko 2023-06-23T18:40:47.496 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/lxt.ko 2023-06-23T18:40:47.496 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/marvell.ko 2023-06-23T18:40:47.496 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/micrel.ko 2023-06-23T18:40:47.496 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/national.ko 2023-06-23T18:40:47.496 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/phylink.ko 2023-06-23T18:40:47.496 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/qsemi.ko 2023-06-23T18:40:47.496 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/realtek.ko 2023-06-23T18:40:47.497 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/smsc.ko 2023-06-23T18:40:47.497 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/ste10Xp.ko 2023-06-23T18:40:47.497 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/vitesse.ko 2023-06-23T18:40:47.497 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp 2023-06-23T18:40:47.497 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-23T18:40:47.497 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_async.ko 2023-06-23T18:40:47.497 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-23T18:40:47.497 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_generic.ko 2023-06-23T18:40:47.498 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-23T18:40:47.498 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-23T18:40:47.498 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppoe.ko 2023-06-23T18:40:47.498 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppox.ko 2023-06-23T18:40:47.498 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pptp.ko 2023-06-23T18:40:47.498 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip 2023-06-23T18:40:47.498 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slhc.ko 2023-06-23T18:40:47.498 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slip.ko 2023-06-23T18:40:47.499 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/sungem_phy.ko 2023-06-23T18:40:47.499 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tap.ko 2023-06-23T18:40:47.499 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team 2023-06-23T18:40:47.499 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team.ko 2023-06-23T18:40:47.499 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-23T18:40:47.499 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-23T18:40:47.499 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-23T18:40:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_random.ko 2023-06-23T18:40:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-23T18:40:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tun.ko 2023-06-23T18:40:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/veth.ko 2023-06-23T18:40:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/virtio_net.ko 2023-06-23T18:40:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3 2023-06-23T18:40:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-23T18:40:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan 2023-06-23T18:40:47.501 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan/vxlan.ko 2023-06-23T18:40:47.501 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback 2023-06-23T18:40:47.501 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-23T18:40:47.501 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netfront.ko 2023-06-23T18:40:47.501 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb 2023-06-23T18:40:47.501 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb/ntb.ko 2023-06-23T18:40:47.501 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme 2023-06-23T18:40:47.502 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host 2023-06-23T18:40:47.502 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme-core.ko 2023-06-23T18:40:47.502 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme.ko 2023-06-23T18:40:47.502 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport 2023-06-23T18:40:47.502 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport.ko 2023-06-23T18:40:47.502 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_cs.ko 2023-06-23T18:40:47.502 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_pc.ko 2023-06-23T18:40:47.503 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_serial.ko 2023-06-23T18:40:47.503 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci 2023-06-23T18:40:47.503 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug 2023-06-23T18:40:47.503 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-23T18:40:47.503 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie 2023-06-23T18:40:47.503 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie/aer_inject.ko 2023-06-23T18:40:47.503 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/xen-pcifront.ko 2023-06-23T18:40:47.503 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia 2023-06-23T18:40:47.504 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/i82092.ko 2023-06-23T18:40:47.504 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/pd6729.ko 2023-06-23T18:40:47.504 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-23T18:40:47.504 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl 2023-06-23T18:40:47.504 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel 2023-06-23T18:40:47.504 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-23T18:40:47.504 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform 2023-06-23T18:40:47.504 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86 2023-06-23T18:40:47.505 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-23T18:40:47.505 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acerhdf.ko 2023-06-23T18:40:47.505 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-23T18:40:47.505 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-23T18:40:47.505 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-23T18:40:47.505 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-23T18:40:47.505 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-23T18:40:47.505 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-23T18:40:47.506 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-23T18:40:47.506 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-23T18:40:47.506 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-23T18:40:47.506 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/hdaps.ko 2023-06-23T18:40:47.506 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel 2023-06-23T18:40:47.506 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-23T18:40:47.506 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel_ips.ko 2023-06-23T18:40:47.507 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-23T18:40:47.507 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-23T18:40:47.507 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-23T18:40:47.507 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-23T18:40:47.507 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-23T18:40:47.507 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-23T18:40:47.507 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-23T18:40:47.507 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-23T18:40:47.508 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-23T18:40:47.508 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi.ko 2023-06-23T18:40:47.508 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap 2023-06-23T18:40:47.508 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-23T18:40:47.508 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-23T18:40:47.508 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps 2023-06-23T18:40:47.508 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients 2023-06-23T18:40:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-23T18:40:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-23T18:40:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps_parport.ko 2023-06-23T18:40:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/pps_core.ko 2023-06-23T18:40:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp 2023-06-23T18:40:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp.ko 2023-06-23T18:40:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp_kvm.ko 2023-06-23T18:40:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc 2023-06-23T18:40:47.510 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-23T18:40:47.510 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-23T18:40:47.510 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-23T18:40:47.510 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-23T18:40:47.510 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-23T18:40:47.510 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-23T18:40:47.510 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-23T18:40:47.511 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-23T18:40:47.511 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-23T18:40:47.511 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-23T18:40:47.511 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-23T18:40:47.511 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-em3027.ko 2023-06-23T18:40:47.511 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-23T18:40:47.511 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-23T18:40:47.511 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-23T18:40:47.512 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-23T18:40:47.512 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-23T18:40:47.512 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-23T18:40:47.512 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-max6900.ko 2023-06-23T18:40:47.512 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-23T18:40:47.512 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-23T18:40:47.512 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-23T18:40:47.512 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-23T18:40:47.513 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-23T18:40:47.513 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-23T18:40:47.513 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-23T18:40:47.513 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-23T18:40:47.513 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-23T18:40:47.513 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-23T18:40:47.513 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-23T18:40:47.513 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-23T18:40:47.514 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-x1205.ko 2023-06-23T18:40:47.514 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi 2023-06-23T18:40:47.514 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-9xxx.ko 2023-06-23T18:40:47.514 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-sas.ko 2023-06-23T18:40:47.514 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-xxxx.ko 2023-06-23T18:40:47.514 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/BusLogic.ko 2023-06-23T18:40:47.514 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/a100u2w.ko 2023-06-23T18:40:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid 2023-06-23T18:40:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-23T18:40:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/advansys.ko 2023-06-23T18:40:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx 2023-06-23T18:40:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-23T18:40:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-23T18:40:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/am53c974.ko 2023-06-23T18:40:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr 2023-06-23T18:40:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-23T18:40:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/atp870u.ko 2023-06-23T18:40:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi 2023-06-23T18:40:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-23T18:40:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa 2023-06-23T18:40:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa/bfa.ko 2023-06-23T18:40:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc 2023-06-23T18:40:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-23T18:40:47.517 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i 2023-06-23T18:40:47.517 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-23T18:40:47.517 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ch.ko 2023-06-23T18:40:47.517 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor 2023-06-23T18:40:47.517 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-23T18:40:47.517 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi 2023-06-23T18:40:47.517 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i 2023-06-23T18:40:47.518 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-23T18:40:47.518 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i 2023-06-23T18:40:47.518 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-23T18:40:47.518 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-23T18:40:47.518 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dc395x.ko 2023-06-23T18:40:47.518 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler 2023-06-23T18:40:47.518 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-06-23T18:40:47.518 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-06-23T18:40:47.519 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-06-23T18:40:47.519 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-06-23T18:40:47.519 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dmx3191d.ko 2023-06-23T18:40:47.519 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r 2023-06-23T18:40:47.519 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-23T18:40:47.519 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esp_scsi.ko 2023-06-23T18:40:47.519 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe 2023-06-23T18:40:47.520 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-23T18:40:47.520 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-23T18:40:47.520 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic 2023-06-23T18:40:47.520 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic/fnic.ko 2023-06-23T18:40:47.520 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hpsa.ko 2023-06-23T18:40:47.520 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hptiop.ko 2023-06-23T18:40:47.520 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hv_storvsc.ko 2023-06-23T18:40:47.521 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/initio.ko 2023-06-23T18:40:47.521 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ipr.ko 2023-06-23T18:40:47.521 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ips.ko 2023-06-23T18:40:47.521 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci 2023-06-23T18:40:47.521 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci/isci.ko 2023-06-23T18:40:47.521 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-23T18:40:47.521 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-23T18:40:47.521 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc 2023-06-23T18:40:47.522 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc/libfc.ko 2023-06-23T18:40:47.522 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi.ko 2023-06-23T18:40:47.522 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-23T18:40:47.522 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas 2023-06-23T18:40:47.522 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas/libsas.ko 2023-06-23T18:40:47.522 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc 2023-06-23T18:40:47.522 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-23T18:40:47.522 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid 2023-06-23T18:40:47.523 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid.ko 2023-06-23T18:40:47.523 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-23T18:40:47.523 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-23T18:40:47.523 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-23T18:40:47.523 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas 2023-06-23T18:40:47.523 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-23T18:40:47.523 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas 2023-06-23T18:40:47.523 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-23T18:40:47.524 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvumi.ko 2023-06-23T18:40:47.524 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001 2023-06-23T18:40:47.524 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-23T18:40:47.524 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pmcraid.ko 2023-06-23T18:40:47.524 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla1280.ko 2023-06-23T18:40:47.524 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx 2023-06-23T18:40:47.524 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-23T18:40:47.524 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-23T18:40:47.525 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx 2023-06-23T18:40:47.525 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-23T18:40:47.525 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/raid_class.ko 2023-06-23T18:40:47.525 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_debug.ko 2023-06-23T18:40:47.525 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-23T18:40:47.525 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-23T18:40:47.525 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-23T18:40:47.525 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-23T18:40:47.526 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-23T18:40:47.526 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ses.ko 2023-06-23T18:40:47.526 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/st.ko 2023-06-23T18:40:47.526 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/stex.ko 2023-06-23T18:40:47.526 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2 2023-06-23T18:40:47.526 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-23T18:40:47.526 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/virtio_scsi.ko 2023-06-23T18:40:47.527 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-23T18:40:47.527 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/wd719x.ko 2023-06-23T18:40:47.527 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb 2023-06-23T18:40:47.527 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb/ssb.ko 2023-06-23T18:40:47.527 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target 2023-06-23T18:40:47.527 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi 2023-06-23T18:40:47.527 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-23T18:40:47.527 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback 2023-06-23T18:40:47.528 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-23T18:40:47.528 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_file.ko 2023-06-23T18:40:47.528 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_iblock.ko 2023-06-23T18:40:47.528 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_mod.ko 2023-06-23T18:40:47.528 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_pscsi.ko 2023-06-23T18:40:47.528 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_user.ko 2023-06-23T18:40:47.528 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc 2023-06-23T18:40:47.528 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-23T18:40:47.529 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal 2023-06-23T18:40:47.529 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel 2023-06-23T18:40:47.529 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal 2023-06-23T18:40:47.529 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-23T18:40:47.529 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-23T18:40:47.529 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-23T18:40:47.529 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-23T18:40:47.530 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-23T18:40:47.530 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-23T18:40:47.530 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-23T18:40:47.530 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-23T18:40:47.530 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-23T18:40:47.530 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-23T18:40:47.530 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-23T18:40:47.530 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-23T18:40:47.531 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-23T18:40:47.531 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-23T18:40:47.531 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-23T18:40:47.531 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty 2023-06-23T18:40:47.531 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless 2023-06-23T18:40:47.531 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-23T18:40:47.531 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_gsm.ko 2023-06-23T18:40:47.531 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_hdlc.ko 2023-06-23T18:40:47.532 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/nozomi.ko 2023-06-23T18:40:47.532 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial 2023-06-23T18:40:47.532 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250 2023-06-23T18:40:47.532 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-23T18:40:47.532 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/arc_uart.ko 2023-06-23T18:40:47.532 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm 2023-06-23T18:40:47.532 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-23T18:40:47.532 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/synclink_gt.ko 2023-06-23T18:40:47.533 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs 2023-06-23T18:40:47.533 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core 2023-06-23T18:40:47.533 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-23T18:40:47.533 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host 2023-06-23T18:40:47.533 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-23T18:40:47.533 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio 2023-06-23T18:40:47.533 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio.ko 2023-06-23T18:40:47.533 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_aec.ko 2023-06-23T18:40:47.534 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_cif.ko 2023-06-23T18:40:47.534 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_pci_generic.ko 2023-06-23T18:40:47.534 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_sercos3.ko 2023-06-23T18:40:47.534 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb 2023-06-23T18:40:47.534 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class 2023-06-23T18:40:47.534 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-acm.ko 2023-06-23T18:40:47.534 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-23T18:40:47.534 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usblp.ko 2023-06-23T18:40:47.535 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usbtmc.ko 2023-06-23T18:40:47.535 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host 2023-06-23T18:40:47.535 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-23T18:40:47.535 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image 2023-06-23T18:40:47.535 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/mdc800.ko 2023-06-23T18:40:47.535 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/microtek.ko 2023-06-23T18:40:47.535 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc 2023-06-23T18:40:47.535 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/adutux.ko 2023-06-23T18:40:47.536 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/appledisplay.ko 2023-06-23T18:40:47.536 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi26.ko 2023-06-23T18:40:47.536 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi62.ko 2023-06-23T18:40:47.536 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ezusb.ko 2023-06-23T18:40:47.536 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/idmouse.ko 2023-06-23T18:40:47.536 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/iowarrior.ko 2023-06-23T18:40:47.536 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-23T18:40:47.537 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ldusb.ko 2023-06-23T18:40:47.537 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/legousbtower.ko 2023-06-23T18:40:47.537 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga 2023-06-23T18:40:47.537 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-23T18:40:47.537 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-23T18:40:47.537 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usb3503.ko 2023-06-23T18:40:47.537 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usblcd.ko 2023-06-23T18:40:47.537 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-23T18:40:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/uss720.ko 2023-06-23T18:40:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/yurex.ko 2023-06-23T18:40:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy 2023-06-23T18:40:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy/phy-generic.ko 2023-06-23T18:40:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial 2023-06-23T18:40:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/aircable.ko 2023-06-23T18:40:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ark3116.ko 2023-06-23T18:40:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-23T18:40:47.539 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ch341.ko 2023-06-23T18:40:47.539 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cp210x.ko 2023-06-23T18:40:47.539 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cyberjack.ko 2023-06-23T18:40:47.539 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-23T18:40:47.539 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-23T18:40:47.539 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/empeg.ko 2023-06-23T18:40:47.539 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-23T18:40:47.539 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-23T18:40:47.540 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-23T18:40:47.540 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_ti.ko 2023-06-23T18:40:47.540 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipaq.ko 2023-06-23T18:40:47.540 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipw.ko 2023-06-23T18:40:47.540 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ir-usb.ko 2023-06-23T18:40:47.540 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-23T18:40:47.540 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan.ko 2023-06-23T18:40:47.540 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-23T18:40:47.541 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-23T18:40:47.541 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-23T18:40:47.541 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mct_u232.ko 2023-06-23T18:40:47.541 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7720.ko 2023-06-23T18:40:47.541 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7840.ko 2023-06-23T18:40:47.541 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/navman.ko 2023-06-23T18:40:47.541 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/omninet.ko 2023-06-23T18:40:47.541 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/opticon.ko 2023-06-23T18:40:47.542 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/option.ko 2023-06-23T18:40:47.542 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/oti6858.ko 2023-06-23T18:40:47.542 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/pl2303.ko 2023-06-23T18:40:47.542 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcaux.ko 2023-06-23T18:40:47.542 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcserial.ko 2023-06-23T18:40:47.542 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/quatech2.ko 2023-06-23T18:40:47.543 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/safe_serial.ko 2023-06-23T18:40:47.543 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/sierra.ko 2023-06-23T18:40:47.543 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-23T18:40:47.543 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ssu100.ko 2023-06-23T18:40:47.543 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/symbolserial.ko 2023-06-23T18:40:47.543 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-23T18:40:47.543 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-23T18:40:47.543 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_debug.ko 2023-06-23T18:40:47.544 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-23T18:40:47.544 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/visor.ko 2023-06-23T18:40:47.544 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/whiteheat.ko 2023-06-23T18:40:47.544 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-23T18:40:47.544 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage 2023-06-23T18:40:47.544 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/uas.ko 2023-06-23T18:40:47.544 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-23T18:40:47.544 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-23T18:40:47.545 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-23T18:40:47.545 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-23T18:40:47.545 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-23T18:40:47.545 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-23T18:40:47.545 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-23T18:40:47.545 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-karma.ko 2023-06-23T18:40:47.545 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-23T18:40:47.545 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-23T18:40:47.546 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-23T18:40:47.546 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-23T18:40:47.546 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-23T18:40:47.546 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/usb-storage.ko 2023-06-23T18:40:47.546 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip 2023-06-23T18:40:47.546 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-23T18:40:47.546 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-23T18:40:47.547 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-23T18:40:47.547 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio 2023-06-23T18:40:47.547 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci 2023-06-23T18:40:47.547 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-23T18:40:47.547 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-23T18:40:47.547 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio.ko 2023-06-23T18:40:47.547 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-23T18:40:47.547 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost 2023-06-23T18:40:47.548 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost.ko 2023-06-23T18:40:47.548 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-23T18:40:47.548 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_net.ko 2023-06-23T18:40:47.548 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_scsi.ko 2023-06-23T18:40:47.548 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video 2023-06-23T18:40:47.548 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight 2023-06-23T18:40:47.548 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/apple_bl.ko 2023-06-23T18:40:47.548 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/lcd.ko 2023-06-23T18:40:47.549 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-23T18:40:47.549 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio 2023-06-23T18:40:47.549 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio.ko 2023-06-23T18:40:47.549 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_balloon.ko 2023-06-23T18:40:47.549 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_mmio.ko 2023-06-23T18:40:47.549 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci.ko 2023-06-23T18:40:47.549 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-06-23T18:40:47.549 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-06-23T18:40:47.550 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_ring.ko 2023-06-23T18:40:47.550 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1 2023-06-23T18:40:47.550 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters 2023-06-23T18:40:47.550 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2482.ko 2023-06-23T18:40:47.550 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2490.ko 2023-06-23T18:40:47.550 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves 2023-06-23T18:40:47.550 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-23T18:40:47.550 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-23T18:40:47.551 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-23T18:40:47.551 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-23T18:40:47.551 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-23T18:40:47.551 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-23T18:40:47.551 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-23T18:40:47.551 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-23T18:40:47.551 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-23T18:40:47.551 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-23T18:40:47.552 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-23T18:40:47.552 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/wire.ko 2023-06-23T18:40:47.552 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog 2023-06-23T18:40:47.552 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-23T18:40:47.552 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-23T18:40:47.552 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-23T18:40:47.552 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/hpwdt.ko 2023-06-23T18:40:47.552 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/i6300esb.ko 2023-06-23T18:40:47.553 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-23T18:40:47.553 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-23T18:40:47.553 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ib700wdt.ko 2023-06-23T18:40:47.553 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ibmasr.ko 2023-06-23T18:40:47.553 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-23T18:40:47.553 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-23T18:40:47.553 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it87_wdt.ko 2023-06-23T18:40:47.553 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/machzwd.ko 2023-06-23T18:40:47.554 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/nv_tco.ko 2023-06-23T18:40:47.554 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-23T18:40:47.554 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-23T18:40:47.554 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-23T18:40:47.554 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-23T18:40:47.554 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/softdog.ko 2023-06-23T18:40:47.554 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-23T18:40:47.554 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/via_wdt.ko 2023-06-23T18:40:47.555 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-23T18:40:47.555 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-23T18:40:47.555 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-23T18:40:47.555 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/wdt_pci.ko 2023-06-23T18:40:47.555 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/xen_wdt.ko 2023-06-23T18:40:47.555 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen 2023-06-23T18:40:47.555 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-acpi-processor.ko 2023-06-23T18:40:47.555 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-evtchn.ko 2023-06-23T18:40:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntalloc.ko 2023-06-23T18:40:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntdev.ko 2023-06-23T18:40:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback 2023-06-23T18:40:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-23T18:40:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-privcmd.ko 2023-06-23T18:40:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs 2023-06-23T18:40:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-23T18:40:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs 2023-06-23T18:40:47.557 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p 2023-06-23T18:40:47.557 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p/9p.ko 2023-06-23T18:40:47.557 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs 2023-06-23T18:40:47.557 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs/affs.ko 2023-06-23T18:40:47.557 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs 2023-06-23T18:40:47.557 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs/befs.ko 2023-06-23T18:40:47.557 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/binfmt_misc.ko 2023-06-23T18:40:47.558 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs 2023-06-23T18:40:47.558 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs/btrfs.ko 2023-06-23T18:40:47.558 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles 2023-06-23T18:40:47.558 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles/cachefiles.ko 2023-06-23T18:40:47.558 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph 2023-06-23T18:40:47.558 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph/ceph.ko 2023-06-23T18:40:47.558 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda 2023-06-23T18:40:47.558 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda/coda.ko 2023-06-23T18:40:47.559 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs 2023-06-23T18:40:47.559 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs/cramfs.ko 2023-06-23T18:40:47.559 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm 2023-06-23T18:40:47.559 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm/dlm.ko 2023-06-23T18:40:47.559 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs 2023-06-23T18:40:47.559 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs/ecryptfs.ko 2023-06-23T18:40:47.559 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs 2023-06-23T18:40:47.559 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs/f2fs.ko 2023-06-23T18:40:47.560 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat 2023-06-23T18:40:47.560 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/fat.ko 2023-06-23T18:40:47.560 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/msdos.ko 2023-06-23T18:40:47.560 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/vfat.ko 2023-06-23T18:40:47.560 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache 2023-06-23T18:40:47.560 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache/fscache.ko 2023-06-23T18:40:47.560 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse 2023-06-23T18:40:47.560 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/cuse.ko 2023-06-23T18:40:47.561 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/fuse.ko 2023-06-23T18:40:47.561 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2 2023-06-23T18:40:47.561 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2/gfs2.ko 2023-06-23T18:40:47.561 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs 2023-06-23T18:40:47.561 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs/hfs.ko 2023-06-23T18:40:47.561 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus 2023-06-23T18:40:47.561 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus/hfsplus.ko 2023-06-23T18:40:47.561 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs 2023-06-23T18:40:47.562 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs/isofs.ko 2023-06-23T18:40:47.562 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs 2023-06-23T18:40:47.562 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs/jfs.ko 2023-06-23T18:40:47.562 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd 2023-06-23T18:40:47.562 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd/lockd.ko 2023-06-23T18:40:47.562 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix 2023-06-23T18:40:47.562 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix/minix.ko 2023-06-23T18:40:47.562 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs 2023-06-23T18:40:47.563 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs/netfs.ko 2023-06-23T18:40:47.563 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs 2023-06-23T18:40:47.563 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout 2023-06-23T18:40:47.563 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-23T18:40:47.563 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout 2023-06-23T18:40:47.563 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-23T18:40:47.563 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout 2023-06-23T18:40:47.564 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-23T18:40:47.564 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfs.ko 2023-06-23T18:40:47.564 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv3.ko 2023-06-23T18:40:47.564 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv4.ko 2023-06-23T18:40:47.564 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common 2023-06-23T18:40:47.564 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/grace.ko 2023-06-23T18:40:47.564 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/nfs_acl.ko 2023-06-23T18:40:47.564 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd 2023-06-23T18:40:47.565 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd/nfsd.ko 2023-06-23T18:40:47.565 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2 2023-06-23T18:40:47.565 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2/nilfs2.ko 2023-06-23T18:40:47.565 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls 2023-06-23T18:40:47.565 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-celtic.ko 2023-06-23T18:40:47.565 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-centeuro.ko 2023-06-23T18:40:47.565 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-croatian.ko 2023-06-23T18:40:47.566 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-cyrillic.ko 2023-06-23T18:40:47.566 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-gaelic.ko 2023-06-23T18:40:47.566 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-greek.ko 2023-06-23T18:40:47.566 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-iceland.ko 2023-06-23T18:40:47.566 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-inuit.ko 2023-06-23T18:40:47.566 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-roman.ko 2023-06-23T18:40:47.566 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-romanian.ko 2023-06-23T18:40:47.566 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-turkish.ko 2023-06-23T18:40:47.567 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1250.ko 2023-06-23T18:40:47.567 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1251.ko 2023-06-23T18:40:47.567 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1255.ko 2023-06-23T18:40:47.567 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp737.ko 2023-06-23T18:40:47.567 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp775.ko 2023-06-23T18:40:47.567 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp850.ko 2023-06-23T18:40:47.567 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp852.ko 2023-06-23T18:40:47.567 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp855.ko 2023-06-23T18:40:47.568 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp857.ko 2023-06-23T18:40:47.568 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp860.ko 2023-06-23T18:40:47.568 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp861.ko 2023-06-23T18:40:47.568 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp862.ko 2023-06-23T18:40:47.568 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp863.ko 2023-06-23T18:40:47.568 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp864.ko 2023-06-23T18:40:47.568 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp865.ko 2023-06-23T18:40:47.568 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp866.ko 2023-06-23T18:40:47.569 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp869.ko 2023-06-23T18:40:47.569 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp874.ko 2023-06-23T18:40:47.569 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp932.ko 2023-06-23T18:40:47.569 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp936.ko 2023-06-23T18:40:47.569 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp949.ko 2023-06-23T18:40:47.569 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp950.ko 2023-06-23T18:40:47.569 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_euc-jp.ko 2023-06-23T18:40:47.569 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-1.ko 2023-06-23T18:40:47.570 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-13.ko 2023-06-23T18:40:47.570 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-14.ko 2023-06-23T18:40:47.570 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-15.ko 2023-06-23T18:40:47.570 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-2.ko 2023-06-23T18:40:47.570 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-3.ko 2023-06-23T18:40:47.570 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-4.ko 2023-06-23T18:40:47.570 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-5.ko 2023-06-23T18:40:47.570 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-6.ko 2023-06-23T18:40:47.571 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-7.ko 2023-06-23T18:40:47.571 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-9.ko 2023-06-23T18:40:47.571 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-r.ko 2023-06-23T18:40:47.571 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-ru.ko 2023-06-23T18:40:47.571 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-u.ko 2023-06-23T18:40:47.571 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_utf8.ko 2023-06-23T18:40:47.571 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2 2023-06-23T18:40:47.571 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster 2023-06-23T18:40:47.572 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-23T18:40:47.572 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm 2023-06-23T18:40:47.572 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-23T18:40:47.572 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs 2023-06-23T18:40:47.572 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-23T18:40:47.572 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2.ko 2023-06-23T18:40:47.572 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-23T18:40:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-23T18:40:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-23T18:40:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs 2023-06-23T18:40:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs/overlay.ko 2023-06-23T18:40:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore 2023-06-23T18:40:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore/ramoops.ko 2023-06-23T18:40:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs 2023-06-23T18:40:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs/reiserfs.ko 2023-06-23T18:40:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs 2023-06-23T18:40:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs/romfs.ko 2023-06-23T18:40:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb 2023-06-23T18:40:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client 2023-06-23T18:40:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client/cifs.ko 2023-06-23T18:40:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common 2023-06-23T18:40:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_arc4.ko 2023-06-23T18:40:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_md4.ko 2023-06-23T18:40:47.575 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs 2023-06-23T18:40:47.575 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs/squashfs.ko 2023-06-23T18:40:47.575 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv 2023-06-23T18:40:47.575 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv/sysv.ko 2023-06-23T18:40:47.575 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf 2023-06-23T18:40:47.575 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf/udf.ko 2023-06-23T18:40:47.575 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs 2023-06-23T18:40:47.575 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs/ufs.ko 2023-06-23T18:40:47.576 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs 2023-06-23T18:40:47.576 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs/xfs.ko 2023-06-23T18:40:47.576 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel 2023-06-23T18:40:47.576 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu 2023-06-23T18:40:47.576 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu/rcutorture.ko 2023-06-23T18:40:47.576 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/torture.ko 2023-06-23T18:40:47.576 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace 2023-06-23T18:40:47.577 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-06-23T18:40:47.577 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib 2023-06-23T18:40:47.577 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/asn1_encoder.ko 2023-06-23T18:40:47.577 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc-itu-t.ko 2023-06-23T18:40:47.577 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc8.ko 2023-06-23T18:40:47.577 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto 2023-06-23T18:40:47.577 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libarc4.ko 2023-06-23T18:40:47.577 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libdes.ko 2023-06-23T18:40:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/libcrc32c.ko 2023-06-23T18:40:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lru_cache.ko 2023-06-23T18:40:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4 2023-06-23T18:40:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4_compress.ko 2023-06-23T18:40:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4hc_compress.ko 2023-06-23T18:40:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math 2023-06-23T18:40:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math/cordic.ko 2023-06-23T18:40:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6 2023-06-23T18:40:47.579 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6/raid6_pq.ko 2023-06-23T18:40:47.579 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon 2023-06-23T18:40:47.579 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-23T18:40:47.579 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_bm.ko 2023-06-23T18:40:47.579 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_fsm.ko 2023-06-23T18:40:47.579 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_kmp.ko 2023-06-23T18:40:47.579 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd 2023-06-23T18:40:47.579 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd/zstd_compress.ko 2023-06-23T18:40:47.580 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm 2023-06-23T18:40:47.580 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm/hwpoison-inject.ko 2023-06-23T18:40:47.580 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net 2023-06-23T18:40:47.580 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan 2023-06-23T18:40:47.580 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/6lowpan.ko 2023-06-23T18:40:47.580 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_dest.ko 2023-06-23T18:40:47.580 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_fragment.ko 2023-06-23T18:40:47.580 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_hop.ko 2023-06-23T18:40:47.581 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-23T18:40:47.581 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_mobility.ko 2023-06-23T18:40:47.581 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_routing.ko 2023-06-23T18:40:47.581 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_udp.ko 2023-06-23T18:40:47.581 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802 2023-06-23T18:40:47.581 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/garp.ko 2023-06-23T18:40:47.581 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/mrp.ko 2023-06-23T18:40:47.581 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/p8022.ko 2023-06-23T18:40:47.582 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/psnap.ko 2023-06-23T18:40:47.582 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/stp.ko 2023-06-23T18:40:47.582 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q 2023-06-23T18:40:47.582 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q/8021q.ko 2023-06-23T18:40:47.582 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p 2023-06-23T18:40:47.582 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet.ko 2023-06-23T18:40:47.582 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_fd.ko 2023-06-23T18:40:47.583 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_rdma.ko 2023-06-23T18:40:47.583 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_virtio.ko 2023-06-23T18:40:47.583 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv 2023-06-23T18:40:47.583 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv/batman-adv.ko 2023-06-23T18:40:47.583 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge 2023-06-23T18:40:47.583 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/br_netfilter.ko 2023-06-23T18:40:47.583 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/bridge.ko 2023-06-23T18:40:47.583 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter 2023-06-23T18:40:47.584 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-23T18:40:47.584 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-23T18:40:47.584 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-23T18:40:47.584 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-23T18:40:47.584 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-23T18:40:47.584 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-23T18:40:47.584 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-23T18:40:47.585 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-23T18:40:47.585 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-23T18:40:47.585 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-23T18:40:47.585 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-23T18:40:47.585 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-23T18:40:47.585 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-23T18:40:47.585 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-23T18:40:47.585 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-23T18:40:47.586 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-23T18:40:47.586 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-23T18:40:47.586 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-23T18:40:47.586 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-23T18:40:47.586 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-23T18:40:47.586 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtables.ko 2023-06-23T18:40:47.586 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-06-23T18:40:47.586 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-23T18:40:47.587 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-23T18:40:47.587 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph 2023-06-23T18:40:47.587 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph/libceph.ko 2023-06-23T18:40:47.587 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core 2023-06-23T18:40:47.587 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/failover.ko 2023-06-23T18:40:47.587 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/pktgen.ko 2023-06-23T18:40:47.587 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp 2023-06-23T18:40:47.587 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp.ko 2023-06-23T18:40:47.588 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_diag.ko 2023-06-23T18:40:47.588 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv4.ko 2023-06-23T18:40:47.588 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv6.ko 2023-06-23T18:40:47.588 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver 2023-06-23T18:40:47.588 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver/dns_resolver.ko 2023-06-23T18:40:47.588 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa 2023-06-23T18:40:47.588 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/dsa_core.ko 2023-06-23T18:40:47.588 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_brcm.ko 2023-06-23T18:40:47.589 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_dsa.ko 2023-06-23T18:40:47.589 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_none.ko 2023-06-23T18:40:47.589 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_trailer.ko 2023-06-23T18:40:47.589 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154 2023-06-23T18:40:47.589 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan 2023-06-23T18:40:47.589 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-23T18:40:47.589 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154.ko 2023-06-23T18:40:47.589 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-23T18:40:47.590 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4 2023-06-23T18:40:47.590 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ah4.ko 2023-06-23T18:40:47.590 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/esp4.ko 2023-06-23T18:40:47.590 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/fou.ko 2023-06-23T18:40:47.590 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/gre.ko 2023-06-23T18:40:47.590 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/inet_diag.ko 2023-06-23T18:40:47.590 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_gre.ko 2023-06-23T18:40:47.591 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_tunnel.ko 2023-06-23T18:40:47.591 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_vti.ko 2023-06-23T18:40:47.591 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipcomp.ko 2023-06-23T18:40:47.591 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipip.ko 2023-06-23T18:40:47.591 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter 2023-06-23T18:40:47.591 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-23T18:40:47.591 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-23T18:40:47.591 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-23T18:40:47.592 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-23T18:40:47.592 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-23T18:40:47.592 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-23T18:40:47.592 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-23T18:40:47.592 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-23T18:40:47.592 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-23T18:40:47.592 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-23T18:40:47.592 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-23T18:40:47.593 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-23T18:40:47.593 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-23T18:40:47.593 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-23T18:40:47.593 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-23T18:40:47.593 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-23T18:40:47.593 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-23T18:40:47.593 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-23T18:40:47.593 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-23T18:40:47.594 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-23T18:40:47.594 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-23T18:40:47.594 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_bic.ko 2023-06-23T18:40:47.594 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_dctcp.ko 2023-06-23T18:40:47.594 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_diag.ko 2023-06-23T18:40:47.594 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_highspeed.ko 2023-06-23T18:40:47.594 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_htcp.ko 2023-06-23T18:40:47.594 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_hybla.ko 2023-06-23T18:40:47.595 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_illinois.ko 2023-06-23T18:40:47.595 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_lp.ko 2023-06-23T18:40:47.595 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_scalable.ko 2023-06-23T18:40:47.595 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_vegas.ko 2023-06-23T18:40:47.595 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_veno.ko 2023-06-23T18:40:47.595 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_westwood.ko 2023-06-23T18:40:47.595 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_yeah.ko 2023-06-23T18:40:47.595 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tunnel4.ko 2023-06-23T18:40:47.596 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_diag.ko 2023-06-23T18:40:47.596 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_tunnel.ko 2023-06-23T18:40:47.596 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-23T18:40:47.596 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6 2023-06-23T18:40:47.596 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ah6.ko 2023-06-23T18:40:47.596 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/esp6.ko 2023-06-23T18:40:47.596 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/fou6.ko 2023-06-23T18:40:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_tunnel.ko 2023-06-23T18:40:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-23T18:40:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_vti.ko 2023-06-23T18:40:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ipcomp6.ko 2023-06-23T18:40:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter 2023-06-23T18:40:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-23T18:40:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-23T18:40:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-23T18:40:47.598 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-23T18:40:47.598 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-23T18:40:47.598 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-23T18:40:47.598 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-23T18:40:47.598 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-23T18:40:47.598 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-23T18:40:47.598 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-23T18:40:47.598 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-23T18:40:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-23T18:40:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-23T18:40:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-23T18:40:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-23T18:40:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-23T18:40:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-23T18:40:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-23T18:40:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-23T18:40:47.600 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-23T18:40:47.600 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-23T18:40:47.600 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-23T18:40:47.600 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-23T18:40:47.600 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-23T18:40:47.600 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/sit.ko 2023-06-23T18:40:47.600 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/tunnel6.ko 2023-06-23T18:40:47.601 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-23T18:40:47.601 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key 2023-06-23T18:40:47.601 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key/af_key.ko 2023-06-23T18:40:47.601 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp 2023-06-23T18:40:47.601 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_core.ko 2023-06-23T18:40:47.601 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-23T18:40:47.601 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_eth.ko 2023-06-23T18:40:47.601 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip.ko 2023-06-23T18:40:47.602 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip6.ko 2023-06-23T18:40:47.602 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_netlink.ko 2023-06-23T18:40:47.602 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ppp.ko 2023-06-23T18:40:47.602 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc 2023-06-23T18:40:47.602 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc/llc.ko 2023-06-23T18:40:47.602 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154 2023-06-23T18:40:47.602 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154/mac802154.ko 2023-06-23T18:40:47.602 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls 2023-06-23T18:40:47.603 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls/mpls_gso.ko 2023-06-23T18:40:47.603 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter 2023-06-23T18:40:47.603 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset 2023-06-23T18:40:47.603 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set.ko 2023-06-23T18:40:47.603 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-23T18:40:47.603 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-23T18:40:47.603 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-23T18:40:47.603 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-23T18:40:47.604 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-23T18:40:47.604 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-23T18:40:47.604 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-23T18:40:47.604 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-23T18:40:47.604 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-23T18:40:47.604 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-23T18:40:47.604 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-23T18:40:47.604 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-23T18:40:47.605 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-23T18:40:47.605 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-23T18:40:47.605 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-23T18:40:47.605 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs 2023-06-23T18:40:47.605 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-23T18:40:47.605 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-23T18:40:47.605 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-23T18:40:47.605 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-23T18:40:47.606 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-23T18:40:47.606 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-23T18:40:47.606 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-23T18:40:47.606 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-23T18:40:47.606 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-23T18:40:47.606 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-23T18:40:47.606 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-23T18:40:47.606 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-23T18:40:47.607 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-23T18:40:47.607 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-23T18:40:47.607 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conncount.ko 2023-06-23T18:40:47.607 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack.ko 2023-06-23T18:40:47.607 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-23T18:40:47.607 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-23T18:40:47.607 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-23T18:40:47.607 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-23T18:40:47.608 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-23T18:40:47.608 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-23T18:40:47.608 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-23T18:40:47.608 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-23T18:40:47.608 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-23T18:40:47.608 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-23T18:40:47.608 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-23T18:40:47.609 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-23T18:40:47.609 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-23T18:40:47.609 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table.ko 2023-06-23T18:40:47.609 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-23T18:40:47.609 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_log_syslog.ko 2023-06-23T18:40:47.609 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat.ko 2023-06-23T18:40:47.609 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-23T18:40:47.609 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-23T18:40:47.610 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_irc.ko 2023-06-23T18:40:47.610 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_sip.ko 2023-06-23T18:40:47.610 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-23T18:40:47.610 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-23T18:40:47.610 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_tables.ko 2023-06-23T18:40:47.610 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink.ko 2023-06-23T18:40:47.610 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-23T18:40:47.610 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_log.ko 2023-06-23T18:40:47.611 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-23T18:40:47.611 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-23T18:40:47.611 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_chain_nat.ko 2023-06-23T18:40:47.611 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_compat.ko 2023-06-23T18:40:47.611 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_ct.ko 2023-06-23T18:40:47.611 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-23T18:40:47.611 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fib.ko 2023-06-23T18:40:47.611 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-23T18:40:47.612 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_hash.ko 2023-06-23T18:40:47.612 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_limit.ko 2023-06-23T18:40:47.612 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_log.ko 2023-06-23T18:40:47.612 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_masq.ko 2023-06-23T18:40:47.612 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_nat.ko 2023-06-23T18:40:47.612 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_numgen.ko 2023-06-23T18:40:47.612 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_queue.ko 2023-06-23T18:40:47.612 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_quota.ko 2023-06-23T18:40:47.613 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_redir.ko 2023-06-23T18:40:47.613 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject.ko 2023-06-23T18:40:47.613 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject_inet.ko 2023-06-23T18:40:47.613 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_socket.ko 2023-06-23T18:40:47.613 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_tunnel.ko 2023-06-23T18:40:47.613 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_AUDIT.ko 2023-06-23T18:40:47.613 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-23T18:40:47.613 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-23T18:40:47.614 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-23T18:40:47.614 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CT.ko 2023-06-23T18:40:47.614 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_DSCP.ko 2023-06-23T18:40:47.614 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HL.ko 2023-06-23T18:40:47.614 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HMARK.ko 2023-06-23T18:40:47.614 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-23T18:40:47.614 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LED.ko 2023-06-23T18:40:47.614 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LOG.ko 2023-06-23T18:40:47.615 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-23T18:40:47.615 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NETMAP.ko 2023-06-23T18:40:47.615 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFLOG.ko 2023-06-23T18:40:47.615 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-23T18:40:47.615 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_RATEEST.ko 2023-06-23T18:40:47.615 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-23T18:40:47.615 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_SECMARK.ko 2023-06-23T18:40:47.615 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-23T18:40:47.616 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-23T18:40:47.616 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TEE.ko 2023-06-23T18:40:47.616 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TPROXY.ko 2023-06-23T18:40:47.616 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TRACE.ko 2023-06-23T18:40:47.616 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_addrtype.ko 2023-06-23T18:40:47.616 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_bpf.ko 2023-06-23T18:40:47.616 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cgroup.ko 2023-06-23T18:40:47.616 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cluster.ko 2023-06-23T18:40:47.617 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_comment.ko 2023-06-23T18:40:47.617 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connbytes.ko 2023-06-23T18:40:47.617 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlabel.ko 2023-06-23T18:40:47.617 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlimit.ko 2023-06-23T18:40:47.617 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connmark.ko 2023-06-23T18:40:47.617 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_conntrack.ko 2023-06-23T18:40:47.617 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cpu.ko 2023-06-23T18:40:47.617 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dccp.ko 2023-06-23T18:40:47.618 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_devgroup.ko 2023-06-23T18:40:47.618 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dscp.ko 2023-06-23T18:40:47.618 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ecn.ko 2023-06-23T18:40:47.618 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_esp.ko 2023-06-23T18:40:47.618 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hashlimit.ko 2023-06-23T18:40:47.618 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_helper.ko 2023-06-23T18:40:47.618 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hl.ko 2023-06-23T18:40:47.618 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipcomp.ko 2023-06-23T18:40:47.619 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_iprange.ko 2023-06-23T18:40:47.619 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipvs.ko 2023-06-23T18:40:47.619 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_l2tp.ko 2023-06-23T18:40:47.619 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_length.ko 2023-06-23T18:40:47.619 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_limit.ko 2023-06-23T18:40:47.619 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mac.ko 2023-06-23T18:40:47.619 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mark.ko 2023-06-23T18:40:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_multiport.ko 2023-06-23T18:40:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nat.ko 2023-06-23T18:40:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nfacct.ko 2023-06-23T18:40:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_osf.ko 2023-06-23T18:40:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_owner.ko 2023-06-23T18:40:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_physdev.ko 2023-06-23T18:40:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_pkttype.ko 2023-06-23T18:40:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_policy.ko 2023-06-23T18:40:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_quota.ko 2023-06-23T18:40:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_rateest.ko 2023-06-23T18:40:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_realm.ko 2023-06-23T18:40:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_recent.ko 2023-06-23T18:40:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_sctp.ko 2023-06-23T18:40:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_set.ko 2023-06-23T18:40:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_socket.ko 2023-06-23T18:40:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_state.ko 2023-06-23T18:40:47.622 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_statistic.ko 2023-06-23T18:40:47.622 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_string.ko 2023-06-23T18:40:47.622 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_tcpmss.ko 2023-06-23T18:40:47.622 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_time.ko 2023-06-23T18:40:47.622 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_u32.ko 2023-06-23T18:40:47.622 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink 2023-06-23T18:40:47.622 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink/netlink_diag.ko 2023-06-23T18:40:47.622 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh 2023-06-23T18:40:47.623 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh/nsh.ko 2023-06-23T18:40:47.623 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch 2023-06-23T18:40:47.623 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/openvswitch.ko 2023-06-23T18:40:47.623 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-geneve.ko 2023-06-23T18:40:47.623 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-gre.ko 2023-06-23T18:40:47.623 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-vxlan.ko 2023-06-23T18:40:47.623 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet 2023-06-23T18:40:47.623 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet/af_packet_diag.ko 2023-06-23T18:40:47.624 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds 2023-06-23T18:40:47.624 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds.ko 2023-06-23T18:40:47.624 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_rdma.ko 2023-06-23T18:40:47.624 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_tcp.ko 2023-06-23T18:40:47.624 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched 2023-06-23T18:40:47.624 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_csum.ko 2023-06-23T18:40:47.624 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_gact.ko 2023-06-23T18:40:47.625 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_ipt.ko 2023-06-23T18:40:47.625 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_mirred.ko 2023-06-23T18:40:47.625 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_nat.ko 2023-06-23T18:40:47.625 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_pedit.ko 2023-06-23T18:40:47.625 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_police.ko 2023-06-23T18:40:47.625 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_simple.ko 2023-06-23T18:40:47.625 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_skbedit.ko 2023-06-23T18:40:47.625 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_vlan.ko 2023-06-23T18:40:47.626 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_basic.ko 2023-06-23T18:40:47.626 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_bpf.ko 2023-06-23T18:40:47.626 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_flow.ko 2023-06-23T18:40:47.626 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_fw.ko 2023-06-23T18:40:47.626 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_route.ko 2023-06-23T18:40:47.626 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_u32.ko 2023-06-23T18:40:47.626 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_cmp.ko 2023-06-23T18:40:47.626 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_ipset.ko 2023-06-23T18:40:47.627 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_meta.ko 2023-06-23T18:40:47.627 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_nbyte.ko 2023-06-23T18:40:47.627 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_text.ko 2023-06-23T18:40:47.627 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_u32.ko 2023-06-23T18:40:47.627 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_choke.ko 2023-06-23T18:40:47.627 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_codel.ko 2023-06-23T18:40:47.627 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_drr.ko 2023-06-23T18:40:47.627 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_fq.ko 2023-06-23T18:40:47.628 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_gred.ko 2023-06-23T18:40:47.628 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hfsc.ko 2023-06-23T18:40:47.628 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hhf.ko 2023-06-23T18:40:47.628 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_htb.ko 2023-06-23T18:40:47.628 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_ingress.ko 2023-06-23T18:40:47.628 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio.ko 2023-06-23T18:40:47.628 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio_lib.ko 2023-06-23T18:40:47.629 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_multiq.ko 2023-06-23T18:40:47.629 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_netem.ko 2023-06-23T18:40:47.629 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_pie.ko 2023-06-23T18:40:47.629 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_plug.ko 2023-06-23T18:40:47.629 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_prio.ko 2023-06-23T18:40:47.629 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_qfq.ko 2023-06-23T18:40:47.629 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_red.ko 2023-06-23T18:40:47.629 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfb.ko 2023-06-23T18:40:47.630 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfq.ko 2023-06-23T18:40:47.630 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_tbf.ko 2023-06-23T18:40:47.630 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_teql.ko 2023-06-23T18:40:47.630 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp 2023-06-23T18:40:47.630 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp.ko 2023-06-23T18:40:47.630 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp_diag.ko 2023-06-23T18:40:47.630 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc 2023-06-23T18:40:47.630 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss 2023-06-23T18:40:47.631 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-23T18:40:47.631 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-23T18:40:47.631 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/sunrpc.ko 2023-06-23T18:40:47.631 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma 2023-06-23T18:40:47.631 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-23T18:40:47.631 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc 2023-06-23T18:40:47.631 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/diag.ko 2023-06-23T18:40:47.631 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/tipc.ko 2023-06-23T18:40:47.632 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix 2023-06-23T18:40:47.632 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix/unix_diag.ko 2023-06-23T18:40:47.632 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock 2023-06-23T18:40:47.632 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-23T18:40:47.632 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-23T18:40:47.632 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock.ko 2023-06-23T18:40:47.632 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-23T18:40:47.632 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-23T18:40:47.633 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm 2023-06-23T18:40:47.633 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-23T18:40:47.633 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security 2023-06-23T18:40:47.633 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys 2023-06-23T18:40:47.633 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys 2023-06-23T18:40:47.633 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-06-23T18:40:47.633 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys 2023-06-23T18:40:47.634 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys/trusted.ko 2023-06-23T18:40:47.634 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt 2023-06-23T18:40:47.634 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib 2023-06-23T18:40:47.634 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib/irqbypass.ko 2023-06-23T18:40:47.634 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias 2023-06-23T18:40:47.634 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias.bin 2023-06-23T18:40:47.634 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin 2023-06-23T18:40:47.634 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.bin 2023-06-23T18:40:47.635 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.modinfo 2023-06-23T18:40:47.635 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep 2023-06-23T18:40:47.635 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep.bin 2023-06-23T18:40:47.635 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.devname 2023-06-23T18:40:47.635 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.order 2023-06-23T18:40:47.635 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.softdep 2023-06-23T18:40:47.635 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols 2023-06-23T18:40:47.635 INFO:teuthology.orchestra.run.smithi178.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols.bin 2023-06-23T18:40:47.636 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:47.637 DEBUG:teuthology.orchestra.run.smithi178:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-06-23T18:40:47.664 INFO:teuthology.orchestra.run.smithi178.stdout:postinstall scriptlet (using /bin/sh): 2023-06-23T18:40:47.664 INFO:teuthology.orchestra.run.smithi178.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 -a -r /boot/System.map-6.4.0-rc5-g1c622d92b6f1 ]; then 2023-06-23T18:40:47.664 INFO:teuthology.orchestra.run.smithi178.stdout:cp /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:40:47.664 INFO:teuthology.orchestra.run.smithi178.stdout:cp /boot/System.map-6.4.0-rc5-g1c622d92b6f1 /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:40:47.664 INFO:teuthology.orchestra.run.smithi178.stdout:rm -f /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:47.665 INFO:teuthology.orchestra.run.smithi178.stdout:/sbin/installkernel 6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:40:47.665 INFO:teuthology.orchestra.run.smithi178.stdout:rm -f /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:40:47.665 INFO:teuthology.orchestra.run.smithi178.stdout:fi 2023-06-23T18:40:47.665 INFO:teuthology.orchestra.run.smithi178.stdout:preuninstall scriptlet (using /bin/sh): 2023-06-23T18:40:47.665 INFO:teuthology.orchestra.run.smithi178.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-06-23T18:40:47.665 INFO:teuthology.orchestra.run.smithi178.stdout:new-kernel-pkg --remove 6.4.0-rc5-g1c622d92b6f1 --rminitrd --initrdfile=/boot/initramfs-6.4.0-rc5-g1c622d92b6f1.img 2023-06-23T18:40:47.665 INFO:teuthology.orchestra.run.smithi178.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-06-23T18:40:47.665 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-install remove 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:47.666 INFO:teuthology.orchestra.run.smithi178.stdout:fi 2023-06-23T18:40:47.666 INFO:teuthology.orchestra.run.smithi178.stdout:postuninstall scriptlet (using /bin/sh): 2023-06-23T18:40:47.666 INFO:teuthology.orchestra.run.smithi178.stdout:if [ -x /sbin/update-bootloader ]; then 2023-06-23T18:40:47.666 INFO:teuthology.orchestra.run.smithi178.stdout:/sbin/update-bootloader --remove 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:47.666 INFO:teuthology.orchestra.run.smithi178.stdout:fi 2023-06-23T18:40:47.667 DEBUG:teuthology.orchestra.run.smithi178:> sudo rpm -qi grub2-tools 2023-06-23T18:40:47.745 INFO:teuthology.orchestra.run.smithi178.stdout:Name : grub2-tools 2023-06-23T18:40:47.746 INFO:teuthology.orchestra.run.smithi178.stdout:Epoch : 1 2023-06-23T18:40:47.746 INFO:teuthology.orchestra.run.smithi178.stdout:Version : 2.02 2023-06-23T18:40:47.747 INFO:teuthology.orchestra.run.smithi178.stdout:Release : 123.el8 2023-06-23T18:40:47.747 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: x86_64 2023-06-23T18:40:47.747 INFO:teuthology.orchestra.run.smithi178.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-06-23T18:40:47.748 INFO:teuthology.orchestra.run.smithi178.stdout:Group : System Environment/Base 2023-06-23T18:40:47.748 INFO:teuthology.orchestra.run.smithi178.stdout:Size : 9265450 2023-06-23T18:40:47.748 INFO:teuthology.orchestra.run.smithi178.stdout:License : GPLv3+ 2023-06-23T18:40:47.749 INFO:teuthology.orchestra.run.smithi178.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-06-23T18:40:47.749 INFO:teuthology.orchestra.run.smithi178.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-06-23T18:40:47.749 INFO:teuthology.orchestra.run.smithi178.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-06-23T18:40:47.750 INFO:teuthology.orchestra.run.smithi178.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-06-23T18:40:47.750 INFO:teuthology.orchestra.run.smithi178.stdout:Relocations : (not relocatable) 2023-06-23T18:40:47.750 INFO:teuthology.orchestra.run.smithi178.stdout:Packager : Red Hat, Inc. 2023-06-23T18:40:47.751 INFO:teuthology.orchestra.run.smithi178.stdout:Vendor : Red Hat, Inc. 2023-06-23T18:40:47.751 INFO:teuthology.orchestra.run.smithi178.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-23T18:40:47.751 INFO:teuthology.orchestra.run.smithi178.stdout:Summary : Support tools for GRUB. 2023-06-23T18:40:47.751 INFO:teuthology.orchestra.run.smithi178.stdout:Description : 2023-06-23T18:40:47.752 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:40:47.752 INFO:teuthology.orchestra.run.smithi178.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-23T18:40:47.753 INFO:teuthology.orchestra.run.smithi178.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-23T18:40:47.753 INFO:teuthology.orchestra.run.smithi178.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-23T18:40:47.754 INFO:teuthology.orchestra.run.smithi178.stdout:hardware devices. 2023-06-23T18:40:47.755 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:40:47.755 INFO:teuthology.orchestra.run.smithi178.stdout:This subpackage provides tools for support of all platforms. 2023-06-23T18:40:47.756 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-23T18:40:47.756 INFO:teuthology.task.kernel:Updating grub on smithi178 to boot 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:47.756 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-23T18:40:52.051 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2023-06-23T18:40:52.361 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-06-23T18:40:52.361 DEBUG:teuthology.orchestra.run.smithi136:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-06-23T18:40:52.416 INFO:teuthology.orchestra.run.smithi136.stdout:/boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:52.416 INFO:teuthology.orchestra.run.smithi136.stdout:/boot/config-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:52.416 INFO:teuthology.orchestra.run.smithi136.stdout:/boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:52.416 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:52.416 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel 2023-06-23T18:40:52.416 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch 2023-06-23T18:40:52.417 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86 2023-06-23T18:40:52.417 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto 2023-06-23T18:40:52.417 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-23T18:40:52.417 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-23T18:40:52.417 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-23T18:40:52.417 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-23T18:40:52.417 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-23T18:40:52.418 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-23T18:40:52.418 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-23T18:40:52.418 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32c-intel.ko 2023-06-23T18:40:52.418 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-23T18:40:52.418 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-23T18:40:52.418 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-23T18:40:52.418 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-23T18:40:52.419 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-23T18:40:52.419 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-23T18:40:52.419 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-23T18:40:52.419 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-23T18:40:52.419 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-23T18:40:52.419 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-23T18:40:52.419 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-23T18:40:52.420 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-23T18:40:52.420 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel 2023-06-23T18:40:52.420 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu 2023-06-23T18:40:52.420 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce 2023-06-23T18:40:52.420 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-23T18:40:52.420 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm 2023-06-23T18:40:52.421 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-23T18:40:52.421 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-23T18:40:52.421 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm.ko 2023-06-23T18:40:52.421 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto 2023-06-23T18:40:52.421 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ansi_cprng.ko 2023-06-23T18:40:52.421 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/anubis.ko 2023-06-23T18:40:52.421 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/arc4.ko 2023-06-23T18:40:52.422 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx 2023-06-23T18:40:52.422 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_memcpy.ko 2023-06-23T18:40:52.422 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_pq.ko 2023-06-23T18:40:52.422 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-23T18:40:52.422 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_tx.ko 2023-06-23T18:40:52.422 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_xor.ko 2023-06-23T18:40:52.422 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/raid6test.ko 2023-06-23T18:40:52.422 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authenc.ko 2023-06-23T18:40:52.423 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authencesn.ko 2023-06-23T18:40:52.423 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blake2b_generic.ko 2023-06-23T18:40:52.423 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_common.ko 2023-06-23T18:40:52.423 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_generic.ko 2023-06-23T18:40:52.423 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/camellia_generic.ko 2023-06-23T18:40:52.423 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast5_generic.ko 2023-06-23T18:40:52.423 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast6_generic.ko 2023-06-23T18:40:52.423 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast_common.ko 2023-06-23T18:40:52.424 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ccm.ko 2023-06-23T18:40:52.424 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cmac.ko 2023-06-23T18:40:52.424 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crc32_generic.ko 2023-06-23T18:40:52.424 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_engine.ko 2023-06-23T18:40:52.424 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_user.ko 2023-06-23T18:40:52.424 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cts.ko 2023-06-23T18:40:52.424 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/des_generic.ko 2023-06-23T18:40:52.425 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/dh_generic.ko 2023-06-23T18:40:52.425 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/echainiv.ko 2023-06-23T18:40:52.425 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/essiv.ko 2023-06-23T18:40:52.425 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/fcrypt.ko 2023-06-23T18:40:52.425 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/khazad.ko 2023-06-23T18:40:52.425 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4.ko 2023-06-23T18:40:52.425 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4hc.ko 2023-06-23T18:40:52.425 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/md4.ko 2023-06-23T18:40:52.426 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/michael_mic.ko 2023-06-23T18:40:52.426 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcbc.ko 2023-06-23T18:40:52.426 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcrypt.ko 2023-06-23T18:40:52.426 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/rmd160.ko 2023-06-23T18:40:52.426 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/seed.ko 2023-06-23T18:40:52.426 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/serpent_generic.ko 2023-06-23T18:40:52.426 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tcrypt.ko 2023-06-23T18:40:52.426 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tea.ko 2023-06-23T18:40:52.427 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_common.ko 2023-06-23T18:40:52.427 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_generic.ko 2023-06-23T18:40:52.427 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/vmac.ko 2023-06-23T18:40:52.427 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/wp512.ko 2023-06-23T18:40:52.427 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xcbc.ko 2023-06-23T18:40:52.427 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xor.ko 2023-06-23T18:40:52.427 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xxhash_generic.ko 2023-06-23T18:40:52.428 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers 2023-06-23T18:40:52.428 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi 2023-06-23T18:40:52.428 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-23T18:40:52.428 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_pad.ko 2023-06-23T18:40:52.428 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/custom_method.ko 2023-06-23T18:40:52.428 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/ec_sys.ko 2023-06-23T18:40:52.428 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/platform_profile.ko 2023-06-23T18:40:52.428 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbs.ko 2023-06-23T18:40:52.429 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbshc.ko 2023-06-23T18:40:52.429 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/video.ko 2023-06-23T18:40:52.429 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata 2023-06-23T18:40:52.429 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/acard-ahci.ko 2023-06-23T18:40:52.429 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ahci_platform.ko 2023-06-23T18:40:52.429 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ata_generic.ko 2023-06-23T18:40:52.429 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/libahci_platform.ko 2023-06-23T18:40:52.429 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_acpi.ko 2023-06-23T18:40:52.430 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ali.ko 2023-06-23T18:40:52.430 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_amd.ko 2023-06-23T18:40:52.430 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_artop.ko 2023-06-23T18:40:52.430 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atiixp.ko 2023-06-23T18:40:52.430 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atp867x.ko 2023-06-23T18:40:52.430 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd640.ko 2023-06-23T18:40:52.430 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd64x.ko 2023-06-23T18:40:52.430 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cypress.ko 2023-06-23T18:40:52.431 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_efar.ko 2023-06-23T18:40:52.431 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt366.ko 2023-06-23T18:40:52.431 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt37x.ko 2023-06-23T18:40:52.431 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-23T18:40:52.431 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-23T18:40:52.432 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it8213.ko 2023-06-23T18:40:52.432 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it821x.ko 2023-06-23T18:40:52.432 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_jmicron.ko 2023-06-23T18:40:52.432 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_marvell.ko 2023-06-23T18:40:52.432 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_mpiix.ko 2023-06-23T18:40:52.432 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_netcell.ko 2023-06-23T18:40:52.433 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ninja32.ko 2023-06-23T18:40:52.433 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87410.ko 2023-06-23T18:40:52.433 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87415.ko 2023-06-23T18:40:52.433 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_oldpiix.ko 2023-06-23T18:40:52.434 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_opti.ko 2023-06-23T18:40:52.434 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_optidma.ko 2023-06-23T18:40:52.434 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pcmcia.ko 2023-06-23T18:40:52.434 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-23T18:40:52.435 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-23T18:40:52.435 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_piccolo.ko 2023-06-23T18:40:52.435 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_rdc.ko 2023-06-23T18:40:52.436 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sch.ko 2023-06-23T18:40:52.436 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_serverworks.ko 2023-06-23T18:40:52.436 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sil680.ko 2023-06-23T18:40:52.436 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sis.ko 2023-06-23T18:40:52.437 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sl82c105.ko 2023-06-23T18:40:52.437 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_triflex.ko 2023-06-23T18:40:52.437 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_via.ko 2023-06-23T18:40:52.437 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pdc_adma.ko 2023-06-23T18:40:52.438 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_inic162x.ko 2023-06-23T18:40:52.438 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_mv.ko 2023-06-23T18:40:52.438 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_nv.ko 2023-06-23T18:40:52.438 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_promise.ko 2023-06-23T18:40:52.439 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_qstor.ko 2023-06-23T18:40:52.439 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil.ko 2023-06-23T18:40:52.439 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil24.ko 2023-06-23T18:40:52.439 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sis.ko 2023-06-23T18:40:52.439 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_svw.ko 2023-06-23T18:40:52.440 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sx4.ko 2023-06-23T18:40:52.440 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_uli.ko 2023-06-23T18:40:52.440 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_via.ko 2023-06-23T18:40:52.440 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_vsc.ko 2023-06-23T18:40:52.440 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay 2023-06-23T18:40:52.440 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay/ks0108.ko 2023-06-23T18:40:52.440 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base 2023-06-23T18:40:52.441 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap 2023-06-23T18:40:52.441 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap/regmap-i2c.ko 2023-06-23T18:40:52.441 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma 2023-06-23T18:40:52.441 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma/bcma.ko 2023-06-23T18:40:52.441 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block 2023-06-23T18:40:52.441 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe 2023-06-23T18:40:52.441 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe/aoe.ko 2023-06-23T18:40:52.442 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/brd.ko 2023-06-23T18:40:52.442 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd 2023-06-23T18:40:52.442 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd/drbd.ko 2023-06-23T18:40:52.442 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/floppy.ko 2023-06-23T18:40:52.442 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/loop.ko 2023-06-23T18:40:52.442 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx 2023-06-23T18:40:52.443 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-23T18:40:52.443 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/nbd.ko 2023-06-23T18:40:52.443 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk 2023-06-23T18:40:52.443 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk/null_blk.ko 2023-06-23T18:40:52.443 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/pktcdvd.ko 2023-06-23T18:40:52.443 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/rbd.ko 2023-06-23T18:40:52.444 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/virtio_blk.ko 2023-06-23T18:40:52.444 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback 2023-06-23T18:40:52.444 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-23T18:40:52.444 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkfront.ko 2023-06-23T18:40:52.444 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram 2023-06-23T18:40:52.444 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram/zram.ko 2023-06-23T18:40:52.444 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char 2023-06-23T18:40:52.444 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hangcheck-timer.ko 2023-06-23T18:40:52.445 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random 2023-06-23T18:40:52.445 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-23T18:40:52.445 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-23T18:40:52.445 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-23T18:40:52.445 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/via-rng.ko 2023-06-23T18:40:52.445 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-23T18:40:52.445 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi 2023-06-23T18:40:52.446 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-23T18:40:52.446 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-23T18:40:52.446 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-23T18:40:52.446 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-23T18:40:52.446 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-23T18:40:52.446 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-23T18:40:52.447 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/lp.ko 2023-06-23T18:40:52.447 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave 2023-06-23T18:40:52.447 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave/mwave.ko 2023-06-23T18:40:52.447 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ppdev.ko 2023-06-23T18:40:52.447 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tlclk.ko 2023-06-23T18:40:52.447 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm 2023-06-23T18:40:52.448 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm.ko 2023-06-23T18:40:52.448 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-23T18:40:52.448 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-23T18:40:52.448 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-23T18:40:52.448 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis.ko 2023-06-23T18:40:52.448 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-06-23T18:40:52.448 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/uv_mmtimer.ko 2023-06-23T18:40:52.449 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/virtio_console.ko 2023-06-23T18:40:52.449 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq 2023-06-23T18:40:52.449 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-06-23T18:40:52.449 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-23T18:40:52.449 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-23T18:40:52.449 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-06-23T18:40:52.449 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/powernow-k8.ko 2023-06-23T18:40:52.449 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-23T18:40:52.450 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto 2023-06-23T18:40:52.450 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp 2023-06-23T18:40:52.450 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-23T18:40:52.450 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp.ko 2023-06-23T18:40:52.450 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel 2023-06-23T18:40:52.450 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat 2023-06-23T18:40:52.450 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common 2023-06-23T18:40:52.451 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-23T18:40:52.451 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-06-23T18:40:52.451 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-23T18:40:52.451 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-aes.ko 2023-06-23T18:40:52.451 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-sha.ko 2023-06-23T18:40:52.451 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio 2023-06-23T18:40:52.451 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-23T18:40:52.451 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca 2023-06-23T18:40:52.452 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca/dca.ko 2023-06-23T18:40:52.452 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq 2023-06-23T18:40:52.452 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-06-23T18:40:52.452 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma 2023-06-23T18:40:52.452 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw 2023-06-23T18:40:52.453 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-23T18:40:52.453 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat 2023-06-23T18:40:52.453 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-23T18:40:52.453 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac 2023-06-23T18:40:52.453 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/amd64_edac.ko 2023-06-23T18:40:52.453 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/e752x_edac.ko 2023-06-23T18:40:52.453 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/edac_mce_amd.ko 2023-06-23T18:40:52.454 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3000_edac.ko 2023-06-23T18:40:52.454 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3200_edac.ko 2023-06-23T18:40:52.454 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5100_edac.ko 2023-06-23T18:40:52.454 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5400_edac.ko 2023-06-23T18:40:52.454 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7300_edac.ko 2023-06-23T18:40:52.454 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7core_edac.ko 2023-06-23T18:40:52.454 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i82975x_edac.ko 2023-06-23T18:40:52.454 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/ie31200_edac.ko 2023-06-23T18:40:52.455 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/sb_edac.ko 2023-06-23T18:40:52.455 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/x38_edac.ko 2023-06-23T18:40:52.455 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware 2023-06-23T18:40:52.455 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/edd.ko 2023-06-23T18:40:52.455 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-23T18:40:52.455 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio 2023-06-23T18:40:52.455 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-ich.ko 2023-06-23T18:40:52.456 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-23T18:40:52.456 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid 2023-06-23T18:40:52.456 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-appleir.ko 2023-06-23T18:40:52.456 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-aureal.ko 2023-06-23T18:40:52.457 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-axff.ko 2023-06-23T18:40:52.457 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-dr.ko 2023-06-23T18:40:52.457 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elecom.ko 2023-06-23T18:40:52.457 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elo.ko 2023-06-23T18:40:52.458 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-emsff.ko 2023-06-23T18:40:52.458 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gaff.ko 2023-06-23T18:40:52.458 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gt683r.ko 2023-06-23T18:40:52.458 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gyration.ko 2023-06-23T18:40:52.459 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-23T18:40:52.459 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-23T18:40:52.459 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtekff.ko 2023-06-23T18:40:52.459 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-hyperv.ko 2023-06-23T18:40:52.460 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-icade.ko 2023-06-23T18:40:52.460 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-keytouch.ko 2023-06-23T18:40:52.460 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-kye.ko 2023-06-23T18:40:52.460 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lcpower.ko 2023-06-23T18:40:52.461 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-led.ko 2023-06-23T18:40:52.461 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lenovo.ko 2023-06-23T18:40:52.461 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-23T18:40:52.461 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-23T18:40:52.462 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-multitouch.ko 2023-06-23T18:40:52.462 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-ortek.ko 2023-06-23T18:40:52.462 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-penmount.ko 2023-06-23T18:40:52.463 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-petalynx.ko 2023-06-23T18:40:52.463 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-picolcd.ko 2023-06-23T18:40:52.463 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-pl.ko 2023-06-23T18:40:52.463 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-plantronics.ko 2023-06-23T18:40:52.463 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-primax.ko 2023-06-23T18:40:52.464 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-rmi.ko 2023-06-23T18:40:52.464 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-23T18:40:52.464 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-common.ko 2023-06-23T18:40:52.464 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-23T18:40:52.464 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-23T18:40:52.465 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-23T18:40:52.465 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-23T18:40:52.465 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-23T18:40:52.465 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-23T18:40:52.465 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-23T18:40:52.465 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-23T18:40:52.465 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-23T18:40:52.465 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat.ko 2023-06-23T18:40:52.466 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-saitek.ko 2023-06-23T18:40:52.466 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-samsung.ko 2023-06-23T18:40:52.466 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-23T18:40:52.466 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sjoy.ko 2023-06-23T18:40:52.466 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sony.ko 2023-06-23T18:40:52.466 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-speedlink.ko 2023-06-23T18:40:52.466 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-steelseries.ko 2023-06-23T18:40:52.467 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sunplus.ko 2023-06-23T18:40:52.467 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-23T18:40:52.467 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tivo.ko 2023-06-23T18:40:52.467 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tmff.ko 2023-06-23T18:40:52.467 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-topseed.ko 2023-06-23T18:40:52.467 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-twinhan.ko 2023-06-23T18:40:52.467 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-uclogic.ko 2023-06-23T18:40:52.467 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-waltop.ko 2023-06-23T18:40:52.468 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-wiimote.ko 2023-06-23T18:40:52.468 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-xinmo.ko 2023-06-23T18:40:52.468 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zpff.ko 2023-06-23T18:40:52.468 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zydacron.ko 2023-06-23T18:40:52.468 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/uhid.ko 2023-06-23T18:40:52.469 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/wacom.ko 2023-06-23T18:40:52.469 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv 2023-06-23T18:40:52.469 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_balloon.ko 2023-06-23T18:40:52.469 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_utils.ko 2023-06-23T18:40:52.469 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_vmbus.ko 2023-06-23T18:40:52.469 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon 2023-06-23T18:40:52.470 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru.ko 2023-06-23T18:40:52.470 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru3.ko 2023-06-23T18:40:52.470 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-23T18:40:52.470 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7414.ko 2023-06-23T18:40:52.470 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7418.ko 2023-06-23T18:40:52.470 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adc128d818.ko 2023-06-23T18:40:52.471 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1025.ko 2023-06-23T18:40:52.471 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1026.ko 2023-06-23T18:40:52.471 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1029.ko 2023-06-23T18:40:52.471 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1031.ko 2023-06-23T18:40:52.471 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm9240.ko 2023-06-23T18:40:52.471 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ads7828.ko 2023-06-23T18:40:52.471 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7410.ko 2023-06-23T18:40:52.471 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7411.ko 2023-06-23T18:40:52.472 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7462.ko 2023-06-23T18:40:52.472 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7470.ko 2023-06-23T18:40:52.472 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7475.ko 2023-06-23T18:40:52.472 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7x10.ko 2023-06-23T18:40:52.472 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/amc6821.ko 2023-06-23T18:40:52.472 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/applesmc.ko 2023-06-23T18:40:52.473 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asb100.ko 2023-06-23T18:40:52.473 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asc7621.ko 2023-06-23T18:40:52.473 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-23T18:40:52.473 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/atxp1.ko 2023-06-23T18:40:52.473 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/coretemp.ko 2023-06-23T18:40:52.473 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-23T18:40:52.473 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dme1737.ko 2023-06-23T18:40:52.474 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds1621.ko 2023-06-23T18:40:52.474 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds620.ko 2023-06-23T18:40:52.474 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc1403.ko 2023-06-23T18:40:52.474 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc6w201.ko 2023-06-23T18:40:52.474 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71805f.ko 2023-06-23T18:40:52.474 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71882fg.ko 2023-06-23T18:40:52.474 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f75375s.ko 2023-06-23T18:40:52.474 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fam15h_power.ko 2023-06-23T18:40:52.475 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fschmd.ko 2023-06-23T18:40:52.475 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g760a.ko 2023-06-23T18:40:52.475 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g762.ko 2023-06-23T18:40:52.475 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl518sm.ko 2023-06-23T18:40:52.475 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl520sm.ko 2023-06-23T18:40:52.475 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-23T18:40:52.475 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5500_temp.ko 2023-06-23T18:40:52.475 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5k_amb.ko 2023-06-23T18:40:52.476 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmaem.ko 2023-06-23T18:40:52.476 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmpex.ko 2023-06-23T18:40:52.476 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina209.ko 2023-06-23T18:40:52.476 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina2xx.ko 2023-06-23T18:40:52.476 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/it87.ko 2023-06-23T18:40:52.476 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k10temp.ko 2023-06-23T18:40:52.476 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k8temp.ko 2023-06-23T18:40:52.476 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lineage-pem.ko 2023-06-23T18:40:52.477 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm63.ko 2023-06-23T18:40:52.477 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm73.ko 2023-06-23T18:40:52.477 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm75.ko 2023-06-23T18:40:52.477 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm77.ko 2023-06-23T18:40:52.477 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm78.ko 2023-06-23T18:40:52.477 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm80.ko 2023-06-23T18:40:52.477 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm83.ko 2023-06-23T18:40:52.477 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm85.ko 2023-06-23T18:40:52.478 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm87.ko 2023-06-23T18:40:52.478 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm90.ko 2023-06-23T18:40:52.478 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm92.ko 2023-06-23T18:40:52.478 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm93.ko 2023-06-23T18:40:52.478 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95234.ko 2023-06-23T18:40:52.478 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95241.ko 2023-06-23T18:40:52.478 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95245.ko 2023-06-23T18:40:52.478 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc2945.ko 2023-06-23T18:40:52.479 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4151.ko 2023-06-23T18:40:52.479 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4215.ko 2023-06-23T18:40:52.479 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4222.ko 2023-06-23T18:40:52.479 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4245.ko 2023-06-23T18:40:52.479 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4260.ko 2023-06-23T18:40:52.479 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4261.ko 2023-06-23T18:40:52.479 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max16065.ko 2023-06-23T18:40:52.479 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1619.ko 2023-06-23T18:40:52.480 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1668.ko 2023-06-23T18:40:52.480 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max197.ko 2023-06-23T18:40:52.480 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6639.ko 2023-06-23T18:40:52.480 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6650.ko 2023-06-23T18:40:52.480 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6697.ko 2023-06-23T18:40:52.480 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/mcp3021.ko 2023-06-23T18:40:52.480 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6683.ko 2023-06-23T18:40:52.480 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775-core.ko 2023-06-23T18:40:52.481 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775.ko 2023-06-23T18:40:52.481 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct7802.ko 2023-06-23T18:40:52.481 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87360.ko 2023-06-23T18:40:52.481 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87427.ko 2023-06-23T18:40:52.481 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pcf8591.ko 2023-06-23T18:40:52.481 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus 2023-06-23T18:40:52.481 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-23T18:40:52.481 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-23T18:40:52.482 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-23T18:40:52.482 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-23T18:40:52.482 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-23T18:40:52.482 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-23T18:40:52.482 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-23T18:40:52.482 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-23T18:40:52.482 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-23T18:40:52.482 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-23T18:40:52.483 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-23T18:40:52.483 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-23T18:40:52.483 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/powr1220.ko 2023-06-23T18:40:52.483 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5627.ko 2023-06-23T18:40:52.483 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5636.ko 2023-06-23T18:40:52.483 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-23T18:40:52.483 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht15.ko 2023-06-23T18:40:52.483 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht21.ko 2023-06-23T18:40:52.484 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/shtc1.ko 2023-06-23T18:40:52.484 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sis5595.ko 2023-06-23T18:40:52.484 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47b397.ko 2023-06-23T18:40:52.484 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m1.ko 2023-06-23T18:40:52.484 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m192.ko 2023-06-23T18:40:52.484 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/thmc50.ko 2023-06-23T18:40:52.484 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp102.ko 2023-06-23T18:40:52.485 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp103.ko 2023-06-23T18:40:52.485 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp401.ko 2023-06-23T18:40:52.485 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp421.ko 2023-06-23T18:40:52.485 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via-cputemp.ko 2023-06-23T18:40:52.485 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via686a.ko 2023-06-23T18:40:52.485 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt1211.ko 2023-06-23T18:40:52.485 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt8231.ko 2023-06-23T18:40:52.485 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627ehf.ko 2023-06-23T18:40:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627hf.ko 2023-06-23T18:40:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83781d.ko 2023-06-23T18:40:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83791d.ko 2023-06-23T18:40:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83792d.ko 2023-06-23T18:40:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83793.ko 2023-06-23T18:40:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83795.ko 2023-06-23T18:40:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l785ts.ko 2023-06-23T18:40:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l786ng.ko 2023-06-23T18:40:52.487 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c 2023-06-23T18:40:52.487 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos 2023-06-23T18:40:52.487 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-23T18:40:52.487 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-23T18:40:52.487 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses 2023-06-23T18:40:52.487 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-23T18:40:52.487 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-23T18:40:52.487 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-23T18:40:52.488 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-23T18:40:52.488 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-23T18:40:52.488 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-23T18:40:52.488 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-23T18:40:52.488 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-23T18:40:52.488 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-23T18:40:52.488 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-23T18:40:52.488 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-23T18:40:52.489 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-23T18:40:52.489 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-23T18:40:52.489 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-23T18:40:52.489 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-23T18:40:52.489 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-23T18:40:52.489 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-23T18:40:52.489 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-23T18:40:52.489 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-23T18:40:52.490 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-23T18:40:52.490 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-23T18:40:52.490 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-23T18:40:52.490 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-23T18:40:52.490 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-dev.ko 2023-06-23T18:40:52.490 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-mux.ko 2023-06-23T18:40:52.490 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-06-23T18:40:52.491 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-smbus.ko 2023-06-23T18:40:52.491 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-stub.ko 2023-06-23T18:40:52.491 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband 2023-06-23T18:40:52.491 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core 2023-06-23T18:40:52.491 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-23T18:40:52.491 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_core.ko 2023-06-23T18:40:52.491 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-23T18:40:52.491 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-23T18:40:52.492 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-23T18:40:52.492 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-23T18:40:52.492 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-23T18:40:52.492 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw 2023-06-23T18:40:52.492 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4 2023-06-23T18:40:52.492 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-23T18:40:52.492 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4 2023-06-23T18:40:52.492 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-23T18:40:52.493 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5 2023-06-23T18:40:52.493 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-23T18:40:52.493 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca 2023-06-23T18:40:52.493 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-23T18:40:52.493 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp 2023-06-23T18:40:52.493 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib 2023-06-23T18:40:52.493 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-23T18:40:52.493 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser 2023-06-23T18:40:52.494 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-23T18:40:52.494 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert 2023-06-23T18:40:52.494 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-23T18:40:52.494 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp 2023-06-23T18:40:52.494 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-23T18:40:52.494 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt 2023-06-23T18:40:52.494 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-23T18:40:52.494 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input 2023-06-23T18:40:52.495 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport 2023-06-23T18:40:52.495 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-23T18:40:52.495 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-23T18:40:52.495 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/gameport.ko 2023-06-23T18:40:52.495 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/lightning.ko 2023-06-23T18:40:52.495 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/ns558.ko 2023-06-23T18:40:52.495 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/joydev.ko 2023-06-23T18:40:52.496 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard 2023-06-23T18:40:52.496 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-23T18:40:52.496 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse 2023-06-23T18:40:52.496 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/appletouch.ko 2023-06-23T18:40:52.496 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/bcm5974.ko 2023-06-23T18:40:52.496 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/cyapatp.ko 2023-06-23T18:40:52.496 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-23T18:40:52.496 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/sermouse.ko 2023-06-23T18:40:52.497 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-23T18:40:52.497 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-23T18:40:52.497 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-23T18:40:52.497 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4 2023-06-23T18:40:52.497 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-23T18:40:52.497 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio 2023-06-23T18:40:52.497 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/altera_ps2.ko 2023-06-23T18:40:52.497 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/arc_ps2.ko 2023-06-23T18:40:52.498 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-23T18:40:52.498 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/serio_raw.ko 2023-06-23T18:40:52.498 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/sparse-keymap.ko 2023-06-23T18:40:52.498 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu 2023-06-23T18:40:52.498 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd 2023-06-23T18:40:52.498 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-23T18:40:52.498 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds 2023-06-23T18:40:52.499 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-blinkm.ko 2023-06-23T18:40:52.499 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lm3530.ko 2023-06-23T18:40:52.499 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lp3944.ko 2023-06-23T18:40:52.499 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-ss4200.ko 2023-06-23T18:40:52.499 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger 2023-06-23T18:40:52.499 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-23T18:40:52.499 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-23T18:40:52.499 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-23T18:40:52.500 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-23T18:40:52.500 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-23T18:40:52.500 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-23T18:40:52.500 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-23T18:40:52.500 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-23T18:40:52.500 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md 2023-06-23T18:40:52.500 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache 2023-06-23T18:40:52.500 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache/bcache.ko 2023-06-23T18:40:52.501 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-bio-prison.ko 2023-06-23T18:40:52.501 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache-smq.ko 2023-06-23T18:40:52.501 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache.ko 2023-06-23T18:40:52.501 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-crypt.ko 2023-06-23T18:40:52.501 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-delay.ko 2023-06-23T18:40:52.501 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-flakey.ko 2023-06-23T18:40:52.501 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-log-userspace.ko 2023-06-23T18:40:52.501 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-multipath.ko 2023-06-23T18:40:52.502 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-queue-length.ko 2023-06-23T18:40:52.502 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-raid.ko 2023-06-23T18:40:52.502 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-round-robin.ko 2023-06-23T18:40:52.502 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-service-time.ko 2023-06-23T18:40:52.502 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-switch.ko 2023-06-23T18:40:52.502 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-thin-pool.ko 2023-06-23T18:40:52.502 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-verity.ko 2023-06-23T18:40:52.502 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/faulty.ko 2023-06-23T18:40:52.503 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/linear.ko 2023-06-23T18:40:52.503 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/multipath.ko 2023-06-23T18:40:52.503 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data 2023-06-23T18:40:52.503 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-23T18:40:52.503 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid0.ko 2023-06-23T18:40:52.503 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid1.ko 2023-06-23T18:40:52.503 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid10.ko 2023-06-23T18:40:52.503 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid456.ko 2023-06-23T18:40:52.504 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message 2023-06-23T18:40:52.504 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion 2023-06-23T18:40:52.504 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptbase.ko 2023-06-23T18:40:52.504 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptctl.ko 2023-06-23T18:40:52.504 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptfc.ko 2023-06-23T18:40:52.504 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptlan.ko 2023-06-23T18:40:52.504 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptsas.ko 2023-06-23T18:40:52.504 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptscsih.ko 2023-06-23T18:40:52.505 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptspi.ko 2023-06-23T18:40:52.505 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd 2023-06-23T18:40:52.505 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_ich.ko 2023-06-23T18:40:52.505 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_sch.ko 2023-06-23T18:40:52.505 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/mfd-core.ko 2023-06-23T18:40:52.505 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/sm501.ko 2023-06-23T18:40:52.505 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/viperboard.ko 2023-06-23T18:40:52.506 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/vx855.ko 2023-06-23T18:40:52.506 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/wl1273-core.ko 2023-06-23T18:40:52.506 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc 2023-06-23T18:40:52.506 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl 2023-06-23T18:40:52.506 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-23T18:40:52.506 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds9802als.ko 2023-06-23T18:40:52.506 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds990x.ko 2023-06-23T18:40:52.506 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/bh1770glc.ko 2023-06-23T18:40:52.507 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710 2023-06-23T18:40:52.507 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710/cb710.ko 2023-06-23T18:40:52.507 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom 2023-06-23T18:40:52.507 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/at24.ko 2023-06-23T18:40:52.507 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-23T18:40:52.507 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-23T18:40:52.507 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/max6875.ko 2023-06-23T18:40:52.507 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/enclosure.ko 2023-06-23T18:40:52.508 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/hpilo.ko 2023-06-23T18:40:52.508 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29003.ko 2023-06-23T18:40:52.508 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29020.ko 2023-06-23T18:40:52.508 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d 2023-06-23T18:40:52.508 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-23T18:40:52.508 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-23T18:40:52.508 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei 2023-06-23T18:40:52.508 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-me.ko 2023-06-23T18:40:52.509 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-txe.ko 2023-06-23T18:40:52.509 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei.ko 2023-06-23T18:40:52.509 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru 2023-06-23T18:40:52.509 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru/gru.ko 2023-06-23T18:40:52.509 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp 2023-06-23T18:40:52.509 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xp.ko 2023-06-23T18:40:52.509 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpc.ko 2023-06-23T18:40:52.509 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-06-23T18:40:52.510 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_7xx1.ko 2023-06-23T18:40:52.510 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_core.ko 2023-06-23T18:40:52.510 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tsl2550.ko 2023-06-23T18:40:52.510 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_balloon.ko 2023-06-23T18:40:52.510 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci 2023-06-23T18:40:52.510 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-23T18:40:52.510 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net 2023-06-23T18:40:52.510 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding 2023-06-23T18:40:52.511 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding/bonding.ko 2023-06-23T18:40:52.511 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa 2023-06-23T18:40:52.511 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53 2023-06-23T18:40:52.511 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-23T18:40:52.511 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-23T18:40:52.511 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-23T18:40:52.511 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx 2023-06-23T18:40:52.511 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-23T18:40:52.512 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dummy.ko 2023-06-23T18:40:52.512 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/eql.ko 2023-06-23T18:40:52.512 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet 2023-06-23T18:40:52.512 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com 2023-06-23T18:40:52.512 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-23T18:40:52.512 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-23T18:40:52.512 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-23T18:40:52.512 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-23T18:40:52.513 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390 2023-06-23T18:40:52.513 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-23T18:40:52.513 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-23T18:40:52.513 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-23T18:40:52.513 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-23T18:40:52.513 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec 2023-06-23T18:40:52.513 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-23T18:40:52.513 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere 2023-06-23T18:40:52.514 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-23T18:40:52.514 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon 2023-06-23T18:40:52.514 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-23T18:40:52.514 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera 2023-06-23T18:40:52.514 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-23T18:40:52.514 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd 2023-06-23T18:40:52.514 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-23T18:40:52.514 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-23T18:40:52.515 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-23T18:40:52.515 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros 2023-06-23T18:40:52.515 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx 2023-06-23T18:40:52.515 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-23T18:40:52.515 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c 2023-06-23T18:40:52.515 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-23T18:40:52.515 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e 2023-06-23T18:40:52.515 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-23T18:40:52.516 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx 2023-06-23T18:40:52.516 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-23T18:40:52.516 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-23T18:40:52.516 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom 2023-06-23T18:40:52.516 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-23T18:40:52.516 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-23T18:40:52.516 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-06-23T18:40:52.517 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-23T18:40:52.517 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-23T18:40:52.517 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet 2023-06-23T18:40:52.517 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-23T18:40:52.517 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-23T18:40:52.517 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade 2023-06-23T18:40:52.517 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna 2023-06-23T18:40:52.517 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-23T18:40:52.518 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio 2023-06-23T18:40:52.518 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb 2023-06-23T18:40:52.518 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-23T18:40:52.518 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-06-23T18:40:52.518 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-23T18:40:52.518 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-06-23T18:40:52.518 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-23T18:40:52.518 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-06-23T18:40:52.519 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-23T18:40:52.519 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-06-23T18:40:52.519 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-23T18:40:52.519 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco 2023-06-23T18:40:52.519 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic 2023-06-23T18:40:52.519 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-23T18:40:52.519 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec 2023-06-23T18:40:52.519 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip 2023-06-23T18:40:52.520 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-23T18:40:52.520 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-23T18:40:52.520 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-23T18:40:52.520 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-23T18:40:52.520 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-23T18:40:52.520 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-23T18:40:52.520 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink 2023-06-23T18:40:52.520 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-23T18:40:52.521 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-23T18:40:52.521 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dnet.ko 2023-06-23T18:40:52.521 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex 2023-06-23T18:40:52.521 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet 2023-06-23T18:40:52.521 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-23T18:40:52.521 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ethoc.ko 2023-06-23T18:40:52.521 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/fealnx.ko 2023-06-23T18:40:52.521 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel 2023-06-23T18:40:52.522 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-23T18:40:52.522 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000 2023-06-23T18:40:52.522 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-23T18:40:52.522 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e 2023-06-23T18:40:52.522 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-23T18:40:52.522 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k 2023-06-23T18:40:52.522 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-23T18:40:52.522 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e 2023-06-23T18:40:52.523 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-23T18:40:52.523 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf 2023-06-23T18:40:52.523 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-23T18:40:52.523 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb 2023-06-23T18:40:52.523 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-23T18:40:52.523 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf 2023-06-23T18:40:52.523 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-23T18:40:52.523 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe 2023-06-23T18:40:52.524 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-23T18:40:52.524 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf 2023-06-23T18:40:52.524 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-23T18:40:52.524 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/jme.ko 2023-06-23T18:40:52.524 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell 2023-06-23T18:40:52.524 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-23T18:40:52.524 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-23T18:40:52.524 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-23T18:40:52.525 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox 2023-06-23T18:40:52.525 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4 2023-06-23T18:40:52.525 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-23T18:40:52.525 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-23T18:40:52.525 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5 2023-06-23T18:40:52.525 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-06-23T18:40:52.525 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-23T18:40:52.525 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel 2023-06-23T18:40:52.526 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-23T18:40:52.526 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom 2023-06-23T18:40:52.526 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge 2023-06-23T18:40:52.526 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-23T18:40:52.526 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi 2023-06-23T18:40:52.526 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-23T18:40:52.526 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-23T18:40:52.527 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion 2023-06-23T18:40:52.527 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-23T18:40:52.527 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia 2023-06-23T18:40:52.527 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-23T18:40:52.527 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines 2023-06-23T18:40:52.527 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-23T18:40:52.527 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-23T18:40:52.527 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic 2023-06-23T18:40:52.528 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen 2023-06-23T18:40:52.528 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-23T18:40:52.528 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-23T18:40:52.528 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-06-23T18:40:52.528 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-23T18:40:52.528 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc 2023-06-23T18:40:52.528 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-23T18:40:52.528 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek 2023-06-23T18:40:52.529 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-23T18:40:52.529 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-23T18:40:52.529 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-23T18:40:52.529 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-23T18:40:52.529 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker 2023-06-23T18:40:52.529 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-06-23T18:40:52.529 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc 2023-06-23T18:40:52.529 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-23T18:40:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan 2023-06-23T18:40:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-23T18:40:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis 2023-06-23T18:40:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-23T18:40:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-23T18:40:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc 2023-06-23T18:40:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-23T18:40:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-23T18:40:52.531 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-23T18:40:52.531 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-23T18:40:52.531 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro 2023-06-23T18:40:52.531 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac 2023-06-23T18:40:52.531 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-23T18:40:52.531 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-23T18:40:52.531 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun 2023-06-23T18:40:52.531 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-23T18:40:52.532 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-23T18:40:52.532 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-23T18:40:52.532 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-23T18:40:52.532 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti 2023-06-23T18:40:52.532 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-23T18:40:52.532 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti 2023-06-23T18:40:52.532 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-23T18:40:52.533 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via 2023-06-23T18:40:52.533 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-23T18:40:52.533 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-23T18:40:52.533 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet 2023-06-23T18:40:52.533 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-23T18:40:52.533 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-23T18:40:52.533 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom 2023-06-23T18:40:52.533 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-23T18:40:52.534 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/geneve.ko 2023-06-23T18:40:52.534 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv 2023-06-23T18:40:52.534 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-23T18:40:52.534 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154 2023-06-23T18:40:52.534 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-23T18:40:52.534 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ifb.ko 2023-06-23T18:40:52.534 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan 2023-06-23T18:40:52.534 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-23T18:40:52.535 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvlan.ko 2023-06-23T18:40:52.535 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvtap.ko 2023-06-23T18:40:52.535 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio 2023-06-23T18:40:52.535 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio.ko 2023-06-23T18:40:52.535 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-23T18:40:52.535 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-23T18:40:52.535 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mii.ko 2023-06-23T18:40:52.535 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/net_failover.ko 2023-06-23T18:40:52.536 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/netconsole.ko 2023-06-23T18:40:52.536 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/nlmon.ko 2023-06-23T18:40:52.536 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs 2023-06-23T18:40:52.536 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-23T18:40:52.536 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-23T18:40:52.536 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy 2023-06-23T18:40:52.536 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/amd.ko 2023-06-23T18:40:52.536 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-23T18:40:52.537 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-06-23T18:40:52.537 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-23T18:40:52.537 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm87xx.ko 2023-06-23T18:40:52.537 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/broadcom.ko 2023-06-23T18:40:52.537 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/cicada.ko 2023-06-23T18:40:52.537 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/davicom.ko 2023-06-23T18:40:52.537 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/dp83640.ko 2023-06-23T18:40:52.537 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/et1011c.ko 2023-06-23T18:40:52.538 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/icplus.ko 2023-06-23T18:40:52.538 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/lxt.ko 2023-06-23T18:40:52.538 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/marvell.ko 2023-06-23T18:40:52.538 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/micrel.ko 2023-06-23T18:40:52.538 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/national.ko 2023-06-23T18:40:52.538 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/phylink.ko 2023-06-23T18:40:52.538 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/qsemi.ko 2023-06-23T18:40:52.538 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/realtek.ko 2023-06-23T18:40:52.539 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/smsc.ko 2023-06-23T18:40:52.539 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/ste10Xp.ko 2023-06-23T18:40:52.539 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/vitesse.ko 2023-06-23T18:40:52.539 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp 2023-06-23T18:40:52.539 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-23T18:40:52.539 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_async.ko 2023-06-23T18:40:52.539 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-23T18:40:52.539 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_generic.ko 2023-06-23T18:40:52.540 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-23T18:40:52.540 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-23T18:40:52.540 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppoe.ko 2023-06-23T18:40:52.540 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppox.ko 2023-06-23T18:40:52.540 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pptp.ko 2023-06-23T18:40:52.540 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip 2023-06-23T18:40:52.540 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slhc.ko 2023-06-23T18:40:52.540 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slip.ko 2023-06-23T18:40:52.541 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/sungem_phy.ko 2023-06-23T18:40:52.541 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tap.ko 2023-06-23T18:40:52.541 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team 2023-06-23T18:40:52.541 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team.ko 2023-06-23T18:40:52.541 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-23T18:40:52.541 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-23T18:40:52.541 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-23T18:40:52.541 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_random.ko 2023-06-23T18:40:52.542 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-23T18:40:52.542 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tun.ko 2023-06-23T18:40:52.542 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/veth.ko 2023-06-23T18:40:52.542 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/virtio_net.ko 2023-06-23T18:40:52.542 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3 2023-06-23T18:40:52.542 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-23T18:40:52.542 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan 2023-06-23T18:40:52.542 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan/vxlan.ko 2023-06-23T18:40:52.543 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback 2023-06-23T18:40:52.543 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-23T18:40:52.543 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netfront.ko 2023-06-23T18:40:52.543 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb 2023-06-23T18:40:52.543 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb/ntb.ko 2023-06-23T18:40:52.543 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme 2023-06-23T18:40:52.543 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host 2023-06-23T18:40:52.543 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme-core.ko 2023-06-23T18:40:52.544 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme.ko 2023-06-23T18:40:52.544 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport 2023-06-23T18:40:52.544 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport.ko 2023-06-23T18:40:52.544 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_cs.ko 2023-06-23T18:40:52.544 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_pc.ko 2023-06-23T18:40:52.544 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_serial.ko 2023-06-23T18:40:52.544 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci 2023-06-23T18:40:52.545 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug 2023-06-23T18:40:52.545 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-23T18:40:52.545 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie 2023-06-23T18:40:52.545 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie/aer_inject.ko 2023-06-23T18:40:52.545 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/xen-pcifront.ko 2023-06-23T18:40:52.545 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia 2023-06-23T18:40:52.545 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/i82092.ko 2023-06-23T18:40:52.545 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/pd6729.ko 2023-06-23T18:40:52.546 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-23T18:40:52.546 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl 2023-06-23T18:40:52.546 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel 2023-06-23T18:40:52.546 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-23T18:40:52.546 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform 2023-06-23T18:40:52.546 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86 2023-06-23T18:40:52.546 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-23T18:40:52.546 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acerhdf.ko 2023-06-23T18:40:52.547 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-23T18:40:52.547 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-23T18:40:52.547 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-23T18:40:52.547 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-23T18:40:52.547 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-23T18:40:52.547 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-23T18:40:52.547 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-23T18:40:52.547 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-23T18:40:52.548 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-23T18:40:52.548 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/hdaps.ko 2023-06-23T18:40:52.548 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel 2023-06-23T18:40:52.548 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-23T18:40:52.548 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel_ips.ko 2023-06-23T18:40:52.548 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-23T18:40:52.548 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-23T18:40:52.548 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-23T18:40:52.549 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-23T18:40:52.549 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-23T18:40:52.549 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-23T18:40:52.549 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-23T18:40:52.549 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-23T18:40:52.549 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-23T18:40:52.549 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi.ko 2023-06-23T18:40:52.549 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap 2023-06-23T18:40:52.550 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-23T18:40:52.550 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-23T18:40:52.550 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps 2023-06-23T18:40:52.550 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients 2023-06-23T18:40:52.550 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-23T18:40:52.550 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-23T18:40:52.550 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps_parport.ko 2023-06-23T18:40:52.550 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/pps_core.ko 2023-06-23T18:40:52.551 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp 2023-06-23T18:40:52.551 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp.ko 2023-06-23T18:40:52.551 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp_kvm.ko 2023-06-23T18:40:52.551 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc 2023-06-23T18:40:52.551 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-23T18:40:52.551 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-23T18:40:52.551 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-23T18:40:52.551 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-23T18:40:52.552 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-23T18:40:52.552 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-23T18:40:52.552 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-23T18:40:52.552 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-23T18:40:52.552 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-23T18:40:52.552 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-23T18:40:52.552 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-23T18:40:52.552 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-em3027.ko 2023-06-23T18:40:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-23T18:40:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-23T18:40:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-23T18:40:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-23T18:40:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-23T18:40:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-23T18:40:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-max6900.ko 2023-06-23T18:40:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-23T18:40:52.554 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-23T18:40:52.554 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-23T18:40:52.554 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-23T18:40:52.554 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-23T18:40:52.554 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-23T18:40:52.554 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-23T18:40:52.554 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-23T18:40:52.554 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-23T18:40:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-23T18:40:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-23T18:40:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-23T18:40:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-x1205.ko 2023-06-23T18:40:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi 2023-06-23T18:40:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-9xxx.ko 2023-06-23T18:40:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-sas.ko 2023-06-23T18:40:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-xxxx.ko 2023-06-23T18:40:52.556 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/BusLogic.ko 2023-06-23T18:40:52.556 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/a100u2w.ko 2023-06-23T18:40:52.556 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid 2023-06-23T18:40:52.556 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-23T18:40:52.556 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/advansys.ko 2023-06-23T18:40:52.556 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx 2023-06-23T18:40:52.556 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-23T18:40:52.557 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-23T18:40:52.557 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/am53c974.ko 2023-06-23T18:40:52.557 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr 2023-06-23T18:40:52.557 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-23T18:40:52.557 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/atp870u.ko 2023-06-23T18:40:52.557 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi 2023-06-23T18:40:52.557 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-23T18:40:52.557 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa 2023-06-23T18:40:52.558 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa/bfa.ko 2023-06-23T18:40:52.558 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc 2023-06-23T18:40:52.558 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-23T18:40:52.558 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i 2023-06-23T18:40:52.558 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-23T18:40:52.558 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ch.ko 2023-06-23T18:40:52.558 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor 2023-06-23T18:40:52.558 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-23T18:40:52.559 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi 2023-06-23T18:40:52.559 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i 2023-06-23T18:40:52.559 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-23T18:40:52.559 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i 2023-06-23T18:40:52.559 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-23T18:40:52.559 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-23T18:40:52.559 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dc395x.ko 2023-06-23T18:40:52.559 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler 2023-06-23T18:40:52.560 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-06-23T18:40:52.560 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-06-23T18:40:52.560 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-06-23T18:40:52.560 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-06-23T18:40:52.560 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dmx3191d.ko 2023-06-23T18:40:52.560 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r 2023-06-23T18:40:52.560 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-23T18:40:52.560 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esp_scsi.ko 2023-06-23T18:40:52.561 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe 2023-06-23T18:40:52.561 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-23T18:40:52.561 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-23T18:40:52.561 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic 2023-06-23T18:40:52.561 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic/fnic.ko 2023-06-23T18:40:52.561 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hpsa.ko 2023-06-23T18:40:52.561 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hptiop.ko 2023-06-23T18:40:52.562 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hv_storvsc.ko 2023-06-23T18:40:52.562 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/initio.ko 2023-06-23T18:40:52.562 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ipr.ko 2023-06-23T18:40:52.562 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ips.ko 2023-06-23T18:40:52.562 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci 2023-06-23T18:40:52.562 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci/isci.ko 2023-06-23T18:40:52.562 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-23T18:40:52.562 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-23T18:40:52.563 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc 2023-06-23T18:40:52.563 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc/libfc.ko 2023-06-23T18:40:52.563 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi.ko 2023-06-23T18:40:52.563 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-23T18:40:52.563 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas 2023-06-23T18:40:52.563 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas/libsas.ko 2023-06-23T18:40:52.563 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc 2023-06-23T18:40:52.563 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-23T18:40:52.564 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid 2023-06-23T18:40:52.564 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid.ko 2023-06-23T18:40:52.564 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-23T18:40:52.564 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-23T18:40:52.564 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-23T18:40:52.564 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas 2023-06-23T18:40:52.564 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-23T18:40:52.564 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas 2023-06-23T18:40:52.565 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-23T18:40:52.565 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvumi.ko 2023-06-23T18:40:52.565 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001 2023-06-23T18:40:52.565 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-23T18:40:52.565 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pmcraid.ko 2023-06-23T18:40:52.565 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla1280.ko 2023-06-23T18:40:52.565 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx 2023-06-23T18:40:52.565 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-23T18:40:52.566 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-23T18:40:52.566 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx 2023-06-23T18:40:52.566 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-23T18:40:52.566 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/raid_class.ko 2023-06-23T18:40:52.566 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_debug.ko 2023-06-23T18:40:52.566 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-23T18:40:52.566 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-23T18:40:52.566 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-23T18:40:52.567 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-23T18:40:52.567 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-23T18:40:52.567 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ses.ko 2023-06-23T18:40:52.567 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/st.ko 2023-06-23T18:40:52.567 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/stex.ko 2023-06-23T18:40:52.567 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2 2023-06-23T18:40:52.567 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-23T18:40:52.567 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/virtio_scsi.ko 2023-06-23T18:40:52.568 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-23T18:40:52.568 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/wd719x.ko 2023-06-23T18:40:52.568 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb 2023-06-23T18:40:52.568 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb/ssb.ko 2023-06-23T18:40:52.568 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target 2023-06-23T18:40:52.568 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi 2023-06-23T18:40:52.568 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-23T18:40:52.568 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback 2023-06-23T18:40:52.569 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-23T18:40:52.569 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_file.ko 2023-06-23T18:40:52.569 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_iblock.ko 2023-06-23T18:40:52.569 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_mod.ko 2023-06-23T18:40:52.569 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_pscsi.ko 2023-06-23T18:40:52.569 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_user.ko 2023-06-23T18:40:52.569 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc 2023-06-23T18:40:52.569 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-23T18:40:52.570 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal 2023-06-23T18:40:52.570 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel 2023-06-23T18:40:52.570 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal 2023-06-23T18:40:52.570 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-23T18:40:52.570 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-23T18:40:52.570 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-23T18:40:52.570 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-23T18:40:52.571 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-23T18:40:52.571 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-23T18:40:52.571 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-23T18:40:52.571 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-23T18:40:52.571 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-23T18:40:52.571 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-23T18:40:52.571 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-23T18:40:52.571 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-23T18:40:52.572 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-23T18:40:52.572 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-23T18:40:52.572 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-23T18:40:52.572 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty 2023-06-23T18:40:52.572 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless 2023-06-23T18:40:52.572 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-23T18:40:52.572 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_gsm.ko 2023-06-23T18:40:52.572 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_hdlc.ko 2023-06-23T18:40:52.573 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/nozomi.ko 2023-06-23T18:40:52.573 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial 2023-06-23T18:40:52.573 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250 2023-06-23T18:40:52.573 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-23T18:40:52.573 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/arc_uart.ko 2023-06-23T18:40:52.573 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm 2023-06-23T18:40:52.573 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-23T18:40:52.573 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/synclink_gt.ko 2023-06-23T18:40:52.574 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs 2023-06-23T18:40:52.574 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core 2023-06-23T18:40:52.574 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-23T18:40:52.574 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host 2023-06-23T18:40:52.574 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-23T18:40:52.574 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio 2023-06-23T18:40:52.574 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio.ko 2023-06-23T18:40:52.574 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_aec.ko 2023-06-23T18:40:52.575 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_cif.ko 2023-06-23T18:40:52.575 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_pci_generic.ko 2023-06-23T18:40:52.575 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_sercos3.ko 2023-06-23T18:40:52.575 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb 2023-06-23T18:40:52.575 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class 2023-06-23T18:40:52.575 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-acm.ko 2023-06-23T18:40:52.575 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-23T18:40:52.575 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usblp.ko 2023-06-23T18:40:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usbtmc.ko 2023-06-23T18:40:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host 2023-06-23T18:40:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-23T18:40:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image 2023-06-23T18:40:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/mdc800.ko 2023-06-23T18:40:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/microtek.ko 2023-06-23T18:40:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc 2023-06-23T18:40:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/adutux.ko 2023-06-23T18:40:52.577 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/appledisplay.ko 2023-06-23T18:40:52.577 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi26.ko 2023-06-23T18:40:52.577 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi62.ko 2023-06-23T18:40:52.577 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ezusb.ko 2023-06-23T18:40:52.577 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/idmouse.ko 2023-06-23T18:40:52.577 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/iowarrior.ko 2023-06-23T18:40:52.577 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-23T18:40:52.577 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ldusb.ko 2023-06-23T18:40:52.578 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/legousbtower.ko 2023-06-23T18:40:52.578 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga 2023-06-23T18:40:52.578 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-23T18:40:52.578 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-23T18:40:52.578 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usb3503.ko 2023-06-23T18:40:52.578 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usblcd.ko 2023-06-23T18:40:52.578 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-23T18:40:52.578 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/uss720.ko 2023-06-23T18:40:52.579 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/yurex.ko 2023-06-23T18:40:52.579 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy 2023-06-23T18:40:52.579 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy/phy-generic.ko 2023-06-23T18:40:52.579 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial 2023-06-23T18:40:52.579 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/aircable.ko 2023-06-23T18:40:52.579 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ark3116.ko 2023-06-23T18:40:52.579 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-23T18:40:52.579 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ch341.ko 2023-06-23T18:40:52.580 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cp210x.ko 2023-06-23T18:40:52.580 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cyberjack.ko 2023-06-23T18:40:52.580 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-23T18:40:52.580 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-23T18:40:52.580 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/empeg.ko 2023-06-23T18:40:52.580 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-23T18:40:52.580 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-23T18:40:52.581 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-23T18:40:52.581 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_ti.ko 2023-06-23T18:40:52.581 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipaq.ko 2023-06-23T18:40:52.581 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipw.ko 2023-06-23T18:40:52.581 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ir-usb.ko 2023-06-23T18:40:52.581 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-23T18:40:52.581 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan.ko 2023-06-23T18:40:52.581 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-23T18:40:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-23T18:40:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-23T18:40:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mct_u232.ko 2023-06-23T18:40:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7720.ko 2023-06-23T18:40:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7840.ko 2023-06-23T18:40:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/navman.ko 2023-06-23T18:40:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/omninet.ko 2023-06-23T18:40:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/opticon.ko 2023-06-23T18:40:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/option.ko 2023-06-23T18:40:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/oti6858.ko 2023-06-23T18:40:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/pl2303.ko 2023-06-23T18:40:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcaux.ko 2023-06-23T18:40:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcserial.ko 2023-06-23T18:40:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/quatech2.ko 2023-06-23T18:40:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/safe_serial.ko 2023-06-23T18:40:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/sierra.ko 2023-06-23T18:40:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-23T18:40:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ssu100.ko 2023-06-23T18:40:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/symbolserial.ko 2023-06-23T18:40:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-23T18:40:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-23T18:40:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_debug.ko 2023-06-23T18:40:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-23T18:40:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/visor.ko 2023-06-23T18:40:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/whiteheat.ko 2023-06-23T18:40:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-23T18:40:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage 2023-06-23T18:40:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/uas.ko 2023-06-23T18:40:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-23T18:40:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-23T18:40:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-23T18:40:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-23T18:40:52.586 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-23T18:40:52.586 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-23T18:40:52.586 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-23T18:40:52.586 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-karma.ko 2023-06-23T18:40:52.586 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-23T18:40:52.586 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-23T18:40:52.586 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-23T18:40:52.586 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-23T18:40:52.587 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-23T18:40:52.587 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/usb-storage.ko 2023-06-23T18:40:52.587 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip 2023-06-23T18:40:52.587 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-23T18:40:52.587 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-23T18:40:52.587 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-23T18:40:52.587 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio 2023-06-23T18:40:52.587 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci 2023-06-23T18:40:52.588 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-23T18:40:52.588 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-23T18:40:52.588 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio.ko 2023-06-23T18:40:52.588 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-23T18:40:52.588 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost 2023-06-23T18:40:52.588 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost.ko 2023-06-23T18:40:52.588 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-23T18:40:52.588 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_net.ko 2023-06-23T18:40:52.589 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_scsi.ko 2023-06-23T18:40:52.589 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video 2023-06-23T18:40:52.589 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight 2023-06-23T18:40:52.589 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/apple_bl.ko 2023-06-23T18:40:52.589 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/lcd.ko 2023-06-23T18:40:52.589 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-23T18:40:52.589 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio 2023-06-23T18:40:52.589 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio.ko 2023-06-23T18:40:52.590 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_balloon.ko 2023-06-23T18:40:52.590 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_mmio.ko 2023-06-23T18:40:52.590 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci.ko 2023-06-23T18:40:52.590 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-06-23T18:40:52.590 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-06-23T18:40:52.590 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_ring.ko 2023-06-23T18:40:52.590 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1 2023-06-23T18:40:52.590 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters 2023-06-23T18:40:52.591 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2482.ko 2023-06-23T18:40:52.591 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2490.ko 2023-06-23T18:40:52.591 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves 2023-06-23T18:40:52.591 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-23T18:40:52.591 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-23T18:40:52.591 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-23T18:40:52.591 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-23T18:40:52.592 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-23T18:40:52.592 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-23T18:40:52.592 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-23T18:40:52.592 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-23T18:40:52.592 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-23T18:40:52.592 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-23T18:40:52.592 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-23T18:40:52.592 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/wire.ko 2023-06-23T18:40:52.593 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog 2023-06-23T18:40:52.593 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-23T18:40:52.593 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-23T18:40:52.593 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-23T18:40:52.593 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/hpwdt.ko 2023-06-23T18:40:52.593 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/i6300esb.ko 2023-06-23T18:40:52.593 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-23T18:40:52.593 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-23T18:40:52.594 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ib700wdt.ko 2023-06-23T18:40:52.594 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ibmasr.ko 2023-06-23T18:40:52.594 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-23T18:40:52.594 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-23T18:40:52.594 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it87_wdt.ko 2023-06-23T18:40:52.594 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/machzwd.ko 2023-06-23T18:40:52.594 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/nv_tco.ko 2023-06-23T18:40:52.594 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-23T18:40:52.595 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-23T18:40:52.595 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-23T18:40:52.595 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-23T18:40:52.595 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/softdog.ko 2023-06-23T18:40:52.595 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-23T18:40:52.595 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/via_wdt.ko 2023-06-23T18:40:52.595 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-23T18:40:52.595 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-23T18:40:52.596 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-23T18:40:52.596 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/wdt_pci.ko 2023-06-23T18:40:52.596 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/xen_wdt.ko 2023-06-23T18:40:52.596 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen 2023-06-23T18:40:52.596 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-acpi-processor.ko 2023-06-23T18:40:52.596 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-evtchn.ko 2023-06-23T18:40:52.596 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntalloc.ko 2023-06-23T18:40:52.596 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntdev.ko 2023-06-23T18:40:52.597 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback 2023-06-23T18:40:52.597 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-23T18:40:52.597 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-privcmd.ko 2023-06-23T18:40:52.597 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs 2023-06-23T18:40:52.597 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-23T18:40:52.597 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs 2023-06-23T18:40:52.597 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p 2023-06-23T18:40:52.597 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p/9p.ko 2023-06-23T18:40:52.598 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs 2023-06-23T18:40:52.598 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs/affs.ko 2023-06-23T18:40:52.598 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs 2023-06-23T18:40:52.598 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs/befs.ko 2023-06-23T18:40:52.598 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/binfmt_misc.ko 2023-06-23T18:40:52.598 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs 2023-06-23T18:40:52.598 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs/btrfs.ko 2023-06-23T18:40:52.598 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles 2023-06-23T18:40:52.599 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles/cachefiles.ko 2023-06-23T18:40:52.599 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph 2023-06-23T18:40:52.599 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph/ceph.ko 2023-06-23T18:40:52.599 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda 2023-06-23T18:40:52.599 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda/coda.ko 2023-06-23T18:40:52.599 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs 2023-06-23T18:40:52.599 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs/cramfs.ko 2023-06-23T18:40:52.599 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm 2023-06-23T18:40:52.600 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm/dlm.ko 2023-06-23T18:40:52.600 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs 2023-06-23T18:40:52.600 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs/ecryptfs.ko 2023-06-23T18:40:52.600 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs 2023-06-23T18:40:52.600 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs/f2fs.ko 2023-06-23T18:40:52.600 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat 2023-06-23T18:40:52.600 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/fat.ko 2023-06-23T18:40:52.600 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/msdos.ko 2023-06-23T18:40:52.601 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/vfat.ko 2023-06-23T18:40:52.601 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache 2023-06-23T18:40:52.601 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache/fscache.ko 2023-06-23T18:40:52.601 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse 2023-06-23T18:40:52.601 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/cuse.ko 2023-06-23T18:40:52.601 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/fuse.ko 2023-06-23T18:40:52.601 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2 2023-06-23T18:40:52.601 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2/gfs2.ko 2023-06-23T18:40:52.602 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs 2023-06-23T18:40:52.602 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs/hfs.ko 2023-06-23T18:40:52.602 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus 2023-06-23T18:40:52.602 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus/hfsplus.ko 2023-06-23T18:40:52.602 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs 2023-06-23T18:40:52.602 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs/isofs.ko 2023-06-23T18:40:52.602 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs 2023-06-23T18:40:52.602 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs/jfs.ko 2023-06-23T18:40:52.603 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd 2023-06-23T18:40:52.603 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd/lockd.ko 2023-06-23T18:40:52.603 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix 2023-06-23T18:40:52.603 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix/minix.ko 2023-06-23T18:40:52.603 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs 2023-06-23T18:40:52.603 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs/netfs.ko 2023-06-23T18:40:52.603 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs 2023-06-23T18:40:52.603 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout 2023-06-23T18:40:52.604 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-23T18:40:52.604 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout 2023-06-23T18:40:52.604 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-23T18:40:52.604 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout 2023-06-23T18:40:52.604 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-23T18:40:52.604 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfs.ko 2023-06-23T18:40:52.604 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv3.ko 2023-06-23T18:40:52.604 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv4.ko 2023-06-23T18:40:52.605 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common 2023-06-23T18:40:52.605 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/grace.ko 2023-06-23T18:40:52.605 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/nfs_acl.ko 2023-06-23T18:40:52.605 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd 2023-06-23T18:40:52.605 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd/nfsd.ko 2023-06-23T18:40:52.605 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2 2023-06-23T18:40:52.605 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2/nilfs2.ko 2023-06-23T18:40:52.605 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls 2023-06-23T18:40:52.606 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-celtic.ko 2023-06-23T18:40:52.606 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-centeuro.ko 2023-06-23T18:40:52.606 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-croatian.ko 2023-06-23T18:40:52.606 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-cyrillic.ko 2023-06-23T18:40:52.606 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-gaelic.ko 2023-06-23T18:40:52.606 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-greek.ko 2023-06-23T18:40:52.606 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-iceland.ko 2023-06-23T18:40:52.606 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-inuit.ko 2023-06-23T18:40:52.607 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-roman.ko 2023-06-23T18:40:52.607 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-romanian.ko 2023-06-23T18:40:52.607 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-turkish.ko 2023-06-23T18:40:52.607 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1250.ko 2023-06-23T18:40:52.607 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1251.ko 2023-06-23T18:40:52.607 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1255.ko 2023-06-23T18:40:52.607 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp737.ko 2023-06-23T18:40:52.607 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp775.ko 2023-06-23T18:40:52.608 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp850.ko 2023-06-23T18:40:52.608 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp852.ko 2023-06-23T18:40:52.608 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp855.ko 2023-06-23T18:40:52.608 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp857.ko 2023-06-23T18:40:52.608 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp860.ko 2023-06-23T18:40:52.608 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp861.ko 2023-06-23T18:40:52.608 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp862.ko 2023-06-23T18:40:52.609 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp863.ko 2023-06-23T18:40:52.609 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp864.ko 2023-06-23T18:40:52.609 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp865.ko 2023-06-23T18:40:52.609 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp866.ko 2023-06-23T18:40:52.609 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp869.ko 2023-06-23T18:40:52.609 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp874.ko 2023-06-23T18:40:52.609 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp932.ko 2023-06-23T18:40:52.609 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp936.ko 2023-06-23T18:40:52.609 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp949.ko 2023-06-23T18:40:52.610 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp950.ko 2023-06-23T18:40:52.610 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_euc-jp.ko 2023-06-23T18:40:52.610 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-1.ko 2023-06-23T18:40:52.610 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-13.ko 2023-06-23T18:40:52.610 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-14.ko 2023-06-23T18:40:52.610 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-15.ko 2023-06-23T18:40:52.610 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-2.ko 2023-06-23T18:40:52.611 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-3.ko 2023-06-23T18:40:52.611 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-4.ko 2023-06-23T18:40:52.611 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-5.ko 2023-06-23T18:40:52.611 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-6.ko 2023-06-23T18:40:52.611 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-7.ko 2023-06-23T18:40:52.611 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-9.ko 2023-06-23T18:40:52.611 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-r.ko 2023-06-23T18:40:52.611 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-ru.ko 2023-06-23T18:40:52.612 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-u.ko 2023-06-23T18:40:52.612 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_utf8.ko 2023-06-23T18:40:52.612 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2 2023-06-23T18:40:52.612 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster 2023-06-23T18:40:52.612 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-23T18:40:52.612 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm 2023-06-23T18:40:52.612 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-23T18:40:52.612 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs 2023-06-23T18:40:52.613 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-23T18:40:52.613 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2.ko 2023-06-23T18:40:52.613 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-23T18:40:52.613 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-23T18:40:52.613 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-23T18:40:52.613 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs 2023-06-23T18:40:52.613 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs/overlay.ko 2023-06-23T18:40:52.613 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore 2023-06-23T18:40:52.614 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore/ramoops.ko 2023-06-23T18:40:52.614 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs 2023-06-23T18:40:52.614 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs/reiserfs.ko 2023-06-23T18:40:52.614 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs 2023-06-23T18:40:52.614 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs/romfs.ko 2023-06-23T18:40:52.614 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb 2023-06-23T18:40:52.614 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client 2023-06-23T18:40:52.614 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client/cifs.ko 2023-06-23T18:40:52.615 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common 2023-06-23T18:40:52.615 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_arc4.ko 2023-06-23T18:40:52.615 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_md4.ko 2023-06-23T18:40:52.615 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs 2023-06-23T18:40:52.615 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs/squashfs.ko 2023-06-23T18:40:52.615 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv 2023-06-23T18:40:52.615 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv/sysv.ko 2023-06-23T18:40:52.615 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf 2023-06-23T18:40:52.616 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf/udf.ko 2023-06-23T18:40:52.616 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs 2023-06-23T18:40:52.616 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs/ufs.ko 2023-06-23T18:40:52.616 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs 2023-06-23T18:40:52.616 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs/xfs.ko 2023-06-23T18:40:52.616 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel 2023-06-23T18:40:52.616 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu 2023-06-23T18:40:52.616 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu/rcutorture.ko 2023-06-23T18:40:52.617 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/torture.ko 2023-06-23T18:40:52.617 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace 2023-06-23T18:40:52.617 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-06-23T18:40:52.617 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib 2023-06-23T18:40:52.617 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/asn1_encoder.ko 2023-06-23T18:40:52.617 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc-itu-t.ko 2023-06-23T18:40:52.617 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc8.ko 2023-06-23T18:40:52.617 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto 2023-06-23T18:40:52.618 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libarc4.ko 2023-06-23T18:40:52.618 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libdes.ko 2023-06-23T18:40:52.618 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/libcrc32c.ko 2023-06-23T18:40:52.618 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lru_cache.ko 2023-06-23T18:40:52.618 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4 2023-06-23T18:40:52.618 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4_compress.ko 2023-06-23T18:40:52.618 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4hc_compress.ko 2023-06-23T18:40:52.618 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math 2023-06-23T18:40:52.619 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math/cordic.ko 2023-06-23T18:40:52.619 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6 2023-06-23T18:40:52.619 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6/raid6_pq.ko 2023-06-23T18:40:52.619 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon 2023-06-23T18:40:52.619 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-23T18:40:52.619 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_bm.ko 2023-06-23T18:40:52.619 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_fsm.ko 2023-06-23T18:40:52.619 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_kmp.ko 2023-06-23T18:40:52.620 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd 2023-06-23T18:40:52.620 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd/zstd_compress.ko 2023-06-23T18:40:52.620 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm 2023-06-23T18:40:52.620 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm/hwpoison-inject.ko 2023-06-23T18:40:52.620 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net 2023-06-23T18:40:52.620 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan 2023-06-23T18:40:52.620 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/6lowpan.ko 2023-06-23T18:40:52.620 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_dest.ko 2023-06-23T18:40:52.621 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_fragment.ko 2023-06-23T18:40:52.621 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_hop.ko 2023-06-23T18:40:52.621 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-23T18:40:52.621 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_mobility.ko 2023-06-23T18:40:52.621 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_routing.ko 2023-06-23T18:40:52.621 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_udp.ko 2023-06-23T18:40:52.621 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802 2023-06-23T18:40:52.621 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/garp.ko 2023-06-23T18:40:52.622 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/mrp.ko 2023-06-23T18:40:52.622 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/p8022.ko 2023-06-23T18:40:52.622 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/psnap.ko 2023-06-23T18:40:52.622 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/stp.ko 2023-06-23T18:40:52.622 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q 2023-06-23T18:40:52.622 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q/8021q.ko 2023-06-23T18:40:52.622 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p 2023-06-23T18:40:52.622 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet.ko 2023-06-23T18:40:52.623 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_fd.ko 2023-06-23T18:40:52.623 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_rdma.ko 2023-06-23T18:40:52.623 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_virtio.ko 2023-06-23T18:40:52.623 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv 2023-06-23T18:40:52.623 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv/batman-adv.ko 2023-06-23T18:40:52.623 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge 2023-06-23T18:40:52.623 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/br_netfilter.ko 2023-06-23T18:40:52.623 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/bridge.ko 2023-06-23T18:40:52.624 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter 2023-06-23T18:40:52.624 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-23T18:40:52.624 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-23T18:40:52.624 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-23T18:40:52.624 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-23T18:40:52.624 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-23T18:40:52.624 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-23T18:40:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-23T18:40:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-23T18:40:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-23T18:40:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-23T18:40:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-23T18:40:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-23T18:40:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-23T18:40:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-23T18:40:52.626 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-23T18:40:52.626 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-23T18:40:52.626 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-23T18:40:52.626 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-23T18:40:52.626 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-23T18:40:52.626 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-23T18:40:52.626 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtables.ko 2023-06-23T18:40:52.626 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-06-23T18:40:52.627 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-23T18:40:52.627 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-23T18:40:52.627 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph 2023-06-23T18:40:52.627 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph/libceph.ko 2023-06-23T18:40:52.627 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core 2023-06-23T18:40:52.627 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/failover.ko 2023-06-23T18:40:52.627 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/pktgen.ko 2023-06-23T18:40:52.627 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp 2023-06-23T18:40:52.628 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp.ko 2023-06-23T18:40:52.628 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_diag.ko 2023-06-23T18:40:52.628 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv4.ko 2023-06-23T18:40:52.628 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv6.ko 2023-06-23T18:40:52.628 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver 2023-06-23T18:40:52.628 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver/dns_resolver.ko 2023-06-23T18:40:52.628 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa 2023-06-23T18:40:52.628 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/dsa_core.ko 2023-06-23T18:40:52.629 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_brcm.ko 2023-06-23T18:40:52.629 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_dsa.ko 2023-06-23T18:40:52.629 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_none.ko 2023-06-23T18:40:52.629 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_trailer.ko 2023-06-23T18:40:52.629 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154 2023-06-23T18:40:52.629 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan 2023-06-23T18:40:52.629 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-23T18:40:52.629 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154.ko 2023-06-23T18:40:52.630 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-23T18:40:52.630 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4 2023-06-23T18:40:52.630 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ah4.ko 2023-06-23T18:40:52.630 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/esp4.ko 2023-06-23T18:40:52.630 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/fou.ko 2023-06-23T18:40:52.630 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/gre.ko 2023-06-23T18:40:52.630 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/inet_diag.ko 2023-06-23T18:40:52.630 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_gre.ko 2023-06-23T18:40:52.631 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_tunnel.ko 2023-06-23T18:40:52.631 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_vti.ko 2023-06-23T18:40:52.631 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipcomp.ko 2023-06-23T18:40:52.631 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipip.ko 2023-06-23T18:40:52.631 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter 2023-06-23T18:40:52.631 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-23T18:40:52.631 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-23T18:40:52.632 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-23T18:40:52.632 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-23T18:40:52.632 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-23T18:40:52.632 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-23T18:40:52.632 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-23T18:40:52.632 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-23T18:40:52.632 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-23T18:40:52.632 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-23T18:40:52.633 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-23T18:40:52.633 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-23T18:40:52.633 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-23T18:40:52.633 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-23T18:40:52.633 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-23T18:40:52.633 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-23T18:40:52.633 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-23T18:40:52.633 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-23T18:40:52.634 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-23T18:40:52.634 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-23T18:40:52.634 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-23T18:40:52.634 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_bic.ko 2023-06-23T18:40:52.634 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_dctcp.ko 2023-06-23T18:40:52.634 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_diag.ko 2023-06-23T18:40:52.634 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_highspeed.ko 2023-06-23T18:40:52.634 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_htcp.ko 2023-06-23T18:40:52.635 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_hybla.ko 2023-06-23T18:40:52.635 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_illinois.ko 2023-06-23T18:40:52.635 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_lp.ko 2023-06-23T18:40:52.635 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_scalable.ko 2023-06-23T18:40:52.635 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_vegas.ko 2023-06-23T18:40:52.635 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_veno.ko 2023-06-23T18:40:52.635 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_westwood.ko 2023-06-23T18:40:52.635 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_yeah.ko 2023-06-23T18:40:52.636 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tunnel4.ko 2023-06-23T18:40:52.636 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_diag.ko 2023-06-23T18:40:52.636 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_tunnel.ko 2023-06-23T18:40:52.636 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-23T18:40:52.636 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6 2023-06-23T18:40:52.636 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ah6.ko 2023-06-23T18:40:52.636 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/esp6.ko 2023-06-23T18:40:52.636 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/fou6.ko 2023-06-23T18:40:52.637 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_tunnel.ko 2023-06-23T18:40:52.637 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-23T18:40:52.637 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_vti.ko 2023-06-23T18:40:52.637 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ipcomp6.ko 2023-06-23T18:40:52.637 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter 2023-06-23T18:40:52.637 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-23T18:40:52.637 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-23T18:40:52.637 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-23T18:40:52.638 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-23T18:40:52.638 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-23T18:40:52.638 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-23T18:40:52.638 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-23T18:40:52.638 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-23T18:40:52.638 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-23T18:40:52.638 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-23T18:40:52.638 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-23T18:40:52.639 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-23T18:40:52.639 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-23T18:40:52.639 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-23T18:40:52.639 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-23T18:40:52.639 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-23T18:40:52.639 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-23T18:40:52.639 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-23T18:40:52.639 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-23T18:40:52.640 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-23T18:40:52.640 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-23T18:40:52.640 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-23T18:40:52.640 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-23T18:40:52.640 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-23T18:40:52.640 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/sit.ko 2023-06-23T18:40:52.640 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/tunnel6.ko 2023-06-23T18:40:52.640 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-23T18:40:52.641 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key 2023-06-23T18:40:52.641 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key/af_key.ko 2023-06-23T18:40:52.641 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp 2023-06-23T18:40:52.641 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_core.ko 2023-06-23T18:40:52.641 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-23T18:40:52.641 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_eth.ko 2023-06-23T18:40:52.641 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip.ko 2023-06-23T18:40:52.641 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip6.ko 2023-06-23T18:40:52.642 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_netlink.ko 2023-06-23T18:40:52.642 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ppp.ko 2023-06-23T18:40:52.642 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc 2023-06-23T18:40:52.642 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc/llc.ko 2023-06-23T18:40:52.642 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154 2023-06-23T18:40:52.642 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154/mac802154.ko 2023-06-23T18:40:52.642 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls 2023-06-23T18:40:52.642 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls/mpls_gso.ko 2023-06-23T18:40:52.643 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter 2023-06-23T18:40:52.643 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset 2023-06-23T18:40:52.643 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set.ko 2023-06-23T18:40:52.643 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-23T18:40:52.643 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-23T18:40:52.643 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-23T18:40:52.643 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-23T18:40:52.643 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-23T18:40:52.644 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-23T18:40:52.644 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-23T18:40:52.644 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-23T18:40:52.644 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-23T18:40:52.644 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-23T18:40:52.644 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-23T18:40:52.644 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-23T18:40:52.645 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-23T18:40:52.645 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-23T18:40:52.645 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-23T18:40:52.645 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs 2023-06-23T18:40:52.645 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-23T18:40:52.645 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-23T18:40:52.645 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-23T18:40:52.645 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-23T18:40:52.646 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-23T18:40:52.646 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-23T18:40:52.646 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-23T18:40:52.646 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-23T18:40:52.646 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-23T18:40:52.646 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-23T18:40:52.646 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-23T18:40:52.646 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-23T18:40:52.647 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-23T18:40:52.647 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-23T18:40:52.647 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conncount.ko 2023-06-23T18:40:52.647 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack.ko 2023-06-23T18:40:52.647 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-23T18:40:52.647 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-23T18:40:52.647 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-23T18:40:52.647 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-23T18:40:52.648 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-23T18:40:52.648 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-23T18:40:52.648 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-23T18:40:52.648 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-23T18:40:52.648 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-23T18:40:52.648 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-23T18:40:52.648 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-23T18:40:52.648 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-23T18:40:52.649 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-23T18:40:52.649 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table.ko 2023-06-23T18:40:52.649 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-23T18:40:52.649 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_log_syslog.ko 2023-06-23T18:40:52.649 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat.ko 2023-06-23T18:40:52.649 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-23T18:40:52.649 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-23T18:40:52.649 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_irc.ko 2023-06-23T18:40:52.650 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_sip.ko 2023-06-23T18:40:52.650 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-23T18:40:52.650 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-23T18:40:52.650 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_tables.ko 2023-06-23T18:40:52.650 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink.ko 2023-06-23T18:40:52.650 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-23T18:40:52.650 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_log.ko 2023-06-23T18:40:52.650 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-23T18:40:52.651 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-23T18:40:52.651 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_chain_nat.ko 2023-06-23T18:40:52.651 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_compat.ko 2023-06-23T18:40:52.651 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_ct.ko 2023-06-23T18:40:52.651 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-23T18:40:52.651 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fib.ko 2023-06-23T18:40:52.651 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-23T18:40:52.651 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_hash.ko 2023-06-23T18:40:52.652 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_limit.ko 2023-06-23T18:40:52.652 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_log.ko 2023-06-23T18:40:52.652 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_masq.ko 2023-06-23T18:40:52.652 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_nat.ko 2023-06-23T18:40:52.652 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_numgen.ko 2023-06-23T18:40:52.652 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_queue.ko 2023-06-23T18:40:52.652 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_quota.ko 2023-06-23T18:40:52.652 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_redir.ko 2023-06-23T18:40:52.653 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject.ko 2023-06-23T18:40:52.653 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject_inet.ko 2023-06-23T18:40:52.653 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_socket.ko 2023-06-23T18:40:52.653 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_tunnel.ko 2023-06-23T18:40:52.653 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_AUDIT.ko 2023-06-23T18:40:52.653 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-23T18:40:52.653 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-23T18:40:52.653 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-23T18:40:52.654 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CT.ko 2023-06-23T18:40:52.654 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_DSCP.ko 2023-06-23T18:40:52.654 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HL.ko 2023-06-23T18:40:52.654 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HMARK.ko 2023-06-23T18:40:52.654 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-23T18:40:52.654 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LED.ko 2023-06-23T18:40:52.654 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LOG.ko 2023-06-23T18:40:52.654 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-23T18:40:52.655 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NETMAP.ko 2023-06-23T18:40:52.655 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFLOG.ko 2023-06-23T18:40:52.655 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-23T18:40:52.655 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_RATEEST.ko 2023-06-23T18:40:52.655 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-23T18:40:52.655 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_SECMARK.ko 2023-06-23T18:40:52.655 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-23T18:40:52.655 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-23T18:40:52.656 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TEE.ko 2023-06-23T18:40:52.656 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TPROXY.ko 2023-06-23T18:40:52.656 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TRACE.ko 2023-06-23T18:40:52.656 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_addrtype.ko 2023-06-23T18:40:52.656 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_bpf.ko 2023-06-23T18:40:52.656 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cgroup.ko 2023-06-23T18:40:52.656 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cluster.ko 2023-06-23T18:40:52.656 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_comment.ko 2023-06-23T18:40:52.657 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connbytes.ko 2023-06-23T18:40:52.657 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlabel.ko 2023-06-23T18:40:52.657 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlimit.ko 2023-06-23T18:40:52.657 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connmark.ko 2023-06-23T18:40:52.657 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_conntrack.ko 2023-06-23T18:40:52.657 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cpu.ko 2023-06-23T18:40:52.657 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dccp.ko 2023-06-23T18:40:52.657 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_devgroup.ko 2023-06-23T18:40:52.658 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dscp.ko 2023-06-23T18:40:52.658 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ecn.ko 2023-06-23T18:40:52.658 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_esp.ko 2023-06-23T18:40:52.658 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hashlimit.ko 2023-06-23T18:40:52.658 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_helper.ko 2023-06-23T18:40:52.658 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hl.ko 2023-06-23T18:40:52.658 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipcomp.ko 2023-06-23T18:40:52.658 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_iprange.ko 2023-06-23T18:40:52.659 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipvs.ko 2023-06-23T18:40:52.659 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_l2tp.ko 2023-06-23T18:40:52.659 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_length.ko 2023-06-23T18:40:52.659 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_limit.ko 2023-06-23T18:40:52.659 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mac.ko 2023-06-23T18:40:52.659 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mark.ko 2023-06-23T18:40:52.659 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_multiport.ko 2023-06-23T18:40:52.659 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nat.ko 2023-06-23T18:40:52.660 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nfacct.ko 2023-06-23T18:40:52.660 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_osf.ko 2023-06-23T18:40:52.660 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_owner.ko 2023-06-23T18:40:52.660 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_physdev.ko 2023-06-23T18:40:52.660 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_pkttype.ko 2023-06-23T18:40:52.660 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_policy.ko 2023-06-23T18:40:52.660 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_quota.ko 2023-06-23T18:40:52.660 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_rateest.ko 2023-06-23T18:40:52.661 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_realm.ko 2023-06-23T18:40:52.661 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_recent.ko 2023-06-23T18:40:52.661 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_sctp.ko 2023-06-23T18:40:52.661 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_set.ko 2023-06-23T18:40:52.661 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_socket.ko 2023-06-23T18:40:52.661 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_state.ko 2023-06-23T18:40:52.661 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_statistic.ko 2023-06-23T18:40:52.661 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_string.ko 2023-06-23T18:40:52.662 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_tcpmss.ko 2023-06-23T18:40:52.662 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_time.ko 2023-06-23T18:40:52.662 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_u32.ko 2023-06-23T18:40:52.662 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink 2023-06-23T18:40:52.662 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink/netlink_diag.ko 2023-06-23T18:40:52.662 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh 2023-06-23T18:40:52.662 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh/nsh.ko 2023-06-23T18:40:52.662 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch 2023-06-23T18:40:52.663 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/openvswitch.ko 2023-06-23T18:40:52.663 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-geneve.ko 2023-06-23T18:40:52.663 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-gre.ko 2023-06-23T18:40:52.663 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-vxlan.ko 2023-06-23T18:40:52.663 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet 2023-06-23T18:40:52.663 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet/af_packet_diag.ko 2023-06-23T18:40:52.663 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds 2023-06-23T18:40:52.663 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds.ko 2023-06-23T18:40:52.664 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_rdma.ko 2023-06-23T18:40:52.664 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_tcp.ko 2023-06-23T18:40:52.664 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched 2023-06-23T18:40:52.664 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_csum.ko 2023-06-23T18:40:52.664 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_gact.ko 2023-06-23T18:40:52.664 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_ipt.ko 2023-06-23T18:40:52.664 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_mirred.ko 2023-06-23T18:40:52.665 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_nat.ko 2023-06-23T18:40:52.665 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_pedit.ko 2023-06-23T18:40:52.665 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_police.ko 2023-06-23T18:40:52.665 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_simple.ko 2023-06-23T18:40:52.665 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_skbedit.ko 2023-06-23T18:40:52.665 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_vlan.ko 2023-06-23T18:40:52.665 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_basic.ko 2023-06-23T18:40:52.665 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_bpf.ko 2023-06-23T18:40:52.666 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_flow.ko 2023-06-23T18:40:52.666 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_fw.ko 2023-06-23T18:40:52.666 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_route.ko 2023-06-23T18:40:52.666 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_u32.ko 2023-06-23T18:40:52.666 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_cmp.ko 2023-06-23T18:40:52.666 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_ipset.ko 2023-06-23T18:40:52.666 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_meta.ko 2023-06-23T18:40:52.666 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_nbyte.ko 2023-06-23T18:40:52.667 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_text.ko 2023-06-23T18:40:52.667 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_u32.ko 2023-06-23T18:40:52.667 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_choke.ko 2023-06-23T18:40:52.667 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_codel.ko 2023-06-23T18:40:52.667 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_drr.ko 2023-06-23T18:40:52.667 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_fq.ko 2023-06-23T18:40:52.667 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_gred.ko 2023-06-23T18:40:52.667 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hfsc.ko 2023-06-23T18:40:52.667 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hhf.ko 2023-06-23T18:40:52.668 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_htb.ko 2023-06-23T18:40:52.668 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_ingress.ko 2023-06-23T18:40:52.668 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio.ko 2023-06-23T18:40:52.668 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio_lib.ko 2023-06-23T18:40:52.668 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_multiq.ko 2023-06-23T18:40:52.668 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_netem.ko 2023-06-23T18:40:52.668 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_pie.ko 2023-06-23T18:40:52.669 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_plug.ko 2023-06-23T18:40:52.669 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_prio.ko 2023-06-23T18:40:52.669 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_qfq.ko 2023-06-23T18:40:52.669 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_red.ko 2023-06-23T18:40:52.669 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfb.ko 2023-06-23T18:40:52.669 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfq.ko 2023-06-23T18:40:52.669 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_tbf.ko 2023-06-23T18:40:52.669 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_teql.ko 2023-06-23T18:40:52.670 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp 2023-06-23T18:40:52.670 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp.ko 2023-06-23T18:40:52.670 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp_diag.ko 2023-06-23T18:40:52.670 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc 2023-06-23T18:40:52.670 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss 2023-06-23T18:40:52.670 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-23T18:40:52.670 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-23T18:40:52.670 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/sunrpc.ko 2023-06-23T18:40:52.671 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma 2023-06-23T18:40:52.671 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-23T18:40:52.671 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc 2023-06-23T18:40:52.671 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/diag.ko 2023-06-23T18:40:52.671 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/tipc.ko 2023-06-23T18:40:52.671 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix 2023-06-23T18:40:52.671 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix/unix_diag.ko 2023-06-23T18:40:52.671 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock 2023-06-23T18:40:52.672 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-23T18:40:52.672 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-23T18:40:52.672 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock.ko 2023-06-23T18:40:52.672 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-23T18:40:52.672 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-23T18:40:52.672 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm 2023-06-23T18:40:52.672 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-23T18:40:52.672 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security 2023-06-23T18:40:52.673 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys 2023-06-23T18:40:52.673 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys 2023-06-23T18:40:52.673 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-06-23T18:40:52.673 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys 2023-06-23T18:40:52.673 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys/trusted.ko 2023-06-23T18:40:52.673 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt 2023-06-23T18:40:52.673 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib 2023-06-23T18:40:52.673 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib/irqbypass.ko 2023-06-23T18:40:52.674 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias 2023-06-23T18:40:52.674 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias.bin 2023-06-23T18:40:52.674 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin 2023-06-23T18:40:52.674 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.bin 2023-06-23T18:40:52.674 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.modinfo 2023-06-23T18:40:52.674 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep 2023-06-23T18:40:52.674 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep.bin 2023-06-23T18:40:52.674 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.devname 2023-06-23T18:40:52.675 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.order 2023-06-23T18:40:52.675 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.softdep 2023-06-23T18:40:52.675 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols 2023-06-23T18:40:52.675 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols.bin 2023-06-23T18:40:52.675 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:52.676 DEBUG:teuthology.orchestra.run.smithi136:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-06-23T18:40:52.702 INFO:teuthology.orchestra.run.smithi136.stdout:postinstall scriptlet (using /bin/sh): 2023-06-23T18:40:52.702 INFO:teuthology.orchestra.run.smithi136.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 -a -r /boot/System.map-6.4.0-rc5-g1c622d92b6f1 ]; then 2023-06-23T18:40:52.702 INFO:teuthology.orchestra.run.smithi136.stdout:cp /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:40:52.702 INFO:teuthology.orchestra.run.smithi136.stdout:cp /boot/System.map-6.4.0-rc5-g1c622d92b6f1 /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:40:52.702 INFO:teuthology.orchestra.run.smithi136.stdout:rm -f /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:52.702 INFO:teuthology.orchestra.run.smithi136.stdout:/sbin/installkernel 6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:40:52.703 INFO:teuthology.orchestra.run.smithi136.stdout:rm -f /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:40:52.703 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2023-06-23T18:40:52.703 INFO:teuthology.orchestra.run.smithi136.stdout:preuninstall scriptlet (using /bin/sh): 2023-06-23T18:40:52.703 INFO:teuthology.orchestra.run.smithi136.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-06-23T18:40:52.703 INFO:teuthology.orchestra.run.smithi136.stdout:new-kernel-pkg --remove 6.4.0-rc5-g1c622d92b6f1 --rminitrd --initrdfile=/boot/initramfs-6.4.0-rc5-g1c622d92b6f1.img 2023-06-23T18:40:52.703 INFO:teuthology.orchestra.run.smithi136.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-06-23T18:40:52.703 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-install remove 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:52.704 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2023-06-23T18:40:52.704 INFO:teuthology.orchestra.run.smithi136.stdout:postuninstall scriptlet (using /bin/sh): 2023-06-23T18:40:52.704 INFO:teuthology.orchestra.run.smithi136.stdout:if [ -x /sbin/update-bootloader ]; then 2023-06-23T18:40:52.704 INFO:teuthology.orchestra.run.smithi136.stdout:/sbin/update-bootloader --remove 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:52.704 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2023-06-23T18:40:52.705 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2023-06-23T18:40:52.783 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2023-06-23T18:40:52.783 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2023-06-23T18:40:52.783 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.02 2023-06-23T18:40:52.783 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 123.el8 2023-06-23T18:40:52.783 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2023-06-23T18:40:52.783 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-06-23T18:40:52.784 INFO:teuthology.orchestra.run.smithi136.stdout:Group : System Environment/Base 2023-06-23T18:40:52.784 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 9265450 2023-06-23T18:40:52.784 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2023-06-23T18:40:52.784 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-06-23T18:40:52.784 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-06-23T18:40:52.784 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-06-23T18:40:52.784 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-06-23T18:40:52.784 INFO:teuthology.orchestra.run.smithi136.stdout:Relocations : (not relocatable) 2023-06-23T18:40:52.785 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : Red Hat, Inc. 2023-06-23T18:40:52.785 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : Red Hat, Inc. 2023-06-23T18:40:52.785 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-23T18:40:52.785 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2023-06-23T18:40:52.785 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2023-06-23T18:40:52.785 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:40:52.785 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-23T18:40:52.785 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-23T18:40:52.786 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-23T18:40:52.786 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2023-06-23T18:40:52.786 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:40:52.786 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2023-06-23T18:40:52.787 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-23T18:40:52.787 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:52.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-23T18:40:54.048 INFO:teuthology.orchestra.run.smithi178.stderr:done 2023-06-23T18:40:54.049 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2023-06-23T18:40:54.066 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.9UOfkO2zVL 2023-06-23T18:40:54.067 DEBUG:teuthology.orchestra.run.smithi178:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9UOfkO2zVL 2023-06-23T18:40:54.152 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.9UOfkO2zVL 2023-06-23T18:40:54.263 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.9UOfkO2zVL is 6KB 2023-06-23T18:40:54.311 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.9UOfkO2zVL 2023-06-23T18:40:54.326 DEBUG:teuthology.orchestra.run.smithi178:> sudo /bin/ls /boot/loader/entries || true 2023-06-23T18:40:54.390 INFO:teuthology.orchestra.run.smithi178.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-06-23T18:40:54.390 INFO:teuthology.orchestra.run.smithi178.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-06-23T18:40:54.390 INFO:teuthology.orchestra.run.smithi178.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.4.0-rc5-g1c622d92b6f1.conf 2023-06-23T18:40:54.391 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:54.525 DEBUG:teuthology.orchestra.run.smithi178:> sudo shutdown -r now 2023-06-23T18:40:56.788 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2023-06-23T18:40:58.615 INFO:teuthology.orchestra.run.smithi136.stderr:done 2023-06-23T18:40:58.617 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2023-06-23T18:40:58.643 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.0Yv98ohslT 2023-06-23T18:40:58.644 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0Yv98ohslT 2023-06-23T18:40:58.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.0Yv98ohslT 2023-06-23T18:40:58.866 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.0Yv98ohslT is 6KB 2023-06-23T18:40:58.913 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.0Yv98ohslT 2023-06-23T18:40:58.930 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2023-06-23T18:40:59.000 INFO:teuthology.orchestra.run.smithi136.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-06-23T18:40:59.000 INFO:teuthology.orchestra.run.smithi136.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-06-23T18:40:59.000 INFO:teuthology.orchestra.run.smithi136.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.4.0-rc5-g1c622d92b6f1.conf 2023-06-23T18:40:59.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:40:59.131 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2023-06-23T18:41:24.553 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-06-23T18:41:24.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-06-23T18:41:24.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:41:29.136 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-23T18:41:29.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-06-23T18:41:29.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:41:43.024 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-23T18:41:47.632 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-06-23T18:42:13.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-06-23T18:42:13.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:42:17.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-06-23T18:42:17.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:42:20.688 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-06-23T18:42:50.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-06-23T18:42:50.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:42:50.967 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-06-23T18:42:51.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-06-23T18:42:51.386 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-rc5-g1c622d92b6f1"... 2023-06-23T18:42:51.386 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2023-06-23T18:42:51.426 INFO:teuthology.orchestra.run.smithi136.stdout:6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:42:51.426 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc5-g1c622d92b6f1 vs 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:42:51.427 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T18:42:51.427 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-06-23T18:42:52.428 DEBUG:teuthology.parallel:result is None 2023-06-23T18:43:13.030 DEBUG:teuthology.orchestra.remote:timed out 2023-06-23T18:43:43.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-06-23T18:43:43.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:43:43.386 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-06-23T18:43:43.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-06-23T18:43:43.776 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-rc5-g1c622d92b6f1"... 2023-06-23T18:43:43.776 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2023-06-23T18:43:43.817 INFO:teuthology.orchestra.run.smithi178.stdout:6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:43:43.818 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc5-g1c622d92b6f1 vs 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:43:43.818 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T18:43:43.818 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-06-23T18:43:44.819 DEBUG:teuthology.parallel:result is None 2023-06-23T18:43:44.820 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-23T18:43:44.828 INFO:teuthology.task.internal:Creating test directory... 2023-06-23T18:43:44.828 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:43:44.834 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:43:44.880 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-23T18:43:44.887 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-23T18:43:44.896 INFO:teuthology.task.internal:Creating archive directory... 2023-06-23T18:43:44.897 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:43:44.902 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:43:45.142 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-23T18:43:45.149 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-23T18:43:45.149 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:43:45.153 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:43:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:43:45.289 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:43:45.320 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:43:45.322 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:43:45.325 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-23T18:43:45.334 INFO:teuthology.task.internal:Configuring sudo... 2023-06-23T18:43:45.335 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:43:45.339 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:43:45.408 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-23T18:43:45.419 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-23T18:43:45.420 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:43:45.424 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:43:45.465 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:43:45.575 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:43:45.667 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:43:45.741 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:43:45.819 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:43:45.819 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:43:45.886 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:43:45.959 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:43:46.054 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:43:46.127 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:43:46.205 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:43:46.205 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:43:46.271 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2023-06-23T18:43:46.276 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2023-06-23T18:43:46.399 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-23T18:43:46.434 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-23T18:43:46.727 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-23T18:43:46.736 INFO:teuthology.task.internal:Starting timer... 2023-06-23T18:43:46.737 INFO:teuthology.run_tasks:Running task pcp... 2023-06-23T18:43:46.755 INFO:teuthology.run_tasks:Running task selinux... 2023-06-23T18:43:46.766 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-06-23T18:43:46.766 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2023-06-23T18:43:46.888 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2023-06-23T18:43:46.891 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2023-06-23T18:43:47.014 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2023-06-23T18:43:47.018 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-23T18:43:47.018 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2023-06-23T18:43:47.068 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2023-06-23T18:43:47.068 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2023-06-23T18:43:47.122 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2023-06-23T18:43:47.122 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi136.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2023-06-23T18:43:47.123 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-23T18:43:47.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:43:47.193 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-23T18:43:47.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:43:47.269 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-23T18:43:47.269 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2023-06-23T18:43:47.337 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2023-06-23T18:43:47.406 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-23T18:43:47.420 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-06-23T18:43:47.420 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-23T18:43:47.443 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-23T18:43:47.445 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi136.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-23T18:55:19.865 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2023-06-23T18:55:19.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-06-23T18:55:19.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:55:19.979 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-06-23T18:55:20.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-06-23T18:55:20.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:55:20.180 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-06-23T18:55:20.300 INFO:teuthology.run_tasks:Running task clock... 2023-06-23T18:55:20.313 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-23T18:55:20.314 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:55:20.314 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:55:20.319 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:55:20.319 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:55:20.389 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-23T18:55:20.414 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-23T18:55:20.422 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-23T18:55:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-23T18:55:20.512 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2023-06-23T18:55:20.534 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2023-06-23T18:55:20.541 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2023-06-23T18:55:20.563 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2023-06-23T18:55:20.574 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-23T18:55:20.597 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-23T18:55:20.607 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-23T18:55:20.631 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-23T18:55:20.698 INFO:teuthology.orchestra.run.smithi136.stderr:bash: ntpq: command not found 2023-06-23T18:55:20.705 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-23T18:55:20.705 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2023-06-23T18:55:20.705 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:55:20.705 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:55:20.705 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:55:20.706 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:55:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:bash: ntpq: command not found 2023-06-23T18:55:20.732 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-23T18:55:20.732 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2023-06-23T18:55:20.732 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:55:20.733 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:55:20.733 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:55:20.733 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:55:20.734 INFO:teuthology.run_tasks:Running task install... 2023-06-23T18:55:20.743 DEBUG:teuthology.task.install:project ceph 2023-06-23T18:55:20.744 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}} 2023-06-23T18:55:20.745 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'} 2023-06-23T18:55:20.745 INFO:teuthology.task.install:Using flavor: default 2023-06-23T18:55:20.752 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-23T18:55:20.752 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-23T18:55:20.753 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'tag': None, 'wait_for_package': False} 2023-06-23T18:55:20.754 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:55:20.756 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'tag': None, 'wait_for_package': False} 2023-06-23T18:55:20.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:55:20.974 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/ 2023-06-23T18:55:20.974 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4479.g8627af3e 2023-06-23T18:55:20.984 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/ 2023-06-23T18:55:20.984 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4479.g8627af3e 2023-06-23T18:55:21.080 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-23T18:55:21.081 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:55:21.081 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-23T18:55:21.086 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-23T18:55:21.086 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:55:21.087 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-23T18:55:21.150 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-23T18:55:21.150 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8627af3e0adcb765a3c249fcc209cba9f4873e1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-23T18:55:21.154 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-23T18:55:21.155 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8627af3e0adcb765a3c249fcc209cba9f4873e1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-23T18:55:21.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-23T18:55:21.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-23T18:55:21.356 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-23T18:55:21.358 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-23T18:55:21.423 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2023-06-23T18:55:21.424 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2023-06-23T18:55:21.426 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2023-06-23T18:55:21.427 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2023-06-23T18:55:21.865 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-06-23T18:55:21.869 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-06-23T18:55:22.197 INFO:teuthology.orchestra.run.smithi178.stdout:44 files removed 2023-06-23T18:55:22.209 INFO:teuthology.orchestra.run.smithi136.stdout:44 files removed 2023-06-23T18:55:22.257 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-23T18:55:22.267 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-23T18:55:22.696 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-06-23T18:55:22.709 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-06-23T18:55:23.514 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 200 kB/s | 81 kB 00:00 2023-06-23T18:55:23.582 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 185 kB/s | 81 kB 00:00 2023-06-23T18:55:23.857 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-06-23T18:55:23.882 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-06-23T18:55:24.149 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-06-23T18:55:24.200 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2023-06-23T18:55:26.084 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2023-06-23T18:55:26.516 INFO:teuthology.orchestra.run.smithi178.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-06-23T18:55:27.712 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-06-23T18:55:31.675 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 528 kB/s | 24 kB 00:00 2023-06-23T18:55:32.769 INFO:teuthology.orchestra.run.smithi178.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 52 MB/s | 53 MB 00:01 2023-06-23T18:55:41.511 INFO:teuthology.orchestra.run.smithi178.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 47 MB 00:01 2023-06-23T18:55:53.042 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:55:53.043 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:55:53.058 INFO:teuthology.orchestra.run.smithi178.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-06-23T18:55:53.059 INFO:teuthology.orchestra.run.smithi178.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-06-23T18:55:53.061 INFO:teuthology.orchestra.run.smithi178.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-06-23T18:55:53.062 INFO:teuthology.orchestra.run.smithi178.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-23T18:55:53.065 INFO:teuthology.orchestra.run.smithi178.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-23T18:55:53.068 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-23T18:55:53.069 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-23T18:55:53.210 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-06-23T18:55:53.222 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2023-06-23T18:55:53.223 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-06-23T18:55:53.223 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2023-06-23T18:55:53.223 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-06-23T18:55:53.224 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-06-23T18:55:53.224 INFO:teuthology.orchestra.run.smithi178.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-06-23T18:55:53.224 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.4 k 2023-06-23T18:55:53.224 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 5.4 M 2023-06-23T18:55:53.224 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 848 k 2023-06-23T18:55:53.225 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 165 k 2023-06-23T18:55:53.225 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 1.5 M 2023-06-23T18:55:53.225 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 128 k 2023-06-23T18:55:53.225 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 1.7 M 2023-06-23T18:55:53.225 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 7.4 M 2023-06-23T18:55:53.225 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 47 k 2023-06-23T18:55:53.225 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 13 M 2023-06-23T18:55:53.225 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 48 M 2023-06-23T18:55:53.226 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 258 k 2023-06-23T18:55:53.226 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 161 k 2023-06-23T18:55:53.226 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 258 k 2023-06-23T18:55:53.226 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 18 k 2023-06-23T18:55:53.226 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-06-23T18:55:53.226 INFO:teuthology.orchestra.run.smithi178.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-06-23T18:55:53.226 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-06-23T18:55:53.226 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 31 k 2023-06-23T18:55:53.227 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 771 k 2023-06-23T18:55:53.227 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 139 k 2023-06-23T18:55:53.227 INFO:teuthology.orchestra.run.smithi178.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-06-23T18:55:53.227 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-06-23T18:55:53.227 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-06-23T18:55:53.227 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-06-23T18:55:53.227 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-06-23T18:55:53.228 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-06-23T18:55:53.228 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 197 k 2023-06-23T18:55:53.228 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 370 k 2023-06-23T18:55:53.228 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 365 k 2023-06-23T18:55:53.229 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 107 k 2023-06-23T18:55:53.229 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 94 k 2023-06-23T18:55:53.229 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.4 M 2023-06-23T18:55:53.229 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 179 k 2023-06-23T18:55:53.229 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-06-23T18:55:53.229 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2023-06-23T18:55:53.229 INFO:teuthology.orchestra.run.smithi178.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-06-23T18:55:53.229 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.7 M 2023-06-23T18:55:53.230 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.6 M 2023-06-23T18:55:53.230 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-06-23T18:55:53.230 INFO:teuthology.orchestra.run.smithi178.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-06-23T18:55:53.230 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 22 M 2023-06-23T18:55:53.230 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 23 k 2023-06-23T18:55:53.230 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 2.3 M 2023-06-23T18:55:53.230 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 240 k 2023-06-23T18:55:53.231 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 4.6 M 2023-06-23T18:55:53.231 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 18 M 2023-06-23T18:55:53.231 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 15 k 2023-06-23T18:55:53.231 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 24 k 2023-06-23T18:55:53.231 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-06-23T18:55:53.231 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-23T18:55:53.231 INFO:teuthology.orchestra.run.smithi178.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-06-23T18:55:53.231 INFO:teuthology.orchestra.run.smithi178.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-06-23T18:55:53.232 INFO:teuthology.orchestra.run.smithi178.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-06-23T18:55:53.232 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 137 k 2023-06-23T18:55:53.232 INFO:teuthology.orchestra.run.smithi178.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-06-23T18:55:53.233 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-06-23T18:55:53.233 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-23T18:55:53.233 INFO:teuthology.orchestra.run.smithi178.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-06-23T18:55:53.233 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-06-23T18:55:53.233 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-06-23T18:55:53.234 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 474 k 2023-06-23T18:55:53.234 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-06-23T18:55:53.234 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.7 M 2023-06-23T18:55:53.234 INFO:teuthology.orchestra.run.smithi178.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-06-23T18:55:53.234 INFO:teuthology.orchestra.run.smithi178.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-06-23T18:55:53.234 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-23T18:55:53.234 INFO:teuthology.orchestra.run.smithi178.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-06-23T18:55:53.235 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-06-23T18:55:53.235 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-06-23T18:55:53.235 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-06-23T18:55:53.235 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-06-23T18:55:53.235 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-06-23T18:55:53.235 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-06-23T18:55:53.235 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-06-23T18:55:53.235 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-23T18:55:53.236 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-06-23T18:55:53.236 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-23T18:55:53.236 INFO:teuthology.orchestra.run.smithi178.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-23T18:55:53.236 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-23T18:55:53.237 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 45 k 2023-06-23T18:55:53.237 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 119 k 2023-06-23T18:55:53.237 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-23T18:55:53.237 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-06-23T18:55:53.238 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-23T18:55:53.238 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-23T18:55:53.238 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-06-23T18:55:53.238 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-23T18:55:53.238 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-23T18:55:53.239 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-23T18:55:53.239 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-23T18:55:53.239 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-06-23T18:55:53.239 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-06-23T18:55:53.239 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-23T18:55:53.240 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-23T18:55:53.240 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-23T18:55:53.240 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-06-23T18:55:53.240 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-06-23T18:55:53.241 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-23T18:55:53.241 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-23T18:55:53.241 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-06-23T18:55:53.241 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-06-23T18:55:53.242 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-06-23T18:55:53.242 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-23T18:55:53.242 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-23T18:55:53.242 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-06-23T18:55:53.243 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-06-23T18:55:53.243 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-06-23T18:55:53.243 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-23T18:55:53.243 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-06-23T18:55:53.244 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-06-23T18:55:53.244 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-23T18:55:53.244 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-23T18:55:53.245 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-23T18:55:53.245 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-23T18:55:53.245 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-06-23T18:55:53.245 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-23T18:55:53.246 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-23T18:55:53.246 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-23T18:55:53.246 INFO:teuthology.orchestra.run.smithi178.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-23T18:55:53.246 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-23T18:55:53.247 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-23T18:55:53.247 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-23T18:55:53.247 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-23T18:55:53.247 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-06-23T18:55:53.248 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-23T18:55:53.248 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-06-23T18:55:53.248 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-23T18:55:53.248 INFO:teuthology.orchestra.run.smithi178.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-06-23T18:55:53.248 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-06-23T18:55:53.248 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-06-23T18:55:53.248 INFO:teuthology.orchestra.run.smithi178.stdout:Enabling module streams: 2023-06-23T18:55:53.249 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql 10 2023-06-23T18:55:53.249 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:55:53.249 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-06-23T18:55:53.249 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2023-06-23T18:55:53.249 INFO:teuthology.orchestra.run.smithi178.stdout:Install 128 Packages 2023-06-23T18:55:53.249 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 3 Packages 2023-06-23T18:55:53.249 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:55:53.250 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 205 M 2023-06-23T18:55:53.250 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-06-23T18:55:53.436 INFO:teuthology.orchestra.run.smithi178.stdout:(1/131): ceph-18.0.0-4479.g8627af3e.el8.x86_64. 55 kB/s | 6.4 kB 00:00 2023-06-23T18:55:53.644 INFO:teuthology.orchestra.run.smithi178.stdout:(2/131): ceph-fuse-18.0.0-4479.g8627af3e.el8.x8 4.0 MB/s | 848 kB 00:00 2023-06-23T18:55:53.711 INFO:teuthology.orchestra.run.smithi178.stdout:(3/131): ceph-immutable-object-cache-18.0.0-447 2.4 MB/s | 165 kB 00:00 2023-06-23T18:55:53.837 INFO:teuthology.orchestra.run.smithi178.stdout:(4/131): ceph-base-18.0.0-4479.g8627af3e.el8.x8 10 MB/s | 5.4 MB 00:00 2023-06-23T18:55:53.971 INFO:teuthology.orchestra.run.smithi178.stdout:(5/131): ceph-mds-18.0.0-4479.g8627af3e.el8.x86 8.8 MB/s | 2.3 MB 00:00 2023-06-23T18:55:54.020 INFO:teuthology.orchestra.run.smithi178.stdout:(6/131): ceph-mgr-18.0.0-4479.g8627af3e.el8.x86 8.5 MB/s | 1.5 MB 00:00 2023-06-23T18:55:54.454 INFO:teuthology.orchestra.run.smithi178.stdout:(7/131): ceph-mon-18.0.0-4479.g8627af3e.el8.x86 9.5 MB/s | 4.6 MB 00:00 2023-06-23T18:55:55.246 INFO:teuthology.orchestra.run.smithi178.stdout:(8/131): ceph-osd-18.0.0-4479.g8627af3e.el8.x86 14 MB/s | 18 MB 00:01 2023-06-23T18:55:55.288 INFO:teuthology.orchestra.run.smithi178.stdout:(9/131): ceph-selinux-18.0.0-4479.g8627af3e.el8 586 kB/s | 24 kB 00:00 2023-06-23T18:55:55.905 INFO:teuthology.orchestra.run.smithi178.stdout:(10/131): ceph-radosgw-18.0.0-4479.g8627af3e.el 9.3 MB/s | 13 MB 00:01 2023-06-23T18:55:55.955 INFO:teuthology.orchestra.run.smithi178.stdout:(11/131): cephfs-mirror-18.0.0-4479.g8627af3e.e 5.1 MB/s | 258 kB 00:00 2023-06-23T18:55:56.030 INFO:teuthology.orchestra.run.smithi178.stdout:(12/131): libcephfs-devel-18.0.0-4479.g8627af3e 415 kB/s | 31 kB 00:00 2023-06-23T18:55:56.181 INFO:teuthology.orchestra.run.smithi178.stdout:(13/131): libcephfs2-18.0.0-4479.g8627af3e.el8. 5.0 MB/s | 771 kB 00:00 2023-06-23T18:55:56.264 INFO:teuthology.orchestra.run.smithi178.stdout:(14/131): libcephsqlite-18.0.0-4479.g8627af3e.e 1.6 MB/s | 137 kB 00:00 2023-06-23T18:55:56.348 INFO:teuthology.orchestra.run.smithi178.stdout:(15/131): librados-devel-18.0.0-4479.g8627af3e. 1.6 MB/s | 139 kB 00:00 2023-06-23T18:55:56.448 INFO:teuthology.orchestra.run.smithi178.stdout:(16/131): libradosstriper1-18.0.0-4479.g8627af3 4.6 MB/s | 474 kB 00:00 2023-06-23T18:55:57.265 INFO:teuthology.orchestra.run.smithi178.stdout:(17/131): librgw2-18.0.0-4479.g8627af3e.el8.x86 8.3 MB/s | 6.7 MB 00:00 2023-06-23T18:55:57.340 INFO:teuthology.orchestra.run.smithi178.stdout:(18/131): python3-ceph-argparse-18.0.0-4479.g86 601 kB/s | 45 kB 00:00 2023-06-23T18:55:57.424 INFO:teuthology.orchestra.run.smithi178.stdout:(19/131): python3-ceph-common-18.0.0-4479.g8627 1.4 MB/s | 119 kB 00:00 2023-06-23T18:55:57.516 INFO:teuthology.orchestra.run.smithi178.stdout:(20/131): python3-cephfs-18.0.0-4479.g8627af3e. 2.1 MB/s | 197 kB 00:00 2023-06-23T18:55:57.641 INFO:teuthology.orchestra.run.smithi178.stdout:(21/131): python3-rados-18.0.0-4479.g8627af3e.e 2.9 MB/s | 370 kB 00:00 2023-06-23T18:55:58.117 INFO:teuthology.orchestra.run.smithi178.stdout:(22/131): ceph-test-18.0.0-4479.g8627af3e.el8.x 17 MB/s | 48 MB 00:02 2023-06-23T18:55:58.151 INFO:teuthology.orchestra.run.smithi178.stdout:(23/131): python3-rbd-18.0.0-4479.g8627af3e.el8 717 kB/s | 365 kB 00:00 2023-06-23T18:55:58.176 INFO:teuthology.orchestra.run.smithi178.stdout:(24/131): python3-rgw-18.0.0-4479.g8627af3e.el8 1.8 MB/s | 107 kB 00:00 2023-06-23T18:55:58.201 INFO:teuthology.orchestra.run.smithi178.stdout:(25/131): rbd-fuse-18.0.0-4479.g8627af3e.el8.x8 1.9 MB/s | 94 kB 00:00 2023-06-23T18:55:58.268 INFO:teuthology.orchestra.run.smithi178.stdout:(26/131): rbd-nbd-18.0.0-4479.g8627af3e.el8.x86 2.6 MB/s | 179 kB 00:00 2023-06-23T18:55:58.343 INFO:teuthology.orchestra.run.smithi178.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4479.g 310 kB/s | 23 kB 00:00 2023-06-23T18:55:58.402 INFO:teuthology.orchestra.run.smithi178.stdout:(28/131): rbd-mirror-18.0.0-4479.g8627af3e.el8. 15 MB/s | 3.4 MB 00:00 2023-06-23T18:55:58.436 INFO:teuthology.orchestra.run.smithi178.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4479.g8627af3 1.4 MB/s | 128 kB 00:00 2023-06-23T18:55:58.527 INFO:teuthology.orchestra.run.smithi178.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4479.g8627a 14 MB/s | 1.7 MB 00:00 2023-06-23T18:55:58.595 INFO:teuthology.orchestra.run.smithi178.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4479.g86 3.5 MB/s | 240 kB 00:00 2023-06-23T18:55:58.661 INFO:teuthology.orchestra.run.smithi178.stdout:(32/131): ceph-mgr-rook-18.0.0-4479.g8627af3e.e 716 kB/s | 47 kB 00:00 2023-06-23T18:55:58.729 INFO:teuthology.orchestra.run.smithi178.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4479.g8 218 kB/s | 15 kB 00:00 2023-06-23T18:55:58.795 INFO:teuthology.orchestra.run.smithi178.stdout:(34/131): ceph-volume-18.0.0-4479.g8627af3e.el8 3.8 MB/s | 258 kB 00:00 2023-06-23T18:55:58.885 INFO:teuthology.orchestra.run.smithi178.stdout:(35/131): cephadm-18.0.0-4479.g8627af3e.el8.noa 1.8 MB/s | 161 kB 00:00 2023-06-23T18:55:58.981 INFO:teuthology.orchestra.run.smithi178.stdout:(36/131): ceph-mgr-diskprediction-local-18.0.0- 14 MB/s | 7.4 MB 00:00 2023-06-23T18:55:58.996 INFO:teuthology.orchestra.run.smithi178.stdout:(37/131): cephfs-top-18.0.0-4479.g8627af3e.el8. 162 kB/s | 18 kB 00:00 2023-06-23T18:55:59.739 INFO:teuthology.orchestra.run.smithi178.stdout:(38/131): ceph-common-18.0.0-4479.g8627af3e.el8 3.4 MB/s | 22 MB 00:06 2023-06-23T18:57:35.013 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 124 kB/s | 16 MB 02:08 2023-06-23T18:57:38.995 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 373 kB/s | 24 kB 00:00 2023-06-23T18:57:40.289 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 39 MB/s | 47 MB 00:01 2023-06-23T18:57:48.855 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 53 MB 00:01 2023-06-23T18:58:00.314 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:58:00.315 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:58:00.330 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-06-23T18:58:00.331 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-06-23T18:58:00.332 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-06-23T18:58:00.334 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-23T18:58:00.336 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-23T18:58:00.339 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-23T18:58:00.340 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-23T18:58:00.479 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2023-06-23T18:58:00.492 INFO:teuthology.orchestra.run.smithi136.stdout:=========================================================================================================================== 2023-06-23T18:58:00.492 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2023-06-23T18:58:00.493 INFO:teuthology.orchestra.run.smithi136.stdout:=========================================================================================================================== 2023-06-23T18:58:00.493 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2023-06-23T18:58:00.493 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-06-23T18:58:00.493 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-06-23T18:58:00.493 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.4 k 2023-06-23T18:58:00.493 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 5.4 M 2023-06-23T18:58:00.493 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 848 k 2023-06-23T18:58:00.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 165 k 2023-06-23T18:58:00.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 1.5 M 2023-06-23T18:58:00.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 128 k 2023-06-23T18:58:00.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 1.7 M 2023-06-23T18:58:00.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 7.4 M 2023-06-23T18:58:00.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 47 k 2023-06-23T18:58:00.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 13 M 2023-06-23T18:58:00.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 48 M 2023-06-23T18:58:00.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 258 k 2023-06-23T18:58:00.495 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 161 k 2023-06-23T18:58:00.495 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 258 k 2023-06-23T18:58:00.495 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 18 k 2023-06-23T18:58:00.495 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-06-23T18:58:00.495 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-06-23T18:58:00.495 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-06-23T18:58:00.496 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 31 k 2023-06-23T18:58:00.496 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 771 k 2023-06-23T18:58:00.496 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 139 k 2023-06-23T18:58:00.496 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-06-23T18:58:00.496 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-06-23T18:58:00.496 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-06-23T18:58:00.497 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-06-23T18:58:00.497 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-06-23T18:58:00.497 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-06-23T18:58:00.497 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 197 k 2023-06-23T18:58:00.497 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 370 k 2023-06-23T18:58:00.497 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 365 k 2023-06-23T18:58:00.497 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 107 k 2023-06-23T18:58:00.497 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 94 k 2023-06-23T18:58:00.498 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.4 M 2023-06-23T18:58:00.498 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 179 k 2023-06-23T18:58:00.498 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-06-23T18:58:00.498 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2023-06-23T18:58:00.498 INFO:teuthology.orchestra.run.smithi136.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-06-23T18:58:00.498 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.7 M 2023-06-23T18:58:00.498 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.6 M 2023-06-23T18:58:00.499 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2023-06-23T18:58:00.499 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-06-23T18:58:00.499 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 22 M 2023-06-23T18:58:00.499 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 23 k 2023-06-23T18:58:00.499 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 2.3 M 2023-06-23T18:58:00.499 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 240 k 2023-06-23T18:58:00.499 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 4.6 M 2023-06-23T18:58:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 18 M 2023-06-23T18:58:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 15 k 2023-06-23T18:58:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 24 k 2023-06-23T18:58:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-06-23T18:58:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-23T18:58:00.501 INFO:teuthology.orchestra.run.smithi136.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-06-23T18:58:00.501 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-06-23T18:58:00.501 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-06-23T18:58:00.501 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 137 k 2023-06-23T18:58:00.501 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-06-23T18:58:00.501 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-06-23T18:58:00.501 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-23T18:58:00.501 INFO:teuthology.orchestra.run.smithi136.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-06-23T18:58:00.502 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-06-23T18:58:00.502 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-06-23T18:58:00.502 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 474 k 2023-06-23T18:58:00.502 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-06-23T18:58:00.502 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.7 M 2023-06-23T18:58:00.502 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-06-23T18:58:00.502 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-06-23T18:58:00.503 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-23T18:58:00.503 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-06-23T18:58:00.503 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-06-23T18:58:00.503 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-06-23T18:58:00.503 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-06-23T18:58:00.503 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-06-23T18:58:00.504 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-06-23T18:58:00.504 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-06-23T18:58:00.504 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-06-23T18:58:00.504 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-23T18:58:00.504 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-06-23T18:58:00.504 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-23T18:58:00.504 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-23T18:58:00.504 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-23T18:58:00.505 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 45 k 2023-06-23T18:58:00.505 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 119 k 2023-06-23T18:58:00.505 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-23T18:58:00.505 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-06-23T18:58:00.505 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-23T18:58:00.505 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-23T18:58:00.505 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-06-23T18:58:00.505 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-23T18:58:00.506 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-23T18:58:00.506 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-23T18:58:00.506 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-23T18:58:00.506 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-06-23T18:58:00.506 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-06-23T18:58:00.506 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-23T18:58:00.506 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-23T18:58:00.507 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-23T18:58:00.507 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-06-23T18:58:00.507 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-06-23T18:58:00.507 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-23T18:58:00.507 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-23T18:58:00.507 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-06-23T18:58:00.507 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-06-23T18:58:00.507 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-06-23T18:58:00.508 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-23T18:58:00.508 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-23T18:58:00.508 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-06-23T18:58:00.508 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-06-23T18:58:00.508 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-06-23T18:58:00.508 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-23T18:58:00.508 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-06-23T18:58:00.509 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-06-23T18:58:00.509 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-23T18:58:00.509 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-23T18:58:00.509 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-23T18:58:00.509 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-23T18:58:00.509 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-06-23T18:58:00.509 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-23T18:58:00.509 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-23T18:58:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-23T18:58:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-23T18:58:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-23T18:58:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-23T18:58:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-23T18:58:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-23T18:58:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-06-23T18:58:00.511 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-23T18:58:00.511 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-06-23T18:58:00.511 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-23T18:58:00.511 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-06-23T18:58:00.511 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-06-23T18:58:00.511 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-06-23T18:58:00.511 INFO:teuthology.orchestra.run.smithi136.stdout:Enabling module streams: 2023-06-23T18:58:00.511 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql 10 2023-06-23T18:58:00.512 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:58:00.512 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2023-06-23T18:58:00.512 INFO:teuthology.orchestra.run.smithi136.stdout:=========================================================================================================================== 2023-06-23T18:58:00.512 INFO:teuthology.orchestra.run.smithi136.stdout:Install 128 Packages 2023-06-23T18:58:00.512 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 3 Packages 2023-06-23T18:58:00.512 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:58:00.513 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 205 M 2023-06-23T18:58:00.513 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2023-06-23T18:58:00.871 INFO:teuthology.orchestra.run.smithi136.stdout:(1/131): ceph-18.0.0-4479.g8627af3e.el8.x86_64. 29 kB/s | 6.4 kB 00:00 2023-06-23T18:58:01.647 INFO:teuthology.orchestra.run.smithi136.stdout:(2/131): ceph-fuse-18.0.0-4479.g8627af3e.el8.x8 1.1 MB/s | 848 kB 00:00 2023-06-23T18:58:01.913 INFO:teuthology.orchestra.run.smithi136.stdout:(3/131): ceph-common-18.0.0-4479.g8627af3e.el8. 18 MB/s | 22 MB 00:01 2023-06-23T18:58:01.939 INFO:teuthology.orchestra.run.smithi136.stdout:(4/131): ceph-immutable-object-cache-18.0.0-447 567 kB/s | 165 kB 00:00 2023-06-23T18:58:02.064 INFO:teuthology.orchestra.run.smithi136.stdout:(5/131): ceph-mds-18.0.0-4479.g8627af3e.el8.x86 15 MB/s | 2.3 MB 00:00 2023-06-23T18:58:02.353 INFO:teuthology.orchestra.run.smithi136.stdout:(6/131): ceph-mon-18.0.0-4479.g8627af3e.el8.x86 16 MB/s | 4.6 MB 00:00 2023-06-23T18:58:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:(7/131): ceph-mgr-18.0.0-4479.g8627af3e.el8.x86 1.9 MB/s | 1.5 MB 00:00 2023-06-23T18:58:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:(8/131): ceph-osd-18.0.0-4479.g8627af3e.el8.x86 19 MB/s | 18 MB 00:00 2023-06-23T18:58:03.356 INFO:teuthology.orchestra.run.smithi136.stdout:(9/131): ceph-base-18.0.0-4479.g8627af3e.el8.x8 2.0 MB/s | 5.4 MB 00:02 2023-06-23T18:58:03.382 INFO:teuthology.orchestra.run.smithi136.stdout:(10/131): ceph-selinux-18.0.0-4479.g8627af3e.el 243 kB/s | 24 kB 00:00 2023-06-23T18:58:03.432 INFO:teuthology.orchestra.run.smithi136.stdout:(11/131): cephfs-mirror-18.0.0-4479.g8627af3e.e 5.1 MB/s | 258 kB 00:00 2023-06-23T18:58:03.482 INFO:teuthology.orchestra.run.smithi136.stdout:(12/131): libcephfs-devel-18.0.0-4479.g8627af3e 618 kB/s | 31 kB 00:00 2023-06-23T18:58:03.557 INFO:teuthology.orchestra.run.smithi136.stdout:(13/131): libcephfs2-18.0.0-4479.g8627af3e.el8. 10 MB/s | 771 kB 00:00 2023-06-23T18:58:03.608 INFO:teuthology.orchestra.run.smithi136.stdout:(14/131): libcephsqlite-18.0.0-4479.g8627af3e.e 2.7 MB/s | 137 kB 00:00 2023-06-23T18:58:03.666 INFO:teuthology.orchestra.run.smithi136.stdout:(15/131): librados-devel-18.0.0-4479.g8627af3e. 2.3 MB/s | 139 kB 00:00 2023-06-23T18:58:03.750 INFO:teuthology.orchestra.run.smithi136.stdout:(16/131): libradosstriper1-18.0.0-4479.g8627af3 5.6 MB/s | 474 kB 00:00 2023-06-23T18:58:04.233 INFO:teuthology.orchestra.run.smithi136.stdout:(17/131): librgw2-18.0.0-4479.g8627af3e.el8.x86 14 MB/s | 6.7 MB 00:00 2023-06-23T18:58:04.283 INFO:teuthology.orchestra.run.smithi136.stdout:(18/131): python3-ceph-argparse-18.0.0-4479.g86 900 kB/s | 45 kB 00:00 2023-06-23T18:58:04.351 INFO:teuthology.orchestra.run.smithi136.stdout:(19/131): python3-ceph-common-18.0.0-4479.g8627 1.7 MB/s | 119 kB 00:00 2023-06-23T18:58:04.426 INFO:teuthology.orchestra.run.smithi136.stdout:(20/131): python3-cephfs-18.0.0-4479.g8627af3e. 2.6 MB/s | 197 kB 00:00 2023-06-23T18:58:04.501 INFO:teuthology.orchestra.run.smithi136.stdout:(21/131): python3-rados-18.0.0-4479.g8627af3e.e 4.8 MB/s | 370 kB 00:00 2023-06-23T18:58:04.568 INFO:teuthology.orchestra.run.smithi136.stdout:(22/131): python3-rbd-18.0.0-4479.g8627af3e.el8 5.4 MB/s | 365 kB 00:00 2023-06-23T18:58:04.635 INFO:teuthology.orchestra.run.smithi136.stdout:(23/131): python3-rgw-18.0.0-4479.g8627af3e.el8 1.6 MB/s | 107 kB 00:00 2023-06-23T18:58:04.844 INFO:teuthology.orchestra.run.smithi136.stdout:(24/131): rbd-fuse-18.0.0-4479.g8627af3e.el8.x8 453 kB/s | 94 kB 00:00 2023-06-23T18:58:04.994 INFO:teuthology.orchestra.run.smithi136.stdout:(25/131): ceph-radosgw-18.0.0-4479.g8627af3e.el 6.0 MB/s | 13 MB 00:02 2023-06-23T18:58:05.094 INFO:teuthology.orchestra.run.smithi136.stdout:(26/131): rbd-mirror-18.0.0-4479.g8627af3e.el8. 14 MB/s | 3.4 MB 00:00 2023-06-23T18:58:05.120 INFO:teuthology.orchestra.run.smithi136.stdout:(27/131): rbd-nbd-18.0.0-4479.g8627af3e.el8.x86 1.4 MB/s | 179 kB 00:00 2023-06-23T18:58:05.145 INFO:teuthology.orchestra.run.smithi136.stdout:(28/131): ceph-grafana-dashboards-18.0.0-4479.g 459 kB/s | 23 kB 00:00 2023-06-23T18:58:05.204 INFO:teuthology.orchestra.run.smithi136.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4479.g8627af3 1.5 MB/s | 128 kB 00:00 2023-06-23T18:58:05.321 INFO:teuthology.orchestra.run.smithi136.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4479.g8627a 9.8 MB/s | 1.7 MB 00:00 2023-06-23T18:58:05.404 INFO:teuthology.orchestra.run.smithi136.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4479.g86 2.8 MB/s | 240 kB 00:00 2023-06-23T18:58:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:(32/131): ceph-mgr-rook-18.0.0-4479.g8627af3e.e 712 kB/s | 47 kB 00:00 2023-06-23T18:58:05.547 INFO:teuthology.orchestra.run.smithi136.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4479.g8 193 kB/s | 15 kB 00:00 2023-06-23T18:58:05.630 INFO:teuthology.orchestra.run.smithi136.stdout:(34/131): ceph-volume-18.0.0-4479.g8627af3e.el8 3.0 MB/s | 258 kB 00:00 2023-06-23T18:58:05.722 INFO:teuthology.orchestra.run.smithi136.stdout:(35/131): cephadm-18.0.0-4479.g8627af3e.el8.noa 1.7 MB/s | 161 kB 00:00 2023-06-23T18:58:05.806 INFO:teuthology.orchestra.run.smithi136.stdout:(36/131): cephfs-top-18.0.0-4479.g8627af3e.el8. 216 kB/s | 18 kB 00:00 2023-06-23T18:58:06.339 INFO:teuthology.orchestra.run.smithi136.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 574 kB/s | 306 kB 00:00 2023-06-23T18:58:06.440 INFO:teuthology.orchestra.run.smithi136.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 590 kB/s | 59 kB 00:00 2023-06-23T18:58:06.524 INFO:teuthology.orchestra.run.smithi136.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 900 kB/s | 75 kB 00:00 2023-06-23T18:58:06.616 INFO:teuthology.orchestra.run.smithi136.stdout:(40/131): ceph-mgr-diskprediction-local-18.0.0- 5.2 MB/s | 7.4 MB 00:01 2023-06-23T18:58:07.074 INFO:teuthology.orchestra.run.smithi136.stdout:(41/131): ceph-test-18.0.0-4479.g8627af3e.el8.x 13 MB/s | 48 MB 00:03 2023-06-23T18:58:07.099 INFO:teuthology.orchestra.run.smithi136.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 827 kB/s | 476 kB 00:00 2023-06-23T18:58:07.158 INFO:teuthology.orchestra.run.smithi136.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 568 kB/s | 33 kB 00:00 2023-06-23T18:58:07.217 INFO:teuthology.orchestra.run.smithi136.stdout:(44/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 73 kB/s | 44 kB 00:00 2023-06-23T18:58:07.242 INFO:teuthology.orchestra.run.smithi136.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 195 kB/s | 16 kB 00:00 2023-06-23T18:58:07.317 INFO:teuthology.orchestra.run.smithi136.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 764 kB/s | 185 kB 00:00 2023-06-23T18:58:07.343 INFO:teuthology.orchestra.run.smithi136.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-06-23T18:58:07.384 INFO:teuthology.orchestra.run.smithi136.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-06-23T18:58:07.401 INFO:teuthology.orchestra.run.smithi136.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-06-23T18:58:07.443 INFO:teuthology.orchestra.run.smithi136.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 301 kB/s | 18 kB 00:00 2023-06-23T18:58:07.469 INFO:teuthology.orchestra.run.smithi136.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-06-23T18:58:07.511 INFO:teuthology.orchestra.run.smithi136.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 727 kB/s | 49 kB 00:00 2023-06-23T18:58:07.561 INFO:teuthology.orchestra.run.smithi136.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 7.3 MB/s | 1.2 MB 00:00 2023-06-23T18:58:07.586 INFO:teuthology.orchestra.run.smithi136.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 803 kB/s | 60 kB 00:00 2023-06-23T18:58:07.637 INFO:teuthology.orchestra.run.smithi136.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-06-23T18:58:07.662 INFO:teuthology.orchestra.run.smithi136.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-06-23T18:58:07.704 INFO:teuthology.orchestra.run.smithi136.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 504 kB/s | 34 kB 00:00 2023-06-23T18:58:07.729 INFO:teuthology.orchestra.run.smithi136.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-06-23T18:58:07.788 INFO:teuthology.orchestra.run.smithi136.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 322 kB/s | 19 kB 00:00 2023-06-23T18:58:07.855 INFO:teuthology.orchestra.run.smithi136.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 359 kB/s | 24 kB 00:00 2023-06-23T18:58:07.922 INFO:teuthology.orchestra.run.smithi136.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 439 kB/s | 29 kB 00:00 2023-06-23T18:58:07.955 INFO:teuthology.orchestra.run.smithi136.stdout:(62/131): python3-more-itertools-7.2.0-3.el8.no 121 kB/s | 59 kB 00:00 2023-06-23T18:58:07.980 INFO:teuthology.orchestra.run.smithi136.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 470 kB/s | 27 kB 00:00 2023-06-23T18:58:08.014 INFO:teuthology.orchestra.run.smithi136.stdout:(64/131): python3-rsa-4.8-1.el8.noarch.rpm 199 kB/s | 61 kB 00:00 2023-06-23T18:58:08.048 INFO:teuthology.orchestra.run.smithi136.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-06-23T18:58:08.081 INFO:teuthology.orchestra.run.smithi136.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 914 kB/s | 61 kB 00:00 2023-06-23T18:58:08.115 INFO:teuthology.orchestra.run.smithi136.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-06-23T18:58:08.357 INFO:teuthology.orchestra.run.smithi136.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 7.2 MB/s | 1.7 MB 00:00 2023-06-23T18:58:08.382 INFO:teuthology.orchestra.run.smithi136.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 76 kB/s | 23 kB 00:00 2023-06-23T18:58:08.408 INFO:teuthology.orchestra.run.smithi136.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-06-23T18:58:08.441 INFO:teuthology.orchestra.run.smithi136.stdout:(71/131): python3-waitress-1.4.3-1.el8.noarch.r 526 kB/s | 255 kB 00:00 2023-06-23T18:58:08.491 INFO:teuthology.orchestra.run.smithi136.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-06-23T18:58:08.517 INFO:teuthology.orchestra.run.smithi136.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 778 kB/s | 54 kB 00:00 2023-06-23T18:58:08.551 INFO:teuthology.orchestra.run.smithi136.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-06-23T18:58:08.593 INFO:teuthology.orchestra.run.smithi136.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-06-23T18:58:08.618 INFO:teuthology.orchestra.run.smithi136.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 582 kB/s | 39 kB 00:00 2023-06-23T18:58:08.660 INFO:teuthology.orchestra.run.smithi136.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-06-23T18:58:08.693 INFO:teuthology.orchestra.run.smithi136.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-06-23T18:58:08.718 INFO:teuthology.orchestra.run.smithi136.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-06-23T18:58:08.744 INFO:teuthology.orchestra.run.smithi136.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-06-23T18:58:08.794 INFO:teuthology.orchestra.run.smithi136.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-06-23T18:58:08.828 INFO:teuthology.orchestra.run.smithi136.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 799 kB/s | 27 kB 00:00 2023-06-23T18:58:08.870 INFO:teuthology.orchestra.run.smithi136.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-06-23T18:58:08.903 INFO:teuthology.orchestra.run.smithi136.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-06-23T18:58:09.020 INFO:teuthology.orchestra.run.smithi136.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-06-23T18:58:09.071 INFO:teuthology.orchestra.run.smithi136.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-06-23T18:58:09.146 INFO:teuthology.orchestra.run.smithi136.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-06-23T18:58:09.180 INFO:teuthology.orchestra.run.smithi136.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-06-23T18:58:09.205 INFO:teuthology.orchestra.run.smithi136.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-06-23T18:58:09.230 INFO:teuthology.orchestra.run.smithi136.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-06-23T18:58:09.256 INFO:teuthology.orchestra.run.smithi136.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-06-23T18:58:09.281 INFO:teuthology.orchestra.run.smithi136.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-06-23T18:58:09.331 INFO:teuthology.orchestra.run.smithi136.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-06-23T18:58:09.373 INFO:teuthology.orchestra.run.smithi136.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-06-23T18:58:09.532 INFO:teuthology.orchestra.run.smithi136.stdout:(95/131): python3-scipy-1.0.0-21.module+el8.5.0 12 MB/s | 14 MB 00:01 2023-06-23T18:58:09.573 INFO:teuthology.orchestra.run.smithi136.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-06-23T18:58:09.624 INFO:teuthology.orchestra.run.smithi136.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-06-23T18:58:09.708 INFO:teuthology.orchestra.run.smithi136.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2023-06-23T18:58:09.799 INFO:teuthology.orchestra.run.smithi136.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-06-23T18:58:10.006 INFO:teuthology.orchestra.run.smithi136.stdout:(100/131): postgresql-contrib-10.21-2.module+el 2.6 MB/s | 808 kB 00:00 2023-06-23T18:58:10.050 INFO:teuthology.orchestra.run.smithi136.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.0 MB/s | 47 kB 00:00 2023-06-23T18:58:10.101 INFO:teuthology.orchestra.run.smithi136.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 5.0 MB/s | 1.5 MB 00:00 2023-06-23T18:58:10.126 INFO:teuthology.orchestra.run.smithi136.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.6 MB/s | 200 kB 00:00 2023-06-23T18:58:10.151 INFO:teuthology.orchestra.run.smithi136.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 846 kB/s | 43 kB 00:00 2023-06-23T18:58:10.175 INFO:teuthology.orchestra.run.smithi178.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-23T18:58:10.175 INFO:teuthology.orchestra.run.smithi178.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-23T18:58:10.178 INFO:teuthology.orchestra.run.smithi178.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-23T18:58:10.193 INFO:teuthology.orchestra.run.smithi136.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-06-23T18:58:10.218 INFO:teuthology.orchestra.run.smithi136.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 722 kB/s | 48 kB 00:00 2023-06-23T18:58:10.244 INFO:teuthology.orchestra.run.smithi136.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-06-23T18:58:10.290 INFO:teuthology.orchestra.run.smithi136.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 603 kB/s | 43 kB 00:00 2023-06-23T18:58:10.319 INFO:teuthology.orchestra.run.smithi136.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-06-23T18:58:10.353 INFO:teuthology.orchestra.run.smithi136.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.5 MB/s | 229 kB 00:00 2023-06-23T18:58:10.361 INFO:teuthology.orchestra.run.smithi178.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 458 B/s | 59 kB 02:11 2023-06-23T18:58:10.386 INFO:teuthology.orchestra.run.smithi178.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 588 B/s | 75 kB 02:10 2023-06-23T18:58:10.403 INFO:teuthology.orchestra.run.smithi136.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.5 MB/s | 560 kB 00:00 2023-06-23T18:58:10.429 INFO:teuthology.orchestra.run.smithi136.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 249 kB/s | 19 kB 00:00 2023-06-23T18:58:10.453 INFO:teuthology.orchestra.run.smithi178.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:11 2023-06-23T18:58:10.454 INFO:teuthology.orchestra.run.smithi136.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-06-23T18:58:10.478 INFO:teuthology.orchestra.run.smithi178.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2023-06-23T18:58:10.529 INFO:teuthology.orchestra.run.smithi136.stdout:(114/131): postgresql-server-10.21-2.module+el8 5.6 MB/s | 5.1 MB 00:00 2023-06-23T18:58:10.536 INFO:teuthology.orchestra.run.smithi178.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-06-23T18:58:10.555 INFO:teuthology.orchestra.run.smithi136.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 178 kB/s | 18 kB 00:00 2023-06-23T18:58:10.562 INFO:teuthology.orchestra.run.smithi178.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 395 kB/s | 33 kB 00:00 2023-06-23T18:58:10.587 INFO:teuthology.orchestra.run.smithi178.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-06-23T18:58:10.588 INFO:teuthology.orchestra.run.smithi136.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.4 MB/s | 559 kB 00:00 2023-06-23T18:58:10.612 INFO:teuthology.orchestra.run.smithi178.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-06-23T18:58:10.622 INFO:teuthology.orchestra.run.smithi136.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-06-23T18:58:10.647 INFO:teuthology.orchestra.run.smithi136.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-06-23T18:58:10.671 INFO:teuthology.orchestra.run.smithi178.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-06-23T18:58:10.672 INFO:teuthology.orchestra.run.smithi136.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-06-23T18:58:10.689 INFO:teuthology.orchestra.run.smithi136.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-06-23T18:58:10.696 INFO:teuthology.orchestra.run.smithi178.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 972 kB/s | 81 kB 00:00 2023-06-23T18:58:10.715 INFO:teuthology.orchestra.run.smithi136.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-06-23T18:58:10.722 INFO:teuthology.orchestra.run.smithi178.stdout:(49/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-06-23T18:58:10.739 INFO:teuthology.orchestra.run.smithi178.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 165 kB/s | 11 kB 00:00 2023-06-23T18:58:10.749 INFO:teuthology.orchestra.run.smithi136.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.6 MB/s | 98 kB 00:00 2023-06-23T18:58:10.764 INFO:teuthology.orchestra.run.smithi178.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 262 kB/s | 18 kB 00:00 2023-06-23T18:58:10.774 INFO:teuthology.orchestra.run.smithi136.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 988 kB/s | 58 kB 00:00 2023-06-23T18:58:10.798 INFO:teuthology.orchestra.run.smithi178.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 839 kB/s | 49 kB 00:00 2023-06-23T18:58:10.799 INFO:teuthology.orchestra.run.smithi136.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 772 kB/s | 39 kB 00:00 2023-06-23T18:58:10.831 INFO:teuthology.orchestra.run.smithi178.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 879 kB/s | 59 kB 00:00 2023-06-23T18:58:10.841 INFO:teuthology.orchestra.run.smithi136.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-06-23T18:58:10.856 INFO:teuthology.orchestra.run.smithi178.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-06-23T18:58:10.866 INFO:teuthology.orchestra.run.smithi136.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-06-23T18:58:10.890 INFO:teuthology.orchestra.run.smithi178.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2023-06-23T18:58:10.891 INFO:teuthology.orchestra.run.smithi136.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-06-23T18:58:10.915 INFO:teuthology.orchestra.run.smithi178.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-06-23T18:58:10.940 INFO:teuthology.orchestra.run.smithi178.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-06-23T18:58:10.950 INFO:teuthology.orchestra.run.smithi136.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.4 MB/s | 2.3 MB 00:00 2023-06-23T18:58:10.966 INFO:teuthology.orchestra.run.smithi178.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2023-06-23T18:58:10.991 INFO:teuthology.orchestra.run.smithi178.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-06-23T18:58:11.000 INFO:teuthology.orchestra.run.smithi136.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-06-23T18:58:11.016 INFO:teuthology.orchestra.run.smithi178.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 817 kB/s | 61 kB 00:00 2023-06-23T18:58:11.041 INFO:teuthology.orchestra.run.smithi178.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-06-23T18:58:11.067 INFO:teuthology.orchestra.run.smithi178.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2023-06-23T18:58:11.092 INFO:teuthology.orchestra.run.smithi178.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 387 kB/s | 29 kB 00:00 2023-06-23T18:58:11.117 INFO:teuthology.orchestra.run.smithi178.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 364 kB/s | 27 kB 00:00 2023-06-23T18:58:11.151 INFO:teuthology.orchestra.run.smithi178.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2023-06-23T18:58:11.177 INFO:teuthology.orchestra.run.smithi178.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-06-23T18:58:11.202 INFO:teuthology.orchestra.run.smithi178.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.2 MB/s | 251 kB 00:00 2023-06-23T18:58:11.227 INFO:teuthology.orchestra.run.smithi178.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-06-23T18:58:11.252 INFO:teuthology.orchestra.run.smithi178.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-06-23T18:58:11.278 INFO:teuthology.orchestra.run.smithi178.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-06-23T18:58:11.320 INFO:teuthology.orchestra.run.smithi178.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 703 kB/s | 47 kB 00:00 2023-06-23T18:58:11.342 INFO:teuthology.orchestra.run.smithi136.stdout:(130/131): librbd1-18.0.0-4479.g8627af3e.el8.x8 7.9 MB/s | 3.6 MB 00:00 2023-06-23T18:58:11.353 INFO:teuthology.orchestra.run.smithi178.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.8 MB/s | 200 kB 00:00 2023-06-23T18:58:11.379 INFO:teuthology.orchestra.run.smithi178.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 730 kB/s | 43 kB 00:00 2023-06-23T18:58:11.420 INFO:teuthology.orchestra.run.smithi178.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 7.9 MB/s | 1.7 MB 00:00 2023-06-23T18:58:11.446 INFO:teuthology.orchestra.run.smithi178.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 722 kB/s | 48 kB 00:00 2023-06-23T18:58:11.459 INFO:teuthology.orchestra.run.smithi136.stdout:(131/131): librados2-18.0.0-4479.g8627af3e.el8. 6.2 MB/s | 3.7 MB 00:00 2023-06-23T18:58:11.461 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2023-06-23T18:58:11.462 INFO:teuthology.orchestra.run.smithi136.stdout:Total 19 MB/s | 205 MB 00:10 2023-06-23T18:58:11.488 INFO:teuthology.orchestra.run.smithi178.stdout:(76/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-06-23T18:58:11.513 INFO:teuthology.orchestra.run.smithi178.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 696 kB/s | 43 kB 00:00 2023-06-23T18:58:11.538 INFO:teuthology.orchestra.run.smithi178.stdout:(78/131): libsepol-devel-2.9-3.el8.x86_64.rpm 743 kB/s | 87 kB 00:00 2023-06-23T18:58:11.563 INFO:teuthology.orchestra.run.smithi178.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-06-23T18:58:11.614 INFO:teuthology.orchestra.run.smithi178.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-06-23T18:58:11.639 INFO:teuthology.orchestra.run.smithi178.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 249 kB/s | 19 kB 00:00 2023-06-23T18:58:11.664 INFO:teuthology.orchestra.run.smithi178.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-06-23T18:58:11.698 INFO:teuthology.orchestra.run.smithi178.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.4 MB/s | 560 kB 00:00 2023-06-23T18:58:11.723 INFO:teuthology.orchestra.run.smithi178.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-06-23T18:58:11.757 INFO:teuthology.orchestra.run.smithi178.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.6 MB/s | 559 kB 00:00 2023-06-23T18:58:11.791 INFO:teuthology.orchestra.run.smithi178.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-06-23T18:58:11.824 INFO:teuthology.orchestra.run.smithi178.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-06-23T18:58:11.850 INFO:teuthology.orchestra.run.smithi178.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-06-23T18:58:11.875 INFO:teuthology.orchestra.run.smithi178.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-06-23T18:58:11.900 INFO:teuthology.orchestra.run.smithi178.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-06-23T18:58:11.925 INFO:teuthology.orchestra.run.smithi178.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-06-23T18:58:11.951 INFO:teuthology.orchestra.run.smithi178.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-06-23T18:58:11.976 INFO:teuthology.orchestra.run.smithi178.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 766 kB/s | 39 kB 00:00 2023-06-23T18:58:12.018 INFO:teuthology.orchestra.run.smithi178.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-06-23T18:58:12.044 INFO:teuthology.orchestra.run.smithi178.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-06-23T18:58:12.069 INFO:teuthology.orchestra.run.smithi178.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-06-23T18:58:12.111 INFO:teuthology.orchestra.run.smithi178.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-06-23T18:58:12.161 INFO:teuthology.orchestra.run.smithi178.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.8 MB/s | 2.3 MB 00:00 2023-06-23T18:58:12.187 INFO:teuthology.orchestra.run.smithi178.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 720 kB/s | 54 kB 00:00 2023-06-23T18:58:12.220 INFO:teuthology.orchestra.run.smithi178.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-06-23T18:58:12.254 INFO:teuthology.orchestra.run.smithi178.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-06-23T18:58:12.279 INFO:teuthology.orchestra.run.smithi178.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-06-23T18:58:12.329 INFO:teuthology.orchestra.run.smithi178.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-06-23T18:58:12.363 INFO:teuthology.orchestra.run.smithi178.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-06-23T18:58:12.388 INFO:teuthology.orchestra.run.smithi178.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-06-23T18:58:12.414 INFO:teuthology.orchestra.run.smithi178.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-06-23T18:58:12.455 INFO:teuthology.orchestra.run.smithi178.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-06-23T18:58:12.506 INFO:teuthology.orchestra.run.smithi178.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 532 kB/s | 27 kB 00:00 2023-06-23T18:58:12.556 INFO:teuthology.orchestra.run.smithi178.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-06-23T18:58:12.598 INFO:teuthology.orchestra.run.smithi178.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-06-23T18:58:12.715 INFO:teuthology.orchestra.run.smithi178.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2023-06-23T18:58:12.773 INFO:teuthology.orchestra.run.smithi178.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-06-23T18:58:12.815 INFO:teuthology.orchestra.run.smithi178.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-06-23T18:58:12.874 INFO:teuthology.orchestra.run.smithi178.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-06-23T18:58:12.899 INFO:teuthology.orchestra.run.smithi178.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 766 kB/s | 64 kB 00:00 2023-06-23T18:58:12.925 INFO:teuthology.orchestra.run.smithi178.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-06-23T18:58:12.950 INFO:teuthology.orchestra.run.smithi178.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-06-23T18:58:12.975 INFO:teuthology.orchestra.run.smithi178.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-06-23T18:58:13.017 INFO:teuthology.orchestra.run.smithi178.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-06-23T18:58:13.060 INFO:teuthology.orchestra.run.smithi178.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-06-23T18:58:13.083 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2023-06-23T18:58:13.216 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2023-06-23T18:58:13.217 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2023-06-23T18:58:13.227 INFO:teuthology.orchestra.run.smithi178.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-06-23T18:58:13.269 INFO:teuthology.orchestra.run.smithi178.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-06-23T18:58:13.319 INFO:teuthology.orchestra.run.smithi178.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 7.0 MB/s | 354 kB 00:00 2023-06-23T18:58:13.411 INFO:teuthology.orchestra.run.smithi178.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-06-23T18:58:13.494 INFO:teuthology.orchestra.run.smithi178.stdout:(125/131): postgresql-contrib-10.21-2.module+el 9.5 MB/s | 808 kB 00:00 2023-06-23T18:58:13.562 INFO:teuthology.orchestra.run.smithi178.stdout:(126/131): openblas-0.3.15-3.el8.x86_64.rpm 9.4 MB/s | 4.7 MB 00:00 2023-06-23T18:58:13.628 INFO:teuthology.orchestra.run.smithi178.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-06-23T18:58:13.721 INFO:teuthology.orchestra.run.smithi178.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-06-23T18:58:13.829 INFO:teuthology.orchestra.run.smithi178.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 7.6 MB/s | 798 kB 00:00 2023-06-23T18:58:14.088 INFO:teuthology.orchestra.run.smithi178.stdout:(130/131): librados2-18.0.0-4479.g8627af3e.el8. 7.0 MB/s | 3.7 MB 00:00 2023-06-23T18:58:14.762 INFO:teuthology.orchestra.run.smithi178.stdout:(131/131): librbd1-18.0.0-4479.g8627af3e.el8.x8 3.2 MB/s | 3.6 MB 00:01 2023-06-23T18:58:14.765 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-06-23T18:58:14.766 INFO:teuthology.orchestra.run.smithi178.stdout:Total 1.4 MB/s | 205 MB 02:21 2023-06-23T18:58:15.032 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2023-06-23T18:58:15.037 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2023-06-23T18:58:16.378 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-06-23T18:58:16.510 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-06-23T18:58:16.511 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-06-23T18:58:18.277 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-06-23T18:58:18.281 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-06-23T18:58:19.816 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2023-06-23T18:58:19.991 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-06-23T18:58:20.477 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-06-23T18:58:20.695 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-06-23T18:58:20.875 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-06-23T18:58:21.032 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-06-23T18:58:21.225 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-06-23T18:58:21.704 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-06-23T18:58:21.966 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 6/134 2023-06-23T18:58:22.409 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 6/134 2023-06-23T18:58:22.591 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 7/134 2023-06-23T18:58:22.742 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 7/134 2023-06-23T18:58:22.974 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 8/134 2023-06-23T18:58:23.088 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 8/134 2023-06-23T18:58:23.115 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-06-23T18:58:23.305 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 9/134 2023-06-23T18:58:23.316 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-06-23T18:58:23.518 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-06-23T18:58:23.556 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-06-23T18:58:23.684 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-06-23T18:58:23.763 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-06-23T18:58:23.848 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-06-23T18:58:24.067 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-06-23T18:58:24.221 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-06-23T18:58:24.477 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-06-23T18:58:24.531 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-06-23T18:58:24.657 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 14/134 2023-06-23T18:58:24.784 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 5/134 2023-06-23T18:58:24.786 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 14/134 2023-06-23T18:58:24.965 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 15/134 2023-06-23T18:58:25.085 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 15/134 2023-06-23T18:58:25.246 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 5/134 2023-06-23T18:58:25.290 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-06-23T18:58:25.458 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 6/134 2023-06-23T18:58:25.460 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-06-23T18:58:25.590 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-06-23T18:58:25.612 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 6/134 2023-06-23T18:58:25.825 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 7/134 2023-06-23T18:58:25.948 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 7/134 2023-06-23T18:58:26.148 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 8/134 2023-06-23T18:58:26.283 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-06-23T18:58:26.358 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-06-23T18:58:26.465 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-06-23T18:58:26.616 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-06-23T18:58:26.822 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-06-23T18:58:27.127 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-06-23T18:58:27.304 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-06-23T18:58:27.315 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-06-23T18:58:27.580 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-06-23T18:58:27.767 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 14/134 2023-06-23T18:58:27.890 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 14/134 2023-06-23T18:58:28.075 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 15/134 2023-06-23T18:58:28.139 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-06-23T18:58:28.254 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 15/134 2023-06-23T18:58:28.407 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-06-23T18:58:28.489 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-06-23T18:58:28.624 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-06-23T18:58:28.667 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-06-23T18:58:28.815 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-06-23T18:58:28.854 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-06-23T18:58:28.949 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-06-23T18:58:29.040 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-06-23T18:58:29.100 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-06-23T18:58:29.266 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-06-23T18:58:29.267 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-06-23T18:58:29.518 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-06-23T18:58:29.681 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 26/134 2023-06-23T18:58:29.819 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 27/134 2023-06-23T18:58:29.958 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-06-23T18:58:30.150 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-06-23T18:58:30.823 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-06-23T18:58:30.832 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 28/134 2023-06-23T18:58:31.033 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-06-23T18:58:31.158 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-06-23T18:58:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-06-23T18:58:31.719 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-06-23T18:58:31.863 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-06-23T18:58:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-06-23T18:58:32.132 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-06-23T18:58:32.349 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-06-23T18:58:32.609 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-06-23T18:58:32.765 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 26/134 2023-06-23T18:58:32.896 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 27/134 2023-06-23T18:58:33.191 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 28/134 2023-06-23T18:58:33.374 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-06-23T18:58:34.014 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-06-23T18:58:34.440 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-06-23T18:58:34.652 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-06-23T18:58:34.836 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-06-23T18:58:35.022 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 36/134 2023-06-23T18:58:35.227 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 37/134 2023-06-23T18:58:35.392 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-06-23T18:58:35.425 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-06-23T18:58:35.892 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-06-23T18:58:36.099 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-06-23T18:58:36.253 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-06-23T18:58:36.478 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-06-23T18:58:36.593 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-06-23T18:58:36.713 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-06-23T18:58:36.944 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-06-23T18:58:37.124 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-06-23T18:58:37.196 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-06-23T18:58:37.403 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-06-23T18:58:37.432 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-06-23T18:58:37.611 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-06-23T18:58:37.651 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-06-23T18:58:37.857 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-06-23T18:58:37.871 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-06-23T18:58:38.065 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 36/134 2023-06-23T18:58:38.114 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-06-23T18:58:38.264 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 37/134 2023-06-23T18:58:38.415 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-06-23T18:58:38.446 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-06-23T18:58:38.581 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-06-23T18:58:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-06-23T18:58:38.789 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-06-23T18:58:38.889 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-06-23T18:58:38.907 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-06-23T18:58:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-06-23T18:58:39.139 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-06-23T18:58:39.326 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-06-23T18:58:39.336 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-06-23T18:58:39.484 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-06-23T18:58:39.506 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-06-23T18:58:39.600 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-06-23T18:58:39.817 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-06-23T18:58:39.834 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-06-23T18:58:40.003 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-06-23T18:58:40.097 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-06-23T18:58:40.169 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-06-23T18:58:40.355 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-06-23T18:58:40.358 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-06-23T18:58:40.533 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-06-23T18:58:40.595 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-06-23T18:58:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-06-23T18:58:40.754 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-06-23T18:58:40.938 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-06-23T18:58:40.955 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-06-23T18:58:41.145 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-06-23T18:58:41.240 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-06-23T18:58:41.411 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-06-23T18:58:41.481 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-06-23T18:58:41.683 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-06-23T18:58:41.826 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-06-23T18:58:41.854 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-06-23T18:58:41.956 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-06-23T18:58:42.154 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-06-23T18:58:42.204 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-06-23T18:58:42.395 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-06-23T18:58:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-06-23T18:58:42.621 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-06-23T18:58:42.657 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-06-23T18:58:42.835 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-06-23T18:58:42.882 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-06-23T18:58:43.095 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-06-23T18:58:43.215 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-06-23T18:58:43.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-06-23T18:58:43.441 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-06-23T18:58:43.456 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-06-23T18:58:43.574 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-06-23T18:58:43.669 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-06-23T18:58:43.775 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-06-23T18:58:43.899 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-06-23T18:58:43.976 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-06-23T18:58:44.089 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-06-23T18:58:44.175 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-06-23T18:58:44.253 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-06-23T18:58:44.331 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-06-23T18:58:44.476 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-06-23T18:58:44.591 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-06-23T18:58:44.700 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-06-23T18:58:44.891 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-06-23T18:58:44.899 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-06-23T18:58:45.076 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-06-23T18:58:45.171 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-06-23T18:58:45.378 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-06-23T18:58:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-06-23T18:58:45.590 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-06-23T18:58:45.603 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-06-23T18:58:45.795 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-06-23T18:58:45.812 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-06-23T18:58:46.008 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-06-23T18:58:46.086 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-06-23T18:58:46.338 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-06-23T18:58:46.493 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-06-23T18:58:46.642 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-06-23T18:58:46.859 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-06-23T18:58:47.086 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-06-23T18:58:47.276 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-06-23T18:58:47.365 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-06-23T18:58:47.441 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-06-23T18:58:47.586 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-06-23T18:58:47.647 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-06-23T18:58:47.849 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-06-23T18:58:47.865 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-06-23T18:58:48.076 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-06-23T18:58:48.182 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-06-23T18:58:48.261 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-06-23T18:58:48.453 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-06-23T18:58:48.540 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-06-23T18:58:48.652 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-06-23T18:58:48.813 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-06-23T18:58:48.996 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-06-23T18:58:49.234 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-06-23T18:58:49.499 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-06-23T18:58:49.701 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 92/134 2023-06-23T18:58:49.804 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 92/134 2023-06-23T18:58:50.019 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 93/134 2023-06-23T18:58:50.520 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-06-23T18:58:50.806 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-06-23T18:58:51.075 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-06-23T18:58:51.417 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-06-23T18:58:51.691 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-06-23T18:58:51.881 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-06-23T18:58:52.727 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-06-23T18:58:52.912 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 92/134 2023-06-23T18:58:53.013 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 92/134 2023-06-23T18:58:53.196 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 93/134 2023-06-23T18:58:54.775 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 94/134 2023-06-23T18:58:55.018 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 94/134 2023-06-23T18:58:55.714 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 94/134 2023-06-23T18:58:55.987 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 95/134 2023-06-23T18:58:56.119 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 95/134 2023-06-23T18:58:56.225 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 96/134 2023-06-23T18:58:57.981 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 94/134 2023-06-23T18:58:58.229 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 94/134 2023-06-23T18:58:58.941 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 94/134 2023-06-23T18:58:59.237 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 95/134 2023-06-23T18:58:59.373 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 95/134 2023-06-23T18:58:59.477 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 96/134 2023-06-23T18:59:16.559 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 96/134 2023-06-23T18:59:16.559 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2023-06-23T18:59:16.559 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2023-06-23T18:59:16.560 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2023-06-23T18:59:16.560 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /run 2023-06-23T18:59:16.560 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2023-06-23T18:59:16.560 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2023-06-23T18:59:16.560 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2023-06-23T18:59:16.560 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2023-06-23T18:59:16.560 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2023-06-23T18:59:16.561 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:16.921 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 97/134 2023-06-23T18:59:18.631 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 97/134 2023-06-23T18:59:18.832 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 98/134 2023-06-23T18:59:19.105 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 98/134 2023-06-23T18:59:19.262 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 99/134 2023-06-23T18:59:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 96/134 2023-06-23T18:59:19.678 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2023-06-23T18:59:19.678 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2023-06-23T18:59:19.678 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /dev 2023-06-23T18:59:19.678 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /run 2023-06-23T18:59:19.678 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2023-06-23T18:59:19.678 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2023-06-23T18:59:19.678 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2023-06-23T18:59:19.679 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2023-06-23T18:59:19.679 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /dev 2023-06-23T18:59:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:19.794 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 99/134 2023-06-23T18:59:20.003 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 100/134 2023-06-23T18:59:20.044 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 100/134 2023-06-23T18:59:20.057 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 97/134 2023-06-23T18:59:21.767 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 97/134 2023-06-23T18:59:21.958 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 98/134 2023-06-23T18:59:22.231 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 98/134 2023-06-23T18:59:22.374 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 99/134 2023-06-23T18:59:22.713 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 101/134 2023-06-23T18:59:22.896 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 101/134 2023-06-23T18:59:22.920 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 99/134 2023-06-23T18:59:23.058 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 102/134 2023-06-23T18:59:23.107 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 100/134 2023-06-23T18:59:23.148 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 100/134 2023-06-23T18:59:23.274 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 103/134 2023-06-23T18:59:23.444 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 104/134 2023-06-23T18:59:23.728 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 104/134 2023-06-23T18:59:23.914 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 105/134 2023-06-23T18:59:25.023 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 105/134 2023-06-23T18:59:25.185 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 106/134 2023-06-23T18:59:25.313 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 106/134 2023-06-23T18:59:25.705 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 107/134 2023-06-23T18:59:25.766 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 101/134 2023-06-23T18:59:25.897 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 108/134 2023-06-23T18:59:25.952 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 101/134 2023-06-23T18:59:25.961 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 108/134 2023-06-23T18:59:26.105 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 102/134 2023-06-23T18:59:26.168 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 109/134 2023-06-23T18:59:26.196 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 109/134 2023-06-23T18:59:26.319 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 103/134 2023-06-23T18:59:26.489 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 104/134 2023-06-23T18:59:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 104/134 2023-06-23T18:59:26.956 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 105/134 2023-06-23T18:59:27.578 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 110/134 2023-06-23T18:59:27.824 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 111/134 2023-06-23T18:59:27.891 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 111/134 2023-06-23T18:59:28.044 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 112/134 2023-06-23T18:59:28.070 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 105/134 2023-06-23T18:59:28.114 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4479.g8627a 112/134 2023-06-23T18:59:28.222 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 106/134 2023-06-23T18:59:28.268 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 113/134 2023-06-23T18:59:28.350 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 106/134 2023-06-23T18:59:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 113/134 2023-06-23T18:59:28.739 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 107/134 2023-06-23T18:59:28.835 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 114/134 2023-06-23T18:59:28.915 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 108/134 2023-06-23T18:59:28.980 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 108/134 2023-06-23T18:59:29.163 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 109/134 2023-06-23T18:59:29.191 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 109/134 2023-06-23T18:59:30.593 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 110/134 2023-06-23T18:59:30.833 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 111/134 2023-06-23T18:59:30.905 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 111/134 2023-06-23T18:59:31.038 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 112/134 2023-06-23T18:59:31.108 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4479.g8627a 112/134 2023-06-23T18:59:31.255 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 113/134 2023-06-23T18:59:31.662 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 113/134 2023-06-23T18:59:31.805 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 114/134 2023-06-23T18:59:33.836 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 114/134 2023-06-23T18:59:34.175 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 115/134 2023-06-23T18:59:34.358 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-06-23T18:59:34.609 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-06-23T18:59:35.864 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-06-23T18:59:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-06-23T18:59:36.426 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 119/134 2023-06-23T18:59:36.621 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-06-23T18:59:36.763 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 114/134 2023-06-23T18:59:36.805 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 121/134 2023-06-23T18:59:36.943 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-23T18:59:37.993 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 115/134 2023-06-23T18:59:38.340 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-06-23T18:59:38.554 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 117/134 2023-06-23T18:59:38.842 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-06-23T18:59:39.020 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-06-23T18:59:39.270 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-06-23T18:59:39.517 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-06-23T18:59:39.709 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 121/134 2023-06-23T18:59:39.871 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-23T18:59:40.217 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-23T18:59:40.474 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-23T18:59:40.512 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-23T18:59:40.721 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 124/134 2023-06-23T18:59:40.916 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 125/134 2023-06-23T18:59:41.237 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 126/134 2023-06-23T18:59:41.501 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-06-23T18:59:41.665 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-23T18:59:41.687 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-23T18:59:41.874 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-06-23T18:59:42.098 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-06-23T18:59:42.205 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-06-23T18:59:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-06-23T18:59:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-06-23T18:59:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-23T18:59:42.679 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-23T18:59:42.680 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-23T18:59:42.955 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-23T18:59:43.110 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-23T18:59:43.148 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-23T18:59:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-23T18:59:43.402 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-06-23T18:59:43.403 INFO:teuthology.orchestra.run.smithi136.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-06-23T18:59:43.403 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:43.416 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-23T18:59:43.688 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 124/134 2023-06-23T18:59:43.714 INFO:teuthology.orchestra.run.smithi136.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-06-23T18:59:43.714 INFO:teuthology.orchestra.run.smithi136.stdout:All rules containing unresolvable specifiers will be skipped. 2023-06-23T18:59:43.714 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:43.937 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 125/134 2023-06-23T18:59:44.010 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 1/134 2023-06-23T18:59:44.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2/134 2023-06-23T18:59:44.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 3/134 2023-06-23T18:59:44.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 4/134 2023-06-23T18:59:44.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 5/134 2023-06-23T18:59:44.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 6/134 2023-06-23T18:59:44.012 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 7/134 2023-06-23T18:59:44.012 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 8/134 2023-06-23T18:59:44.012 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 9/134 2023-06-23T18:59:44.012 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 10/134 2023-06-23T18:59:44.012 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 11/134 2023-06-23T18:59:44.012 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 12/134 2023-06-23T18:59:44.012 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 13/134 2023-06-23T18:59:44.013 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 14/134 2023-06-23T18:59:44.013 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 15/134 2023-06-23T18:59:44.013 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 16/134 2023-06-23T18:59:44.013 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 17/134 2023-06-23T18:59:44.013 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/134 2023-06-23T18:59:44.013 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 19/134 2023-06-23T18:59:44.013 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 20/134 2023-06-23T18:59:44.013 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 21/134 2023-06-23T18:59:44.014 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 22/134 2023-06-23T18:59:44.014 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 23/134 2023-06-23T18:59:44.014 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 24/134 2023-06-23T18:59:44.014 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 25/134 2023-06-23T18:59:44.014 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 26/134 2023-06-23T18:59:44.014 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 27/134 2023-06-23T18:59:44.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 28/134 2023-06-23T18:59:44.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 29/134 2023-06-23T18:59:44.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 30/134 2023-06-23T18:59:44.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 31/134 2023-06-23T18:59:44.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 32/134 2023-06-23T18:59:44.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 33/134 2023-06-23T18:59:44.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 34/134 2023-06-23T18:59:44.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 35/134 2023-06-23T18:59:44.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 36/134 2023-06-23T18:59:44.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 37/134 2023-06-23T18:59:44.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 38/134 2023-06-23T18:59:44.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-06-23T18:59:44.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-06-23T18:59:44.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-06-23T18:59:44.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-06-23T18:59:44.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-06-23T18:59:44.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-06-23T18:59:44.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-06-23T18:59:44.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-06-23T18:59:44.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-06-23T18:59:44.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-06-23T18:59:44.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-06-23T18:59:44.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-06-23T18:59:44.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-06-23T18:59:44.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-06-23T18:59:44.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-06-23T18:59:44.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-06-23T18:59:44.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-06-23T18:59:44.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-06-23T18:59:44.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-06-23T18:59:44.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-06-23T18:59:44.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-06-23T18:59:44.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-06-23T18:59:44.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-06-23T18:59:44.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-06-23T18:59:44.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-06-23T18:59:44.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-06-23T18:59:44.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-06-23T18:59:44.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-06-23T18:59:44.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-06-23T18:59:44.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-06-23T18:59:44.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-06-23T18:59:44.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-06-23T18:59:44.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-06-23T18:59:44.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-06-23T18:59:44.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-06-23T18:59:44.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-06-23T18:59:44.028 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-06-23T18:59:44.028 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-06-23T18:59:44.028 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-06-23T18:59:44.028 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-06-23T18:59:44.028 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-06-23T18:59:44.028 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-06-23T18:59:44.028 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-06-23T18:59:44.028 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-06-23T18:59:44.029 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-06-23T18:59:44.029 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-06-23T18:59:44.029 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-06-23T18:59:44.029 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-06-23T18:59:44.029 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-06-23T18:59:44.029 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-06-23T18:59:44.029 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-06-23T18:59:44.030 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-06-23T18:59:44.030 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-06-23T18:59:44.030 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-06-23T18:59:44.030 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-06-23T18:59:44.030 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-06-23T18:59:44.030 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-06-23T18:59:44.030 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-06-23T18:59:44.030 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-06-23T18:59:44.031 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-06-23T18:59:44.031 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-06-23T18:59:44.031 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-06-23T18:59:44.031 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-06-23T18:59:44.031 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-06-23T18:59:44.031 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-06-23T18:59:44.031 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-06-23T18:59:44.031 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-06-23T18:59:44.032 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-06-23T18:59:44.032 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-06-23T18:59:44.032 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-06-23T18:59:44.032 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-06-23T18:59:44.032 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-06-23T18:59:44.032 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-06-23T18:59:44.032 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-06-23T18:59:44.032 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-06-23T18:59:44.033 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-06-23T18:59:44.033 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-06-23T18:59:44.033 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-06-23T18:59:44.033 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-06-23T18:59:44.033 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-06-23T18:59:44.033 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-06-23T18:59:44.033 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-06-23T18:59:44.033 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-06-23T18:59:44.034 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-23T18:59:44.034 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-06-23T18:59:44.034 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-06-23T18:59:44.034 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-06-23T18:59:44.034 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-06-23T18:59:44.034 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-06-23T18:59:44.034 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-23T18:59:44.034 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 129/134 2023-06-23T18:59:44.035 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-06-23T18:59:44.035 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 131/134 2023-06-23T18:59:44.035 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-23T18:59:44.035 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-06-23T18:59:44.250 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 126/134 2023-06-23T18:59:44.625 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-06-23T18:59:44.802 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-06-23T18:59:44.908 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-06-23T18:59:45.119 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-06-23T18:59:45.146 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-06-23T18:59:45.344 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-06-23T18:59:45.365 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-06-23T18:59:45.564 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-06-23T18:59:45.564 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-23T18:59:45.784 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-23T18:59:45.784 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-23T18:59:46.042 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-23T18:59:46.235 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-23T18:59:46.491 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-06-23T18:59:46.491 INFO:teuthology.orchestra.run.smithi178.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-06-23T18:59:46.491 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:46.793 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-23T18:59:46.794 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:58 ago on Fri 23 Jun 2023 06:57:48 PM UTC. 2023-06-23T18:59:46.818 INFO:teuthology.orchestra.run.smithi178.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-06-23T18:59:46.818 INFO:teuthology.orchestra.run.smithi178.stdout:All rules containing unresolvable specifiers will be skipped. 2023-06-23T18:59:46.818 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:47.124 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 1/134 2023-06-23T18:59:47.124 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2/134 2023-06-23T18:59:47.125 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 3/134 2023-06-23T18:59:47.125 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 4/134 2023-06-23T18:59:47.125 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 5/134 2023-06-23T18:59:47.125 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 6/134 2023-06-23T18:59:47.125 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 7/134 2023-06-23T18:59:47.125 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 8/134 2023-06-23T18:59:47.125 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 9/134 2023-06-23T18:59:47.126 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 10/134 2023-06-23T18:59:47.126 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 11/134 2023-06-23T18:59:47.126 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 12/134 2023-06-23T18:59:47.126 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 13/134 2023-06-23T18:59:47.126 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 14/134 2023-06-23T18:59:47.126 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 15/134 2023-06-23T18:59:47.126 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 16/134 2023-06-23T18:59:47.126 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 17/134 2023-06-23T18:59:47.127 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/134 2023-06-23T18:59:47.127 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 19/134 2023-06-23T18:59:47.127 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 20/134 2023-06-23T18:59:47.127 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 21/134 2023-06-23T18:59:47.127 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 22/134 2023-06-23T18:59:47.127 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 23/134 2023-06-23T18:59:47.127 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 24/134 2023-06-23T18:59:47.128 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 25/134 2023-06-23T18:59:47.134 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 26/134 2023-06-23T18:59:47.135 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 27/134 2023-06-23T18:59:47.135 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 28/134 2023-06-23T18:59:47.135 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 29/134 2023-06-23T18:59:47.135 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 30/134 2023-06-23T18:59:47.135 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 31/134 2023-06-23T18:59:47.135 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 32/134 2023-06-23T18:59:47.135 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 33/134 2023-06-23T18:59:47.136 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 34/134 2023-06-23T18:59:47.136 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 35/134 2023-06-23T18:59:47.136 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 36/134 2023-06-23T18:59:47.136 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 37/134 2023-06-23T18:59:47.136 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 38/134 2023-06-23T18:59:47.136 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-06-23T18:59:47.136 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-06-23T18:59:47.137 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-06-23T18:59:47.137 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-06-23T18:59:47.137 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-06-23T18:59:47.137 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-06-23T18:59:47.137 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-06-23T18:59:47.137 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-06-23T18:59:47.137 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-06-23T18:59:47.137 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-06-23T18:59:47.138 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-06-23T18:59:47.138 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-06-23T18:59:47.138 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-06-23T18:59:47.138 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-06-23T18:59:47.138 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-06-23T18:59:47.138 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-06-23T18:59:47.138 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-06-23T18:59:47.139 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-06-23T18:59:47.139 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-06-23T18:59:47.139 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-06-23T18:59:47.139 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-06-23T18:59:47.139 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-06-23T18:59:47.139 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-06-23T18:59:47.139 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-06-23T18:59:47.140 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-06-23T18:59:47.140 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-06-23T18:59:47.140 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-06-23T18:59:47.140 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-06-23T18:59:47.141 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-06-23T18:59:47.141 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-06-23T18:59:47.141 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-06-23T18:59:47.141 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-06-23T18:59:47.141 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-06-23T18:59:47.141 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-06-23T18:59:47.141 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-06-23T18:59:47.141 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-06-23T18:59:47.142 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-06-23T18:59:47.142 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-06-23T18:59:47.142 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-06-23T18:59:47.142 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-06-23T18:59:47.142 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-06-23T18:59:47.142 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-06-23T18:59:47.142 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-06-23T18:59:47.143 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-06-23T18:59:47.143 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-06-23T18:59:47.143 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-06-23T18:59:47.143 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-06-23T18:59:47.143 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-06-23T18:59:47.143 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-06-23T18:59:47.143 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-06-23T18:59:47.143 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-06-23T18:59:47.144 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-06-23T18:59:47.144 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-06-23T18:59:47.144 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-06-23T18:59:47.144 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-06-23T18:59:47.144 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-06-23T18:59:47.144 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-06-23T18:59:47.144 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-06-23T18:59:47.144 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-06-23T18:59:47.145 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-06-23T18:59:47.145 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-06-23T18:59:47.145 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-06-23T18:59:47.145 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-06-23T18:59:47.146 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-06-23T18:59:47.146 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-06-23T18:59:47.146 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-06-23T18:59:47.147 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-06-23T18:59:47.147 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-06-23T18:59:47.147 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-06-23T18:59:47.147 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-06-23T18:59:47.148 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-06-23T18:59:47.148 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-06-23T18:59:47.148 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-06-23T18:59:47.149 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-06-23T18:59:47.149 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-06-23T18:59:47.149 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-06-23T18:59:47.149 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-06-23T18:59:47.149 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-06-23T18:59:47.150 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-06-23T18:59:47.150 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-06-23T18:59:47.150 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-06-23T18:59:47.150 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-06-23T18:59:47.150 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-06-23T18:59:47.150 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-06-23T18:59:47.150 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-06-23T18:59:47.150 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-06-23T18:59:47.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-06-23T18:59:47.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-06-23T18:59:47.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-06-23T18:59:47.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-06-23T18:59:47.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 129/134 2023-06-23T18:59:47.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-06-23T18:59:47.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 131/134 2023-06-23T18:59:47.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-23T18:59:47.152 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-06-23T18:59:49.445 INFO:teuthology.orchestra.run.smithi136.stdout:Installed products updated. 2023-06-23T18:59:49.689 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:49.689 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2023-06-23T18:59:49.689 INFO:teuthology.orchestra.run.smithi136.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-06-23T18:59:49.689 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.689 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.690 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2023-06-23T18:59:49.690 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-06-23T18:59:49.690 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.1-7.el8.noarch 2023-06-23T18:59:49.690 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.0.4-10.el8.x86_64 2023-06-23T18:59:49.690 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.690 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.690 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.690 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.691 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.691 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.691 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.691 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.691 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.691 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.691 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.691 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.692 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.692 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.692 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.692 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.692 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.692 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.692 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.693 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.693 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.693 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.693 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:49.693 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-06-23T18:59:49.693 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.1-9.el8.x86_64 2023-06-23T18:59:49.693 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.7-15.el8.x86_64 2023-06-23T18:59:49.693 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-23T18:59:49.694 INFO:teuthology.orchestra.run.smithi136.stdout: jq-1.6-3.el8.x86_64 2023-06-23T18:59:49.694 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-23T18:59:49.694 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-06-23T18:59:49.694 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-23T18:59:49.694 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.694 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.694 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.695 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-06-23T18:59:49.695 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-06-23T18:59:49.695 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-23T18:59:49.695 INFO:teuthology.orchestra.run.smithi136.stdout: libpq-13.5-1.el8.x86_64 2023-06-23T18:59:49.695 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-06-23T18:59:49.695 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-23T18:59:49.695 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.695 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.696 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-23T18:59:49.696 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.696 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-06-23T18:59:49.696 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-23T18:59:49.696 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-23T18:59:49.696 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-23T18:59:49.696 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-06-23T18:59:49.697 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-06-23T18:59:49.697 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-23T18:59:49.697 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-23T18:59:49.697 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.15-3.el8.x86_64 2023-06-23T18:59:49.697 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-06-23T18:59:49.697 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-06-23T18:59:49.698 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-06-23T18:59:49.698 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-06-23T18:59:49.698 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-06-23T18:59:49.698 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-23T18:59:49.698 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-23T18:59:49.698 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-23T18:59:49.698 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-23T18:59:49.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-23T18:59:49.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-23T18:59:49.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-23T18:59:49.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-23T18:59:49.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.700 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-23T18:59:49.700 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-23T18:59:49.700 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-23T18:59:49.700 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-23T18:59:49.700 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-23T18:59:49.700 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-23T18:59:49.701 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-23T18:59:49.701 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-23T18:59:49.701 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-23T18:59:49.701 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-23T18:59:49.701 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-23T18:59:49.701 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-23T18:59:49.701 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-23T18:59:49.701 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-23T18:59:49.702 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.0.6-13.el8.noarch 2023-06-23T18:59:49.702 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-23T18:59:49.702 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-23T18:59:49.702 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-23T18:59:49.702 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-23T18:59:49.702 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-23T18:59:49.702 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-23T18:59:49.702 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-23T18:59:49.703 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-2.6-1.el8.noarch 2023-06-23T18:59:49.703 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-23T18:59:49.703 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-23T18:59:49.703 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-23T18:59:49.703 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-23T18:59:49.703 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-23T18:59:49.703 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-23T18:59:49.703 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.704 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.704 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-23T18:59:49.704 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-23T18:59:49.704 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.704 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-23T18:59:49.704 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-23T18:59:49.704 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-06-23T18:59:49.705 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-23T18:59:49.705 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-23T18:59:49.705 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-23T18:59:49.705 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-23T18:59:49.705 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-23T18:59:49.705 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-23T18:59:49.705 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-23T18:59:49.705 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-23T18:59:49.706 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-23T18:59:49.706 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-23T18:59:49.706 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.706 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.706 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:49.706 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-23T18:59:49.706 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-23T18:59:49.706 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-23T18:59:49.707 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-06-23T18:59:49.707 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-23T18:59:49.707 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-06-23T18:59:49.707 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:49.707 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2023-06-23T18:59:49.829 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-23T18:59:49.829 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:04:09 ago on Fri 23 Jun 2023 06:55:40 PM UTC. 2023-06-23T18:59:50.764 DEBUG:teuthology.parallel:result is None 2023-06-23T18:59:52.554 INFO:teuthology.orchestra.run.smithi178.stdout:Installed products updated. 2023-06-23T18:59:52.808 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:52.808 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2023-06-23T18:59:52.808 INFO:teuthology.orchestra.run.smithi178.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-06-23T18:59:52.808 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.808 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.808 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-06-23T18:59:52.809 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-06-23T18:59:52.809 INFO:teuthology.orchestra.run.smithi178.stdout: automake-1.16.1-7.el8.noarch 2023-06-23T18:59:52.809 INFO:teuthology.orchestra.run.smithi178.stdout: bison-3.0.4-10.el8.x86_64 2023-06-23T18:59:52.809 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.809 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.809 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.809 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.810 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.810 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.810 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.810 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.810 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.810 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.810 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.810 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.811 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.811 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.811 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.811 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.811 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.811 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.811 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.811 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.812 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.812 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.812 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:59:52.812 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-06-23T18:59:52.812 INFO:teuthology.orchestra.run.smithi178.stdout: flex-2.6.1-9.el8.x86_64 2023-06-23T18:59:52.812 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-2.9.7-15.el8.x86_64 2023-06-23T18:59:52.812 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-23T18:59:52.813 INFO:teuthology.orchestra.run.smithi178.stdout: jq-1.6-3.el8.x86_64 2023-06-23T18:59:52.813 INFO:teuthology.orchestra.run.smithi178.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-23T18:59:52.813 INFO:teuthology.orchestra.run.smithi178.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-06-23T18:59:52.813 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-23T18:59:52.813 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.813 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.813 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.813 INFO:teuthology.orchestra.run.smithi178.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-06-23T18:59:52.814 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-06-23T18:59:52.814 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-23T18:59:52.814 INFO:teuthology.orchestra.run.smithi178.stdout: libpq-13.5-1.el8.x86_64 2023-06-23T18:59:52.814 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-06-23T18:59:52.814 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-23T18:59:52.814 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.814 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.815 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-23T18:59:52.815 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.815 INFO:teuthology.orchestra.run.smithi178.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-06-23T18:59:52.815 INFO:teuthology.orchestra.run.smithi178.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-23T18:59:52.815 INFO:teuthology.orchestra.run.smithi178.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-23T18:59:52.815 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-23T18:59:52.815 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-06-23T18:59:52.815 INFO:teuthology.orchestra.run.smithi178.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-06-23T18:59:52.816 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-23T18:59:52.816 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-23T18:59:52.816 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.15-3.el8.x86_64 2023-06-23T18:59:52.816 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-06-23T18:59:52.816 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-06-23T18:59:52.816 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-06-23T18:59:52.816 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-06-23T18:59:52.816 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-06-23T18:59:52.817 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-23T18:59:52.817 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-23T18:59:52.817 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-23T18:59:52.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-23T18:59:52.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-23T18:59:52.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-23T18:59:52.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-23T18:59:52.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-23T18:59:52.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-23T18:59:52.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-23T18:59:52.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-23T18:59:52.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-23T18:59:52.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-23T18:59:52.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-23T18:59:52.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-23T18:59:52.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-23T18:59:52.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-23T18:59:52.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-23T18:59:52.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-23T18:59:52.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-23T18:59:52.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-23T18:59:52.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-23T18:59:52.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.0.6-13.el8.noarch 2023-06-23T18:59:52.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-23T18:59:52.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-23T18:59:52.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-23T18:59:52.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-23T18:59:52.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-23T18:59:52.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-23T18:59:52.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-23T18:59:52.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-2.6-1.el8.noarch 2023-06-23T18:59:52.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-23T18:59:52.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-23T18:59:52.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-23T18:59:52.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-23T18:59:52.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-23T18:59:52.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-23T18:59:52.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-23T18:59:52.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-23T18:59:52.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-23T18:59:52.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-23T18:59:52.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-06-23T18:59:52.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-23T18:59:52.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-23T18:59:52.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-23T18:59:52.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-23T18:59:52.824 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-23T18:59:52.824 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-23T18:59:52.824 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-23T18:59:52.824 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-23T18:59:52.824 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-23T18:59:52.824 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-23T18:59:52.824 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.824 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.825 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:59:52.825 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-23T18:59:52.825 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-23T18:59:52.825 INFO:teuthology.orchestra.run.smithi178.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-23T18:59:52.825 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-06-23T18:59:52.825 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-23T18:59:52.826 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-06-23T18:59:52.826 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:52.826 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-06-23T18:59:53.144 DEBUG:teuthology.parallel:result is None 2023-06-23T18:59:53.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:59:53.380 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-23T18:59:53.433 INFO:teuthology.orchestra.run.smithi136.stdout:18.0.0-4479.g8627af3e.el8 2023-06-23T18:59:53.434 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479.g8627af3e.el8 2023-06-23T18:59:53.434 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479.g8627af3e is installed. 2023-06-23T18:59:53.435 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:59:53.667 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-23T18:59:53.727 INFO:teuthology.orchestra.run.smithi178.stdout:18.0.0-4479.g8627af3e.el8 2023-06-23T18:59:53.728 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479.g8627af3e.el8 2023-06-23T18:59:53.728 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479.g8627af3e is installed. 2023-06-23T18:59:53.729 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-23T18:59:53.730 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:53.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:59:53.820 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:59:53.821 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:59:53.917 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-23T18:59:53.917 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:53.918 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:59:53.985 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:59:54.094 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:59:54.095 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:59:54.162 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:59:54.268 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-23T18:59:54.268 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:54.269 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:59:54.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:59:54.448 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:59:54.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:59:54.515 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:59:54.625 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-23T18:59:54.625 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:54.626 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:59:54.694 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:59:54.802 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:59:54.803 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:59:54.871 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:59:54.982 INFO:teuthology.run_tasks:Running task ceph... 2023-06-23T18:59:55.058 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-23T18:59:55.059 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2023-06-23T18:59:55.063 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2023-06-23T18:59:55.134 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-23T18:59:55.134 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:59:55.139 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:59:55.206 INFO:tasks.ceph:Creating extra log directories... 2023-06-23T18:59:55.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:59:55.211 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:59:55.290 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-23T18:59:55.290 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-23T18:59:55.291 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-23T18:59:55.291 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:55.291 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:59:55.333 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:59:55.544 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-23T18:59:55.613 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:59:55.613 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:59:55.656 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:59:55.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-23T18:59:55.952 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-23T18:59:55.952 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-23T18:59:55.952 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313897', 'branch': 'wip-rishabh-improvements-authmon', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7313897', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-improvements-authmon'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-improvements-authmon', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-improvements-authmon', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi136.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi178.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '076bbebc42a14f7d568aaa78eabb0038327bcb23', 'timestamp': '2023-06-23_17:37:30', 'tube': 'smithi', 'user': 'rishabh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-23T18:59:55.953 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:59:55.958 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:59:56.002 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:59:56.041 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:59:56.111 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:56.112 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T18:59:56.153 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T18:59:56.154 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2023-06-23T18:59:56.238 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T18:59:56.238 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:59:56.238 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-06-23T18:59:56.238 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:59:56.239 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:59:56.239 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-06-23 18:59:43.528323890 +0000 2023-06-23T18:59:56.239 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-06-23 18:54:40.053325523 +0000 2023-06-23T18:59:56.239 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-06-23 18:54:40.053325523 +0000 2023-06-23T18:59:56.239 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2023-06-23 18:54:40.024326166 +0000 2023-06-23T18:59:56.239 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T18:59:56.344 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-06-23T18:59:56.345 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-06-23T18:59:56.345 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000335749 s, 1.5 MB/s 2023-06-23T18:59:56.347 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T18:59:56.391 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2023-06-23T18:59:56.475 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T18:59:56.475 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:59:56.475 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-06-23T18:59:56.475 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:59:56.476 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:59:56.476 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-06-23 18:59:43.528323890 +0000 2023-06-23T18:59:56.476 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-06-23 18:54:40.886307025 +0000 2023-06-23T18:59:56.476 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-06-23 18:54:40.886307025 +0000 2023-06-23T18:59:56.476 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2023-06-23 18:54:40.858307647 +0000 2023-06-23T18:59:56.476 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T18:59:56.582 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-06-23T18:59:56.582 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-06-23T18:59:56.582 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000282418 s, 1.8 MB/s 2023-06-23T18:59:56.585 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T18:59:56.631 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2023-06-23T18:59:56.675 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T18:59:56.675 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:59:56.675 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-06-23T18:59:56.675 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:59:56.675 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:59:56.676 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-06-23 18:59:43.529323867 +0000 2023-06-23T18:59:56.676 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-06-23 18:54:41.714288638 +0000 2023-06-23T18:59:56.676 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-06-23 18:54:41.714288638 +0000 2023-06-23T18:59:56.676 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2023-06-23 18:54:41.687289238 +0000 2023-06-23T18:59:56.676 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T18:59:56.783 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-06-23T18:59:56.783 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-06-23T18:59:56.784 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000304324 s, 1.7 MB/s 2023-06-23T18:59:56.786 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T18:59:56.833 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2023-06-23T18:59:56.916 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T18:59:56.916 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:59:56.917 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-06-23T18:59:56.917 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:59:56.917 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:59:56.917 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-06-23 18:59:43.529323867 +0000 2023-06-23T18:59:56.917 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-06-23 18:54:42.537270363 +0000 2023-06-23T18:59:56.917 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-06-23 18:54:42.537270363 +0000 2023-06-23T18:59:56.917 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2023-06-23 18:54:42.512270918 +0000 2023-06-23T18:59:56.918 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T18:59:57.022 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-06-23T18:59:57.022 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-06-23T18:59:57.022 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000305236 s, 1.7 MB/s 2023-06-23T18:59:57.024 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T18:59:57.069 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:59:57.070 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:59:57.070 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T18:59:57.112 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T18:59:57.113 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2023-06-23T18:59:57.198 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T18:59:57.198 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:59:57.198 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-06-23T18:59:57.198 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:59:57.198 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:59:57.198 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-06-23 18:59:46.623192720 +0000 2023-06-23T18:59:57.199 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-06-23 18:54:33.928318883 +0000 2023-06-23T18:59:57.199 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-06-23 18:54:33.928318883 +0000 2023-06-23T18:59:57.199 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2023-06-23 18:54:33.905319262 +0000 2023-06-23T18:59:57.199 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T18:59:57.306 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-06-23T18:59:57.306 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-06-23T18:59:57.306 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000218997 s, 2.3 MB/s 2023-06-23T18:59:57.309 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T18:59:57.354 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2023-06-23T18:59:57.439 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T18:59:57.439 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:59:57.439 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-06-23T18:59:57.440 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:59:57.440 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:59:57.440 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-06-23 18:59:46.623192720 +0000 2023-06-23T18:59:57.440 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-06-23 18:54:34.731305663 +0000 2023-06-23T18:59:57.440 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-06-23 18:54:34.731305663 +0000 2023-06-23T18:59:57.440 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2023-06-23 18:54:34.708306042 +0000 2023-06-23T18:59:57.441 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T18:59:57.546 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-06-23T18:59:57.546 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-06-23T18:59:57.546 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000170915 s, 3.0 MB/s 2023-06-23T18:59:57.549 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T18:59:57.596 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2023-06-23T18:59:57.640 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T18:59:57.640 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:59:57.640 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-06-23T18:59:57.640 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:59:57.641 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:59:57.641 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-06-23 18:59:46.623192720 +0000 2023-06-23T18:59:57.641 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-06-23 18:54:35.552292146 +0000 2023-06-23T18:59:57.641 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-06-23 18:54:35.552292146 +0000 2023-06-23T18:59:57.641 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2023-06-23 18:54:35.530292509 +0000 2023-06-23T18:59:57.641 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T18:59:57.744 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-06-23T18:59:57.744 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-06-23T18:59:57.745 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000168314 s, 3.0 MB/s 2023-06-23T18:59:57.747 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T18:59:57.791 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2023-06-23T18:59:57.877 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T18:59:57.878 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:59:57.878 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-06-23T18:59:57.878 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:59:57.878 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:59:57.878 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-06-23 18:59:46.624192703 +0000 2023-06-23T18:59:57.878 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-06-23 18:54:36.405278103 +0000 2023-06-23T18:59:57.879 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-06-23 18:54:36.405278103 +0000 2023-06-23T18:59:57.879 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2023-06-23 18:54:36.384278449 +0000 2023-06-23T18:59:57.879 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T18:59:57.984 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-06-23T18:59:57.984 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-06-23T18:59:57.984 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000179096 s, 2.9 MB/s 2023-06-23T18:59:57.986 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T18:59:58.031 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:59:58.031 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T18:59:58.031 INFO:tasks.ceph:Generating config... 2023-06-23T18:59:58.033 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-23T18:59:58.033 INFO:tasks.ceph:[client] debug client = 20 2023-06-23T18:59:58.033 INFO:tasks.ceph:[client] debug ms = 1 2023-06-23T18:59:58.033 INFO:tasks.ceph:[client] pid file = 2023-06-23T18:59:58.034 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-23T18:59:58.034 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-23T18:59:58.034 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-23T18:59:58.034 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-23T18:59:58.034 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-23T18:59:58.035 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-23T18:59:58.035 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-23T18:59:58.035 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-23T18:59:58.035 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-23T18:59:58.035 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-23T18:59:58.036 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-23T18:59:58.036 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-23T18:59:58.036 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-23T18:59:58.036 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-23T18:59:58.036 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-23T18:59:58.036 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-23T18:59:58.037 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-23T18:59:58.037 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-23T18:59:58.037 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-23T18:59:58.037 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-23T18:59:58.037 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-23T18:59:58.038 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-23T18:59:58.038 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-23T18:59:58.038 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-23T18:59:58.038 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-23T18:59:58.038 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-23T18:59:58.039 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-23T18:59:58.039 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-23T18:59:58.039 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-23T18:59:58.039 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-23T18:59:58.039 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-23T18:59:58.039 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-23T18:59:58.040 INFO:tasks.ceph:Setting up mon.a... 2023-06-23T18:59:58.040 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-23T18:59:58.146 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.keyring 2023-06-23T18:59:58.153 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-23T18:59:58.255 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:59:58.323 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.136'), ('mon.b', '172.21.15.178'), ('mon.c', '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]')] 2023-06-23T18:59:58.324 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.136,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-23T18:59:58.325 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:58.325 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T18:59:58.367 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.136 --add b 172.21.15.178 --addv c '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:59:58.496 INFO:teuthology.orchestra.run.smithi136.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:59:58.497 INFO:teuthology.orchestra.run.smithi136.stdout:monmaptool: generated fsid ad363bec-53b9-481a-9d11-1e4839eb0e65 2023-06-23T18:59:58.497 INFO:teuthology.orchestra.run.smithi136.stdout:setting min_mon_release = pacific 2023-06-23T18:59:58.497 INFO:teuthology.orchestra.run.smithi136.stdout:epoch 0 2023-06-23T18:59:58.498 INFO:teuthology.orchestra.run.smithi136.stdout:fsid ad363bec-53b9-481a-9d11-1e4839eb0e65 2023-06-23T18:59:58.498 INFO:teuthology.orchestra.run.smithi136.stdout:last_changed 2023-06-23T18:59:58.494097+0000 2023-06-23T18:59:58.498 INFO:teuthology.orchestra.run.smithi136.stdout:created 2023-06-23T18:59:58.494097+0000 2023-06-23T18:59:58.498 INFO:teuthology.orchestra.run.smithi136.stdout:min_mon_release 16 (pacific) 2023-06-23T18:59:58.499 INFO:teuthology.orchestra.run.smithi136.stdout:election_strategy: 1 2023-06-23T18:59:58.499 INFO:teuthology.orchestra.run.smithi136.stdout:0: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.a 2023-06-23T18:59:58.499 INFO:teuthology.orchestra.run.smithi136.stdout:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2023-06-23T18:59:58.499 INFO:teuthology.orchestra.run.smithi136.stdout:2: [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] mon.c 2023-06-23T18:59:58.500 INFO:teuthology.orchestra.run.smithi136.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-23T18:59:58.501 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T18:59:58.543 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ad363bec-53b9-481a-9d11-1e4839eb0e65... 2023-06-23T18:59:58.545 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:59:58.587 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:59:58.704 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2023-06-23T18:59:58.704 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2023-06-23T18:59:58.704 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:59:58.705 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2023-06-23T18:59:58.705 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.705 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2023-06-23T18:59:58.706 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.706 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2023-06-23T18:59:58.706 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.706 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2023-06-23T18:59:58.707 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2023-06-23T18:59:58.707 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.707 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2023-06-23T18:59:58.707 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2023-06-23T18:59:58.708 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.708 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:59:58.709 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2023-06-23T18:59:58.709 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.709 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:59:58.709 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:59:58.710 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.710 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2023-06-23T18:59:58.710 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.710 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2023-06-23T18:59:58.710 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2023-06-23T18:59:58.710 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:59:58.710 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:59:58.711 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2023-06-23T18:59:58.711 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:59:58.711 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2023-06-23T18:59:58.711 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:59:58.711 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:59:58.711 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2023-06-23T18:59:58.711 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.711 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:59:58.712 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.712 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2023-06-23T18:59:58.712 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.712 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2023-06-23T18:59:58.712 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.712 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2023-06-23T18:59:58.712 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2023-06-23T18:59:58.713 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2023-06-23T18:59:58.713 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.136,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-06-23T18:59:58.713 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on skipped message = False 2023-06-23T18:59:58.713 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = ad363bec-53b9-481a-9d11-1e4839eb0e65 2023-06-23T18:59:58.713 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.713 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2023-06-23T18:59:58.714 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2023-06-23T18:59:58.714 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.714 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2023-06-23T18:59:58.714 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2023-06-23T18:59:58.714 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:59:58.714 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.714 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2023-06-23T18:59:58.715 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2023-06-23T18:59:58.715 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.715 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2023-06-23T18:59:58.715 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2023-06-23T18:59:58.715 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2023-06-23T18:59:58.715 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.715 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2023-06-23T18:59:58.716 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2023-06-23T18:59:58.716 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.716 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:59:58.716 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.716 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2023-06-23T18:59:58.716 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.716 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2023-06-23T18:59:58.717 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.717 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:59:58.717 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2023-06-23T18:59:58.717 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.717 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2023-06-23T18:59:58.717 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2023-06-23T18:59:58.717 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2023-06-23T18:59:58.718 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2023-06-23T18:59:58.718 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2023-06-23T18:59:58.718 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2023-06-23T18:59:58.718 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-06-23T18:59:58.718 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2023-06-23T18:59:58.718 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2023-06-23T18:59:58.718 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:59:58.718 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2023-06-23T18:59:58.719 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:59:58.719 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:59:58.719 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2023-06-23T18:59:58.719 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2023-06-23T18:59:58.719 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.719 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2023-06-23T18:59:58.719 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-06-23T18:59:58.720 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2023-06-23T18:59:58.720 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2023-06-23T18:59:58.720 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2023-06-23T18:59:58.720 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:59:58.720 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:59:58.720 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2023-06-23T18:59:58.720 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.720 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2023-06-23T18:59:58.721 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-06-23T18:59:58.721 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2023-06-23T18:59:58.721 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2023-06-23T18:59:58.721 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2023-06-23T18:59:58.721 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2023-06-23T18:59:58.721 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2023-06-23T18:59:58.721 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:59:58.721 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2023-06-23T18:59:58.722 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2023-06-23T18:59:58.722 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:59:58.722 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.722 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:59:58.722 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:59:58.722 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:59:58.722 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.723 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:59:58.723 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:59:58.723 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:59:58.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.723 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2023-06-23T18:59:58.723 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:59:58.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.724 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:59:58.724 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2023-06-23T18:59:58.724 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T18:59:58.724 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2023-06-23T18:59:58.724 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2023-06-23T18:59:58.724 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2023-06-23T18:59:58.724 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2023-06-23T18:59:58.724 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:59:58.725 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:59:58.725 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2023-06-23T18:59:58.725 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2023-06-23T18:59:58.725 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-06-23T18:59:58.725 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = "" 2023-06-23T18:59:58.725 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2023-06-23T18:59:58.725 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2023-06-23T18:59:58.725 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2023-06-23T18:59:58.726 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2023-06-23T18:59:58.726 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2023-06-23T18:59:58.726 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2023-06-23T18:59:58.726 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2023-06-23T18:59:58.726 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2023-06-23T18:59:58.726 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2023-06-23T18:59:58.726 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2023-06-23T18:59:58.727 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2023-06-23T18:59:58.727 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds balancer = 20 2023-06-23T18:59:58.727 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-06-23T18:59:58.727 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2023-06-23T18:59:58.727 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2023-06-23T18:59:58.727 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2023-06-23T18:59:58.727 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2023-06-23T18:59:58.728 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2023-06-23T18:59:58.728 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2023-06-23T18:59:58.728 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2023-06-23T18:59:58.729 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2023-06-23T18:59:58.729 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2023-06-23T18:59:58.729 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:59:58.729 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2023-06-23T18:59:58.729 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.729 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2023-06-23T18:59:58.730 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.730 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2023-06-23T18:59:58.730 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.730 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2023-06-23T18:59:58.730 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2023-06-23T18:59:58.730 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.731 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2023-06-23T18:59:58.731 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2023-06-23T18:59:58.731 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.731 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:59:58.731 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2023-06-23T18:59:58.731 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.731 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:59:58.732 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:59:58.732 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.732 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2023-06-23T18:59:58.732 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.732 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2023-06-23T18:59:58.732 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2023-06-23T18:59:58.732 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:59:58.732 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:59:58.733 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2023-06-23T18:59:58.733 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:59:58.733 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2023-06-23T18:59:58.733 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:59:58.733 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:59:58.733 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2023-06-23T18:59:58.733 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.734 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:59:58.734 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.734 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2023-06-23T18:59:58.734 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.734 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2023-06-23T18:59:58.734 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.735 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2023-06-23T18:59:58.735 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2023-06-23T18:59:58.735 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2023-06-23T18:59:58.735 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.136,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-06-23T18:59:58.735 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2023-06-23T18:59:58.735 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = ad363bec-53b9-481a-9d11-1e4839eb0e65 2023-06-23T18:59:58.735 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.735 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2023-06-23T18:59:58.736 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2023-06-23T18:59:58.736 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.736 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2023-06-23T18:59:58.736 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2023-06-23T18:59:58.736 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:59:58.736 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.736 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2023-06-23T18:59:58.737 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2023-06-23T18:59:58.737 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.737 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2023-06-23T18:59:58.737 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2023-06-23T18:59:58.737 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2023-06-23T18:59:58.738 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.738 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2023-06-23T18:59:58.738 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2023-06-23T18:59:58.738 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.739 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:59:58.739 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.739 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2023-06-23T18:59:58.739 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.739 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2023-06-23T18:59:58.739 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.739 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:59:58.739 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2023-06-23T18:59:58.740 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.740 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2023-06-23T18:59:58.740 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2023-06-23T18:59:58.740 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2023-06-23T18:59:58.740 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2023-06-23T18:59:58.741 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 20 2023-06-23T18:59:58.741 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 20 2023-06-23T18:59:58.741 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-06-23T18:59:58.741 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2023-06-23T18:59:58.741 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 10 2023-06-23T18:59:58.741 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:59:58.741 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2023-06-23T18:59:58.741 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:59:58.742 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:59:58.742 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2023-06-23T18:59:58.742 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-06-23T18:59:58.742 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.742 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2023-06-23T18:59:58.742 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-06-23T18:59:58.742 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2023-06-23T18:59:58.743 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-06-23T18:59:58.743 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-06-23T18:59:58.743 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:59:58.743 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:59:58.743 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2023-06-23T18:59:58.743 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.743 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2023-06-23T18:59:58.743 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-06-23T18:59:58.744 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-06-23T18:59:58.744 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2023-06-23T18:59:58.744 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-06-23T18:59:58.744 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2023-06-23T18:59:58.744 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2023-06-23T18:59:58.744 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:59:58.745 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2023-06-23T18:59:58.745 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2023-06-23T18:59:58.745 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:59:58.745 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.745 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:59:58.745 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:59:58.745 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:59:58.745 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.746 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:59:58.746 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:59:58.746 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:59:58.746 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.746 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2023-06-23T18:59:58.746 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:59:58.747 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.747 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:59:58.747 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2023-06-23T18:59:58.747 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-23T18:59:58.747 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2023-06-23T18:59:58.747 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2023-06-23T18:59:58.747 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2023-06-23T18:59:58.747 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2023-06-23T18:59:58.748 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:59:58.748 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:59:58.748 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2023-06-23T18:59:58.748 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2023-06-23T18:59:58.748 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-06-23T18:59:58.748 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2023-06-23T18:59:58.748 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-06-23T18:59:58.749 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-06-23T18:59:58.749 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2023-06-23T18:59:58.749 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2023-06-23T18:59:58.749 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2023-06-23T18:59:58.749 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-06-23T18:59:58.749 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-06-23T18:59:58.749 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-06-23T18:59:58.750 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-06-23T18:59:58.750 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2023-06-23T18:59:58.750 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2023-06-23T18:59:58.750 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2023-06-23T18:59:58.750 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-06-23T18:59:58.750 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2023-06-23T18:59:58.750 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2023-06-23T18:59:58.751 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2023-06-23T18:59:58.751 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = True 2023-06-23T18:59:58.751 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-06-23T18:59:58.751 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-06-23T18:59:58.751 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-06-23T18:59:58.753 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-23T18:59:58.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-23T18:59:58.865 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-23T18:59:58.866 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:58.866 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-23T18:59:58.908 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:58.909 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-23T18:59:58.990 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2023-06-23T18:59:58.991 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:58.991 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:59:58.991 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:59:59.130 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T18:59:59.130 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:59:59.214 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2023-06-23T18:59:59.214 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:59:59.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:59:59.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:59:59.308 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T18:59:59.308 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:59:59.388 INFO:tasks.ceph:Setting up mon nodes... 2023-06-23T18:59:59.389 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-23T18:59:59.389 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T18:59:59.513 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T18:59:59.519 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T18:59:59.663 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T18:59:59.670 INFO:tasks.ceph:Setting up mds nodes... 2023-06-23T18:59:59.670 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T18:59:59.795 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T18:59:59.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-23T18:59:59.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-23T18:59:59.992 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-23T18:59:59.997 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-23T19:00:00.074 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T19:00:00.205 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T19:00:00.212 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-23T19:00:00.282 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-23T19:00:00.405 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-23T19:00:00.411 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-23T19:00:00.479 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-23T19:00:00.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-23T19:00:00.576 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-23T19:00:00.613 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-23T19:00:00.710 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-23T19:00:00.743 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-23T19:00:00.845 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-23T19:00:00.880 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-23T19:00:00.975 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-23T19:00:01.008 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-23T19:00:01.009 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T19:00:01.009 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-23T19:00:01.079 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T19:00:01.079 INFO:tasks.ceph:role: osd.0 2023-06-23T19:00:01.080 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2023-06-23T19:00:01.080 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T19:00:01.154 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T19:00:01.155 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T19:00:01.155 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T19:00:01.155 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T19:00:01.155 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T19:00:01.155 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-06-23T19:00:01.155 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T19:00:01.155 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T19:00:01.156 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T19:00:01.156 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T19:00:01.634 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-06-23T19:00:01.639 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-06-23T19:00:01.640 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-23T19:00:01.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-23T19:00:01.883 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-23T19:00:01.948 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T19:00:01.948 INFO:tasks.ceph:role: osd.1 2023-06-23T19:00:01.949 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com 2023-06-23T19:00:01.949 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T19:00:02.021 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T19:00:02.021 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T19:00:02.021 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T19:00:02.022 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T19:00:02.022 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T19:00:02.022 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-06-23T19:00:02.022 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T19:00:02.023 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T19:00:02.023 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T19:00:02.023 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T19:00:02.490 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-06-23T19:00:02.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-06-23T19:00:02.495 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-23T19:00:02.665 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-23T19:00:02.741 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-23T19:00:02.807 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T19:00:02.807 INFO:tasks.ceph:role: osd.2 2023-06-23T19:00:02.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com 2023-06-23T19:00:02.808 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T19:00:02.883 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T19:00:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T19:00:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T19:00:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T19:00:02.884 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T19:00:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-06-23T19:00:02.884 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T19:00:02.884 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T19:00:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T19:00:02.884 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T19:00:03.360 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-06-23T19:00:03.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-06-23T19:00:03.364 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-23T19:00:03.517 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-23T19:00:03.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-23T19:00:03.666 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T19:00:03.666 INFO:tasks.ceph:role: osd.3 2023-06-23T19:00:03.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com 2023-06-23T19:00:03.667 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T19:00:03.744 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T19:00:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T19:00:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T19:00:03.746 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T19:00:03.746 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T19:00:03.746 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-06-23T19:00:03.746 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T19:00:03.747 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T19:00:03.747 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T19:00:03.747 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T19:00:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-06-23T19:00:04.234 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-06-23T19:00:04.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-23T19:00:04.385 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-23T19:00:04.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:04.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:04.584+0000 7f9219227640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-23T19:00:04.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:04.586+0000 7f9219227640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-23T19:00:04.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:04.586+0000 7f9219227640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T19:00:04.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:04.586+0000 7f9219227640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T19:00:04.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:04.586+0000 7f9219227640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T19:00:04.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:04.595+0000 7f9219227640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-23T19:00:07.540 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-23T19:00:07.615 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:07.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:07.717+0000 7f1c11f54640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-23T19:00:07.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:07.718+0000 7f1c11f54640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-23T19:00:07.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:07.718+0000 7f1c11f54640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T19:00:07.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:07.718+0000 7f1c11f54640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T19:00:07.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:07.718+0000 7f1c11f54640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T19:00:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:07.719+0000 7f1c11f54640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-23T19:00:10.650 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-23T19:00:10.718 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:10.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:10.819+0000 7f7f0d517640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-23T19:00:10.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:10.819+0000 7f7f0d517640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-23T19:00:10.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:10.819+0000 7f7f0d517640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T19:00:10.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:10.819+0000 7f7f0d517640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T19:00:10.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:10.819+0000 7f7f0d517640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T19:00:10.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:10.821+0000 7f7f0d517640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-23T19:00:13.758 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-23T19:00:13.825 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:13.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:13.927+0000 7fbd71e71640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-23T19:00:13.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:13.928+0000 7fbd71e71640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-23T19:00:13.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:13.928+0000 7fbd71e71640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T19:00:13.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:13.928+0000 7fbd71e71640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T19:00:13.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:13.928+0000 7fbd71e71640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T19:00:13.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:13.929+0000 7fbd71e71640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-23T19:00:16.897 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-23T19:00:16.965 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-23T19:00:17.035 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T19:00:17.035 INFO:tasks.ceph:role: osd.4 2023-06-23T19:00:17.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2023-06-23T19:00:17.036 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T19:00:17.104 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T19:00:17.104 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T19:00:17.105 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T19:00:17.105 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T19:00:17.105 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T19:00:17.105 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-06-23T19:00:17.105 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T19:00:17.105 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T19:00:17.105 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T19:00:17.106 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T19:00:17.127 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-06-23T19:00:17.131 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-06-23T19:00:17.132 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-23T19:00:17.241 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-23T19:00:17.318 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-23T19:00:17.388 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T19:00:17.388 INFO:tasks.ceph:role: osd.5 2023-06-23T19:00:17.389 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2023-06-23T19:00:17.389 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T19:00:17.458 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T19:00:17.459 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T19:00:17.459 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T19:00:17.459 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T19:00:17.459 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T19:00:17.460 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-06-23T19:00:17.460 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T19:00:17.460 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T19:00:17.461 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T19:00:17.461 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T19:00:17.482 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-06-23T19:00:17.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-06-23T19:00:17.487 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-23T19:00:17.592 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-23T19:00:17.674 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-23T19:00:17.744 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T19:00:17.744 INFO:tasks.ceph:role: osd.6 2023-06-23T19:00:17.744 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2023-06-23T19:00:17.745 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T19:00:17.813 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T19:00:17.814 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T19:00:17.814 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T19:00:17.814 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T19:00:17.814 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T19:00:17.814 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-06-23T19:00:17.815 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T19:00:17.815 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T19:00:17.815 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T19:00:17.815 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T19:00:17.840 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-06-23T19:00:17.844 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-06-23T19:00:17.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-23T19:00:17.951 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-23T19:00:18.028 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-23T19:00:18.096 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T19:00:18.097 INFO:tasks.ceph:role: osd.7 2023-06-23T19:00:18.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com 2023-06-23T19:00:18.097 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T19:00:18.164 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T19:00:18.164 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T19:00:18.164 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T19:00:18.165 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T19:00:18.165 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T19:00:18.165 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-06-23T19:00:18.165 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T19:00:18.165 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T19:00:18.165 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T19:00:18.165 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T19:00:18.188 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-06-23T19:00:18.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-06-23T19:00:18.192 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-23T19:00:18.298 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-23T19:00:18.374 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:18.497 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:18.492+0000 7feb6ec71640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-23T19:00:18.497 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:18.493+0000 7feb6ec71640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-23T19:00:18.497 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:18.493+0000 7feb6ec71640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T19:00:18.497 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:18.493+0000 7feb6ec71640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T19:00:18.498 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:18.493+0000 7feb6ec71640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T19:00:18.498 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:18.494+0000 7feb6ec71640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-23T19:00:21.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-23T19:00:21.516 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:21.621 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:21.617+0000 7f7f75de0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-23T19:00:21.622 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:21.617+0000 7f7f75de0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-23T19:00:21.622 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:21.617+0000 7f7f75de0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T19:00:21.622 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:21.618+0000 7f7f75de0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T19:00:21.622 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:21.618+0000 7f7f75de0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T19:00:21.623 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:21.619+0000 7f7f75de0640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-23T19:00:24.561 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-23T19:00:24.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:24.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:24.732+0000 7f1c17186640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-23T19:00:24.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:24.733+0000 7f1c17186640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-23T19:00:24.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:24.733+0000 7f1c17186640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T19:00:24.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:24.733+0000 7f1c17186640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T19:00:24.738 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:24.733+0000 7f1c17186640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T19:00:24.738 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:24.734+0000 7f1c17186640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-23T19:00:25.955 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:00:25.960 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:00:27.681 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-23T19:00:27.753 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:27.863 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:27.860+0000 7f00d5d95640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-23T19:00:27.863 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:27.860+0000 7f00d5d95640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-23T19:00:27.864 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:27.860+0000 7f00d5d95640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T19:00:27.864 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:27.860+0000 7f00d5d95640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T19:00:27.864 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:27.860+0000 7f00d5d95640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T19:00:27.864 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:27.861+0000 7f00d5d95640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-23T19:00:30.801 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-23T19:00:30.870 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-23T19:00:30.871 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:30.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-23T19:00:30.937 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:30.938 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-23T19:00:31.045 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:31.046 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-23T19:00:31.152 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:31.152 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-23T19:00:31.262 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:31.262 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-23T19:00:31.370 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:31.370 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-23T19:00:31.478 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:31.479 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-23T19:00:31.587 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:31.588 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-23T19:00:31.656 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:31.657 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-23T19:00:31.766 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:31.766 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-23T19:00:31.873 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:31.873 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-23T19:00:31.981 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:31.981 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-23T19:00:32.089 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:32.089 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-23T19:00:32.196 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:32.196 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-23T19:00:32.311 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:32.312 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-23T19:00:32.354 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:32.355 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-23T19:00:32.437 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:32.438 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-23T19:00:32.485 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:32.485 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-23T19:00:32.571 INFO:tasks.ceph:Adding keys to all mons... 2023-06-23T19:00:32.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T19:00:32.576 DEBUG:teuthology.orchestra.run.smithi178:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T19:00:32.636 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.y] 2023-06-23T19:00:32.636 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCv65VkUyZ7HhAAy50RyRlXSg8RXcPahtv0VA== 2023-06-23T19:00:32.636 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2023-06-23T19:00:32.636 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCv65VkgJtBLxAALLUShhq5TOzfscbJVliFsg== 2023-06-23T19:00:32.637 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2023-06-23T19:00:32.637 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCv65VkKAD6OhAA1g0UICoC3n8Hezg8NO7rrA== 2023-06-23T19:00:32.637 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.0] 2023-06-23T19:00:32.637 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC065VkOY/nIhAAXBGComnktye+OUXf0sF+JQ== 2023-06-23T19:00:32.637 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.1] 2023-06-23T19:00:32.637 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC365Vk9DfZKhAA8UrZCfkwS2oaFK1qm9olrA== 2023-06-23T19:00:32.637 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.2] 2023-06-23T19:00:32.638 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC665VkNpjjMBAASmfj3XoAjA+FsQnFCDlbdA== 2023-06-23T19:00:32.638 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.3] 2023-06-23T19:00:32.638 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC965VkWYVcNxAAdykzMBeKfR0eZg4r0+ugrQ== 2023-06-23T19:00:32.638 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.x] 2023-06-23T19:00:32.638 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCv65VkCZhkJxAAQAC8svONiU5OTkNrXm2I9A== 2023-06-23T19:00:32.638 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2023-06-23T19:00:32.638 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCw65Vk7rkbDBAAOxmBal0flpFTShDcGxvtCA== 2023-06-23T19:00:32.638 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2023-06-23T19:00:32.639 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCw65Vk84sJGBAAqvFCgbT0gp9aWInFiJMogQ== 2023-06-23T19:00:32.639 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.4] 2023-06-23T19:00:32.639 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDC65Vk6MJ2HRAAyIkE0Ed+8VBSjykKcB8xiw== 2023-06-23T19:00:32.639 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.5] 2023-06-23T19:00:32.639 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDF65Vk4BXkJBAA6sarDd9WmApQCzhv3mmonQ== 2023-06-23T19:00:32.639 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.6] 2023-06-23T19:00:32.639 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDI65Vk2x7IKxAAbL/KPWXJeLHbkOhA94XxDA== 2023-06-23T19:00:32.639 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.7] 2023-06-23T19:00:32.640 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDL65VkX6FMMxAAbQmUjIN/ktBQT1YPfAWG0Q== 2023-06-23T19:00:32.640 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2023-06-23T19:00:32.640 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCw65Vk9m0xIhAArVabtYN8Q1ol3rPOb8C1Fw== 2023-06-23T19:00:32.640 INFO:teuthology.orchestra.run.smithi136.stdout:[client.2] 2023-06-23T19:00:32.641 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCw65Vk/wk5KhAA6Q4fWvV7QaMxKpxpxMfhAQ== 2023-06-23T19:00:32.641 INFO:teuthology.orchestra.run.smithi136.stdout:[client.1] 2023-06-23T19:00:32.641 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCw65VkCphAMhAABxj47jbcdUFZDa8FQkF/Fg== 2023-06-23T19:00:32.641 INFO:teuthology.orchestra.run.smithi136.stdout:[client.3] 2023-06-23T19:00:32.641 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCw65VksTP/ORAA5MY1d29ddc25bYVCCphpjg== 2023-06-23T19:00:32.679 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.y] 2023-06-23T19:00:32.680 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCv65VkUyZ7HhAAy50RyRlXSg8RXcPahtv0VA== 2023-06-23T19:00:32.680 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-06-23T19:00:32.680 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCv65VkgJtBLxAALLUShhq5TOzfscbJVliFsg== 2023-06-23T19:00:32.680 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-06-23T19:00:32.680 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCv65VkKAD6OhAA1g0UICoC3n8Hezg8NO7rrA== 2023-06-23T19:00:32.681 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2023-06-23T19:00:32.681 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQC065VkOY/nIhAAXBGComnktye+OUXf0sF+JQ== 2023-06-23T19:00:32.681 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2023-06-23T19:00:32.681 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQC365Vk9DfZKhAA8UrZCfkwS2oaFK1qm9olrA== 2023-06-23T19:00:32.681 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2023-06-23T19:00:32.681 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQC665VkNpjjMBAASmfj3XoAjA+FsQnFCDlbdA== 2023-06-23T19:00:32.681 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.3] 2023-06-23T19:00:32.681 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQC965VkWYVcNxAAdykzMBeKfR0eZg4r0+ugrQ== 2023-06-23T19:00:32.682 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.x] 2023-06-23T19:00:32.682 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCv65VkCZhkJxAAQAC8svONiU5OTkNrXm2I9A== 2023-06-23T19:00:32.682 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-06-23T19:00:32.682 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCw65Vk7rkbDBAAOxmBal0flpFTShDcGxvtCA== 2023-06-23T19:00:32.682 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-06-23T19:00:32.682 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCw65Vk84sJGBAAqvFCgbT0gp9aWInFiJMogQ== 2023-06-23T19:00:32.682 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.4] 2023-06-23T19:00:32.683 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQDC65Vk6MJ2HRAAyIkE0Ed+8VBSjykKcB8xiw== 2023-06-23T19:00:32.683 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.5] 2023-06-23T19:00:32.683 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQDF65Vk4BXkJBAA6sarDd9WmApQCzhv3mmonQ== 2023-06-23T19:00:32.683 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.6] 2023-06-23T19:00:32.683 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQDI65Vk2x7IKxAAbL/KPWXJeLHbkOhA94XxDA== 2023-06-23T19:00:32.683 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.7] 2023-06-23T19:00:32.683 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQDL65VkX6FMMxAAbQmUjIN/ktBQT1YPfAWG0Q== 2023-06-23T19:00:32.683 INFO:teuthology.orchestra.run.smithi178.stdout:[client.0] 2023-06-23T19:00:32.684 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCw65Vk9m0xIhAArVabtYN8Q1ol3rPOb8C1Fw== 2023-06-23T19:00:32.684 INFO:teuthology.orchestra.run.smithi178.stdout:[client.2] 2023-06-23T19:00:32.684 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCw65Vk/wk5KhAA6Q4fWvV7QaMxKpxpxMfhAQ== 2023-06-23T19:00:32.684 INFO:teuthology.orchestra.run.smithi178.stdout:[client.1] 2023-06-23T19:00:32.684 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCw65VkCphAMhAABxj47jbcdUFZDa8FQkF/Fg== 2023-06-23T19:00:32.684 INFO:teuthology.orchestra.run.smithi178.stdout:[client.3] 2023-06-23T19:00:32.684 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCw65VksTP/ORAA5MY1d29ddc25bYVCCphpjg== 2023-06-23T19:00:32.685 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T19:00:32.690 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T19:00:32.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T19:00:32.842 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T19:00:32.956 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T19:00:32.961 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T19:00:33.073 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:33.077 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:33.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:33.190 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:33.302 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:33.306 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:33.424 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:33.429 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:33.538 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T19:00:33.542 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T19:00:33.655 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T19:00:33.659 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T19:00:33.772 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T19:00:33.776 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T19:00:33.888 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:33.892 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:34.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:34.006 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:34.113 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:34.118 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:34.227 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:34.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T19:00:34.341 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T19:00:34.345 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T19:00:34.457 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T19:00:34.462 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T19:00:34.571 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T19:00:34.576 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T19:00:34.688 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T19:00:34.692 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T19:00:34.804 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-23T19:00:34.804 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-23T19:00:34.873 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T19:00:34.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-23T19:00:35.062 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-23T19:00:35.129 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T19:00:35.251 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-23T19:00:35.320 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-23T19:00:35.389 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T19:00:35.511 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-23T19:00:35.578 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:35.582 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T19:00:35.626 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-23T19:00:35.627 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-23T19:00:35.627 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-23T19:00:35.666 INFO:tasks.ceph.mon.a:Started 2023-06-23T19:00:35.666 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-23T19:00:35.666 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-23T19:00:35.670 INFO:tasks.ceph.mon.b:Started 2023-06-23T19:00:35.671 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-23T19:00:35.671 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-23T19:00:35.676 INFO:tasks.ceph.mon.c:Started 2023-06-23T19:00:35.676 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-23T19:00:35.676 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-23T19:00:35.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-23T19:00:35.681 INFO:tasks.ceph.mgr.y:Started 2023-06-23T19:00:35.681 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-23T19:00:35.681 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-23T19:00:35.686 INFO:tasks.ceph.mgr.x:Started 2023-06-23T19:00:35.687 INFO:tasks.ceph:Setting crush tunables to default 2023-06-23T19:00:35.687 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd crush tunables default 2023-06-23T19:00:35.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.900+0000 7fe6f43ff700 1 Processor -- start 2023-06-23T19:00:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.900+0000 7fe6f43ff700 1 -- start start 2023-06-23T19:00:35.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.901+0000 7fe6f43ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6ec0709f0 0x7fe6ec0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:35.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.901+0000 7fe6f43ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ec06d130 con 0x7fe6ec0b2b40 2023-06-23T19:00:35.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.901+0000 7fe6f43ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ec06c520 con 0x7fe6ec15a5a0 2023-06-23T19:00:35.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.901+0000 7fe6f43ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ec0cf6a0 con 0x7fe6ec0709f0 2023-06-23T19:00:35.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.902+0000 7fe6f299c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe6ec0b2b40 0x7fe6ec06d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:48988/0 (socket says 172.21.15.136:48988) 2023-06-23T19:00:35.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.902+0000 7fe6f299c700 1 -- 172.21.15.136:0/2723327506 learned_addr learned my addr 172.21.15.136:0/2723327506 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:00:35.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.902+0000 7fe6f199a700 1 --2- 172.21.15.136:0/2723327506 >> v2:172.21.15.178:3300/0 conn(0x7fe6ec0709f0 0x7fe6ec0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:35.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.902+0000 7fe6f199a700 1 -- 172.21.15.136:0/2723327506 >> v2:172.21.15.178:3300/0 conn(0x7fe6ec0709f0 msgr2=0x7fe6ec0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T19:00:35.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.902+0000 7fe6f199a700 1 -- 172.21.15.136:0/2723327506 >> v2:172.21.15.178:3300/0 conn(0x7fe6ec0709f0 msgr2=0x7fe6ec0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T19:00:35.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.902+0000 7fe6f199a700 1 --2- 172.21.15.136:0/2723327506 >> v2:172.21.15.178:3300/0 conn(0x7fe6ec0709f0 0x7fe6ec0b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T19:00:35.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:35.902+0000 7fe6f199a700 1 --2- 172.21.15.136:0/2723327506 >> v2:172.21.15.178:3300/0 conn(0x7fe6ec0709f0 0x7fe6ec0b4210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T19:00:36.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.083+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496065393 0 0) 0x7fe6ec06c520 con 0x7fe6ec15a5a0 2023-06-23T19:00:36.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.083+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d80035b0 con 0x7fe6ec15a5a0 2023-06-23T19:00:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033918807 0 0) 0x7fe6d80035b0 con 0x7fe6ec15a5a0 2023-06-23T19:00:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 >> v2:172.21.15.178:3300/0 conn(0x7fe6ec0709f0 msgr2=0x7fe6ec0b4210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:00:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 --2- 172.21.15.136:0/2723327506 >> v2:172.21.15.178:3300/0 conn(0x7fe6ec0709f0 0x7fe6ec0b4210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 >> v1:172.21.15.136:6789/0 conn(0x7fe6ec0b2b40 legacy=0x7fe6ec06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec06c800 con 0x7fe6ec15a5a0 2023-06-23T19:00:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fe6e8001670 con 0x7fe6ec15a5a0 2023-06-23T19:00:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 >> v1:172.21.15.178:6789/0 conn(0x7fe6ec15a5a0 legacy=0x7fe6ec0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6d8003a00 0x7fe6d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8004850 0x7fe6d8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:36.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d8009a00 0x7fe6d8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:36.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8014890 con 0x7fe6d8009a00 2023-06-23T19:00:36.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8014a00 con 0x7fe6d8004850 2023-06-23T19:00:36.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8014bc0 con 0x7fe6d8003a00 2023-06-23T19:00:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f219b700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6d8003a00 0x7fe6d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.084+0000 7fe6f199a700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8004850 0x7fe6d8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.085+0000 7fe6f299c700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d8009a00 0x7fe6d8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.085+0000 7fe6f299c700 1 -- 172.21.15.136:0/2723327506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6d8003a00 msgr2=0x7fe6d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.085+0000 7fe6f299c700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6d8003a00 0x7fe6d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.085+0000 7fe6f299c700 1 -- 172.21.15.136:0/2723327506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8004850 msgr2=0x7fe6d8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.085+0000 7fe6f299c700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8004850 0x7fe6d8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.085+0000 7fe6f299c700 1 -- 172.21.15.136:0/2723327506 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec06c800 con 0x7fe6d8009a00 2023-06-23T19:00:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.085+0000 7fe6f199a700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8004850 0x7fe6d8004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.085+0000 7fe6f299c700 1 -- 172.21.15.136:0/2723327506 reap_dead start 2023-06-23T19:00:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.086+0000 7fe6f299c700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d8009a00 0x7fe6d8005220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0711e0 tx=0x7fe6d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beaf3f22cbfa7d4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.086+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4001e40 con 0x7fe6d8009a00 2023-06-23T19:00:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.086+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e400cd90 con 0x7fe6d8009a00 2023-06-23T19:00:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.086+0000 7fe6f1199700 1 -- 172.21.15.136:0/2723327506 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40073b0 con 0x7fe6d8009a00 2023-06-23T19:00:36.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.087+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2723327506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d8009a00 msgr2=0x7fe6d8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.087+0000 7fe6f43ff700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d8009a00 0x7fe6d8005220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0711e0 tx=0x7fe6d8005880 comp rx=0 tx=0).stop 2023-06-23T19:00:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.087+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2723327506 shutdown_connections 2023-06-23T19:00:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.087+0000 7fe6f43ff700 1 --2- 172.21.15.136:0/2723327506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d8009a00 0x7fe6d8005220 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.087+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2723327506 >> 172.21.15.136:0/2723327506 conn(0x7fe6ec06ab80 msgr2=0x7fe6ec0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.087+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2723327506 shutdown_connections 2023-06-23T19:00:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.088+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2723327506 wait complete. 2023-06-23T19:00:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.090+0000 7fe6f43ff700 1 Processor -- start 2023-06-23T19:00:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.090+0000 7fe6f43ff700 1 -- start start 2023-06-23T19:00:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f43ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8009a00 0x7fe6ec14eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f43ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ec0c4d30 0x7fe6ec0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f43ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ec0cd8b0 0x7fe6ec0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f43ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0ce290 con 0x7fe6ec0cd8b0 2023-06-23T19:00:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f43ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec14f430 con 0x7fe6d8009a00 2023-06-23T19:00:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f43ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0c75b0 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f199a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ec0c4d30 0x7fe6ec0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f199a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ec0c4d30 0x7fe6ec0c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:34874/0 (socket says 172.21.15.136:34874) 2023-06-23T19:00:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f199a700 1 -- 172.21.15.136:0/2271335612 learned_addr learned my addr 172.21.15.136:0/2271335612 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f219b700 1 --2- 172.21.15.136:0/2271335612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8009a00 0x7fe6ec14eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.092+0000 7fe6f299c700 1 --2- 172.21.15.136:0/2271335612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ec0cd8b0 0x7fe6ec0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6f199a700 1 -- 172.21.15.136:0/2271335612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8009a00 msgr2=0x7fe6ec14eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6f199a700 1 --2- 172.21.15.136:0/2271335612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8009a00 0x7fe6ec14eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6f199a700 1 -- 172.21.15.136:0/2271335612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ec0cd8b0 msgr2=0x7fe6ec0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6f199a700 1 --2- 172.21.15.136:0/2271335612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ec0cd8b0 0x7fe6ec0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6f199a700 1 -- 172.21.15.136:0/2271335612 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0c7890 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6f199a700 1 --2- 172.21.15.136:0/2271335612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ec0c4d30 0x7fe6ec0c5790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0108f0 tx=0x7fe6dc010c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6e2ffd700 1 -- 172.21.15.136:0/2271335612 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc006ea0 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6e2ffd700 1 -- 172.21.15.136:0/2271335612 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc004020 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2271335612 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec0c7b70 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6e2ffd700 1 -- 172.21.15.136:0/2271335612 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0043d0 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.093+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2271335612 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec0c8130 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.094+0000 7fe6e2ffd700 1 -- 172.21.15.136:0/2271335612 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe6dc00e6b0 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.094+0000 7fe6e2ffd700 1 -- 172.21.15.136:0/2271335612 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe6dc003ce0 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.095+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2271335612 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ec0c8350 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.098+0000 7fe6e2ffd700 1 -- 172.21.15.136:0/2271335612 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe6dc01a030 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.179+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2271335612 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe6ec04ea20 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.187 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.184+0000 7fe6e2ffd700 1 -- 172.21.15.136:0/2271335612 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe6dc004530 con 0x7fe6ec0c4d30 2023-06-23T19:00:36.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.186+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2271335612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ec0c4d30 msgr2=0x7fe6ec0c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:36.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.186+0000 7fe6f43ff700 1 --2- 172.21.15.136:0/2271335612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ec0c4d30 0x7fe6ec0c5790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0108f0 tx=0x7fe6dc010c00 comp rx=0 tx=0).stop 2023-06-23T19:00:36.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.186+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2271335612 shutdown_connections 2023-06-23T19:00:36.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.186+0000 7fe6f43ff700 1 --2- 172.21.15.136:0/2271335612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d8009a00 0x7fe6ec14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:36.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.186+0000 7fe6f43ff700 1 --2- 172.21.15.136:0/2271335612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ec0cd8b0 0x7fe6ec0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:36.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.186+0000 7fe6f43ff700 1 --2- 172.21.15.136:0/2271335612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ec0c4d30 0x7fe6ec0c5790 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:36.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.186+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2271335612 >> 172.21.15.136:0/2271335612 conn(0x7fe6ec06ab80 msgr2=0x7fe6ec0c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:36.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.186+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2271335612 shutdown_connections 2023-06-23T19:00:36.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:36.186+0000 7fe6f43ff700 1 -- 172.21.15.136:0/2271335612 wait complete. 2023-06-23T19:00:36.192 INFO:teuthology.orchestra.run.smithi136.stderr:adjusted tunables profile to default 2023-06-23T19:00:36.208 INFO:tasks.ceph:check_enable_crimson: False 2023-06-23T19:00:36.208 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-23T19:00:36.208 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:36.209 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-23T19:00:36.248 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:36.245+0000 7fe4f706d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T19:00:36.287 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:36.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-23T19:00:36.338 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:36.335+0000 7fe4f706d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T19:00:36.395 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:36.396 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-23T19:00:36.435 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:36.432+0000 7fe4f706d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T19:00:36.503 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:00:36.503 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-23T19:00:36.538 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:36.534+0000 7fe4f706d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T19:00:36.590 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:36.587+0000 7f5f52a98200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T19:00:36.606 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:36.606 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-23T19:00:36.673 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:36.673 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-23T19:00:36.685 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:36.682+0000 7f5f52a98200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T19:00:36.721 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:36.717+0000 7fe4f706d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T19:00:36.755 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:36.756 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-23T19:00:36.802 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:36.800+0000 7f5f52a98200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T19:00:36.868 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:00:36.869 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-23T19:00:36.912 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:36.906+0000 7f5f52a98200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T19:00:36.975 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new d1391cb3-e6f8-4211-a8dc-ec9664243e0c 0 2023-06-23T19:00:37.101 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:37.098+0000 7fe4f706d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T19:00:37.104 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:37.101+0000 7f5f52a98200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T19:00:37.194 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:37.191+0000 7fe4f706d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T19:00:37.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.215+0000 7f20389ff700 1 Processor -- start 2023-06-23T19:00:37.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.215+0000 7f20389ff700 1 -- start start 2023-06-23T19:00:37.222 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.216+0000 7f20389ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f20340cf590 0x7f20340d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.223 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.216+0000 7f20389ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20340cd6d0 con 0x7f203415d280 2023-06-23T19:00:37.223 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.216+0000 7f20389ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20340d2b20 con 0x7f20340cd1d0 2023-06-23T19:00:37.223 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.216+0000 7f20389ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20340cd9b0 con 0x7f20340cf590 2023-06-23T19:00:37.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.217+0000 7f203259c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f20340cf590 0x7f20340d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.217+0000 7f203259c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f20340cf590 0x7f20340d3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:37492/0 (socket says 172.21.15.178:37492) 2023-06-23T19:00:37.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.217+0000 7f203259c700 1 -- 172.21.15.178:0/3902501030 learned_addr learned my addr 172.21.15.178:0/3902501030 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:37.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.217+0000 7f2031d9b700 1 --1- 172.21.15.178:0/3902501030 >> v1:172.21.15.178:6789/0 conn(0x7f20340cd1d0 0x7f20340cf960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:36752/0 (socket says 172.21.15.178:36752) 2023-06-23T19:00:37.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.217+0000 7f203159a700 1 -- 172.21.15.178:0/3902501030 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902046192 0 0) 0x7f20340cd6d0 con 0x7f203415d280 2023-06-23T19:00:37.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.217+0000 7f203259c700 1 -- 172.21.15.178:0/3902501030 >> v1:172.21.15.178:6789/0 conn(0x7f20340cd1d0 legacy=0x7f20340cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.217+0000 7f203259c700 1 -- 172.21.15.178:0/3902501030 >> v1:172.21.15.136:6789/0 conn(0x7f203415d280 legacy=0x7f20340d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.217+0000 7f203259c700 1 -- 172.21.15.178:0/3902501030 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20340d2e00 con 0x7f20340cf590 2023-06-23T19:00:37.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.218+0000 7f203259c700 1 --2- 172.21.15.178:0/3902501030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20340cf590 0x7f20340d3600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f20240098f0 tx=0x7f2024009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39307adad6e25244 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:37.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.218+0000 7f203159a700 1 -- 172.21.15.178:0/3902501030 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400b8a0 con 0x7f20340cf590 2023-06-23T19:00:37.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.218+0000 7f203159a700 1 -- 172.21.15.178:0/3902501030 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202400ba00 con 0x7f20340cf590 2023-06-23T19:00:37.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.218+0000 7f203159a700 1 -- 172.21.15.178:0/3902501030 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400bd90 con 0x7f20340cf590 2023-06-23T19:00:37.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.219+0000 7f20389ff700 1 -- 172.21.15.178:0/3902501030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20340cf590 msgr2=0x7f20340d3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.219+0000 7f20389ff700 1 --2- 172.21.15.178:0/3902501030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20340cf590 0x7f20340d3600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f20240098f0 tx=0x7f2024009c00 comp rx=0 tx=0).stop 2023-06-23T19:00:37.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.219+0000 7f20389ff700 1 -- 172.21.15.178:0/3902501030 shutdown_connections 2023-06-23T19:00:37.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.219+0000 7f20389ff700 1 --2- 172.21.15.178:0/3902501030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20340cf590 0x7f20340d3600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.219+0000 7f20389ff700 1 -- 172.21.15.178:0/3902501030 >> 172.21.15.178:0/3902501030 conn(0x7f203406b3b0 msgr2=0x7f203406b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:37.227 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.219+0000 7f20389ff700 1 -- 172.21.15.178:0/3902501030 shutdown_connections 2023-06-23T19:00:37.227 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.219+0000 7f20389ff700 1 -- 172.21.15.178:0/3902501030 wait complete. 2023-06-23T19:00:37.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.221+0000 7f20389ff700 1 Processor -- start 2023-06-23T19:00:37.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.222+0000 7f20389ff700 1 -- start start 2023-06-23T19:00:37.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f20389ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20340cd1d0 0x7f20340cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f20389ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20340cf590 0x7f20341f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f20389ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203415d280 0x7f20340c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f20389ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20341f2c10 con 0x7f20340cf590 2023-06-23T19:00:37.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f20389ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340c7810 con 0x7f20340cd1d0 2023-06-23T19:00:37.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f20389ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20340c7af0 con 0x7f203415d280 2023-06-23T19:00:37.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f2032d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203415d280 0x7f20340c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f2032d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203415d280 0x7f20340c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:49346/0 (socket says 172.21.15.178:49346) 2023-06-23T19:00:37.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f2031d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20340cf590 0x7f20341f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.223+0000 7f2032d9d700 1 -- 172.21.15.178:0/2350971593 learned_addr learned my addr 172.21.15.178:0/2350971593 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:37.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f203259c700 1 --2- 172.21.15.178:0/2350971593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20340cd1d0 0x7f20340cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f2032d9d700 1 -- 172.21.15.178:0/2350971593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20340cd1d0 msgr2=0x7f20340cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f2032d9d700 1 --2- 172.21.15.178:0/2350971593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20340cd1d0 0x7f20340cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f2032d9d700 1 -- 172.21.15.178:0/2350971593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20340cf590 msgr2=0x7f20341f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f2032d9d700 1 --2- 172.21.15.178:0/2350971593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20340cf590 0x7f20341f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f2032d9d700 1 -- 172.21.15.178:0/2350971593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2024009550 con 0x7f203415d280 2023-06-23T19:00:37.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f2032d9d700 1 --2- 172.21.15.178:0/2350971593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203415d280 0x7f20340c85d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c810 tx=0x7f202c00cb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:37.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f2022ffd700 1 -- 172.21.15.178:0/2350971593 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c003e30 con 0x7f203415d280 2023-06-23T19:00:37.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f2022ffd700 1 -- 172.21.15.178:0/2350971593 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c005070 con 0x7f203415d280 2023-06-23T19:00:37.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.224+0000 7f20389ff700 1 -- 172.21.15.178:0/2350971593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20340c7dd0 con 0x7f203415d280 2023-06-23T19:00:37.233 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.225+0000 7f2022ffd700 1 -- 172.21.15.178:0/2350971593 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c005400 con 0x7f203415d280 2023-06-23T19:00:37.233 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.225+0000 7f20389ff700 1 -- 172.21.15.178:0/2350971593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20340cbff0 con 0x7f203415d280 2023-06-23T19:00:37.233 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.225+0000 7f2022ffd700 1 -- 172.21.15.178:0/2350971593 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f202c01b400 con 0x7f203415d280 2023-06-23T19:00:37.233 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.225+0000 7f2022ffd700 1 -- 172.21.15.178:0/2350971593 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f202c012740 con 0x7f203415d280 2023-06-23T19:00:37.233 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.226+0000 7f20389ff700 1 -- 172.21.15.178:0/2350971593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20340c82f0 con 0x7f203415d280 2023-06-23T19:00:37.234 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.228+0000 7f2022ffd700 1 -- 172.21.15.178:0/2350971593 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f20340c82f0 con 0x7f203415d280 2023-06-23T19:00:37.321 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.318+0000 7f20389ff700 1 -- 172.21.15.178:0/2350971593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d1391cb3-e6f8-4211-a8dc-ec9664243e0c", "id": 0} v 0) v1 -- 0x7f203404ea20 con 0x7f203415d280 2023-06-23T19:00:37.328 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.325+0000 7f2022ffd700 1 -- 172.21.15.178:0/2350971593 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1391cb3-e6f8-4211-a8dc-ec9664243e0c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f202c01ba10 con 0x7f203415d280 2023-06-23T19:00:37.329 INFO:teuthology.orchestra.run.smithi178.stdout:0 2023-06-23T19:00:37.330 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.326+0000 7f20389ff700 1 -- 172.21.15.178:0/2350971593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203415d280 msgr2=0x7f20340c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.330 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.326+0000 7f20389ff700 1 --2- 172.21.15.178:0/2350971593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203415d280 0x7f20340c85d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c810 tx=0x7f202c00cb20 comp rx=0 tx=0).stop 2023-06-23T19:00:37.330 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.326+0000 7f20389ff700 1 -- 172.21.15.178:0/2350971593 shutdown_connections 2023-06-23T19:00:37.330 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.326+0000 7f20389ff700 1 --2- 172.21.15.178:0/2350971593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20340cd1d0 0x7f20340cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.330 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.326+0000 7f20389ff700 1 --2- 172.21.15.178:0/2350971593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203415d280 0x7f20340c85d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.326+0000 7f20389ff700 1 --2- 172.21.15.178:0/2350971593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20340cf590 0x7f20341f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.326+0000 7f20389ff700 1 -- 172.21.15.178:0/2350971593 >> 172.21.15.178:0/2350971593 conn(0x7f203406b3b0 msgr2=0x7f20340cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:37.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.327+0000 7f20389ff700 1 -- 172.21.15.178:0/2350971593 shutdown_connections 2023-06-23T19:00:37.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.327+0000 7f20389ff700 1 -- 172.21.15.178:0/2350971593 wait complete. 2023-06-23T19:00:37.347 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new a68c2f59-6364-4da0-bf4f-effe0c0f0c94 1 2023-06-23T19:00:37.348 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:37.345+0000 7fe4f706d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T19:00:37.461 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:37.458+0000 7fe4f706d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T19:00:37.553 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.550+0000 7f651a7ff700 1 Processor -- start 2023-06-23T19:00:37.553 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.550+0000 7f651a7ff700 1 -- start start 2023-06-23T19:00:37.554 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.551+0000 7f651a7ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f65140b51d0 0x7f65140cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.554 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.551+0000 7f651a7ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65140b5ec0 con 0x7f65140b5a70 2023-06-23T19:00:37.554 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.551+0000 7f651a7ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65140cd9d0 con 0x7f65140d0a60 2023-06-23T19:00:37.555 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.551+0000 7f651a7ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65140d0060 con 0x7f65140b51d0 2023-06-23T19:00:37.556 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.551+0000 7f6513fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f65140d0a60 0x7f65140d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:36766/0 (socket says 172.21.15.178:36766) 2023-06-23T19:00:37.556 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.551+0000 7f6513fff700 1 -- 172.21.15.178:0/852802421 learned_addr learned my addr 172.21.15.178:0/852802421 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-06-23T19:00:37.556 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.551+0000 7f6518d9c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f65140b51d0 0x7f65140cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.556 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.552+0000 7f6512ffd700 1 -- 172.21.15.178:0/852802421 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248003692 0 0) 0x7f65140cd9d0 con 0x7f65140d0a60 2023-06-23T19:00:37.556 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.552+0000 7f6512ffd700 1 -- 172.21.15.178:0/852802421 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64fc0035b0 con 0x7f65140d0a60 2023-06-23T19:00:37.557 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.552+0000 7f6512ffd700 1 -- 172.21.15.178:0/852802421 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949567259 0 0) 0x7f65140b5ec0 con 0x7f65140b5a70 2023-06-23T19:00:37.557 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.552+0000 7f6512ffd700 1 -- 172.21.15.178:0/852802421 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65140cd9d0 con 0x7f65140b5a70 2023-06-23T19:00:37.557 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.552+0000 7f6518d9c700 1 -- 172.21.15.178:0/852802421 >> v1:172.21.15.178:6789/0 conn(0x7f65140d0a60 legacy=0x7f65140d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.557 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.552+0000 7f6518d9c700 1 -- 172.21.15.178:0/852802421 >> v1:172.21.15.136:6789/0 conn(0x7f65140b5a70 legacy=0x7f65140d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.557 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.552+0000 7f6518d9c700 1 -- 172.21.15.178:0/852802421 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65140b5610 con 0x7f65140b51d0 2023-06-23T19:00:37.557 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.552+0000 7f6518d9c700 1 --2- 172.21.15.178:0/852802421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140b51d0 0x7f65140cf910 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f650c009d90 tx=0x7f650c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdd0f8c8cdb994ff server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:37.558 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.553+0000 7f6512ffd700 1 -- 172.21.15.178:0/852802421 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c00e070 con 0x7f65140b51d0 2023-06-23T19:00:37.558 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.553+0000 7f6512ffd700 1 -- 172.21.15.178:0/852802421 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c00bae0 con 0x7f65140b51d0 2023-06-23T19:00:37.558 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.553+0000 7f6512ffd700 1 -- 172.21.15.178:0/852802421 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c00be90 con 0x7f65140b51d0 2023-06-23T19:00:37.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.553+0000 7f651a7ff700 1 -- 172.21.15.178:0/852802421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140b51d0 msgr2=0x7f65140cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.553+0000 7f651a7ff700 1 --2- 172.21.15.178:0/852802421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140b51d0 0x7f65140cf910 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f650c009d90 tx=0x7f650c00b330 comp rx=0 tx=0).stop 2023-06-23T19:00:37.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.553+0000 7f651a7ff700 1 -- 172.21.15.178:0/852802421 shutdown_connections 2023-06-23T19:00:37.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.553+0000 7f651a7ff700 1 --2- 172.21.15.178:0/852802421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140b51d0 0x7f65140cf910 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.553+0000 7f651a7ff700 1 -- 172.21.15.178:0/852802421 >> 172.21.15.178:0/852802421 conn(0x7f6514071620 msgr2=0x7f65140719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:37.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.554+0000 7f651a7ff700 1 -- 172.21.15.178:0/852802421 shutdown_connections 2023-06-23T19:00:37.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.554+0000 7f651a7ff700 1 -- 172.21.15.178:0/852802421 wait complete. 2023-06-23T19:00:37.560 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:37.554+0000 7f5f52a98200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T19:00:37.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.555+0000 7f651a7ff700 1 Processor -- start 2023-06-23T19:00:37.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.556+0000 7f651a7ff700 1 -- start start 2023-06-23T19:00:37.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.556+0000 7f651a7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65140b51d0 0x7f6514155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.556+0000 7f651a7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65140b5a70 0x7f6514155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.563 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f651a7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140d0a60 0x7f651415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.563 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f651a7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65140c6840 con 0x7f65140b51d0 2023-06-23T19:00:37.563 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f651a7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65140c6ae0 con 0x7f65140d0a60 2023-06-23T19:00:37.563 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f651a7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65140c6dc0 con 0x7f65140b5a70 2023-06-23T19:00:37.563 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6513fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65140b51d0 0x7f6514155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.563 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6518d9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140d0a60 0x7f651415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.564 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f65137fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65140b5a70 0x7f6514155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.564 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6518d9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140d0a60 0x7f651415f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:37520/0 (socket says 172.21.15.178:37520) 2023-06-23T19:00:37.564 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6513fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65140b51d0 0x7f6514155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.178:37016/0 (socket says 172.21.15.178:37016) 2023-06-23T19:00:37.564 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6518d9c700 1 -- 172.21.15.178:0/3767394004 learned_addr learned my addr 172.21.15.178:0/3767394004 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:37.564 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6518d9c700 1 -- 172.21.15.178:0/3767394004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65140b5a70 msgr2=0x7f6514155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.564 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6518d9c700 1 --2- 172.21.15.178:0/3767394004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65140b5a70 0x7f6514155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6518d9c700 1 -- 172.21.15.178:0/3767394004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65140b51d0 msgr2=0x7f6514155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6518d9c700 1 --2- 172.21.15.178:0/3767394004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65140b51d0 0x7f6514155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.557+0000 7f6518d9c700 1 -- 172.21.15.178:0/3767394004 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c009a70 con 0x7f65140d0a60 2023-06-23T19:00:37.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.558+0000 7f6518d9c700 1 --2- 172.21.15.178:0/3767394004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140d0a60 0x7f651415f1d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f65140d3d20 tx=0x7f650c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:37.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.558+0000 7f6510ff9700 1 -- 172.21.15.178:0/3767394004 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c004540 con 0x7f65140d0a60 2023-06-23T19:00:37.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.558+0000 7f6510ff9700 1 -- 172.21.15.178:0/3767394004 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c0046a0 con 0x7f65140d0a60 2023-06-23T19:00:37.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.558+0000 7f651a7ff700 1 -- 172.21.15.178:0/3767394004 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65140c70a0 con 0x7f65140d0a60 2023-06-23T19:00:37.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.558+0000 7f6510ff9700 1 -- 172.21.15.178:0/3767394004 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c012430 con 0x7f65140d0a60 2023-06-23T19:00:37.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.558+0000 7f651a7ff700 1 -- 172.21.15.178:0/3767394004 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651415f710 con 0x7f65140d0a60 2023-06-23T19:00:37.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.559+0000 7f6510ff9700 1 -- 172.21.15.178:0/3767394004 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f650c012890 con 0x7f65140d0a60 2023-06-23T19:00:37.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.559+0000 7f6510ff9700 1 -- 172.21.15.178:0/3767394004 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f650c01dd50 con 0x7f65140d0a60 2023-06-23T19:00:37.568 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.559+0000 7f651a7ff700 1 -- 172.21.15.178:0/3767394004 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65140c75c0 con 0x7f65140d0a60 2023-06-23T19:00:37.568 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.562+0000 7f6510ff9700 1 -- 172.21.15.178:0/3767394004 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f65140c75c0 con 0x7f65140d0a60 2023-06-23T19:00:37.654 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.651+0000 7f651a7ff700 1 -- 172.21.15.178:0/3767394004 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a68c2f59-6364-4da0-bf4f-effe0c0f0c94", "id": 1} v 0) v1 -- 0x7f651404ea20 con 0x7f65140d0a60 2023-06-23T19:00:37.662 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:37.659+0000 7f5f52a98200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T19:00:37.662 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.659+0000 7f6510ff9700 1 -- 172.21.15.178:0/3767394004 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a68c2f59-6364-4da0-bf4f-effe0c0f0c94", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f650c01d4f0 con 0x7f65140d0a60 2023-06-23T19:00:37.663 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-06-23T19:00:37.664 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.660+0000 7f651a7ff700 1 -- 172.21.15.178:0/3767394004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140d0a60 msgr2=0x7f651415f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.664 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.660+0000 7f651a7ff700 1 --2- 172.21.15.178:0/3767394004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140d0a60 0x7f651415f1d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f65140d3d20 tx=0x7f650c004ad0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.664 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.661+0000 7f651a7ff700 1 -- 172.21.15.178:0/3767394004 shutdown_connections 2023-06-23T19:00:37.664 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.661+0000 7f651a7ff700 1 --2- 172.21.15.178:0/3767394004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65140d0a60 0x7f651415f1d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.664 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.661+0000 7f651a7ff700 1 --2- 172.21.15.178:0/3767394004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65140b51d0 0x7f6514155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.665 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.661+0000 7f651a7ff700 1 --2- 172.21.15.178:0/3767394004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65140b5a70 0x7f6514155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.665 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.661+0000 7f651a7ff700 1 -- 172.21.15.178:0/3767394004 >> 172.21.15.178:0/3767394004 conn(0x7f6514071620 msgr2=0x7f65140d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:37.665 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.661+0000 7f651a7ff700 1 -- 172.21.15.178:0/3767394004 shutdown_connections 2023-06-23T19:00:37.665 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.661+0000 7f651a7ff700 1 -- 172.21.15.178:0/3767394004 wait complete. 2023-06-23T19:00:37.683 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe 2 2023-06-23T19:00:37.824 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:37.821+0000 7f5f52a98200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T19:00:37.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.889+0000 7f3ecdbff700 1 Processor -- start 2023-06-23T19:00:37.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.889+0000 7f3ecdbff700 1 -- start start 2023-06-23T19:00:37.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.890+0000 7f3ecdbff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3ec80cf590 0x7f3ec80d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.894 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.890+0000 7f3ecdbff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3ec80cd1d0 0x7f3ec815d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.894 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.890+0000 7f3ecdbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cf960 0x7f3ec80d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.894 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.890+0000 7f3ecdbff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80cd9b0 con 0x7f3ec80cd1d0 2023-06-23T19:00:37.894 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.890+0000 7f3ecdbff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80b55b0 con 0x7f3ec80cf590 2023-06-23T19:00:37.894 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.890+0000 7f3ecdbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec815d7c0 con 0x7f3ec80cf960 2023-06-23T19:00:37.894 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3ec80cf590 0x7f3ec80d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.895 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3ec80cf590 0x7f3ec80d3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:37524/0 (socket says 172.21.15.178:37524) 2023-06-23T19:00:37.895 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec77fe700 1 -- 172.21.15.178:0/17790618 learned_addr learned my addr 172.21.15.178:0/17790618 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:37.896 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec6ffd700 1 --2- 172.21.15.178:0/17790618 >> v2:172.21.15.136:3300/0 conn(0x7f3ec80cd1d0 0x7f3ec815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec7fff700 1 --2- 172.21.15.178:0/17790618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cf960 0x7f3ec80d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec77fe700 1 -- 172.21.15.178:0/17790618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cf960 msgr2=0x7f3ec80d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec77fe700 1 --2- 172.21.15.178:0/17790618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cf960 0x7f3ec80d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec77fe700 1 -- 172.21.15.178:0/17790618 >> v2:172.21.15.136:3300/0 conn(0x7f3ec80cd1d0 msgr2=0x7f3ec815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec77fe700 1 --2- 172.21.15.178:0/17790618 >> v2:172.21.15.136:3300/0 conn(0x7f3ec80cd1d0 0x7f3ec815d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec77fe700 1 -- 172.21.15.178:0/17790618 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80cd6d0 con 0x7f3ec80cf590 2023-06-23T19:00:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec7fff700 1 --2- 172.21.15.178:0/17790618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cf960 0x7f3ec80d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:00:37.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.891+0000 7f3ec77fe700 1 --2- 172.21.15.178:0/17790618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf590 0x7f3ec80d3600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80b4ce0 tx=0x7f3eb8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db353bcb9b001e50 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:37.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.892+0000 7f3ec67fc700 1 -- 172.21.15.178:0/17790618 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8011830 con 0x7f3ec80cf590 2023-06-23T19:00:37.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.892+0000 7f3ec67fc700 1 -- 172.21.15.178:0/17790618 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb8011990 con 0x7f3ec80cf590 2023-06-23T19:00:37.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.892+0000 7f3ec67fc700 1 -- 172.21.15.178:0/17790618 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8011d20 con 0x7f3ec80cf590 2023-06-23T19:00:37.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.892+0000 7f3ecdbff700 1 -- 172.21.15.178:0/17790618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf590 msgr2=0x7f3ec80d3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.892+0000 7f3ecdbff700 1 --2- 172.21.15.178:0/17790618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf590 0x7f3ec80d3600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80b4ce0 tx=0x7f3eb8009bd0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.893+0000 7f3ecdbff700 1 -- 172.21.15.178:0/17790618 shutdown_connections 2023-06-23T19:00:37.899 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.893+0000 7f3ecdbff700 1 --2- 172.21.15.178:0/17790618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cf960 0x7f3ec80d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.899 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.893+0000 7f3ecdbff700 1 --2- 172.21.15.178:0/17790618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf590 0x7f3ec80d3600 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.899 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.893+0000 7f3ecdbff700 1 --2- 172.21.15.178:0/17790618 >> v2:172.21.15.136:3300/0 conn(0x7f3ec80cd1d0 0x7f3ec815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.899 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.893+0000 7f3ecdbff700 1 -- 172.21.15.178:0/17790618 >> 172.21.15.178:0/17790618 conn(0x7f3ec806b3b0 msgr2=0x7f3ec806b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:37.899 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.893+0000 7f3ecdbff700 1 -- 172.21.15.178:0/17790618 shutdown_connections 2023-06-23T19:00:37.899 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.893+0000 7f3ecdbff700 1 -- 172.21.15.178:0/17790618 wait complete. 2023-06-23T19:00:37.901 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.895+0000 7f3ecdbff700 1 Processor -- start 2023-06-23T19:00:37.901 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.895+0000 7f3ecdbff700 1 -- start start 2023-06-23T19:00:37.901 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.896+0000 7f3ecdbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cd1d0 0x7f3ec80c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.901 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ecdbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ec80cf590 0x7f3ec81505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.901 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ecdbff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf960 0x7f3ec80cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:37.901 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ecdbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80ca2e0 con 0x7f3ec80cf590 2023-06-23T19:00:37.901 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ecdbff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80ca5c0 con 0x7f3ec80cf960 2023-06-23T19:00:37.902 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ecdbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80ca8a0 con 0x7f3ec80cd1d0 2023-06-23T19:00:37.902 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cd1d0 0x7f3ec80c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.902 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cd1d0 0x7f3ec80c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:49360/0 (socket says 172.21.15.178:49360) 2023-06-23T19:00:37.902 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec77fe700 1 -- 172.21.15.178:0/193027732 learned_addr learned my addr 172.21.15.178:0/193027732 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:37.902 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec6ffd700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ec80cf590 0x7f3ec81505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.902 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec7fff700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf960 0x7f3ec80cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:37.903 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec7fff700 1 -- 172.21.15.178:0/193027732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cd1d0 msgr2=0x7f3ec80c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.903 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec7fff700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cd1d0 0x7f3ec80c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.903 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec7fff700 1 -- 172.21.15.178:0/193027732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ec80cf590 msgr2=0x7f3ec81505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:37.903 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec7fff700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ec80cf590 0x7f3ec81505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:37.903 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec7fff700 1 -- 172.21.15.178:0/193027732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb8009550 con 0x7f3ec80cf960 2023-06-23T19:00:37.903 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec77fe700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cd1d0 0x7f3ec80c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:37.903 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.897+0000 7f3ec6ffd700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ec80cf590 0x7f3ec81505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:37.904 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.898+0000 7f3ec7fff700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf960 0x7f3ec80cb380 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000cdf0 tx=0x7f3ec000ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:37.904 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.898+0000 7f3eaffff700 1 -- 172.21.15.178:0/193027732 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000ac80 con 0x7f3ec80cf960 2023-06-23T19:00:37.905 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.898+0000 7f3eaffff700 1 -- 172.21.15.178:0/193027732 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec000ade0 con 0x7f3ec80cf960 2023-06-23T19:00:37.905 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.898+0000 7f3eaffff700 1 -- 172.21.15.178:0/193027732 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0015680 con 0x7f3ec80cf960 2023-06-23T19:00:37.905 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.898+0000 7f3ecdbff700 1 -- 172.21.15.178:0/193027732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec80cab80 con 0x7f3ec80cf960 2023-06-23T19:00:37.905 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.898+0000 7f3ecdbff700 1 -- 172.21.15.178:0/193027732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec81515f0 con 0x7f3ec80cf960 2023-06-23T19:00:37.905 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.898+0000 7f3eaffff700 1 -- 172.21.15.178:0/193027732 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3ec0015ae0 con 0x7f3ec80cf960 2023-06-23T19:00:37.905 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.899+0000 7f3eaffff700 1 -- 172.21.15.178:0/193027732 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3ec0015d90 con 0x7f3ec80cf960 2023-06-23T19:00:37.905 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.899+0000 7f3ecdbff700 1 -- 172.21.15.178:0/193027732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec80cb0a0 con 0x7f3ec80cf960 2023-06-23T19:00:37.906 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.902+0000 7f3eaffff700 1 -- 172.21.15.178:0/193027732 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3ec80cb0a0 con 0x7f3ec80cf960 2023-06-23T19:00:37.933 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:37.930+0000 7f5f52a98200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T19:00:37.980 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:37.976+0000 7fe4f706d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T19:00:37.993 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.990+0000 7f3ecdbff700 1 -- 172.21.15.178:0/193027732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe", "id": 2} v 0) v1 -- 0x7f3ec804ea20 con 0x7f3ec80cf960 2023-06-23T19:00:38.001 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.998+0000 7f3eaffff700 1 -- 172.21.15.178:0/193027732 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ec0024060 con 0x7f3ec80cf960 2023-06-23T19:00:38.002 INFO:teuthology.orchestra.run.smithi178.stdout:2 2023-06-23T19:00:38.003 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.999+0000 7f3ecdbff700 1 -- 172.21.15.178:0/193027732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf960 msgr2=0x7f3ec80cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.003 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:37.999+0000 7f3ecdbff700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf960 0x7f3ec80cb380 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000cdf0 tx=0x7f3ec000ce20 comp rx=0 tx=0).stop 2023-06-23T19:00:38.003 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.000+0000 7f3ecdbff700 1 -- 172.21.15.178:0/193027732 shutdown_connections 2023-06-23T19:00:38.003 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.000+0000 7f3ecdbff700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec80cf960 0x7f3ec80cb380 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.003 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.000+0000 7f3ecdbff700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec80cd1d0 0x7f3ec80c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.003 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.000+0000 7f3ecdbff700 1 --2- 172.21.15.178:0/193027732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ec80cf590 0x7f3ec81505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.004 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.000+0000 7f3ecdbff700 1 -- 172.21.15.178:0/193027732 >> 172.21.15.178:0/193027732 conn(0x7f3ec806b3b0 msgr2=0x7f3ec815d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:38.004 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.000+0000 7f3ecdbff700 1 -- 172.21.15.178:0/193027732 shutdown_connections 2023-06-23T19:00:38.004 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.000+0000 7f3ecdbff700 1 -- 172.21.15.178:0/193027732 wait complete. 2023-06-23T19:00:38.020 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 491ea7ca-6e40-4205-b2ed-c5171ced5dfb 3 2023-06-23T19:00:38.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.216+0000 7f5492dff700 1 Processor -- start 2023-06-23T19:00:38.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.217+0000 7f5492dff700 1 -- start start 2023-06-23T19:00:38.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f5492dff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f548c0d0a60 0x7f548c0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f5492dff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f548c0cf910 0x7f548c0d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f5492dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c0cd9d0 con 0x7f548c0b51d0 2023-06-23T19:00:38.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f5492dff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c0d0060 con 0x7f548c0d0a60 2023-06-23T19:00:38.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f5492dff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c0b5620 con 0x7f548c0cf910 2023-06-23T19:00:38.223 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f549139c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f548c0cf910 0x7f548c0d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.223 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f549139c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f548c0cf910 0x7f548c0d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:37538/0 (socket says 172.21.15.178:37538) 2023-06-23T19:00:38.223 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f549139c700 1 -- 172.21.15.178:0/164421018 learned_addr learned my addr 172.21.15.178:0/164421018 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:38.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f5490b9b700 1 --2- 172.21.15.178:0/164421018 >> v2:172.21.15.136:3300/0 conn(0x7f548c0d0a60 0x7f548c0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f549139c700 1 -- 172.21.15.178:0/164421018 >> v2:172.21.15.136:3300/0 conn(0x7f548c0d0a60 msgr2=0x7f548c0b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:38.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f549139c700 1 --2- 172.21.15.178:0/164421018 >> v2:172.21.15.136:3300/0 conn(0x7f548c0d0a60 0x7f548c0b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f549139c700 1 -- 172.21.15.178:0/164421018 >> v1:172.21.15.136:6789/0 conn(0x7f548c0b51d0 legacy=0x7f548c0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.224 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f549139c700 1 -- 172.21.15.178:0/164421018 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c0cd410 con 0x7f548c0cf910 2023-06-23T19:00:38.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.218+0000 7f548b7fe700 1 -- 172.21.15.178:0/164421018 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973702616 0 0) 0x7f548c0cd9d0 con 0x7f548c0b51d0 2023-06-23T19:00:38.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.219+0000 7f549139c700 1 --2- 172.21.15.178:0/164421018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0cf910 0x7f548c0d2e00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f548c0b2610 tx=0x7f548400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d777ab6a8557dc7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:38.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.219+0000 7f548b7fe700 1 -- 172.21.15.178:0/164421018 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400e070 con 0x7f548c0cf910 2023-06-23T19:00:38.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.219+0000 7f548b7fe700 1 -- 172.21.15.178:0/164421018 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548400b910 con 0x7f548c0cf910 2023-06-23T19:00:38.225 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.219+0000 7f548b7fe700 1 -- 172.21.15.178:0/164421018 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400bcc0 con 0x7f548c0cf910 2023-06-23T19:00:38.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.220+0000 7f5492dff700 1 -- 172.21.15.178:0/164421018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0cf910 msgr2=0x7f548c0d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.220+0000 7f5492dff700 1 --2- 172.21.15.178:0/164421018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0cf910 0x7f548c0d2e00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f548c0b2610 tx=0x7f548400b330 comp rx=0 tx=0).stop 2023-06-23T19:00:38.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.220+0000 7f5492dff700 1 -- 172.21.15.178:0/164421018 shutdown_connections 2023-06-23T19:00:38.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.220+0000 7f5492dff700 1 --2- 172.21.15.178:0/164421018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0cf910 0x7f548c0d2e00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.220+0000 7f5492dff700 1 --2- 172.21.15.178:0/164421018 >> v2:172.21.15.136:3300/0 conn(0x7f548c0d0a60 0x7f548c0b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.220+0000 7f5492dff700 1 -- 172.21.15.178:0/164421018 >> 172.21.15.178:0/164421018 conn(0x7f548c071620 msgr2=0x7f548c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:38.226 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.220+0000 7f5492dff700 1 -- 172.21.15.178:0/164421018 shutdown_connections 2023-06-23T19:00:38.227 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.220+0000 7f5492dff700 1 -- 172.21.15.178:0/164421018 wait complete. 2023-06-23T19:00:38.228 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.222+0000 7f5492dff700 1 Processor -- start 2023-06-23T19:00:38.228 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.222+0000 7f5492dff700 1 -- start start 2023-06-23T19:00:38.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f5492dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f548c0b51d0 0x7f548c15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f5492dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c0cf910 0x7f548c0b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f5492dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0d0a60 0x7f548c0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f5492dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1f1ac0 con 0x7f548c0b51d0 2023-06-23T19:00:38.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f5492dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0b8770 con 0x7f548c0d0a60 2023-06-23T19:00:38.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f5492dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0b7400 con 0x7f548c0cf910 2023-06-23T19:00:38.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f548bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c0cf910 0x7f548c0b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.229 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f5490b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f548c0b51d0 0x7f548c15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f5490b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f548c0b51d0 0x7f548c15acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.178:37046/0 (socket says 172.21.15.178:37046) 2023-06-23T19:00:38.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f5490b9b700 1 -- 172.21.15.178:0/3276888338 learned_addr learned my addr 172.21.15.178:0/3276888338 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:38.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.223+0000 7f549139c700 1 --2- 172.21.15.178:0/3276888338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0d0a60 0x7f548c0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f5490b9b700 1 -- 172.21.15.178:0/3276888338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c0cf910 msgr2=0x7f548c0b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f5490b9b700 1 --2- 172.21.15.178:0/3276888338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c0cf910 0x7f548c0b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f5490b9b700 1 -- 172.21.15.178:0/3276888338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0d0a60 msgr2=0x7f548c0c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.230 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f5490b9b700 1 --2- 172.21.15.178:0/3276888338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0d0a60 0x7f548c0c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f5490b9b700 1 -- 172.21.15.178:0/3276888338 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484009b30 con 0x7f548c0b51d0 2023-06-23T19:00:38.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f549139c700 1 --2- 172.21.15.178:0/3276888338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0d0a60 0x7f548c0c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:38.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f5490b9b700 1 --2- 172.21.15.178:0/3276888338 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f548c0b51d0 0x7f548c15acf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f548000e8a0 tx=0x7f548000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:38.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f54897fa700 1 -- 172.21.15.178:0/3276888338 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480009590 con 0x7f548c0b51d0 2023-06-23T19:00:38.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f54897fa700 1 -- 172.21.15.178:0/3276888338 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480013680 con 0x7f548c0b51d0 2023-06-23T19:00:38.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f54897fa700 1 -- 172.21.15.178:0/3276888338 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800139f0 con 0x7f548c0b51d0 2023-06-23T19:00:38.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f5492dff700 1 -- 172.21.15.178:0/3276888338 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c15b230 con 0x7f548c0b51d0 2023-06-23T19:00:38.231 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.224+0000 7f5492dff700 1 -- 172.21.15.178:0/3276888338 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c0b6b60 con 0x7f548c0b51d0 2023-06-23T19:00:38.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.225+0000 7f54897fa700 1 -- 172.21.15.178:0/3276888338 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5480005a20 con 0x7f548c0b51d0 2023-06-23T19:00:38.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.225+0000 7f54897fa700 1 -- 172.21.15.178:0/3276888338 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5480006660 con 0x7f548c0b51d0 2023-06-23T19:00:38.232 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.225+0000 7f5492dff700 1 -- 172.21.15.178:0/3276888338 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c04ea20 con 0x7f548c0b51d0 2023-06-23T19:00:38.233 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.228+0000 7f54897fa700 1 -- 172.21.15.178:0/3276888338 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5480021060 con 0x7f548c0b51d0 2023-06-23T19:00:38.322 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.319+0000 7f5492dff700 1 -- 172.21.15.178:0/3276888338 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "491ea7ca-6e40-4205-b2ed-c5171ced5dfb", "id": 3} v 0) v1 -- 0x7f548c0d01a0 con 0x7f548c0b51d0 2023-06-23T19:00:38.329 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.326+0000 7f54897fa700 1 -- 172.21.15.178:0/3276888338 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "491ea7ca-6e40-4205-b2ed-c5171ced5dfb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5480017070 con 0x7f548c0b51d0 2023-06-23T19:00:38.329 INFO:teuthology.orchestra.run.smithi178.stdout:3 2023-06-23T19:00:38.330 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.327+0000 7f5492dff700 1 -- 172.21.15.178:0/3276888338 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f548c0b51d0 msgr2=0x7f548c15acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.327+0000 7f5492dff700 1 --2- 172.21.15.178:0/3276888338 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f548c0b51d0 0x7f548c15acf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f548000e8a0 tx=0x7f548000ebb0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.327+0000 7f5492dff700 1 -- 172.21.15.178:0/3276888338 shutdown_connections 2023-06-23T19:00:38.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.327+0000 7f5492dff700 1 --2- 172.21.15.178:0/3276888338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c0d0a60 0x7f548c0c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.327+0000 7f5492dff700 1 --2- 172.21.15.178:0/3276888338 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f548c0b51d0 0x7f548c15acf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.327+0000 7f5492dff700 1 --2- 172.21.15.178:0/3276888338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c0cf910 0x7f548c0b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.327+0000 7f5492dff700 1 -- 172.21.15.178:0/3276888338 >> 172.21.15.178:0/3276888338 conn(0x7f548c071620 msgr2=0x7f548c0c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:38.332 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.327+0000 7f5492dff700 1 -- 172.21.15.178:0/3276888338 shutdown_connections 2023-06-23T19:00:38.332 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.327+0000 7f5492dff700 1 -- 172.21.15.178:0/3276888338 wait complete. 2023-06-23T19:00:38.347 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 52320eb5-b8e0-4054-9017-683dd67f4f92 4 2023-06-23T19:00:38.537 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.534+0000 7f72cf7ff700 1 Processor -- start 2023-06-23T19:00:38.538 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.534+0000 7f72cf7ff700 1 -- start start 2023-06-23T19:00:38.538 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.535+0000 7f72cf7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80d0a60 0x7f72c80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.539 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72cf7ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80cd9d0 con 0x7f72c80cf910 2023-06-23T19:00:38.539 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72cf7ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80b5640 con 0x7f72c80b51d0 2023-06-23T19:00:38.539 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72cf7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80d0060 con 0x7f72c80d0a60 2023-06-23T19:00:38.539 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80d0a60 0x7f72c80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72ccd9a700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f72c80b51d0 0x7f72c80d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:36772/0 (socket says 172.21.15.178:36772) 2023-06-23T19:00:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72ccd9a700 1 -- 172.21.15.178:0/2259023289 learned_addr learned my addr 172.21.15.178:0/2259023289 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-06-23T19:00:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80d0a60 0x7f72c80b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:49368/0 (socket says 172.21.15.178:49368) 2023-06-23T19:00:38.541 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72cd59b700 1 -- 172.21.15.178:0/2259023289 >> v1:172.21.15.178:6789/0 conn(0x7f72c80b51d0 legacy=0x7f72c80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.541 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72cd59b700 1 -- 172.21.15.178:0/2259023289 >> v1:172.21.15.136:6789/0 conn(0x7f72c80cf910 legacy=0x7f72c80d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.541 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72cd59b700 1 -- 172.21.15.178:0/2259023289 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80cfd90 con 0x7f72c80d0a60 2023-06-23T19:00:38.541 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.536+0000 7f72bffff700 1 -- 172.21.15.178:0/2259023289 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855640214 0 0) 0x7f72c80b5640 con 0x7f72c80b51d0 2023-06-23T19:00:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.537+0000 7f72cd59b700 1 --2- 172.21.15.178:0/2259023289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80d0a60 0x7f72c80b5a70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009870 tx=0x7f72c4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f61513e5ebbc5f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.537+0000 7f72bffff700 1 -- 172.21.15.178:0/2259023289 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4004230 con 0x7f72c80d0a60 2023-06-23T19:00:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.537+0000 7f72bffff700 1 -- 172.21.15.178:0/2259023289 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4004390 con 0x7f72c80d0a60 2023-06-23T19:00:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.537+0000 7f72bffff700 1 -- 172.21.15.178:0/2259023289 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40036a0 con 0x7f72c80d0a60 2023-06-23T19:00:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.538+0000 7f72cf7ff700 1 -- 172.21.15.178:0/2259023289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80d0a60 msgr2=0x7f72c80b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.538+0000 7f72cf7ff700 1 --2- 172.21.15.178:0/2259023289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80d0a60 0x7f72c80b5a70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009870 tx=0x7f72c4009b80 comp rx=0 tx=0).stop 2023-06-23T19:00:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.538+0000 7f72cf7ff700 1 -- 172.21.15.178:0/2259023289 shutdown_connections 2023-06-23T19:00:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.538+0000 7f72cf7ff700 1 --2- 172.21.15.178:0/2259023289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80d0a60 0x7f72c80b5a70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.543 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.538+0000 7f72cf7ff700 1 -- 172.21.15.178:0/2259023289 >> 172.21.15.178:0/2259023289 conn(0x7f72c8071620 msgr2=0x7f72c80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:38.543 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.538+0000 7f72cf7ff700 1 -- 172.21.15.178:0/2259023289 shutdown_connections 2023-06-23T19:00:38.543 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.538+0000 7f72cf7ff700 1 -- 172.21.15.178:0/2259023289 wait complete. 2023-06-23T19:00:38.543 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.540+0000 7f72cf7ff700 1 Processor -- start 2023-06-23T19:00:38.544 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.540+0000 7f72cf7ff700 1 -- start start 2023-06-23T19:00:38.544 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.541+0000 7f72cf7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80b51d0 0x7f72c80c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.541+0000 7f72cf7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c80cf910 0x7f72c815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.541+0000 7f72cf7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72c80d0a60 0x7f72c815a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.541+0000 7f72cf7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8158a90 con 0x7f72c80d0a60 2023-06-23T19:00:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.541+0000 7f72cf7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8156850 con 0x7f72c80cf910 2023-06-23T19:00:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.541+0000 7f72cf7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c815d150 con 0x7f72c80b51d0 2023-06-23T19:00:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80b51d0 0x7f72c80c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80b51d0 0x7f72c80c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:49374/0 (socket says 172.21.15.178:49374) 2023-06-23T19:00:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cd59b700 1 -- 172.21.15.178:0/3955002190 learned_addr learned my addr 172.21.15.178:0/3955002190 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72ccd9a700 1 --2- 172.21.15.178:0/3955002190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c80cf910 0x7f72c815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cdd9c700 1 --2- 172.21.15.178:0/3955002190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72c80d0a60 0x7f72c815a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cd59b700 1 -- 172.21.15.178:0/3955002190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c80cf910 msgr2=0x7f72c815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cd59b700 1 --2- 172.21.15.178:0/3955002190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c80cf910 0x7f72c815cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cd59b700 1 -- 172.21.15.178:0/3955002190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72c80d0a60 msgr2=0x7f72c815a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cd59b700 1 --2- 172.21.15.178:0/3955002190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72c80d0a60 0x7f72c815a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cd59b700 1 -- 172.21.15.178:0/3955002190 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40094a0 con 0x7f72c80b51d0 2023-06-23T19:00:38.548 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.542+0000 7f72cd59b700 1 --2- 172.21.15.178:0/3955002190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80b51d0 0x7f72c80c8b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72c40090b0 tx=0x7f72c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:38.548 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.543+0000 7f72bdffb700 1 -- 172.21.15.178:0/3955002190 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4003cd0 con 0x7f72c80b51d0 2023-06-23T19:00:38.548 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.543+0000 7f72bdffb700 1 -- 172.21.15.178:0/3955002190 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c401f070 con 0x7f72c80b51d0 2023-06-23T19:00:38.549 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.543+0000 7f72cf7ff700 1 -- 172.21.15.178:0/3955002190 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c815d380 con 0x7f72c80b51d0 2023-06-23T19:00:38.549 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.543+0000 7f72bdffb700 1 -- 172.21.15.178:0/3955002190 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4011870 con 0x7f72c80b51d0 2023-06-23T19:00:38.549 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.543+0000 7f72cf7ff700 1 -- 172.21.15.178:0/3955002190 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c81586b0 con 0x7f72c80b51d0 2023-06-23T19:00:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.543+0000 7f72bdffb700 1 -- 172.21.15.178:0/3955002190 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f72c4021030 con 0x7f72c80b51d0 2023-06-23T19:00:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.543+0000 7f72bdffb700 1 -- 172.21.15.178:0/3955002190 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f72c401b440 con 0x7f72c80b51d0 2023-06-23T19:00:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.544+0000 7f72cf7ff700 1 -- 172.21.15.178:0/3955002190 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c804ea20 con 0x7f72c80b51d0 2023-06-23T19:00:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.547+0000 7f72bdffb700 1 -- 172.21.15.178:0/3955002190 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f72c401a440 con 0x7f72c80b51d0 2023-06-23T19:00:38.602 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:38.599+0000 7f5f52a98200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.639+0000 7f72cf7ff700 1 -- 172.21.15.178:0/3955002190 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "52320eb5-b8e0-4054-9017-683dd67f4f92", "id": 4} v 0) v1 -- 0x7f72c804ea20 con 0x7f72c80b51d0 2023-06-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.645+0000 7f72bdffb700 1 -- 172.21.15.178:0/3955002190 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52320eb5-b8e0-4054-9017-683dd67f4f92", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72c401a9e0 con 0x7f72c80b51d0 2023-06-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi178.stdout:4 2023-06-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.646+0000 7f72cf7ff700 1 -- 172.21.15.178:0/3955002190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80b51d0 msgr2=0x7f72c80c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.646+0000 7f72cf7ff700 1 --2- 172.21.15.178:0/3955002190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80b51d0 0x7f72c80c8b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72c40090b0 tx=0x7f72c4004750 comp rx=0 tx=0).stop 2023-06-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.646+0000 7f72cf7ff700 1 -- 172.21.15.178:0/3955002190 shutdown_connections 2023-06-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.646+0000 7f72cf7ff700 1 --2- 172.21.15.178:0/3955002190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72c80d0a60 0x7f72c815a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.646+0000 7f72cf7ff700 1 --2- 172.21.15.178:0/3955002190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c80b51d0 0x7f72c80c8b20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.646+0000 7f72cf7ff700 1 --2- 172.21.15.178:0/3955002190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c80cf910 0x7f72c815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.646+0000 7f72cf7ff700 1 -- 172.21.15.178:0/3955002190 >> 172.21.15.178:0/3955002190 conn(0x7f72c8071620 msgr2=0x7f72c80d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.646+0000 7f72cf7ff700 1 -- 172.21.15.178:0/3955002190 shutdown_connections 2023-06-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.646+0000 7f72cf7ff700 1 -- 172.21.15.178:0/3955002190 wait complete. 2023-06-23T19:00:38.668 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new e381a4d7-491a-43bd-9f07-d27ea87c30d4 5 2023-06-23T19:00:38.677 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:38.674+0000 7fe4f706d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-23T19:00:38.862 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.859+0000 7f7e291ff700 1 Processor -- start 2023-06-23T19:00:38.863 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.859+0000 7f7e291ff700 1 -- start start 2023-06-23T19:00:38.864 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e291ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e240709f0 0x7f7e240b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.864 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e291ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240b2b40 0x7f7e2406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.864 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e291ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2406d130 con 0x7f7e2415a5a0 2023-06-23T19:00:38.864 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e291ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e240cf6a0 con 0x7f7e240709f0 2023-06-23T19:00:38.865 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e291ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2406c520 con 0x7f7e240b2b40 2023-06-23T19:00:38.865 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e1bfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e240709f0 0x7f7e240b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.865 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e2359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240b2b40 0x7f7e2406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.865 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e1bfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e240709f0 0x7f7e240b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:37560/0 (socket says 172.21.15.178:37560) 2023-06-23T19:00:38.865 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e1bfff700 1 -- 172.21.15.178:0/804539017 learned_addr learned my addr 172.21.15.178:0/804539017 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:38.865 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e2359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240b2b40 0x7f7e2406d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:49376/0 (socket says 172.21.15.178:49376) 2023-06-23T19:00:38.866 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e1bfff700 1 -- 172.21.15.178:0/804539017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240b2b40 msgr2=0x7f7e2406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:38.866 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e1bfff700 1 --2- 172.21.15.178:0/804539017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240b2b40 0x7f7e2406d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.867 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e1bfff700 1 -- 172.21.15.178:0/804539017 >> v1:172.21.15.136:6789/0 conn(0x7f7e2415a5a0 legacy=0x7f7e240702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.867 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e1bfff700 1 -- 172.21.15.178:0/804539017 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2406c800 con 0x7f7e240709f0 2023-06-23T19:00:38.867 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e2359e700 1 --2- 172.21.15.178:0/804539017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240b2b40 0x7f7e2406d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:38.867 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.861+0000 7f7e2259c700 1 -- 172.21.15.178:0/804539017 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484941373 0 0) 0x7f7e2406d130 con 0x7f7e2415a5a0 2023-06-23T19:00:38.867 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.862+0000 7f7e1bfff700 1 --2- 172.21.15.178:0/804539017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e240709f0 0x7f7e240b4210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0098f0 tx=0x7f7e0c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc4cb0754c7a42de server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:38.867 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.862+0000 7f7e2259c700 1 -- 172.21.15.178:0/804539017 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c011830 con 0x7f7e240709f0 2023-06-23T19:00:38.867 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.862+0000 7f7e2259c700 1 -- 172.21.15.178:0/804539017 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c011990 con 0x7f7e240709f0 2023-06-23T19:00:38.868 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.862+0000 7f7e2259c700 1 -- 172.21.15.178:0/804539017 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c011d20 con 0x7f7e240709f0 2023-06-23T19:00:38.868 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.863+0000 7f7e291ff700 1 -- 172.21.15.178:0/804539017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e240709f0 msgr2=0x7f7e240b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.868 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.863+0000 7f7e291ff700 1 --2- 172.21.15.178:0/804539017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e240709f0 0x7f7e240b4210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0098f0 tx=0x7f7e0c009c00 comp rx=0 tx=0).stop 2023-06-23T19:00:38.868 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.863+0000 7f7e291ff700 1 -- 172.21.15.178:0/804539017 shutdown_connections 2023-06-23T19:00:38.868 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.863+0000 7f7e291ff700 1 --2- 172.21.15.178:0/804539017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240b2b40 0x7f7e2406d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.868 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.863+0000 7f7e291ff700 1 --2- 172.21.15.178:0/804539017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e240709f0 0x7f7e240b4210 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.868 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.863+0000 7f7e291ff700 1 -- 172.21.15.178:0/804539017 >> 172.21.15.178:0/804539017 conn(0x7f7e2406ab80 msgr2=0x7f7e240ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:38.869 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.863+0000 7f7e291ff700 1 -- 172.21.15.178:0/804539017 shutdown_connections 2023-06-23T19:00:38.869 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.863+0000 7f7e291ff700 1 -- 172.21.15.178:0/804539017 wait complete. 2023-06-23T19:00:38.869 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:38.863+0000 7fe4f706d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T19:00:38.870 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.865+0000 7f7e291ff700 1 Processor -- start 2023-06-23T19:00:38.871 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.865+0000 7f7e291ff700 1 -- start start 2023-06-23T19:00:38.871 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e291ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240709f0 0x7f7e240bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.871 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e291ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e240b2b40 0x7f7e240ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.871 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e291ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e2415a5a0 0x7f7e241fa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:38.871 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e291ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240c8d10 con 0x7f7e240b2b40 2023-06-23T19:00:38.871 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e291ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240c8f60 con 0x7f7e2415a5a0 2023-06-23T19:00:38.872 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e291ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240c9240 con 0x7f7e240709f0 2023-06-23T19:00:38.872 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e22d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240709f0 0x7f7e240bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.872 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e1bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e240b2b40 0x7f7e240ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.872 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e1bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e240b2b40 0x7f7e240ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.178:37058/0 (socket says 172.21.15.178:37058) 2023-06-23T19:00:38.872 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e2359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e2415a5a0 0x7f7e241fa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:38.872 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e1bfff700 1 -- 172.21.15.178:0/3393637937 learned_addr learned my addr 172.21.15.178:0/3393637937 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:38.872 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.866+0000 7f7e22d9d700 1 --2- 172.21.15.178:0/3393637937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240709f0 0x7f7e240bd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:49384/0 (socket says 172.21.15.178:49384) 2023-06-23T19:00:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e1bfff700 1 -- 172.21.15.178:0/3393637937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240709f0 msgr2=0x7f7e240bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e1bfff700 1 --2- 172.21.15.178:0/3393637937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240709f0 0x7f7e240bd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e1bfff700 1 -- 172.21.15.178:0/3393637937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e2415a5a0 msgr2=0x7f7e241fa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e1bfff700 1 --2- 172.21.15.178:0/3393637937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e2415a5a0 0x7f7e241fa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e1bfff700 1 -- 172.21.15.178:0/3393637937 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c009a70 con 0x7f7e240b2b40 2023-06-23T19:00:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e2359e700 1 --2- 172.21.15.178:0/3393637937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e2415a5a0 0x7f7e241fa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e1bfff700 1 --2- 172.21.15.178:0/3393637937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e240b2b40 0x7f7e240ca000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009c40 tx=0x7f7e0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e1b7fe700 1 -- 172.21.15.178:0/3393637937 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c004300 con 0x7f7e240b2b40 2023-06-23T19:00:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e1b7fe700 1 -- 172.21.15.178:0/3393637937 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c01f070 con 0x7f7e240b2b40 2023-06-23T19:00:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.867+0000 7f7e291ff700 1 -- 172.21.15.178:0/3393637937 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c009550 con 0x7f7e240b2b40 2023-06-23T19:00:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.868+0000 7f7e1b7fe700 1 -- 172.21.15.178:0/3393637937 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0036a0 con 0x7f7e240b2b40 2023-06-23T19:00:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.868+0000 7f7e291ff700 1 -- 172.21.15.178:0/3393637937 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e240c9800 con 0x7f7e240b2b40 2023-06-23T19:00:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.868+0000 7f7e1b7fe700 1 -- 172.21.15.178:0/3393637937 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e0c021030 con 0x7f7e240b2b40 2023-06-23T19:00:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.868+0000 7f7e1b7fe700 1 -- 172.21.15.178:0/3393637937 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7e0c01a450 con 0x7f7e240b2b40 2023-06-23T19:00:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.869+0000 7f7e291ff700 1 -- 172.21.15.178:0/3393637937 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2404ea20 con 0x7f7e240b2b40 2023-06-23T19:00:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.871+0000 7f7e1b7fe700 1 -- 172.21.15.178:0/3393637937 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7e0c015020 con 0x7f7e240b2b40 2023-06-23T19:00:38.965 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.962+0000 7f7e291ff700 1 -- 172.21.15.178:0/3393637937 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e381a4d7-491a-43bd-9f07-d27ea87c30d4", "id": 5} v 0) v1 -- 0x7f7e24071490 con 0x7f7e240b2b40 2023-06-23T19:00:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.966+0000 7f7e1b7fe700 1 -- 172.21.15.178:0/3393637937 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e381a4d7-491a-43bd-9f07-d27ea87c30d4", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e0c033020 con 0x7f7e240b2b40 2023-06-23T19:00:38.970 INFO:teuthology.orchestra.run.smithi178.stdout:5 2023-06-23T19:00:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.968+0000 7f7e291ff700 1 -- 172.21.15.178:0/3393637937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e240b2b40 msgr2=0x7f7e240ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.968+0000 7f7e291ff700 1 --2- 172.21.15.178:0/3393637937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e240b2b40 0x7f7e240ca000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009c40 tx=0x7f7e0c004750 comp rx=0 tx=0).stop 2023-06-23T19:00:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.968+0000 7f7e291ff700 1 -- 172.21.15.178:0/3393637937 shutdown_connections 2023-06-23T19:00:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.968+0000 7f7e291ff700 1 --2- 172.21.15.178:0/3393637937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e2415a5a0 0x7f7e241fa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.968+0000 7f7e291ff700 1 --2- 172.21.15.178:0/3393637937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e240709f0 0x7f7e240bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.972 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.968+0000 7f7e291ff700 1 --2- 172.21.15.178:0/3393637937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e240b2b40 0x7f7e240ca000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:38.972 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.968+0000 7f7e291ff700 1 -- 172.21.15.178:0/3393637937 >> 172.21.15.178:0/3393637937 conn(0x7f7e2406ab80 msgr2=0x7f7e240c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:38.972 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.968+0000 7f7e291ff700 1 -- 172.21.15.178:0/3393637937 shutdown_connections 2023-06-23T19:00:38.972 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:38.968+0000 7f7e291ff700 1 -- 172.21.15.178:0/3393637937 wait complete. 2023-06-23T19:00:38.988 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new e3239dd0-b26f-40a1-acfc-4e15a61fb220 6 2023-06-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.207+0000 7f010efff700 1 Processor -- start 2023-06-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.207+0000 7f010efff700 1 -- start start 2023-06-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.208+0000 7f010efff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b51d0 0x7f01080cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.208+0000 7f010efff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01080b5ec0 con 0x7f01080d0a60 2023-06-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.208+0000 7f010efff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01080b5650 con 0x7f01080b5a70 2023-06-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.208+0000 7f010efff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01080d0060 con 0x7f01080b51d0 2023-06-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.208+0000 7f010cd9b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f01080d0a60 0x7f01080d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.178:33044/0 (socket says 172.21.15.178:33044) 2023-06-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.208+0000 7f010cd9b700 1 -- 172.21.15.178:0/1849138554 learned_addr learned my addr 172.21.15.178:0/1849138554 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-06-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.209+0000 7f010d59c700 1 --2- 172.21.15.178:0/1849138554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b51d0 0x7f01080cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.209+0000 7f010d59c700 1 -- 172.21.15.178:0/1849138554 >> v1:172.21.15.178:6789/0 conn(0x7f01080b5a70 legacy=0x7f01080d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.209+0000 7f010d59c700 1 -- 172.21.15.178:0/1849138554 >> v1:172.21.15.136:6789/0 conn(0x7f01080d0a60 legacy=0x7f01080d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.209+0000 7f01077fe700 1 -- 172.21.15.178:0/1849138554 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045995616 0 0) 0x7f01080b5ec0 con 0x7f01080d0a60 2023-06-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.209+0000 7f010d59c700 1 -- 172.21.15.178:0/1849138554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080cd9d0 con 0x7f01080b51d0 2023-06-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.209+0000 7f010d59c700 1 --2- 172.21.15.178:0/1849138554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b51d0 0x7f01080cf910 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0100009dc0 tx=0x7f010000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98099a94dce35591 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.210+0000 7f01077fe700 1 -- 172.21.15.178:0/1849138554 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010000e070 con 0x7f01080b51d0 2023-06-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.210+0000 7f01077fe700 1 -- 172.21.15.178:0/1849138554 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010000bad0 con 0x7f01080b51d0 2023-06-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.210+0000 7f01077fe700 1 -- 172.21.15.178:0/1849138554 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010000be80 con 0x7f01080b51d0 2023-06-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.210+0000 7f010efff700 1 -- 172.21.15.178:0/1849138554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b51d0 msgr2=0x7f01080cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.210+0000 7f010efff700 1 --2- 172.21.15.178:0/1849138554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b51d0 0x7f01080cf910 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0100009dc0 tx=0x7f010000b330 comp rx=0 tx=0).stop 2023-06-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.211+0000 7f010efff700 1 -- 172.21.15.178:0/1849138554 shutdown_connections 2023-06-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.211+0000 7f010efff700 1 --2- 172.21.15.178:0/1849138554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b51d0 0x7f01080cf910 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.211+0000 7f010efff700 1 -- 172.21.15.178:0/1849138554 >> 172.21.15.178:0/1849138554 conn(0x7f0108071620 msgr2=0x7f01080719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.211+0000 7f010efff700 1 -- 172.21.15.178:0/1849138554 shutdown_connections 2023-06-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.211+0000 7f010efff700 1 -- 172.21.15.178:0/1849138554 wait complete. 2023-06-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.212+0000 7f010efff700 1 Processor -- start 2023-06-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.212+0000 7f010efff700 1 -- start start 2023-06-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.213+0000 7f010efff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01080b51d0 0x7f010815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.213+0000 7f010efff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b5a70 0x7f01080c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.213+0000 7f010efff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01080d0a60 0x7f01081f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.213+0000 7f010efff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01081f5a70 con 0x7f01080b51d0 2023-06-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.213+0000 7f010efff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01081f5cc0 con 0x7f01080d0a60 2023-06-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.213+0000 7f010efff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01081f5fa0 con 0x7f01080b5a70 2023-06-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f0107fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b5a70 0x7f01080c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f0107fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b5a70 0x7f01080c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:49398/0 (socket says 172.21.15.178:49398) 2023-06-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f0107fff700 1 -- 172.21.15.178:0/1018220911 learned_addr learned my addr 172.21.15.178:0/1018220911 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f010d59c700 1 --2- 172.21.15.178:0/1018220911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01080d0a60 0x7f01081f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f010cd9b700 1 --2- 172.21.15.178:0/1018220911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01080b51d0 0x7f010815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f0107fff700 1 -- 172.21.15.178:0/1018220911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01080d0a60 msgr2=0x7f01081f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f0107fff700 1 --2- 172.21.15.178:0/1018220911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01080d0a60 0x7f01081f2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f0107fff700 1 -- 172.21.15.178:0/1018220911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01080b51d0 msgr2=0x7f010815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f0107fff700 1 --2- 172.21.15.178:0/1018220911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01080b51d0 0x7f010815d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f0107fff700 1 -- 172.21.15.178:0/1018220911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0100009a70 con 0x7f01080b5a70 2023-06-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.214+0000 7f0107fff700 1 --2- 172.21.15.178:0/1018220911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b5a70 0x7f01080c6ee0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c780 tx=0x7f00f400ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.215+0000 7f01057fa700 1 -- 172.21.15.178:0/1018220911 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f40054e0 con 0x7f01080b5a70 2023-06-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.215+0000 7f01057fa700 1 -- 172.21.15.178:0/1018220911 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f4003680 con 0x7f01080b5a70 2023-06-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.215+0000 7f010efff700 1 -- 172.21.15.178:0/1018220911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01081f6280 con 0x7f01080b5a70 2023-06-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.215+0000 7f01057fa700 1 -- 172.21.15.178:0/1018220911 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4003a30 con 0x7f01080b5a70 2023-06-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.215+0000 7f010efff700 1 -- 172.21.15.178:0/1018220911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01081f68d0 con 0x7f01080b5a70 2023-06-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.215+0000 7f01057fa700 1 -- 172.21.15.178:0/1018220911 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f00f401c440 con 0x7f01080b5a70 2023-06-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.215+0000 7f01057fa700 1 -- 172.21.15.178:0/1018220911 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f00f40129f0 con 0x7f01080b5a70 2023-06-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.216+0000 7f010efff700 1 -- 172.21.15.178:0/1018220911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010804ea20 con 0x7f01080b5a70 2023-06-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.218+0000 7f01057fa700 1 -- 172.21.15.178:0/1018220911 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f00f4017070 con 0x7f01080b5a70 2023-06-23T19:00:39.309 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.305+0000 7f010efff700 1 -- 172.21.15.178:0/1018220911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e3239dd0-b26f-40a1-acfc-4e15a61fb220", "id": 6} v 0) v1 -- 0x7f01080d01a0 con 0x7f01080b5a70 2023-06-23T19:00:39.316 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.313+0000 7f01057fa700 1 -- 172.21.15.178:0/1018220911 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3239dd0-b26f-40a1-acfc-4e15a61fb220", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f00f40124d0 con 0x7f01080b5a70 2023-06-23T19:00:39.317 INFO:teuthology.orchestra.run.smithi178.stdout:6 2023-06-23T19:00:39.317 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.314+0000 7f010efff700 1 -- 172.21.15.178:0/1018220911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b5a70 msgr2=0x7f01080c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.318 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.314+0000 7f010efff700 1 --2- 172.21.15.178:0/1018220911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b5a70 0x7f01080c6ee0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c780 tx=0x7f00f400ca90 comp rx=0 tx=0).stop 2023-06-23T19:00:39.318 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.314+0000 7f010efff700 1 -- 172.21.15.178:0/1018220911 shutdown_connections 2023-06-23T19:00:39.318 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.314+0000 7f010efff700 1 --2- 172.21.15.178:0/1018220911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01080d0a60 0x7f01081f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.318 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.314+0000 7f010efff700 1 --2- 172.21.15.178:0/1018220911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01080b51d0 0x7f010815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.318 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.314+0000 7f010efff700 1 --2- 172.21.15.178:0/1018220911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01080b5a70 0x7f01080c6ee0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.318 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.314+0000 7f010efff700 1 -- 172.21.15.178:0/1018220911 >> 172.21.15.178:0/1018220911 conn(0x7f0108071620 msgr2=0x7f010815f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:39.319 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.315+0000 7f010efff700 1 -- 172.21.15.178:0/1018220911 shutdown_connections 2023-06-23T19:00:39.319 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.315+0000 7f010efff700 1 -- 172.21.15.178:0/1018220911 wait complete. 2023-06-23T19:00:39.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 3f02d50d-1afd-4974-9214-5462856d6431 7 2023-06-23T19:00:39.380 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:39.377+0000 7f5f52a98200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-23T19:00:39.538 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.535+0000 7fe0f47ff700 1 Processor -- start 2023-06-23T19:00:39.538 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.535+0000 7fe0f47ff700 1 -- start start 2023-06-23T19:00:39.539 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.536+0000 7fe0f47ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec0cf590 0x7fe0ec0d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.539 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.536+0000 7fe0f47ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe0ec15d280 0x7fe0ec0d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.539 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.536+0000 7fe0f47ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec0cd6d0 con 0x7fe0ec0cd1d0 2023-06-23T19:00:39.540 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.536+0000 7fe0f47ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec0cd9b0 con 0x7fe0ec15d280 2023-06-23T19:00:39.540 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.536+0000 7fe0f47ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0b55b0 con 0x7fe0ec0cf590 2023-06-23T19:00:39.541 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.536+0000 7fe0f2d9c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe0ec15d280 0x7fe0ec0d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.541 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.536+0000 7fe0f259b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec0cf590 0x7fe0ec0d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.541 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f1d9a700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe0ec0cd1d0 0x7fe0ec0cf960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:36788/0 (socket says 172.21.15.178:36788) 2023-06-23T19:00:39.541 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f1d9a700 1 -- 172.21.15.178:0/3963250377 learned_addr learned my addr 172.21.15.178:0/3963250377 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-06-23T19:00:39.541 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f2d9c700 1 -- 172.21.15.178:0/3963250377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec0cf590 msgr2=0x7fe0ec0d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f2d9c700 1 --2- 172.21.15.178:0/3963250377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec0cf590 0x7fe0ec0d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f2d9c700 1 -- 172.21.15.178:0/3963250377 >> v1:172.21.15.178:6789/0 conn(0x7fe0ec0cd1d0 legacy=0x7fe0ec0cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f2d9c700 1 -- 172.21.15.178:0/3963250377 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0d2b20 con 0x7fe0ec15d280 2023-06-23T19:00:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f259b700 1 --2- 172.21.15.178:0/3963250377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec0cf590 0x7fe0ec0d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f1599700 1 -- 172.21.15.178:0/3963250377 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628819454 0 0) 0x7fe0ec0cd6d0 con 0x7fe0ec0cd1d0 2023-06-23T19:00:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f2d9c700 1 --2- 172.21.15.178:0/3963250377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec15d280 0x7fe0ec0d0750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009d90 tx=0x7fe0e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fcc5275df42ec70 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:39.543 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.537+0000 7fe0f1599700 1 -- 172.21.15.178:0/3963250377 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400e070 con 0x7fe0ec15d280 2023-06-23T19:00:39.543 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.538+0000 7fe0f1599700 1 -- 172.21.15.178:0/3963250377 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400bb20 con 0x7fe0ec15d280 2023-06-23T19:00:39.543 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.538+0000 7fe0f1599700 1 -- 172.21.15.178:0/3963250377 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4012430 con 0x7fe0ec15d280 2023-06-23T19:00:39.544 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.538+0000 7fe0f47ff700 1 -- 172.21.15.178:0/3963250377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec15d280 msgr2=0x7fe0ec0d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.544 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.538+0000 7fe0f47ff700 1 --2- 172.21.15.178:0/3963250377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec15d280 0x7fe0ec0d0750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009d90 tx=0x7fe0e400b330 comp rx=0 tx=0).stop 2023-06-23T19:00:39.544 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.538+0000 7fe0f47ff700 1 -- 172.21.15.178:0/3963250377 shutdown_connections 2023-06-23T19:00:39.544 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.538+0000 7fe0f47ff700 1 --2- 172.21.15.178:0/3963250377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec15d280 0x7fe0ec0d0750 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.544 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.538+0000 7fe0f47ff700 1 --2- 172.21.15.178:0/3963250377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec0cf590 0x7fe0ec0d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.538+0000 7fe0f47ff700 1 -- 172.21.15.178:0/3963250377 >> 172.21.15.178:0/3963250377 conn(0x7fe0ec06b3b0 msgr2=0x7fe0ec06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.539+0000 7fe0f47ff700 1 -- 172.21.15.178:0/3963250377 shutdown_connections 2023-06-23T19:00:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.539+0000 7fe0f47ff700 1 -- 172.21.15.178:0/3963250377 wait complete. 2023-06-23T19:00:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.540+0000 7fe0f47ff700 1 Processor -- start 2023-06-23T19:00:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.541+0000 7fe0f47ff700 1 -- start start 2023-06-23T19:00:39.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.541+0000 7fe0f47ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0ec0cd1d0 0x7fe0ec1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f47ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec0cf590 0x7fe0ec1e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f47ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec15d280 0x7fe0ec0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.547 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f47ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec156620 con 0x7fe0ec0cd1d0 2023-06-23T19:00:39.548 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f47ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1e73e0 con 0x7fe0ec0cf590 2023-06-23T19:00:39.548 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f47ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1e76c0 con 0x7fe0ec15d280 2023-06-23T19:00:39.548 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f1d9a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec0cf590 0x7fe0ec1e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.548 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f1d9a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec0cf590 0x7fe0ec1e4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:37594/0 (socket says 172.21.15.178:37594) 2023-06-23T19:00:39.548 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f2d9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec15d280 0x7fe0ec0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.548 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f1d9a700 1 -- 172.21.15.178:0/4215481961 learned_addr learned my addr 172.21.15.178:0/4215481961 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-06-23T19:00:39.549 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f259b700 1 --2- 172.21.15.178:0/4215481961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0ec0cd1d0 0x7fe0ec1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.549 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f2d9c700 1 -- 172.21.15.178:0/4215481961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec0cf590 msgr2=0x7fe0ec1e4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.549 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f2d9c700 1 --2- 172.21.15.178:0/4215481961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec0cf590 0x7fe0ec1e4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.549 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f2d9c700 1 -- 172.21.15.178:0/4215481961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0ec0cd1d0 msgr2=0x7fe0ec1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.549 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f2d9c700 1 --2- 172.21.15.178:0/4215481961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0ec0cd1d0 0x7fe0ec1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.549 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f2d9c700 1 -- 172.21.15.178:0/4215481961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80094a0 con 0x7fe0ec15d280 2023-06-23T19:00:39.550 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.542+0000 7fe0f1d9a700 1 --2- 172.21.15.178:0/4215481961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec0cf590 0x7fe0ec1e4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:39.550 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.543+0000 7fe0f2d9c700 1 --2- 172.21.15.178:0/4215481961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec15d280 0x7fe0ec0b30d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec06c570 tx=0x7fe0e4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:39.550 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.543+0000 7fe0e2ffd700 1 -- 172.21.15.178:0/4215481961 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4012430 con 0x7fe0ec15d280 2023-06-23T19:00:39.550 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.543+0000 7fe0e2ffd700 1 -- 172.21.15.178:0/4215481961 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e4020070 con 0x7fe0ec15d280 2023-06-23T19:00:39.550 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.543+0000 7fe0f47ff700 1 -- 172.21.15.178:0/4215481961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e4009a70 con 0x7fe0ec15d280 2023-06-23T19:00:39.550 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.543+0000 7fe0e2ffd700 1 -- 172.21.15.178:0/4215481961 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40098f0 con 0x7fe0ec15d280 2023-06-23T19:00:39.551 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.543+0000 7fe0f47ff700 1 -- 172.21.15.178:0/4215481961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec1e7c80 con 0x7fe0ec15d280 2023-06-23T19:00:39.551 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.543+0000 7fe0e2ffd700 1 -- 172.21.15.178:0/4215481961 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe0e4004340 con 0x7fe0ec15d280 2023-06-23T19:00:39.551 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.544+0000 7fe0e2ffd700 1 -- 172.21.15.178:0/4215481961 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe0e4022070 con 0x7fe0ec15d280 2023-06-23T19:00:39.551 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.544+0000 7fe0f47ff700 1 -- 172.21.15.178:0/4215481961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec04ea20 con 0x7fe0ec15d280 2023-06-23T19:00:39.552 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.547+0000 7fe0e2ffd700 1 -- 172.21.15.178:0/4215481961 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe0e402c060 con 0x7fe0ec15d280 2023-06-23T19:00:39.584 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:39.581+0000 7f5f52a98200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T19:00:39.637 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.634+0000 7fe0f47ff700 1 -- 172.21.15.178:0/4215481961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3f02d50d-1afd-4974-9214-5462856d6431", "id": 7} v 0) v1 -- 0x7fe0ec0b8b00 con 0x7fe0ec15d280 2023-06-23T19:00:39.645 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.642+0000 7fe0e2ffd700 1 -- 172.21.15.178:0/4215481961 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f02d50d-1afd-4974-9214-5462856d6431", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe0e4004780 con 0x7fe0ec15d280 2023-06-23T19:00:39.645 INFO:teuthology.orchestra.run.smithi178.stdout:7 2023-06-23T19:00:39.647 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.643+0000 7fe0f47ff700 1 -- 172.21.15.178:0/4215481961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec15d280 msgr2=0x7fe0ec0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.647 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.643+0000 7fe0f47ff700 1 --2- 172.21.15.178:0/4215481961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec15d280 0x7fe0ec0b30d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec06c570 tx=0x7fe0e4004ad0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.648 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.643+0000 7fe0f47ff700 1 -- 172.21.15.178:0/4215481961 shutdown_connections 2023-06-23T19:00:39.648 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.643+0000 7fe0f47ff700 1 --2- 172.21.15.178:0/4215481961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0ec15d280 0x7fe0ec0b30d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.648 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.643+0000 7fe0f47ff700 1 --2- 172.21.15.178:0/4215481961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0ec0cd1d0 0x7fe0ec1560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.649 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.643+0000 7fe0f47ff700 1 --2- 172.21.15.178:0/4215481961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0ec0cf590 0x7fe0ec1e4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.649 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.643+0000 7fe0f47ff700 1 -- 172.21.15.178:0/4215481961 >> 172.21.15.178:0/4215481961 conn(0x7fe0ec06b3b0 msgr2=0x7fe0ec0b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:39.649 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.643+0000 7fe0f47ff700 1 -- 172.21.15.178:0/4215481961 shutdown_connections 2023-06-23T19:00:39.649 INFO:teuthology.orchestra.run.smithi178.stderr:2023-06-23T19:00:39.643+0000 7fe0f47ff700 1 -- 172.21.15.178:0/4215481961 wait complete. 2023-06-23T19:00:39.664 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-23T19:00:39.664 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-23T19:00:39.669 INFO:tasks.ceph.osd.0:Started 2023-06-23T19:00:39.669 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-23T19:00:39.670 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-23T19:00:39.674 INFO:tasks.ceph.osd.1:Started 2023-06-23T19:00:39.675 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-23T19:00:39.675 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-23T19:00:39.679 INFO:tasks.ceph.osd.2:Started 2023-06-23T19:00:39.680 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-23T19:00:39.680 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-23T19:00:39.685 INFO:tasks.ceph.osd.3:Started 2023-06-23T19:00:39.685 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-23T19:00:39.686 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-23T19:00:39.708 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:39.705+0000 7fe4f706d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T19:00:39.710 INFO:tasks.ceph.osd.4:Started 2023-06-23T19:00:39.710 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-23T19:00:39.710 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-23T19:00:39.716 INFO:tasks.ceph.osd.5:Started 2023-06-23T19:00:39.717 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-23T19:00:39.717 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-23T19:00:39.724 INFO:tasks.ceph.osd.6:Started 2023-06-23T19:00:39.724 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-23T19:00:39.724 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-23T19:00:39.729 INFO:tasks.ceph.osd.7:Started 2023-06-23T19:00:39.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:00:39.856 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:39.852+0000 7fe4f706d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T19:00:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.978+0000 7f9b635ff700 1 Processor -- start 2023-06-23T19:00:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.978+0000 7f9b635ff700 1 -- start start 2023-06-23T19:00:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.979+0000 7f9b635ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b5c0cddf0 0x7f9b5c1607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.979+0000 7f9b635ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c06c060 0x7f9b5c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.979+0000 7f9b635ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c15c770 con 0x7f9b5c15a000 2023-06-23T19:00:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.979+0000 7f9b635ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c15ca50 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.979+0000 7f9b635ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0cc9c0 con 0x7f9b5c06c060 2023-06-23T19:00:39.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b60b9a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b5c0cddf0 0x7f9b5c1607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b61b9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c06c060 0x7f9b5c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b6139b700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9b5c15a000 0x7f9b5c15cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:56768/0 (socket says 172.21.15.136:56768) 2023-06-23T19:00:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b6139b700 1 -- 172.21.15.136:0/3814447276 learned_addr learned my addr 172.21.15.136:0/3814447276 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:00:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b53fff700 1 -- 172.21.15.136:0/3814447276 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210271980 0 0) 0x7f9b5c15c770 con 0x7f9b5c15a000 2023-06-23T19:00:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b53fff700 1 -- 172.21.15.136:0/3814447276 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b480035b0 con 0x7f9b5c15a000 2023-06-23T19:00:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b60b9a700 1 -- 172.21.15.136:0/3814447276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c06c060 msgr2=0x7f9b5c06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b60b9a700 1 --2- 172.21.15.136:0/3814447276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c06c060 0x7f9b5c06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b60b9a700 1 -- 172.21.15.136:0/3814447276 >> v1:172.21.15.178:6789/0 conn(0x7f9b5c15a000 legacy=0x7f9b5c15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b60b9a700 1 -- 172.21.15.136:0/3814447276 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c160d10 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.980+0000 7f9b61b9c700 1 --2- 172.21.15.136:0/3814447276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c06c060 0x7f9b5c06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b60b9a700 1 --2- 172.21.15.136:0/3814447276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b5c0cddf0 0x7f9b5c1607d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009840 tx=0x7f9b4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9b34e2e0ed982ae server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b53fff700 1 -- 172.21.15.136:0/3814447276 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c011830 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b53fff700 1 -- 172.21.15.136:0/3814447276 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c011990 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b53fff700 1 -- 172.21.15.136:0/3814447276 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c011d20 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b635ff700 1 -- 172.21.15.136:0/3814447276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b5c0cddf0 msgr2=0x7f9b5c1607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b635ff700 1 --2- 172.21.15.136:0/3814447276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b5c0cddf0 0x7f9b5c1607d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009840 tx=0x7f9b4c009b50 comp rx=0 tx=0).stop 2023-06-23T19:00:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b635ff700 1 -- 172.21.15.136:0/3814447276 shutdown_connections 2023-06-23T19:00:39.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b635ff700 1 --2- 172.21.15.136:0/3814447276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c06c060 0x7f9b5c06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b635ff700 1 --2- 172.21.15.136:0/3814447276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b5c0cddf0 0x7f9b5c1607d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.981+0000 7f9b635ff700 1 -- 172.21.15.136:0/3814447276 >> 172.21.15.136:0/3814447276 conn(0x7f9b5c0b0ef0 msgr2=0x7f9b5c0ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:39.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.982+0000 7f9b635ff700 1 -- 172.21.15.136:0/3814447276 shutdown_connections 2023-06-23T19:00:39.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.982+0000 7f9b635ff700 1 -- 172.21.15.136:0/3814447276 wait complete. 2023-06-23T19:00:39.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.983+0000 7f9b635ff700 1 Processor -- start 2023-06-23T19:00:39.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.983+0000 7f9b635ff700 1 -- start start 2023-06-23T19:00:39.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.984+0000 7f9b635ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b5c06c060 0x7f9b5c1f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.984+0000 7f9b635ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c0cddf0 0x7f9b5c1f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.984+0000 7f9b635ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b5c15a000 0x7f9b5c0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:39.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.984+0000 7f9b635ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0b17c0 con 0x7f9b5c06c060 2023-06-23T19:00:39.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.984+0000 7f9b635ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c1f26a0 con 0x7f9b5c15a000 2023-06-23T19:00:39.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.984+0000 7f9b635ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c1f2980 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b6139b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b5c06c060 0x7f9b5c1f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b60b9a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c0cddf0 0x7f9b5c1f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b6139b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b5c06c060 0x7f9b5c1f1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58490/0 (socket says 172.21.15.136:58490) 2023-06-23T19:00:39.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b60b9a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c0cddf0 0x7f9b5c1f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:34950/0 (socket says 172.21.15.136:34950) 2023-06-23T19:00:39.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b6139b700 1 -- 172.21.15.136:0/1912532759 learned_addr learned my addr 172.21.15.136:0/1912532759 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:39.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b61b9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b5c15a000 0x7f9b5c0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:39.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b60b9a700 1 -- 172.21.15.136:0/1912532759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b5c15a000 msgr2=0x7f9b5c0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b60b9a700 1 --2- 172.21.15.136:0/1912532759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b5c15a000 0x7f9b5c0b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b60b9a700 1 -- 172.21.15.136:0/1912532759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b5c06c060 msgr2=0x7f9b5c1f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:39.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b60b9a700 1 --2- 172.21.15.136:0/1912532759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b5c06c060 0x7f9b5c1f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:39.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b60b9a700 1 -- 172.21.15.136:0/1912532759 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009a70 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.985+0000 7f9b60b9a700 1 --2- 172.21.15.136:0/1912532759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c0cddf0 0x7f9b5c1f3080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c016000 tx=0x7f9b4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:39.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.986+0000 7f9b51ffb700 1 -- 172.21.15.136:0/1912532759 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c004550 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.986+0000 7f9b51ffb700 1 -- 172.21.15.136:0/1912532759 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c01f070 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.986+0000 7f9b635ff700 1 -- 172.21.15.136:0/1912532759 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c0094a0 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.986+0000 7f9b51ffb700 1 -- 172.21.15.136:0/1912532759 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0038a0 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.986+0000 7f9b635ff700 1 -- 172.21.15.136:0/1912532759 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c1f23b0 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.986+0000 7f9b51ffb700 1 -- 172.21.15.136:0/1912532759 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9b4c003d00 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.986+0000 7f9b51ffb700 1 -- 172.21.15.136:0/1912532759 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9b4c021070 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.987+0000 7f9b635ff700 1 -- 172.21.15.136:0/1912532759 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c0b1900 con 0x7f9b5c0cddf0 2023-06-23T19:00:39.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:39.989+0000 7f9b51ffb700 1 -- 172.21.15.136:0/1912532759 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9b5c0b1900 con 0x7f9b5c0cddf0 2023-06-23T19:00:40.048 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:40.044+0000 7fe4f706d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T19:00:40.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.062+0000 7f9b635ff700 1 -- 172.21.15.136:0/1912532759 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b5c1f2ea0 con 0x7f9b5c0cddf0 2023-06-23T19:00:40.066 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.062+0000 7f9b51ffb700 1 -- 172.21.15.136:0/1912532759 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9b4c02b020 con 0x7f9b5c0cddf0 2023-06-23T19:00:40.066 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:00:40.066 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":10,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:00:39.635787+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:00:40.067 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.063+0000 7f9b635ff700 1 -- 172.21.15.136:0/1912532759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c0cddf0 msgr2=0x7f9b5c1f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:40.067 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.063+0000 7f9b635ff700 1 --2- 172.21.15.136:0/1912532759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c0cddf0 0x7f9b5c1f3080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c016000 tx=0x7f9b4c004750 comp rx=0 tx=0).stop 2023-06-23T19:00:40.067 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.064+0000 7f9b635ff700 1 -- 172.21.15.136:0/1912532759 shutdown_connections 2023-06-23T19:00:40.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.064+0000 7f9b635ff700 1 --2- 172.21.15.136:0/1912532759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b5c15a000 0x7f9b5c0b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:40.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.064+0000 7f9b635ff700 1 --2- 172.21.15.136:0/1912532759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b5c06c060 0x7f9b5c1f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:40.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.064+0000 7f9b635ff700 1 --2- 172.21.15.136:0/1912532759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b5c0cddf0 0x7f9b5c1f3080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:40.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.064+0000 7f9b635ff700 1 -- 172.21.15.136:0/1912532759 >> 172.21.15.136:0/1912532759 conn(0x7f9b5c0b0ef0 msgr2=0x7f9b5c06c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:40.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.064+0000 7f9b635ff700 1 -- 172.21.15.136:0/1912532759 shutdown_connections 2023-06-23T19:00:40.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:40.064+0000 7f9b635ff700 1 -- 172.21.15.136:0/1912532759 wait complete. 2023-06-23T19:00:40.085 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-23T19:00:40.086 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-23T19:00:40.345 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:40.342+0000 7fe4f706d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-23T19:00:40.394 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T19:00:40.391+0000 7f6f8dc9a640 -1 Falling back to public interface 2023-06-23T19:00:40.394 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T19:00:40.391+0000 7fe8b713c640 -1 Falling back to public interface 2023-06-23T19:00:40.396 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T19:00:40.393+0000 7f2415f48640 -1 Falling back to public interface 2023-06-23T19:00:40.397 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T19:00:40.393+0000 7f495e304640 -1 Falling back to public interface 2023-06-23T19:00:40.401 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T19:00:40.398+0000 7f91e15d2640 -1 Falling back to public interface 2023-06-23T19:00:40.414 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T19:00:40.411+0000 7f5eca983640 -1 Falling back to public interface 2023-06-23T19:00:40.439 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T19:00:40.435+0000 7fa478b2c640 -1 Falling back to public interface 2023-06-23T19:00:40.445 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T19:00:40.442+0000 7fea1837a640 -1 Falling back to public interface 2023-06-23T19:00:40.447 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:40.443+0000 7fe4f706d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T19:00:40.490 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:40.487+0000 7f5f52a98200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T19:00:40.588 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:40.584+0000 7f5f52a98200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T19:00:40.765 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:40.762+0000 7f5f52a98200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T19:00:40.773 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:40.770+0000 7fe4f706d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T19:00:40.891 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T19:00:41.055 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:41.052+0000 7fe4f706d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T19:00:41.061 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:41.058+0000 7f5f52a98200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-23T19:00:41.064 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.060+0000 7fcfb91ff700 1 Processor -- start 2023-06-23T19:00:41.064 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.060+0000 7fcfb91ff700 1 -- start start 2023-06-23T19:00:41.065 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.061+0000 7fcfb91ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40b8410 0x7fcfb40d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:41.066 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.061+0000 7fcfb91ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcfb40cee90 0x7fcfb40cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:41.066 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb91ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcfb40d0f10 0x7fcfb40d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:41.066 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb91ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40d0810 con 0x7fcfb40cee90 2023-06-23T19:00:41.066 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb91ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40cd290 con 0x7fcfb40d0f10 2023-06-23T19:00:41.066 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb91ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40d18b0 con 0x7fcfb40b8410 2023-06-23T19:00:41.066 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb259c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcfb40cee90 0x7fcfb40cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:41.066 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb2d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40b8410 0x7fcfb40d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:41.066 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb259c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcfb40cee90 0x7fcfb40cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58492/0 (socket says 172.21.15.136:58492) 2023-06-23T19:00:41.067 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb259c700 1 -- 172.21.15.136:0/2483804601 learned_addr learned my addr 172.21.15.136:0/2483804601 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:41.067 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb359e700 1 --2- 172.21.15.136:0/2483804601 >> v2:172.21.15.178:3300/0 conn(0x7fcfb40d0f10 0x7fcfb40d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:41.068 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb259c700 1 -- 172.21.15.136:0/2483804601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40b8410 msgr2=0x7fcfb40d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:41.068 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb259c700 1 --2- 172.21.15.136:0/2483804601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40b8410 0x7fcfb40d35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.068 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb259c700 1 -- 172.21.15.136:0/2483804601 >> v2:172.21.15.178:3300/0 conn(0x7fcfb40d0f10 msgr2=0x7fcfb40d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:41.068 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb259c700 1 --2- 172.21.15.136:0/2483804601 >> v2:172.21.15.178:3300/0 conn(0x7fcfb40d0f10 0x7fcfb40d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.069 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.062+0000 7fcfb259c700 1 -- 172.21.15.136:0/2483804601 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40d0a80 con 0x7fcfb40cee90 2023-06-23T19:00:41.069 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb259c700 1 --2- 172.21.15.136:0/2483804601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 0x7fcfb40cf2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfb408be00 tx=0x7fcfa8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cb29eee332e849 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:41.069 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb1d9b700 1 -- 172.21.15.136:0/2483804601 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8011830 con 0x7fcfb40cee90 2023-06-23T19:00:41.069 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb1d9b700 1 -- 172.21.15.136:0/2483804601 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8011990 con 0x7fcfb40cee90 2023-06-23T19:00:41.069 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb1d9b700 1 -- 172.21.15.136:0/2483804601 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8011d20 con 0x7fcfb40cee90 2023-06-23T19:00:41.069 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb91ff700 1 -- 172.21.15.136:0/2483804601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 msgr2=0x7fcfb40cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:41.069 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb91ff700 1 --2- 172.21.15.136:0/2483804601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 0x7fcfb40cf2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfb408be00 tx=0x7fcfa8009bd0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.070 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb91ff700 1 -- 172.21.15.136:0/2483804601 shutdown_connections 2023-06-23T19:00:41.070 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb91ff700 1 --2- 172.21.15.136:0/2483804601 >> v2:172.21.15.178:3300/0 conn(0x7fcfb40d0f10 0x7fcfb40d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.070 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb91ff700 1 --2- 172.21.15.136:0/2483804601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40b8410 0x7fcfb40d35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.070 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb91ff700 1 --2- 172.21.15.136:0/2483804601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 0x7fcfb40cf2e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.070 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb91ff700 1 -- 172.21.15.136:0/2483804601 >> 172.21.15.136:0/2483804601 conn(0x7fcfb4071620 msgr2=0x7fcfb40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:41.070 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.063+0000 7fcfb91ff700 1 -- 172.21.15.136:0/2483804601 shutdown_connections 2023-06-23T19:00:41.070 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.064+0000 7fcfb91ff700 1 -- 172.21.15.136:0/2483804601 wait complete. 2023-06-23T19:00:41.072 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.065+0000 7fcfb91ff700 1 Processor -- start 2023-06-23T19:00:41.073 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.065+0000 7fcfb91ff700 1 -- start start 2023-06-23T19:00:41.073 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.066+0000 7fcfb91ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfb40b8410 0x7fcfb41e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:41.073 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.066+0000 7fcfb91ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 0x7fcfb40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:41.073 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.066+0000 7fcfb91ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40d0f10 0x7fcfb4159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:41.073 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.066+0000 7fcfb91ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40aa790 con 0x7fcfb40cee90 2023-06-23T19:00:41.073 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.066+0000 7fcfb91ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41e69b0 con 0x7fcfb40b8410 2023-06-23T19:00:41.073 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.066+0000 7fcfb91ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41e6c50 con 0x7fcfb40d0f10 2023-06-23T19:00:41.074 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 0x7fcfb40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:41.074 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40d0f10 0x7fcfb4159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:41.074 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 0x7fcfb40cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58496/0 (socket says 172.21.15.136:58496) 2023-06-23T19:00:41.074 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb259c700 1 -- 172.21.15.136:0/3834739356 learned_addr learned my addr 172.21.15.136:0/3834739356 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:41.074 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb2d9d700 1 --2- 172.21.15.136:0/3834739356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfb40b8410 0x7fcfb41e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:41.074 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb359e700 1 -- 172.21.15.136:0/3834739356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfb40b8410 msgr2=0x7fcfb41e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:41.074 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb359e700 1 --2- 172.21.15.136:0/3834739356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfb40b8410 0x7fcfb41e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.074 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb359e700 1 -- 172.21.15.136:0/3834739356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 msgr2=0x7fcfb40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:41.075 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb359e700 1 --2- 172.21.15.136:0/3834739356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 0x7fcfb40cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.075 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb359e700 1 -- 172.21.15.136:0/3834739356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8009550 con 0x7fcfb40d0f10 2023-06-23T19:00:41.075 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb259c700 1 --2- 172.21.15.136:0/3834739356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 0x7fcfb40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:41.075 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.067+0000 7fcfb359e700 1 --2- 172.21.15.136:0/3834739356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40d0f10 0x7fcfb4159fe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00eba0 tx=0x7fcfac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:41.075 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.068+0000 7fcf9b7fe700 1 -- 172.21.15.136:0/3834739356 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac009a80 con 0x7fcfb40d0f10 2023-06-23T19:00:41.075 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.068+0000 7fcf9b7fe700 1 -- 172.21.15.136:0/3834739356 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac00f040 con 0x7fcfb40d0f10 2023-06-23T19:00:41.075 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.068+0000 7fcf9b7fe700 1 -- 172.21.15.136:0/3834739356 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00cc40 con 0x7fcfb40d0f10 2023-06-23T19:00:41.076 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.068+0000 7fcfb91ff700 1 -- 172.21.15.136:0/3834739356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb41e6f30 con 0x7fcfb40d0f10 2023-06-23T19:00:41.076 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.068+0000 7fcfb91ff700 1 -- 172.21.15.136:0/3834739356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb41f2100 con 0x7fcfb40d0f10 2023-06-23T19:00:41.076 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.068+0000 7fcf9b7fe700 1 -- 172.21.15.136:0/3834739356 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcfac014780 con 0x7fcfb40d0f10 2023-06-23T19:00:41.076 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.068+0000 7fcf9b7fe700 1 -- 172.21.15.136:0/3834739356 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcfac00cda0 con 0x7fcfb40d0f10 2023-06-23T19:00:41.076 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.069+0000 7fcfb91ff700 1 -- 172.21.15.136:0/3834739356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb40cead0 con 0x7fcfb40d0f10 2023-06-23T19:00:41.076 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.072+0000 7fcf9b7fe700 1 -- 172.21.15.136:0/3834739356 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcfac03bb00 con 0x7fcfb40d0f10 2023-06-23T19:00:41.145 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.142+0000 7fcfb91ff700 1 -- 172.21.15.136:0/3834739356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfb404e1d0 con 0x7fcfb40d0f10 2023-06-23T19:00:41.147 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.143+0000 7fcf9b7fe700 1 -- 172.21.15.136:0/3834739356 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcfac02a030 con 0x7fcfb40d0f10 2023-06-23T19:00:41.148 INFO:teuthology.misc.health.smithi136.stdout: 2023-06-23T19:00:41.148 INFO:teuthology.misc.health.smithi136.stdout:{"epoch":10,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:00:39.635787+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:00:41.149 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.144+0000 7fcfb91ff700 1 -- 172.21.15.136:0/3834739356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40d0f10 msgr2=0x7fcfb4159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:41.149 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.144+0000 7fcfb91ff700 1 --2- 172.21.15.136:0/3834739356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40d0f10 0x7fcfb4159fe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00eba0 tx=0x7fcfac00eeb0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.149 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.144+0000 7fcfb91ff700 1 -- 172.21.15.136:0/3834739356 shutdown_connections 2023-06-23T19:00:41.149 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.144+0000 7fcfb91ff700 1 --2- 172.21.15.136:0/3834739356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfb40b8410 0x7fcfb41e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.150 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.144+0000 7fcfb91ff700 1 --2- 172.21.15.136:0/3834739356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfb40d0f10 0x7fcfb4159fe0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.150 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.144+0000 7fcfb91ff700 1 --2- 172.21.15.136:0/3834739356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb40cee90 0x7fcfb40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:41.150 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.144+0000 7fcfb91ff700 1 -- 172.21.15.136:0/3834739356 >> 172.21.15.136:0/3834739356 conn(0x7fcfb4071620 msgr2=0x7fcfb415da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:41.150 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.144+0000 7fcfb91ff700 1 -- 172.21.15.136:0/3834739356 shutdown_connections 2023-06-23T19:00:41.150 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:41.144+0000 7fcfb91ff700 1 -- 172.21.15.136:0/3834739356 wait complete. 2023-06-23T19:00:41.158 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:41.154+0000 7f5f52a98200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T19:00:41.162 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-23T19:00:41.260 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:41.257+0000 7fe4f706d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T19:00:41.405 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:41.401+0000 7fe4f706d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-23T19:00:41.489 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:41.486+0000 7f5f52a98200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T19:00:41.592 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:41.589+0000 7fe4f706d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T19:00:41.766 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:41.763+0000 7f5f52a98200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T19:00:41.928 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:41.924+0000 7fe4f706d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T19:00:41.966 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:41.963+0000 7f5f52a98200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T19:00:42.116 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:42.112+0000 7f5f52a98200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-23T19:00:42.162 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:42.158+0000 7fe4f706d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T19:00:42.302 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:42.299+0000 7f5f52a98200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T19:00:42.636 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:42.633+0000 7f5f52a98200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T19:00:42.883 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:42.879+0000 7f5f52a98200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T19:00:42.913 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:42.909+0000 7fe4f706d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T19:00:43.702 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T19:00:43.698+0000 7fe8b713c640 -1 osd.3 0 log_to_monitors true 2023-06-23T19:00:43.771 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-06-23T19:00:43.768+0000 7f5f52a98200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T19:00:43.939 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:43.935+0000 7fe4aabfa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-23T19:00:43.940 INFO:tasks.ceph.mgr.y.smithi136.stderr:2023-06-23T19:00:43.937+0000 7fe4aabfa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-23T19:00:43.948 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T19:00:43.945+0000 7f5eca983640 -1 osd.6 0 log_to_monitors true 2023-06-23T19:00:43.961 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T19:00:43.957+0000 7f495e304640 -1 osd.2 0 log_to_monitors true 2023-06-23T19:00:43.971 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T19:00:43.968+0000 7f2415f48640 -1 osd.1 0 log_to_monitors true 2023-06-23T19:00:43.978 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T19:00:43.974+0000 7f91e15d2640 -1 osd.0 0 log_to_monitors true 2023-06-23T19:00:44.006 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T19:00:44.003+0000 7fea1837a640 -1 osd.5 0 log_to_monitors true 2023-06-23T19:00:44.016 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T19:00:44.013+0000 7fa478b2c640 -1 osd.7 0 log_to_monitors true 2023-06-23T19:00:44.165 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T19:00:44.162+0000 7f6f8dc9a640 -1 osd.4 0 log_to_monitors true 2023-06-23T19:00:45.718 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T19:00:45.715+0000 7f5eb97f7700 -1 osd.6 0 waiting for initial osdmap 2023-06-23T19:00:45.732 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T19:00:45.729+0000 7f5eb0ffa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T19:00:46.149 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T19:00:46.145+0000 7f494d1f7700 -1 osd.2 0 waiting for initial osdmap 2023-06-23T19:00:46.176 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T19:00:46.173+0000 7f49449fa700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T19:00:47.158 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T19:00:47.154+0000 7fe8a5ff7700 -1 osd.3 0 waiting for initial osdmap 2023-06-23T19:00:47.181 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T19:00:47.177+0000 7fe89d7fa700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T19:00:47.193 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T19:00:47.190+0000 7fea071f7700 -1 osd.5 0 waiting for initial osdmap 2023-06-23T19:00:47.205 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T19:00:47.202+0000 7fe9fe9fa700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T19:00:47.229 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T19:00:47.226+0000 7f6f7cbf7700 -1 osd.4 0 waiting for initial osdmap 2023-06-23T19:00:47.247 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T19:00:47.244+0000 7f6f743fa700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T19:00:47.264 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T19:00:47.261+0000 7fa4679f7700 -1 osd.7 0 waiting for initial osdmap 2023-06-23T19:00:47.284 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T19:00:47.281+0000 7fa45f1fa700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T19:00:47.913 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T19:00:47.910+0000 7f2404df7700 -1 osd.1 0 waiting for initial osdmap 2023-06-23T19:00:47.929 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T19:00:47.926+0000 7f23fc5fa700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T19:00:47.968 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T19:00:48.207 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.203+0000 7fadd77ff700 1 Processor -- start 2023-06-23T19:00:48.207 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.203+0000 7fadd77ff700 1 -- start start 2023-06-23T19:00:48.208 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.204+0000 7fadd77ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fadd00afe20 0x7fadd00b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:48.208 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd77ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd015a750 con 0x7fadd01549b0 2023-06-23T19:00:48.208 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd77ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd015aa10 con 0x7fadd006ce90 2023-06-23T19:00:48.208 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd77ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd015acf0 con 0x7fadd00afe20 2023-06-23T19:00:48.209 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd4d9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fadd00afe20 0x7fadd00b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:48.210 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd4d9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fadd00afe20 0x7fadd00b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38482/0 (socket says 172.21.15.136:38482) 2023-06-23T19:00:48.210 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd4d9a700 1 -- 172.21.15.136:0/1070322104 learned_addr learned my addr 172.21.15.136:0/1070322104 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:48.210 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd559b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fadd01549b0 0x7fadd006c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:57314/0 (socket says 172.21.15.136:57314) 2023-06-23T19:00:48.210 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd4d9a700 1 -- 172.21.15.136:0/1070322104 >> v1:172.21.15.178:6789/0 conn(0x7fadd006ce90 legacy=0x7fadd00b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:48.210 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd4d9a700 1 -- 172.21.15.136:0/1070322104 >> v1:172.21.15.136:6789/0 conn(0x7fadd01549b0 legacy=0x7fadd006c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:48.210 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadd4d9a700 1 -- 172.21.15.136:0/1070322104 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd015afd0 con 0x7fadd00afe20 2023-06-23T19:00:48.210 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.205+0000 7fadc7fff700 1 -- 172.21.15.136:0/1070322104 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177053843 0 0) 0x7fadd015a750 con 0x7fadd01549b0 2023-06-23T19:00:48.211 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.206+0000 7fadd4d9a700 1 --2- 172.21.15.136:0/1070322104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 0x7fadd00b2be0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadc00098f0 tx=0x7fadc0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da763a41a610fa8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:48.211 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.206+0000 7fadc7fff700 1 -- 172.21.15.136:0/1070322104 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000b8a0 con 0x7fadd00afe20 2023-06-23T19:00:48.211 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.206+0000 7fadc7fff700 1 -- 172.21.15.136:0/1070322104 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc000ba00 con 0x7fadd00afe20 2023-06-23T19:00:48.211 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.206+0000 7fadc7fff700 1 -- 172.21.15.136:0/1070322104 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000bd90 con 0x7fadd00afe20 2023-06-23T19:00:48.212 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.206+0000 7fadd77ff700 1 -- 172.21.15.136:0/1070322104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 msgr2=0x7fadd00b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:48.212 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.206+0000 7fadd77ff700 1 --2- 172.21.15.136:0/1070322104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 0x7fadd00b2be0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadc00098f0 tx=0x7fadc0009c00 comp rx=0 tx=0).stop 2023-06-23T19:00:48.212 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.207+0000 7fadd77ff700 1 -- 172.21.15.136:0/1070322104 shutdown_connections 2023-06-23T19:00:48.212 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.207+0000 7fadd77ff700 1 --2- 172.21.15.136:0/1070322104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 0x7fadd00b2be0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:48.212 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.207+0000 7fadd77ff700 1 -- 172.21.15.136:0/1070322104 >> 172.21.15.136:0/1070322104 conn(0x7fadd0065c20 msgr2=0x7fadd0065ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:48.212 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.207+0000 7fadd77ff700 1 -- 172.21.15.136:0/1070322104 shutdown_connections 2023-06-23T19:00:48.213 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.207+0000 7fadd77ff700 1 -- 172.21.15.136:0/1070322104 wait complete. 2023-06-23T19:00:48.213 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.208+0000 7fadd77ff700 1 Processor -- start 2023-06-23T19:00:48.214 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.209+0000 7fadd77ff700 1 -- start start 2023-06-23T19:00:48.215 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd77ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadd006ce90 0x7fadd0141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:48.215 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd77ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 0x7fadd0071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:48.215 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd77ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadd01549b0 0x7fadd0159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:48.215 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd77ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0071540 con 0x7fadd00afe20 2023-06-23T19:00:48.215 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd77ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00717a0 con 0x7fadd006ce90 2023-06-23T19:00:48.215 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd77ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0071a80 con 0x7fadd01549b0 2023-06-23T19:00:48.215 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd4d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 0x7fadd0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:48.215 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd4d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 0x7fadd0071000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38494/0 (socket says 172.21.15.136:38494) 2023-06-23T19:00:48.216 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd4d9a700 1 -- 172.21.15.136:0/1576629276 learned_addr learned my addr 172.21.15.136:0/1576629276 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:48.216 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd559b700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadd006ce90 0x7fadd0141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:48.216 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd5d9c700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadd01549b0 0x7fadd0159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:48.216 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd4d9a700 1 -- 172.21.15.136:0/1576629276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadd01549b0 msgr2=0x7fadd0159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:48.216 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd4d9a700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadd01549b0 0x7fadd0159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:48.216 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd4d9a700 1 -- 172.21.15.136:0/1576629276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadd006ce90 msgr2=0x7fadd0141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:48.216 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd4d9a700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadd006ce90 0x7fadd0141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:48.217 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.210+0000 7fadd4d9a700 1 -- 172.21.15.136:0/1576629276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc0009550 con 0x7fadd00afe20 2023-06-23T19:00:48.217 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.211+0000 7fadd4d9a700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 0x7fadd0071000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fadd015dca0 tx=0x7fadc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:48.217 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.211+0000 7fadc5ffb700 1 -- 172.21.15.136:0/1576629276 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc001a900 con 0x7fadd00afe20 2023-06-23T19:00:48.217 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.211+0000 7fadc5ffb700 1 -- 172.21.15.136:0/1576629276 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc001f070 con 0x7fadd00afe20 2023-06-23T19:00:48.217 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.211+0000 7fadc5ffb700 1 -- 172.21.15.136:0/1576629276 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc001ac60 con 0x7fadd00afe20 2023-06-23T19:00:48.217 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.211+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd0071d60 con 0x7fadd00afe20 2023-06-23T19:00:48.217 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.211+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd0072320 con 0x7fadd00afe20 2023-06-23T19:00:48.218 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.212+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd004e1d0 con 0x7fadd00afe20 2023-06-23T19:00:48.218 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.213+0000 7fadc5ffb700 1 -- 172.21.15.136:0/1576629276 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fadc001b430 con 0x7fadd00afe20 2023-06-23T19:00:48.218 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.214+0000 7fadc5ffb700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fadb406ac50 0x7fadb406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:48.219 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.214+0000 7fadc5ffb700 1 -- 172.21.15.136:0/1576629276 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4191+0+0 (secure 0 0 0) 0x7fadc0021070 con 0x7fadd00afe20 2023-06-23T19:00:48.219 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.214+0000 7fadd559b700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fadb406ac50 0x7fadb406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:48.219 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.215+0000 7fadd559b700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fadb406ac50 0x7fadb406d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000f60 tx=0x7fadcc004a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:48.227 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.223+0000 7fadc5ffb700 1 -- 172.21.15.136:0/1576629276 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fadc0055ed0 con 0x7fadd00afe20 2023-06-23T19:00:48.237 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T19:00:48.234+0000 7f91d0bf8700 -1 osd.0 0 waiting for initial osdmap 2023-06-23T19:00:48.252 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T19:00:48.249+0000 7f91c7bfa700 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T19:00:48.430 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.426+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadd00cbc90 con 0x7fadd00afe20 2023-06-23T19:00:48.430 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.427+0000 7fadc5ffb700 1 -- 172.21.15.136:0/1576629276 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10492 (secure 0 0 0) 0x7fadc00594f0 con 0x7fadd00afe20 2023-06-23T19:00:48.431 INFO:teuthology.misc.health.smithi136.stdout: 2023-06-23T19:00:48.431 INFO:teuthology.misc.health.smithi136.stdout:{"epoch":15,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:00:47.987443+0000","last_up_change":"2023-06-23T19:00:47.987443+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:00:48.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fadb406ac50 msgr2=0x7fadb406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:48.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fadb406ac50 0x7fadb406d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000f60 tx=0x7fadcc004a50 comp rx=0 tx=0).stop 2023-06-23T19:00:48.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 msgr2=0x7fadd0071000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:48.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 0x7fadd0071000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fadd015dca0 tx=0x7fadc0004750 comp rx=0 tx=0).stop 2023-06-23T19:00:48.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 shutdown_connections 2023-06-23T19:00:48.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fadb406ac50 0x7fadb406d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:48.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadd006ce90 0x7fadd0141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:48.435 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadd01549b0 0x7fadd0159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:48.435 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 --2- 172.21.15.136:0/1576629276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadd00afe20 0x7fadd0071000 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:48.435 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 >> 172.21.15.136:0/1576629276 conn(0x7fadd0065c20 msgr2=0x7fadd0072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:48.435 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 shutdown_connections 2023-06-23T19:00:48.435 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:48.430+0000 7fadd77ff700 1 -- 172.21.15.136:0/1576629276 wait complete. 2023-06-23T19:00:48.449 DEBUG:teuthology.misc:7 of 8 OSDs are up 2023-06-23T19:00:55.255 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T19:00:55.432 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.428+0000 7f98a5fff700 1 Processor -- start 2023-06-23T19:00:55.432 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.428+0000 7f98a5fff700 1 -- start start 2023-06-23T19:00:55.433 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.430+0000 7f98a5fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f98a006ce90 0x7f98a01650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.430+0000 7f98a5fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a015a750 con 0x7f98a01549b0 2023-06-23T19:00:55.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.430+0000 7f98a5fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a015aa10 con 0x7f98a00afe20 2023-06-23T19:00:55.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.430+0000 7f98a5fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a015acf0 con 0x7f98a006ce90 2023-06-23T19:00:55.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.430+0000 7f989ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f98a006ce90 0x7f98a01650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:55.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.430+0000 7f989f7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f98a01549b0 0x7f98a006c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53266/0 (socket says 172.21.15.136:53266) 2023-06-23T19:00:55.434 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.430+0000 7f989f7fe700 1 -- 172.21.15.136:0/1620312658 learned_addr learned my addr 172.21.15.136:0/1620312658 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:00:55.435 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.430+0000 7f989ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f98a006ce90 0x7f98a01650d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:37962/0 (socket says 172.21.15.136:37962) 2023-06-23T19:00:55.436 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f989ffff700 1 -- 172.21.15.136:0/1620312658 >> v1:172.21.15.178:6789/0 conn(0x7f98a00afe20 legacy=0x7f98a00b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.436 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f989ffff700 1 -- 172.21.15.136:0/1620312658 >> v1:172.21.15.136:6789/0 conn(0x7f98a01549b0 legacy=0x7f98a006c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.436 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f989ffff700 1 -- 172.21.15.136:0/1620312658 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a015afd0 con 0x7f98a006ce90 2023-06-23T19:00:55.436 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f989effd700 1 -- 172.21.15.136:0/1620312658 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347001871 0 0) 0x7f98a015a750 con 0x7f98a01549b0 2023-06-23T19:00:55.436 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f989ffff700 1 --2- 172.21.15.136:0/1620312658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 0x7f98a01650d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9898009d90 tx=0x7f989800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b74f23f67c63b53 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:55.436 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f989effd700 1 -- 172.21.15.136:0/1620312658 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800e070 con 0x7f98a006ce90 2023-06-23T19:00:55.437 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f989effd700 1 -- 172.21.15.136:0/1620312658 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989800bbd0 con 0x7f98a006ce90 2023-06-23T19:00:55.437 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f989effd700 1 -- 172.21.15.136:0/1620312658 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898012430 con 0x7f98a006ce90 2023-06-23T19:00:55.437 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f98a5fff700 1 -- 172.21.15.136:0/1620312658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 msgr2=0x7f98a01650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.437 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.431+0000 7f98a5fff700 1 --2- 172.21.15.136:0/1620312658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 0x7f98a01650d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9898009d90 tx=0x7f989800b330 comp rx=0 tx=0).stop 2023-06-23T19:00:55.437 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.432+0000 7f98a5fff700 1 -- 172.21.15.136:0/1620312658 shutdown_connections 2023-06-23T19:00:55.437 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.432+0000 7f98a5fff700 1 --2- 172.21.15.136:0/1620312658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 0x7f98a01650d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.437 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.432+0000 7f98a5fff700 1 -- 172.21.15.136:0/1620312658 >> 172.21.15.136:0/1620312658 conn(0x7f98a0065c20 msgr2=0x7f98a0065ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:55.438 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.432+0000 7f98a5fff700 1 -- 172.21.15.136:0/1620312658 shutdown_connections 2023-06-23T19:00:55.438 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.432+0000 7f98a5fff700 1 -- 172.21.15.136:0/1620312658 wait complete. 2023-06-23T19:00:55.439 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.433+0000 7f98a5fff700 1 Processor -- start 2023-06-23T19:00:55.439 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.434+0000 7f98a5fff700 1 -- start start 2023-06-23T19:00:55.439 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.434+0000 7f98a5fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 0x7f98a0148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.440 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.434+0000 7f98a5fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a00afe20 0x7f98a00b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.440 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.434+0000 7f98a5fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a01549b0 0x7f98a00b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.440 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.434+0000 7f98a5fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a014dbb0 con 0x7f98a006ce90 2023-06-23T19:00:55.440 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.434+0000 7f98a5fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0153dc0 con 0x7f98a00afe20 2023-06-23T19:00:55.440 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.434+0000 7f98a5fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a014dfd0 con 0x7f98a01549b0 2023-06-23T19:00:55.440 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 0x7f98a0148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:55.441 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 0x7f98a0148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:37964/0 (socket says 172.21.15.136:37964) 2023-06-23T19:00:55.441 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989f7fe700 1 -- 172.21.15.136:0/1473580393 learned_addr learned my addr 172.21.15.136:0/1473580393 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:55.441 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989f7fe700 1 -- 172.21.15.136:0/1473580393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a01549b0 msgr2=0x7f98a00b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.441 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989f7fe700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a01549b0 0x7f98a00b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.441 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989f7fe700 1 -- 172.21.15.136:0/1473580393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a00afe20 msgr2=0x7f98a00b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.441 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989f7fe700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a00afe20 0x7f98a00b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.441 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989f7fe700 1 -- 172.21.15.136:0/1473580393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898009a70 con 0x7f98a006ce90 2023-06-23T19:00:55.441 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989f7fe700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 0x7f98a0148f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f989000c520 tx=0x7f989000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:55.442 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989cff9700 1 -- 172.21.15.136:0/1473580393 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890004c80 con 0x7f98a006ce90 2023-06-23T19:00:55.442 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989cff9700 1 -- 172.21.15.136:0/1473580393 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9890004e20 con 0x7f98a006ce90 2023-06-23T19:00:55.442 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a014cf50 con 0x7f98a006ce90 2023-06-23T19:00:55.442 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.435+0000 7f989cff9700 1 -- 172.21.15.136:0/1473580393 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890007310 con 0x7f98a006ce90 2023-06-23T19:00:55.442 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.436+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a014d4f0 con 0x7f98a006ce90 2023-06-23T19:00:55.443 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.437+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a004e1d0 con 0x7f98a006ce90 2023-06-23T19:00:55.443 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.437+0000 7f989cff9700 1 -- 172.21.15.136:0/1473580393 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9890007470 con 0x7f98a006ce90 2023-06-23T19:00:55.443 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.438+0000 7f989cff9700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f988006ace0 0x7f988006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.443 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.438+0000 7f989cff9700 1 -- 172.21.15.136:0/1473580393 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9890088cc0 con 0x7f98a006ce90 2023-06-23T19:00:55.443 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.439+0000 7f9897fff700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f988006ace0 0x7f988006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:55.444 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.439+0000 7f9897fff700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f988006ace0 0x7f988006d190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9888000f60 tx=0x7f9888007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:55.447 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.444+0000 7f989cff9700 1 -- 172.21.15.136:0/1473580393 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f989008f080 con 0x7f98a006ce90 2023-06-23T19:00:55.644 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.640+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98a0149790 con 0x7f98a006ce90 2023-06-23T19:00:55.644 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.641+0000 7f989cff9700 1 -- 172.21.15.136:0/1473580393 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f9890054210 con 0x7f98a006ce90 2023-06-23T19:00:55.645 INFO:teuthology.misc.health.smithi136.stdout: 2023-06-23T19:00:55.645 INFO:teuthology.misc.health.smithi136.stdout:{"epoch":18,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:00:50.993653+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:00:55.647 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.643+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f988006ace0 msgr2=0x7f988006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.648 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.643+0000 7f98a5fff700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f988006ace0 0x7f988006d190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9888000f60 tx=0x7f9888007a40 comp rx=0 tx=0).stop 2023-06-23T19:00:55.648 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 msgr2=0x7f98a0148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.648 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 0x7f98a0148f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f989000c520 tx=0x7f989000c8e0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.648 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 shutdown_connections 2023-06-23T19:00:55.648 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f988006ace0 0x7f988006d190 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.648 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a01549b0 0x7f98a00b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.649 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a006ce90 0x7f98a0148f80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.649 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 --2- 172.21.15.136:0/1473580393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a00afe20 0x7f98a00b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.649 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 >> 172.21.15.136:0/1473580393 conn(0x7f98a0065c20 msgr2=0x7f98a006c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:55.649 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 shutdown_connections 2023-06-23T19:00:55.649 INFO:teuthology.misc.health.smithi136.stderr:2023-06-23T19:00:55.644+0000 7f98a5fff700 1 -- 172.21.15.136:0/1473580393 wait complete. 2023-06-23T19:00:55.663 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-23T19:00:55.663 INFO:tasks.ceph:Creating RBD pool 2023-06-23T19:00:55.663 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-23T19:00:55.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.846+0000 7eff259ff700 1 Processor -- start 2023-06-23T19:00:55.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.846+0000 7eff259ff700 1 -- start start 2023-06-23T19:00:55.852 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.847+0000 7eff259ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff200d0a60 0x7eff200b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.847+0000 7eff259ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff200d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.847+0000 7eff259ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff200cd9d0 con 0x7eff200b51d0 2023-06-23T19:00:55.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.847+0000 7eff259ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff200d0060 con 0x7eff200d0a60 2023-06-23T19:00:55.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.847+0000 7eff259ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff200b5620 con 0x7eff200cf910 2023-06-23T19:00:55.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff200d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:55.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff200d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:42178/0 (socket says 172.21.15.136:42178) 2023-06-23T19:00:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1f7fe700 1 -- 172.21.15.136:0/3517312315 learned_addr learned my addr 172.21.15.136:0/3517312315 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1effd700 1 --2- 172.21.15.136:0/3517312315 >> v2:172.21.15.178:3300/0 conn(0x7eff200d0a60 0x7eff200b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1dffb700 1 -- 172.21.15.136:0/3517312315 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047239947 0 0) 0x7eff200cd9d0 con 0x7eff200b51d0 2023-06-23T19:00:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1dffb700 1 -- 172.21.15.136:0/3517312315 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff080035b0 con 0x7eff200b51d0 2023-06-23T19:00:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1f7fe700 1 -- 172.21.15.136:0/3517312315 >> v2:172.21.15.178:3300/0 conn(0x7eff200d0a60 msgr2=0x7eff200b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1f7fe700 1 --2- 172.21.15.136:0/3517312315 >> v2:172.21.15.178:3300/0 conn(0x7eff200d0a60 0x7eff200b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1f7fe700 1 -- 172.21.15.136:0/3517312315 >> v1:172.21.15.178:6789/0 conn(0x7eff200b51d0 legacy=0x7eff200d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.848+0000 7eff1f7fe700 1 -- 172.21.15.136:0/3517312315 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff200cfd90 con 0x7eff200cf910 2023-06-23T19:00:55.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff1f7fe700 1 --2- 172.21.15.136:0/3517312315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff200d2e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff18009e50 tx=0x7eff1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf5c5b51b3707f3f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:55.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff1dffb700 1 -- 172.21.15.136:0/3517312315 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800e070 con 0x7eff200cf910 2023-06-23T19:00:55.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff1dffb700 1 -- 172.21.15.136:0/3517312315 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1800b910 con 0x7eff200cf910 2023-06-23T19:00:55.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff1dffb700 1 -- 172.21.15.136:0/3517312315 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800bcc0 con 0x7eff200cf910 2023-06-23T19:00:55.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff259ff700 1 -- 172.21.15.136:0/3517312315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 msgr2=0x7eff200d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff259ff700 1 --2- 172.21.15.136:0/3517312315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff200d2e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff18009e50 tx=0x7eff1800b330 comp rx=0 tx=0).stop 2023-06-23T19:00:55.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff259ff700 1 -- 172.21.15.136:0/3517312315 shutdown_connections 2023-06-23T19:00:55.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff259ff700 1 --2- 172.21.15.136:0/3517312315 >> v2:172.21.15.178:3300/0 conn(0x7eff200d0a60 0x7eff200b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff259ff700 1 --2- 172.21.15.136:0/3517312315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff200d2e00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.849+0000 7eff259ff700 1 -- 172.21.15.136:0/3517312315 >> 172.21.15.136:0/3517312315 conn(0x7eff20071620 msgr2=0x7eff200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:55.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.850+0000 7eff259ff700 1 -- 172.21.15.136:0/3517312315 shutdown_connections 2023-06-23T19:00:55.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.850+0000 7eff259ff700 1 -- 172.21.15.136:0/3517312315 wait complete. 2023-06-23T19:00:55.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.851+0000 7eff259ff700 1 Processor -- start 2023-06-23T19:00:55.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.851+0000 7eff259ff700 1 -- start start 2023-06-23T19:00:55.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.852+0000 7eff259ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff200b51d0 0x7eff2014dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.852+0000 7eff259ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff2015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.852+0000 7eff259ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff200d0a60 0x7eff2015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.852+0000 7eff259ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2014e520 con 0x7eff200d0a60 2023-06-23T19:00:55.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.852+0000 7eff259ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2015f0b0 con 0x7eff200b51d0 2023-06-23T19:00:55.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.852+0000 7eff259ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2015f350 con 0x7eff200cf910 2023-06-23T19:00:55.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.852+0000 7eff1f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff200d0a60 0x7eff2015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:55.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff200d0a60 0x7eff2015cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:37966/0 (socket says 172.21.15.136:37966) 2023-06-23T19:00:55.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1f7fe700 1 -- 172.21.15.136:0/1127262622 learned_addr learned my addr 172.21.15.136:0/1127262622 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:55.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1effd700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff200b51d0 0x7eff2014dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:55.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1e7fc700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff2015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:55.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1f7fe700 1 -- 172.21.15.136:0/1127262622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 msgr2=0x7eff2015c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1f7fe700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff2015c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1f7fe700 1 -- 172.21.15.136:0/1127262622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff200b51d0 msgr2=0x7eff2014dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:55.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1f7fe700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff200b51d0 0x7eff2014dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:55.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1f7fe700 1 -- 172.21.15.136:0/1127262622 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009b30 con 0x7eff200d0a60 2023-06-23T19:00:55.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1effd700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff200b51d0 0x7eff2014dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:00:55.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff1f7fe700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff200d0a60 0x7eff2015cf60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff200b5760 tx=0x7eff18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:55.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff07fff700 1 -- 172.21.15.136:0/1127262622 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180048b0 con 0x7eff200d0a60 2023-06-23T19:00:55.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff07fff700 1 -- 172.21.15.136:0/1127262622 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff180099b0 con 0x7eff200d0a60 2023-06-23T19:00:55.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2015f630 con 0x7eff200d0a60 2023-06-23T19:00:55.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.853+0000 7eff07fff700 1 -- 172.21.15.136:0/1127262622 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1801c680 con 0x7eff200d0a60 2023-06-23T19:00:55.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.854+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2015cb10 con 0x7eff200d0a60 2023-06-23T19:00:55.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.854+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2015f870 con 0x7eff200d0a60 2023-06-23T19:00:55.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.856+0000 7eff07fff700 1 -- 172.21.15.136:0/1127262622 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff1801c7e0 con 0x7eff200d0a60 2023-06-23T19:00:55.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.856+0000 7eff07fff700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff0c06ace0 0x7eff0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:55.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.856+0000 7eff07fff700 1 -- 172.21.15.136:0/1127262622 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff1808ab50 con 0x7eff200d0a60 2023-06-23T19:00:55.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.857+0000 7eff1effd700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff0c06ace0 0x7eff0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:55.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.857+0000 7eff1effd700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff0c06ace0 0x7eff0c06d190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff10009b90 tx=0x7eff10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:55.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:55.861+0000 7eff07fff700 1 -- 172.21.15.136:0/1127262622 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff2015f870 con 0x7eff200d0a60 2023-06-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:56.059+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7eff200c8b30 con 0x7eff200d0a60 2023-06-23T19:00:56.097 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:00:56.102 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:00:57.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.022+0000 7eff07fff700 1 -- 172.21.15.136:0/1127262622 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7eff200c8b30 con 0x7eff200d0a60 2023-06-23T19:00:57.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff0c06ace0 msgr2=0x7eff0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:57.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff0c06ace0 0x7eff0c06d190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff10009b90 tx=0x7eff10008040 comp rx=0 tx=0).stop 2023-06-23T19:00:57.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff200d0a60 msgr2=0x7eff2015cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:57.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff200d0a60 0x7eff2015cf60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff200b5760 tx=0x7eff18004ad0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 shutdown_connections 2023-06-23T19:00:57.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff0c06ace0 0x7eff0c06d190 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff200b51d0 0x7eff2014dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff200d0a60 0x7eff2015cf60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 --2- 172.21.15.136:0/1127262622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff200cf910 0x7eff2015c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 >> 172.21.15.136:0/1127262622 conn(0x7eff20071620 msgr2=0x7eff200c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:57.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 shutdown_connections 2023-06-23T19:00:57.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.026+0000 7eff259ff700 1 -- 172.21.15.136:0/1127262622 wait complete. 2023-06-23T19:00:57.032 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'rbd' created 2023-06-23T19:00:57.050 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-23T19:00:57.243 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.240+0000 7f174b9ff700 1 Processor -- start 2023-06-23T19:00:57.244 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.240+0000 7f174b9ff700 1 -- start start 2023-06-23T19:00:57.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.241+0000 7f174b9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440d0a60 0x7f17440b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:57.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.241+0000 7f174b9ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f17440cf910 0x7f17440d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:57.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.241+0000 7f174b9ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17440cd9d0 con 0x7f17440b51d0 2023-06-23T19:00:57.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.241+0000 7f174b9ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17440d0060 con 0x7f17440cf910 2023-06-23T19:00:57.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.241+0000 7f174b9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17440b5640 con 0x7f17440d0a60 2023-06-23T19:00:57.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.241+0000 7f1749f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f17440cf910 0x7f17440d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:57.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.241+0000 7f1749f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f17440cf910 0x7f17440d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:37972/0 (socket says 172.21.15.136:37972) 2023-06-23T19:00:57.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.241+0000 7f1749f9c700 1 -- 172.21.15.136:0/3492281821 learned_addr learned my addr 172.21.15.136:0/3492281821 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:57.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.241+0000 7f174979b700 1 --2- 172.21.15.136:0/3492281821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440d0a60 0x7f17440b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:57.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.242+0000 7f1749f9c700 1 -- 172.21.15.136:0/3492281821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440d0a60 msgr2=0x7f17440b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:57.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.242+0000 7f1749f9c700 1 --2- 172.21.15.136:0/3492281821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440d0a60 0x7f17440b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.242+0000 7f1749f9c700 1 -- 172.21.15.136:0/3492281821 >> v1:172.21.15.178:6789/0 conn(0x7f17440b51d0 legacy=0x7f17440d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:57.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.242+0000 7f1749f9c700 1 -- 172.21.15.136:0/3492281821 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17440cfd90 con 0x7f17440cf910 2023-06-23T19:00:57.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.242+0000 7f1749f9c700 1 --2- 172.21.15.136:0/3492281821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440cf910 0x7f17440d2e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f173c009e50 tx=0x7f173c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7edce8fbb8e059 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:57.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.242+0000 7f173bfff700 1 -- 172.21.15.136:0/3492281821 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c00e070 con 0x7f17440cf910 2023-06-23T19:00:57.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.242+0000 7f173bfff700 1 -- 172.21.15.136:0/3492281821 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c00b910 con 0x7f17440cf910 2023-06-23T19:00:57.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.242+0000 7f173bfff700 1 -- 172.21.15.136:0/3492281821 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c00bcc0 con 0x7f17440cf910 2023-06-23T19:00:57.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.243+0000 7f174b9ff700 1 -- 172.21.15.136:0/3492281821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440cf910 msgr2=0x7f17440d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:57.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.243+0000 7f174b9ff700 1 --2- 172.21.15.136:0/3492281821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440cf910 0x7f17440d2e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f173c009e50 tx=0x7f173c00b330 comp rx=0 tx=0).stop 2023-06-23T19:00:57.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.243+0000 7f174b9ff700 1 -- 172.21.15.136:0/3492281821 shutdown_connections 2023-06-23T19:00:57.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.243+0000 7f174b9ff700 1 --2- 172.21.15.136:0/3492281821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440cf910 0x7f17440d2e00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.243+0000 7f174b9ff700 1 --2- 172.21.15.136:0/3492281821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440d0a60 0x7f17440b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.243+0000 7f174b9ff700 1 -- 172.21.15.136:0/3492281821 >> 172.21.15.136:0/3492281821 conn(0x7f1744071620 msgr2=0x7f17440719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:57.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.243+0000 7f174b9ff700 1 -- 172.21.15.136:0/3492281821 shutdown_connections 2023-06-23T19:00:57.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.243+0000 7f174b9ff700 1 -- 172.21.15.136:0/3492281821 wait complete. 2023-06-23T19:00:57.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.244+0000 7f174b9ff700 1 Processor -- start 2023-06-23T19:00:57.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.245+0000 7f174b9ff700 1 -- start start 2023-06-23T19:00:57.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f174b9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440b51d0 0x7f17441f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:57.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f174b9ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17440cf910 0x7f17441f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:57.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f174b9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440d0a60 0x7f17440cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:57.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f174b9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17441f64e0 con 0x7f17440d0a60 2023-06-23T19:00:57.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f174b9ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17441f5f20 con 0x7f17440cf910 2023-06-23T19:00:57.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f174b9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17441f6200 con 0x7f17440b51d0 2023-06-23T19:00:57.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1749f9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440d0a60 0x7f17440cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:57.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1749f9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440d0a60 0x7f17440cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:37984/0 (socket says 172.21.15.136:37984) 2023-06-23T19:00:57.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1749f9c700 1 -- 172.21.15.136:0/565486357 learned_addr learned my addr 172.21.15.136:0/565486357 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:57.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f174979b700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440b51d0 0x7f17441f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:57.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1749f9c700 1 -- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440b51d0 msgr2=0x7f17441f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:57.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1748f9a700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17440cf910 0x7f17441f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:57.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1749f9c700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440b51d0 0x7f17441f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1749f9c700 1 -- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17440cf910 msgr2=0x7f17441f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:57.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1749f9c700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17440cf910 0x7f17441f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:57.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1749f9c700 1 -- 172.21.15.136:0/565486357 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c009b30 con 0x7f17440d0a60 2023-06-23T19:00:57.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f174979b700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440b51d0 0x7f17441f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:00:57.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1748f9a700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17440cf910 0x7f17441f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:00:57.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.246+0000 7f1749f9c700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440d0a60 0x7f17440cbe80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f17440d3d20 tx=0x7f173c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:57.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.247+0000 7f1739ffb700 1 -- 172.21.15.136:0/565486357 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c004960 con 0x7f17440d0a60 2023-06-23T19:00:57.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.247+0000 7f1739ffb700 1 -- 172.21.15.136:0/565486357 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c0099b0 con 0x7f17440d0a60 2023-06-23T19:00:57.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.247+0000 7f1739ffb700 1 -- 172.21.15.136:0/565486357 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c01c680 con 0x7f17440d0a60 2023-06-23T19:00:57.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.247+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1744156e90 con 0x7f17440d0a60 2023-06-23T19:00:57.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.247+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17441f1d70 con 0x7f17440d0a60 2023-06-23T19:00:57.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.248+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17440cd3d0 con 0x7f17440d0a60 2023-06-23T19:00:57.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.249+0000 7f1739ffb700 1 -- 172.21.15.136:0/565486357 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f173c01c7e0 con 0x7f17440d0a60 2023-06-23T19:00:57.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.250+0000 7f1739ffb700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f172806ace0 0x7f172806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:57.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.250+0000 7f1739ffb700 1 -- 172.21.15.136:0/565486357 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f173c08aef0 con 0x7f17440d0a60 2023-06-23T19:00:57.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.250+0000 7f174979b700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f172806ace0 0x7f172806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:57.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.251+0000 7f174979b700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f172806ace0 0x7f172806d190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1740009ac0 tx=0x7f1740008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:57.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.255+0000 7f1739ffb700 1 -- 172.21.15.136:0/565486357 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f173c0562f0 con 0x7f17440d0a60 2023-06-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:57.452+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f17440ca5c0 con 0x7f17440d0a60 2023-06-23T19:00:58.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.027+0000 7f1739ffb700 1 -- 172.21.15.136:0/565486357 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7f173c059910 con 0x7f17440d0a60 2023-06-23T19:00:58.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f172806ace0 msgr2=0x7f172806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f172806ace0 0x7f172806d190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1740009ac0 tx=0x7f1740008040 comp rx=0 tx=0).stop 2023-06-23T19:00:58.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440d0a60 msgr2=0x7f17440cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440d0a60 0x7f17440cbe80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f17440d3d20 tx=0x7f173c004ad0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 shutdown_connections 2023-06-23T19:00:58.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f172806ace0 0x7f172806d190 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17440d0a60 0x7f17440cbe80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17440b51d0 0x7f17441f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 --2- 172.21.15.136:0/565486357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17440cf910 0x7f17441f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 >> 172.21.15.136:0/565486357 conn(0x7f1744071620 msgr2=0x7f17440c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:58.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 shutdown_connections 2023-06-23T19:00:58.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.031+0000 7f174b9ff700 1 -- 172.21.15.136:0/565486357 wait complete. 2023-06-23T19:00:58.037 INFO:teuthology.orchestra.run.smithi136.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-23T19:00:58.053 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-23T19:00:58.054 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-23T19:00:58.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-23T19:00:58.059 INFO:tasks.ceph.mds.a:Started 2023-06-23T19:00:58.059 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-23T19:00:58.059 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-23T19:00:58.063 INFO:tasks.ceph.mds.c:Started 2023-06-23T19:00:58.064 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-23T19:00:58.064 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-23T19:00:58.068 INFO:tasks.ceph.mds.b:Started 2023-06-23T19:00:58.069 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-23T19:00:58.069 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-23T19:00:58.073 INFO:tasks.ceph.mds.d:Started 2023-06-23T19:00:58.073 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-23T19:00:58.074 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:00:58.205 INFO:tasks.ceph.mds.a.smithi136.stdout:starting mds.a at 2023-06-23T19:00:58.213 INFO:tasks.ceph.mds.c.smithi136.stdout:starting mds.c at 2023-06-23T19:00:58.221 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-06-23T19:00:58.223 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-06-23T19:00:58.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.279+0000 7ff9089ff700 1 Processor -- start 2023-06-23T19:00:58.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.279+0000 7ff9089ff700 1 -- start start 2023-06-23T19:00:58.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.280+0000 7ff9089ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff90415a0c0 0x7ff9040cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.280+0000 7ff9089ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9040c8ce0 0x7ff9040ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.280+0000 7ff9089ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff904069ef0 0x7ff90406a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.280+0000 7ff9089ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90406a870 con 0x7ff904069ef0 2023-06-23T19:00:58.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.280+0000 7ff9089ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9040caea0 con 0x7ff90415a0c0 2023-06-23T19:00:58.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.280+0000 7ff9089ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90415a490 con 0x7ff9040c8ce0 2023-06-23T19:00:58.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.280+0000 7ff902d9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff904069ef0 0x7ff90406a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff902d9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff904069ef0 0x7ff90406a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38010/0 (socket says 172.21.15.136:38010) 2023-06-23T19:00:58.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff902d9d700 1 -- 172.21.15.136:0/1966708257 learned_addr learned my addr 172.21.15.136:0/1966708257 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:58.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff90259c700 1 --2- 172.21.15.136:0/1966708257 >> v2:172.21.15.178:3300/0 conn(0x7ff90415a0c0 0x7ff9040cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff8fbfff700 1 --2- 172.21.15.136:0/1966708257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9040c8ce0 0x7ff9040ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff902d9d700 1 -- 172.21.15.136:0/1966708257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9040c8ce0 msgr2=0x7ff9040ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:58.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff902d9d700 1 --2- 172.21.15.136:0/1966708257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9040c8ce0 0x7ff9040ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff902d9d700 1 -- 172.21.15.136:0/1966708257 >> v2:172.21.15.178:3300/0 conn(0x7ff90415a0c0 msgr2=0x7ff9040cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:58.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff902d9d700 1 --2- 172.21.15.136:0/1966708257 >> v2:172.21.15.178:3300/0 conn(0x7ff90415a0c0 0x7ff9040cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff902d9d700 1 -- 172.21.15.136:0/1966708257 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9040ca620 con 0x7ff904069ef0 2023-06-23T19:00:58.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff902d9d700 1 --2- 172.21.15.136:0/1966708257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff904069ef0 0x7ff90406a330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff9040671b0 tx=0x7ff8fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a946b556206c9c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:58.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.281+0000 7ff901d9b700 1 -- 172.21.15.136:0/1966708257 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00e070 con 0x7ff904069ef0 2023-06-23T19:00:58.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff901d9b700 1 -- 172.21.15.136:0/1966708257 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc00b910 con 0x7ff904069ef0 2023-06-23T19:00:58.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff901d9b700 1 -- 172.21.15.136:0/1966708257 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00bcc0 con 0x7ff904069ef0 2023-06-23T19:00:58.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff9089ff700 1 -- 172.21.15.136:0/1966708257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff904069ef0 msgr2=0x7ff90406a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff9089ff700 1 --2- 172.21.15.136:0/1966708257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff904069ef0 0x7ff90406a330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff9040671b0 tx=0x7ff8fc00b330 comp rx=0 tx=0).stop 2023-06-23T19:00:58.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff9089ff700 1 -- 172.21.15.136:0/1966708257 shutdown_connections 2023-06-23T19:00:58.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff9089ff700 1 --2- 172.21.15.136:0/1966708257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff904069ef0 0x7ff90406a330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff9089ff700 1 --2- 172.21.15.136:0/1966708257 >> v2:172.21.15.178:3300/0 conn(0x7ff90415a0c0 0x7ff9040cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff9089ff700 1 --2- 172.21.15.136:0/1966708257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9040c8ce0 0x7ff9040ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff9089ff700 1 -- 172.21.15.136:0/1966708257 >> 172.21.15.136:0/1966708257 conn(0x7ff9040b0ef0 msgr2=0x7ff9040ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:58.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff9089ff700 1 -- 172.21.15.136:0/1966708257 shutdown_connections 2023-06-23T19:00:58.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.282+0000 7ff9089ff700 1 -- 172.21.15.136:0/1966708257 wait complete. 2023-06-23T19:00:58.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.284+0000 7ff9089ff700 1 Processor -- start 2023-06-23T19:00:58.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.284+0000 7ff9089ff700 1 -- start start 2023-06-23T19:00:58.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff9089ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff904069ef0 0x7ff904148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff9089ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9040c8ce0 0x7ff90415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff9089ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff90415a0c0 0x7ff90415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff9089ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9041486b0 con 0x7ff9040c8ce0 2023-06-23T19:00:58.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff9089ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90414d0b0 con 0x7ff904069ef0 2023-06-23T19:00:58.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff9089ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90414caf0 con 0x7ff90415a0c0 2023-06-23T19:00:58.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff8fbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9040c8ce0 0x7ff90415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff90259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff904069ef0 0x7ff904148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff8fbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9040c8ce0 0x7ff90415aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38018/0 (socket says 172.21.15.136:38018) 2023-06-23T19:00:58.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff8fbfff700 1 -- 172.21.15.136:0/3994399870 learned_addr learned my addr 172.21.15.136:0/3994399870 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:58.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.285+0000 7ff902d9d700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff90415a0c0 0x7ff90415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff8fbfff700 1 -- 172.21.15.136:0/3994399870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff90415a0c0 msgr2=0x7ff90415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff8fbfff700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff90415a0c0 0x7ff90415b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff8fbfff700 1 -- 172.21.15.136:0/3994399870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff904069ef0 msgr2=0x7ff904148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff8fbfff700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff904069ef0 0x7ff904148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff8fbfff700 1 -- 172.21.15.136:0/3994399870 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc009b30 con 0x7ff9040c8ce0 2023-06-23T19:00:58.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff90259c700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff904069ef0 0x7ff904148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:58.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff902d9d700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff90415a0c0 0x7ff90415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:00:58.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff8fbfff700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9040c8ce0 0x7ff90415aff0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00e9b0 tx=0x7ff8ec00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:58.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff8faffd700 1 -- 172.21.15.136:0/3994399870 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec009710 con 0x7ff9040c8ce0 2023-06-23T19:00:58.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff8faffd700 1 -- 172.21.15.136:0/3994399870 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec00ee50 con 0x7ff9040c8ce0 2023-06-23T19:00:58.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff8faffd700 1 -- 172.21.15.136:0/3994399870 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00ca50 con 0x7ff9040c8ce0 2023-06-23T19:00:58.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90414cdd0 con 0x7ff9040c8ce0 2023-06-23T19:00:58.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.286+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9040c25d0 con 0x7ff9040c8ce0 2023-06-23T19:00:58.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.287+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9040c2790 con 0x7ff9040c8ce0 2023-06-23T19:00:58.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.288+0000 7ff8faffd700 1 -- 172.21.15.136:0/3994399870 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8ec00cbb0 con 0x7ff9040c8ce0 2023-06-23T19:00:58.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.289+0000 7ff8faffd700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff8e406ace0 0x7ff8e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.289+0000 7ff8faffd700 1 -- 172.21.15.136:0/3994399870 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff8ec089110 con 0x7ff9040c8ce0 2023-06-23T19:00:58.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.289+0000 7ff90259c700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff8e406ace0 0x7ff8e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.290+0000 7ff90259c700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff8e406ace0 0x7ff8e406d190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009eb0 tx=0x7ff8f4009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:58.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.294+0000 7ff8faffd700 1 -- 172.21.15.136:0/3994399870 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8ec057f90 con 0x7ff9040c8ce0 2023-06-23T19:00:58.496 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.492+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff90406e160 con 0x7ff9040c8ce0 2023-06-23T19:00:58.497 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.493+0000 7ff8faffd700 1 -- 172.21.15.136:0/3994399870 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14673 (secure 0 0 0) 0x7ff8ec00ce60 con 0x7ff9040c8ce0 2023-06-23T19:00:58.498 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:00:58.498 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":20,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:00:58.021005+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:00:58.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff8e406ace0 msgr2=0x7ff8e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff8e406ace0 0x7ff8e406d190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009eb0 tx=0x7ff8f4009210 comp rx=0 tx=0).stop 2023-06-23T19:00:58.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9040c8ce0 msgr2=0x7ff90415aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9040c8ce0 0x7ff90415aff0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00e9b0 tx=0x7ff8ec00ecc0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 shutdown_connections 2023-06-23T19:00:58.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff8e406ace0 0x7ff8e406d190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff904069ef0 0x7ff904148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff90415a0c0 0x7ff90415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 --2- 172.21.15.136:0/3994399870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9040c8ce0 0x7ff90415aff0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 >> 172.21.15.136:0/3994399870 conn(0x7ff9040b0ef0 msgr2=0x7ff904151090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:58.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 shutdown_connections 2023-06-23T19:00:58.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.495+0000 7ff9089ff700 1 -- 172.21.15.136:0/3994399870 wait complete. 2023-06-23T19:00:58.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T19:00:58.518 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:00:58.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.710+0000 7fc25adff700 1 Processor -- start 2023-06-23T19:00:58.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.710+0000 7fc25adff700 1 -- start start 2023-06-23T19:00:58.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.711+0000 7fc25adff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2540d0a60 0x7fc2540b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.711+0000 7fc25adff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2540cd9d0 con 0x7fc2540b51d0 2023-06-23T19:00:58.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.711+0000 7fc25adff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2540b5620 con 0x7fc2540cf910 2023-06-23T19:00:58.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.711+0000 7fc25adff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2540d0060 con 0x7fc2540d0a60 2023-06-23T19:00:58.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc253fff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc2540b51d0 0x7fc2540d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53292/0 (socket says 172.21.15.136:53292) 2023-06-23T19:00:58.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc253fff700 1 -- 172.21.15.136:0/2782678990 learned_addr learned my addr 172.21.15.136:0/2782678990 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:00:58.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc258b9b700 1 --2- 172.21.15.136:0/2782678990 >> v2:172.21.15.178:3300/0 conn(0x7fc2540d0a60 0x7fc2540b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc2537fe700 1 -- 172.21.15.136:0/2782678990 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298956614 0 0) 0x7fc2540cd9d0 con 0x7fc2540b51d0 2023-06-23T19:00:58.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc2537fe700 1 -- 172.21.15.136:0/2782678990 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2440035b0 con 0x7fc2540b51d0 2023-06-23T19:00:58.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc2537fe700 1 -- 172.21.15.136:0/2782678990 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318441111 0 0) 0x7fc2540b5620 con 0x7fc2540cf910 2023-06-23T19:00:58.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc2537fe700 1 -- 172.21.15.136:0/2782678990 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2540cd9d0 con 0x7fc2540cf910 2023-06-23T19:00:58.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc2537fe700 1 -- 172.21.15.136:0/2782678990 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2254081377 0 0) 0x7fc2440035b0 con 0x7fc2540b51d0 2023-06-23T19:00:58.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc258b9b700 1 -- 172.21.15.136:0/2782678990 >> v1:172.21.15.178:6789/0 conn(0x7fc2540cf910 legacy=0x7fc2540d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc258b9b700 1 -- 172.21.15.136:0/2782678990 >> v1:172.21.15.136:6789/0 conn(0x7fc2540b51d0 legacy=0x7fc2540d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.712+0000 7fc258b9b700 1 -- 172.21.15.136:0/2782678990 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2540cd410 con 0x7fc2540d0a60 2023-06-23T19:00:58.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.713+0000 7fc258b9b700 1 --2- 172.21.15.136:0/2782678990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2540d0a60 0x7fc2540b5a70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc248009840 tx=0x7fc248009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df56d8127faf626d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:58.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.713+0000 7fc2537fe700 1 -- 172.21.15.136:0/2782678990 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240001670 con 0x7fc2540d0a60 2023-06-23T19:00:58.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.713+0000 7fc2537fe700 1 -- 172.21.15.136:0/2782678990 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248004030 con 0x7fc2540d0a60 2023-06-23T19:00:58.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.713+0000 7fc2537fe700 1 -- 172.21.15.136:0/2782678990 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2480043c0 con 0x7fc2540d0a60 2023-06-23T19:00:58.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.713+0000 7fc25adff700 1 -- 172.21.15.136:0/2782678990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2540d0a60 msgr2=0x7fc2540b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.713+0000 7fc25adff700 1 --2- 172.21.15.136:0/2782678990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2540d0a60 0x7fc2540b5a70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc248009840 tx=0x7fc248009b50 comp rx=0 tx=0).stop 2023-06-23T19:00:58.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.713+0000 7fc25adff700 1 -- 172.21.15.136:0/2782678990 shutdown_connections 2023-06-23T19:00:58.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.713+0000 7fc25adff700 1 --2- 172.21.15.136:0/2782678990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2540d0a60 0x7fc2540b5a70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.714+0000 7fc25adff700 1 -- 172.21.15.136:0/2782678990 >> 172.21.15.136:0/2782678990 conn(0x7fc254071620 msgr2=0x7fc2540719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:58.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.714+0000 7fc25adff700 1 -- 172.21.15.136:0/2782678990 shutdown_connections 2023-06-23T19:00:58.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.714+0000 7fc25adff700 1 -- 172.21.15.136:0/2782678990 wait complete. 2023-06-23T19:00:58.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.715+0000 7fc25adff700 1 Processor -- start 2023-06-23T19:00:58.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.715+0000 7fc25adff700 1 -- start start 2023-06-23T19:00:58.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.716+0000 7fc25adff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2540b51d0 0x7fc2540b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.716+0000 7fc25adff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2540cf910 0x7fc2540c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.716+0000 7fc25adff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2540d0a60 0x7fc2541f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.716+0000 7fc25adff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2540c7250 con 0x7fc2540d0a60 2023-06-23T19:00:58.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.716+0000 7fc25adff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2540c68b0 con 0x7fc2540cf910 2023-06-23T19:00:58.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.716+0000 7fc25adff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2540c6b90 con 0x7fc2540b51d0 2023-06-23T19:00:58.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25939c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2540d0a60 0x7fc2541f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25939c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2540d0a60 0x7fc2541f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38024/0 (socket says 172.21.15.136:38024) 2023-06-23T19:00:58.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25939c700 1 -- 172.21.15.136:0/3730255938 learned_addr learned my addr 172.21.15.136:0/3730255938 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:58.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc253fff700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2540cf910 0x7fc2540c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc258b9b700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2540b51d0 0x7fc2540b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25939c700 1 -- 172.21.15.136:0/3730255938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2540b51d0 msgr2=0x7fc2540b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25939c700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2540b51d0 0x7fc2540b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25939c700 1 -- 172.21.15.136:0/3730255938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2540cf910 msgr2=0x7fc2540c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25939c700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2540cf910 0x7fc2540c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25939c700 1 -- 172.21.15.136:0/3730255938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2480094a0 con 0x7fc2540d0a60 2023-06-23T19:00:58.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25939c700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2540d0a60 0x7fc2541f2c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00cc20 tx=0x7fc24c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:58.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc2517fa700 1 -- 172.21.15.136:0/3730255938 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00ac20 con 0x7fc2540d0a60 2023-06-23T19:00:58.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc2517fa700 1 -- 172.21.15.136:0/3730255938 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c00ad80 con 0x7fc2540d0a60 2023-06-23T19:00:58.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2540c6e70 con 0x7fc2540d0a60 2023-06-23T19:00:58.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.717+0000 7fc2517fa700 1 -- 172.21.15.136:0/3730255938 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c003c20 con 0x7fc2540d0a60 2023-06-23T19:00:58.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.718+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2541f3190 con 0x7fc2540d0a60 2023-06-23T19:00:58.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.719+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25404ea20 con 0x7fc2540d0a60 2023-06-23T19:00:58.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.719+0000 7fc2517fa700 1 -- 172.21.15.136:0/3730255938 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc24c0050d0 con 0x7fc2540d0a60 2023-06-23T19:00:58.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.720+0000 7fc2517fa700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc23806ace0 0x7fc23806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:58.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.721+0000 7fc2517fa700 1 -- 172.21.15.136:0/3730255938 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc24c0892b0 con 0x7fc2540d0a60 2023-06-23T19:00:58.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.721+0000 7fc258b9b700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc23806ace0 0x7fc23806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:58.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.721+0000 7fc258b9b700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc23806ace0 0x7fc23806d190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2480090b0 tx=0x7fc248013040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:58.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.725+0000 7fc2517fa700 1 -- 172.21.15.136:0/3730255938 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc24c0546e0 con 0x7fc2540d0a60 2023-06-23T19:00:58.926 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.923+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2540d20d0 con 0x7fc2540d0a60 2023-06-23T19:00:58.927 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.923+0000 7fc2517fa700 1 -- 172.21.15.136:0/3730255938 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc24c057d00 con 0x7fc2540d0a60 2023-06-23T19:00:58.927 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:00:58.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc23806ace0 msgr2=0x7fc23806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc23806ace0 0x7fc23806d190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2480090b0 tx=0x7fc248013040 comp rx=0 tx=0).stop 2023-06-23T19:00:58.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2540d0a60 msgr2=0x7fc2541f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:58.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2540d0a60 0x7fc2541f2c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00cc20 tx=0x7fc24c00a060 comp rx=0 tx=0).stop 2023-06-23T19:00:58.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 shutdown_connections 2023-06-23T19:00:58.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc23806ace0 0x7fc23806d190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2540d0a60 0x7fc2541f2c50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2540b51d0 0x7fc2540b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 --2- 172.21.15.136:0/3730255938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2540cf910 0x7fc2540c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:58.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.925+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 >> 172.21.15.136:0/3730255938 conn(0x7fc254071620 msgr2=0x7fc2540d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:58.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.926+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 shutdown_connections 2023-06-23T19:00:58.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:58.926+0000 7fc25adff700 1 -- 172.21.15.136:0/3730255938 wait complete. 2023-06-23T19:00:58.947 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:00:59.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.143+0000 7fba9e1ff700 1 Processor -- start 2023-06-23T19:00:59.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.143+0000 7fba9e1ff700 1 -- start start 2023-06-23T19:00:59.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.144+0000 7fba9e1ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fba980d0a60 0x7fba980b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.144+0000 7fba9e1ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fba980cf910 0x7fba980d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.144+0000 7fba9e1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba980cd9d0 con 0x7fba980b51d0 2023-06-23T19:00:59.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.144+0000 7fba9e1ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980d0060 con 0x7fba980cf910 2023-06-23T19:00:59.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.144+0000 7fba9e1ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980b5620 con 0x7fba980d0a60 2023-06-23T19:00:59.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.144+0000 7fba97fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fba980cf910 0x7fba980d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba97fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fba980cf910 0x7fba980d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38040/0 (socket says 172.21.15.136:38040) 2023-06-23T19:00:59.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba97fff700 1 -- 172.21.15.136:0/3121154868 learned_addr learned my addr 172.21.15.136:0/3121154868 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:59.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba977fe700 1 --2- 172.21.15.136:0/3121154868 >> v2:172.21.15.178:3300/0 conn(0x7fba980d0a60 0x7fba980b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba97fff700 1 -- 172.21.15.136:0/3121154868 >> v2:172.21.15.178:3300/0 conn(0x7fba980d0a60 msgr2=0x7fba980b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:59.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba97fff700 1 --2- 172.21.15.136:0/3121154868 >> v2:172.21.15.178:3300/0 conn(0x7fba980d0a60 0x7fba980b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba97fff700 1 -- 172.21.15.136:0/3121154868 >> v1:172.21.15.178:6789/0 conn(0x7fba980b51d0 legacy=0x7fba980d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba97fff700 1 -- 172.21.15.136:0/3121154868 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba980cd410 con 0x7fba980cf910 2023-06-23T19:00:59.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba977fe700 1 --2- 172.21.15.136:0/3121154868 >> v2:172.21.15.178:3300/0 conn(0x7fba980d0a60 0x7fba980b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:00:59.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba97fff700 1 --2- 172.21.15.136:0/3121154868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 0x7fba980d2e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba9806c6e0 tx=0x7fba9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1982c669cb55f476 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:59.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba967fc700 1 -- 172.21.15.136:0/3121154868 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000e070 con 0x7fba980cf910 2023-06-23T19:00:59.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba967fc700 1 -- 172.21.15.136:0/3121154868 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9000b9c0 con 0x7fba980cf910 2023-06-23T19:00:59.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.145+0000 7fba967fc700 1 -- 172.21.15.136:0/3121154868 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000bd70 con 0x7fba980cf910 2023-06-23T19:00:59.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.146+0000 7fba9e1ff700 1 -- 172.21.15.136:0/3121154868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 msgr2=0x7fba980d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.146+0000 7fba9e1ff700 1 --2- 172.21.15.136:0/3121154868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 0x7fba980d2e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba9806c6e0 tx=0x7fba9000b330 comp rx=0 tx=0).stop 2023-06-23T19:00:59.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.146+0000 7fba9e1ff700 1 -- 172.21.15.136:0/3121154868 shutdown_connections 2023-06-23T19:00:59.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.146+0000 7fba9e1ff700 1 --2- 172.21.15.136:0/3121154868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 0x7fba980d2e00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.146+0000 7fba9e1ff700 1 --2- 172.21.15.136:0/3121154868 >> v2:172.21.15.178:3300/0 conn(0x7fba980d0a60 0x7fba980b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.146+0000 7fba9e1ff700 1 -- 172.21.15.136:0/3121154868 >> 172.21.15.136:0/3121154868 conn(0x7fba98071620 msgr2=0x7fba980719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:59.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.146+0000 7fba9e1ff700 1 -- 172.21.15.136:0/3121154868 shutdown_connections 2023-06-23T19:00:59.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.146+0000 7fba9e1ff700 1 -- 172.21.15.136:0/3121154868 wait complete. 2023-06-23T19:00:59.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.148+0000 7fba9e1ff700 1 Processor -- start 2023-06-23T19:00:59.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.148+0000 7fba9e1ff700 1 -- start start 2023-06-23T19:00:59.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba9e1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba980b51d0 0x7fba980b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba9e1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 0x7fba98152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba9e1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba980d0a60 0x7fba98152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba9e1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980c87c0 con 0x7fba980cf910 2023-06-23T19:00:59.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba9e1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba98153480 con 0x7fba980b51d0 2023-06-23T19:00:59.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba9e1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980c7720 con 0x7fba980d0a60 2023-06-23T19:00:59.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba96ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 0x7fba98152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba96ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 0x7fba98152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38042/0 (socket says 172.21.15.136:38042) 2023-06-23T19:00:59.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba96ffd700 1 -- 172.21.15.136:0/214068009 learned_addr learned my addr 172.21.15.136:0/214068009 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:59.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba977fe700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba980b51d0 0x7fba980b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba97fff700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba980d0a60 0x7fba98152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba96ffd700 1 -- 172.21.15.136:0/214068009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba980d0a60 msgr2=0x7fba98152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba96ffd700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba980d0a60 0x7fba98152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba96ffd700 1 -- 172.21.15.136:0/214068009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba980b51d0 msgr2=0x7fba980b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba96ffd700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba980b51d0 0x7fba980b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba96ffd700 1 -- 172.21.15.136:0/214068009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009b30 con 0x7fba980cf910 2023-06-23T19:00:59.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.149+0000 7fba97fff700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba980d0a60 0x7fba98152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:00:59.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.150+0000 7fba96ffd700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 0x7fba98152a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00c4e0 tx=0x7fba8c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:59.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.150+0000 7fba7ffff700 1 -- 172.21.15.136:0/214068009 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c0052d0 con 0x7fba980cf910 2023-06-23T19:00:59.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.150+0000 7fba7ffff700 1 -- 172.21.15.136:0/214068009 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c005430 con 0x7fba980cf910 2023-06-23T19:00:59.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.150+0000 7fba7ffff700 1 -- 172.21.15.136:0/214068009 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c0038c0 con 0x7fba980cf910 2023-06-23T19:00:59.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.150+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba980c7a00 con 0x7fba980cf910 2023-06-23T19:00:59.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.150+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba980c7fc0 con 0x7fba980cf910 2023-06-23T19:00:59.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.151+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9804ea20 con 0x7fba980cf910 2023-06-23T19:00:59.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.152+0000 7fba7ffff700 1 -- 172.21.15.136:0/214068009 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba8c003a20 con 0x7fba980cf910 2023-06-23T19:00:59.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.153+0000 7fba7ffff700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8406ace0 0x7fba8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.153+0000 7fba7ffff700 1 -- 172.21.15.136:0/214068009 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fba8c0886f0 con 0x7fba980cf910 2023-06-23T19:00:59.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.153+0000 7fba977fe700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8406ace0 0x7fba8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.153+0000 7fba977fe700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8406ace0 0x7fba8406d190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba980cca00 tx=0x7fba88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:59.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.157+0000 7fba7ffff700 1 -- 172.21.15.136:0/214068009 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba8c053a50 con 0x7fba980cf910 2023-06-23T19:00:59.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.359+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba980caff0 con 0x7fba980cf910 2023-06-23T19:00:59.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.359+0000 7fba7ffff700 1 -- 172.21.15.136:0/214068009 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fba8c057070 con 0x7fba980cf910 2023-06-23T19:00:59.363 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:00:59.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.361+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8406ace0 msgr2=0x7fba8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.361+0000 7fba9e1ff700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8406ace0 0x7fba8406d190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba980cca00 tx=0x7fba88008040 comp rx=0 tx=0).stop 2023-06-23T19:00:59.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.361+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 msgr2=0x7fba98152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.361+0000 7fba9e1ff700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 0x7fba98152a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00c4e0 tx=0x7fba8c00c8a0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.362+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 shutdown_connections 2023-06-23T19:00:59.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.362+0000 7fba9e1ff700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8406ace0 0x7fba8406d190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.362+0000 7fba9e1ff700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba980b51d0 0x7fba980b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.362+0000 7fba9e1ff700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba980d0a60 0x7fba98152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.362+0000 7fba9e1ff700 1 --2- 172.21.15.136:0/214068009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba980cf910 0x7fba98152a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.362+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 >> 172.21.15.136:0/214068009 conn(0x7fba98071620 msgr2=0x7fba980c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:59.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.362+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 shutdown_connections 2023-06-23T19:00:59.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.362+0000 7fba9e1ff700 1 -- 172.21.15.136:0/214068009 wait complete. 2023-06-23T19:00:59.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:00:59.576 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.572+0000 7f5152fff700 1 Processor -- start 2023-06-23T19:00:59.577 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.573+0000 7f5152fff700 1 -- start start 2023-06-23T19:00:59.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5152fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f514c15c570 0x7f514c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5152fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c160a50 0x7f514c0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5152fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c1610a0 con 0x7f514c0cd660 2023-06-23T19:00:59.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5152fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c15d670 con 0x7f514c15c570 2023-06-23T19:00:59.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5152fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c160eb0 con 0x7f514c160a50 2023-06-23T19:00:59.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5150d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f514c15c570 0x7f514c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5150d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f514c15c570 0x7f514c0cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38046/0 (socket says 172.21.15.136:38046) 2023-06-23T19:00:59.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5150d9b700 1 -- 172.21.15.136:0/2429750872 learned_addr learned my addr 172.21.15.136:0/2429750872 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:59.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f515159c700 1 --2- 172.21.15.136:0/2429750872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c160a50 0x7f514c0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5150d9b700 1 -- 172.21.15.136:0/2429750872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c160a50 msgr2=0x7f514c0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:00:59.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5150d9b700 1 --2- 172.21.15.136:0/2429750872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c160a50 0x7f514c0d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5150d9b700 1 -- 172.21.15.136:0/2429750872 >> v1:172.21.15.178:6789/0 conn(0x7f514c0cd660 legacy=0x7f514c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.574+0000 7f5150d9b700 1 -- 172.21.15.136:0/2429750872 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c15da90 con 0x7f514c15c570 2023-06-23T19:00:59.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.575+0000 7f515159c700 1 --2- 172.21.15.136:0/2429750872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c160a50 0x7f514c0d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:00:59.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.575+0000 7f5150d9b700 1 --2- 172.21.15.136:0/2429750872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 0x7f514c0cd120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5140009920 tx=0x7f5140009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04297c226eb79c7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:59.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.575+0000 7f514b7fe700 1 -- 172.21.15.136:0/2429750872 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514000ba20 con 0x7f514c15c570 2023-06-23T19:00:59.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.575+0000 7f514b7fe700 1 -- 172.21.15.136:0/2429750872 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514000bb80 con 0x7f514c15c570 2023-06-23T19:00:59.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.575+0000 7f514b7fe700 1 -- 172.21.15.136:0/2429750872 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140009e70 con 0x7f514c15c570 2023-06-23T19:00:59.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.576+0000 7f5152fff700 1 -- 172.21.15.136:0/2429750872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 msgr2=0x7f514c0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.576+0000 7f5152fff700 1 --2- 172.21.15.136:0/2429750872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 0x7f514c0cd120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5140009920 tx=0x7f5140009c30 comp rx=0 tx=0).stop 2023-06-23T19:00:59.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.576+0000 7f5152fff700 1 -- 172.21.15.136:0/2429750872 shutdown_connections 2023-06-23T19:00:59.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.576+0000 7f5152fff700 1 --2- 172.21.15.136:0/2429750872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 0x7f514c0cd120 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.576+0000 7f5152fff700 1 --2- 172.21.15.136:0/2429750872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c160a50 0x7f514c0d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.576+0000 7f5152fff700 1 -- 172.21.15.136:0/2429750872 >> 172.21.15.136:0/2429750872 conn(0x7f514c071620 msgr2=0x7f514c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:59.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.576+0000 7f5152fff700 1 -- 172.21.15.136:0/2429750872 shutdown_connections 2023-06-23T19:00:59.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.576+0000 7f5152fff700 1 -- 172.21.15.136:0/2429750872 wait complete. 2023-06-23T19:00:59.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.578+0000 7f5152fff700 1 Processor -- start 2023-06-23T19:00:59.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.579+0000 7f5152fff700 1 -- start start 2023-06-23T19:00:59.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.579+0000 7f5152fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c0cd660 0x7f514c1e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.579+0000 7f5152fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 0x7f514c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.579+0000 7f5152fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f514c160a50 0x7f514c0b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.579+0000 7f5152fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1e7000 con 0x7f514c15c570 2023-06-23T19:00:59.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.579+0000 7f5152fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1e8530 con 0x7f514c160a50 2023-06-23T19:00:59.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.579+0000 7f5152fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1e7230 con 0x7f514c0cd660 2023-06-23T19:00:59.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f514bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 0x7f514c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f514bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 0x7f514c0b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38050/0 (socket says 172.21.15.136:38050) 2023-06-23T19:00:59.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f514bfff700 1 -- 172.21.15.136:0/3456836028 learned_addr learned my addr 172.21.15.136:0/3456836028 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:00:59.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f5150d9b700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c0cd660 0x7f514c1e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f515159c700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f514c160a50 0x7f514c0b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f514bfff700 1 -- 172.21.15.136:0/3456836028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c0cd660 msgr2=0x7f514c1e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f514bfff700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c0cd660 0x7f514c1e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f514bfff700 1 -- 172.21.15.136:0/3456836028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f514c160a50 msgr2=0x7f514c0b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f514bfff700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f514c160a50 0x7f514c0b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f514bfff700 1 -- 172.21.15.136:0/3456836028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009550 con 0x7f514c15c570 2023-06-23T19:00:59.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f5150d9b700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c0cd660 0x7f514c1e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:00:59.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.580+0000 7f514bfff700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 0x7f514c0b4310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f513800c4e0 tx=0x7f513800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:59.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.581+0000 7f51497fa700 1 -- 172.21.15.136:0/3456836028 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380052d0 con 0x7f514c15c570 2023-06-23T19:00:59.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.581+0000 7f51497fa700 1 -- 172.21.15.136:0/3456836028 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138005430 con 0x7f514c15c570 2023-06-23T19:00:59.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.581+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c1e7510 con 0x7f514c15c570 2023-06-23T19:00:59.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.581+0000 7f51497fa700 1 -- 172.21.15.136:0/3456836028 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380038c0 con 0x7f514c15c570 2023-06-23T19:00:59.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.581+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c1e7ad0 con 0x7f514c15c570 2023-06-23T19:00:59.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.582+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c0666c0 con 0x7f514c15c570 2023-06-23T19:00:59.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.583+0000 7f51497fa700 1 -- 172.21.15.136:0/3456836028 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5138003a20 con 0x7f514c15c570 2023-06-23T19:00:59.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.584+0000 7f51497fa700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f513006ace0 0x7f513006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:00:59.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.584+0000 7f51497fa700 1 -- 172.21.15.136:0/3456836028 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5138088660 con 0x7f514c15c570 2023-06-23T19:00:59.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.584+0000 7f5150d9b700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f513006ace0 0x7f513006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:00:59.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.584+0000 7f5150d9b700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f513006ace0 0x7f513006d190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5140000c00 tx=0x7f5140008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:00:59.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.588+0000 7f51497fa700 1 -- 172.21.15.136:0/3456836028 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5138053a50 con 0x7f514c15c570 2023-06-23T19:00:59.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.826+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f514c073910 con 0x7f514c15c570 2023-06-23T19:00:59.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.826+0000 7f51497fa700 1 -- 172.21.15.136:0/3456836028 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f5138017de0 con 0x7f514c15c570 2023-06-23T19:00:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:00:59.831 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-23T19:00:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f513006ace0 msgr2=0x7f513006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f513006ace0 0x7f513006d190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5140000c00 tx=0x7f5140008030 comp rx=0 tx=0).stop 2023-06-23T19:00:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 msgr2=0x7f514c0b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:00:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 0x7f514c0b4310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f513800c4e0 tx=0x7f513800c8a0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 shutdown_connections 2023-06-23T19:00:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f513006ace0 0x7f513006d190 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f514c160a50 0x7f514c0b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f514c0cd660 0x7f514c1e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 --2- 172.21.15.136:0/3456836028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f514c15c570 0x7f514c0b4310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:00:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 >> 172.21.15.136:0/3456836028 conn(0x7f514c071620 msgr2=0x7f514c0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:00:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 shutdown_connections 2023-06-23T19:00:59.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:00:59.829+0000 7f5152fff700 1 -- 172.21.15.136:0/3456836028 wait complete. 2023-06-23T19:00:59.835 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 3 2023-06-23T19:00:59.851 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:00.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.040+0000 7fe7041ff700 1 Processor -- start 2023-06-23T19:01:00.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.040+0000 7fe7041ff700 1 -- start start 2023-06-23T19:01:00.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.041+0000 7fe7041ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6fc15c570 0x7fe6fc0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe7041ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe6fc160a50 0x7fe6fc0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe7041ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6fc160e70 con 0x7fe6fc0cd660 2023-06-23T19:01:00.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe7041ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc15d670 con 0x7fe6fc160a50 2023-06-23T19:01:00.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe7041ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0cdae0 con 0x7fe6fc15c570 2023-06-23T19:01:00.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe70279c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe6fc160a50 0x7fe6fc0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe70279c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe6fc160a50 0x7fe6fc0d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38056/0 (socket says 172.21.15.136:38056) 2023-06-23T19:01:00.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe70279c700 1 -- 172.21.15.136:0/3804554227 learned_addr learned my addr 172.21.15.136:0/3804554227 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:00.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe701f9b700 1 --2- 172.21.15.136:0/3804554227 >> v2:172.21.15.178:3300/0 conn(0x7fe6fc15c570 0x7fe6fc0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe70279c700 1 -- 172.21.15.136:0/3804554227 >> v2:172.21.15.178:3300/0 conn(0x7fe6fc15c570 msgr2=0x7fe6fc0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:00.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe70279c700 1 --2- 172.21.15.136:0/3804554227 >> v2:172.21.15.178:3300/0 conn(0x7fe6fc15c570 0x7fe6fc0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe70279c700 1 -- 172.21.15.136:0/3804554227 >> v1:172.21.15.178:6789/0 conn(0x7fe6fc0cd660 legacy=0x7fe6fc160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe70279c700 1 -- 172.21.15.136:0/3804554227 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc1610a0 con 0x7fe6fc160a50 2023-06-23T19:01:00.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe701f9b700 1 --2- 172.21.15.136:0/3804554227 >> v2:172.21.15.178:3300/0 conn(0x7fe6fc15c570 0x7fe6fc0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:00.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.042+0000 7fe70279c700 1 --2- 172.21.15.136:0/3804554227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 0x7fe6fc0d0bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc08bd60 tx=0x7fe6f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd3ddaf29b267ac server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:00.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe700f99700 1 -- 172.21.15.136:0/3804554227 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400e070 con 0x7fe6fc160a50 2023-06-23T19:01:00.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe700f99700 1 -- 172.21.15.136:0/3804554227 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f400b9c0 con 0x7fe6fc160a50 2023-06-23T19:01:00.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe700f99700 1 -- 172.21.15.136:0/3804554227 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400bd70 con 0x7fe6fc160a50 2023-06-23T19:01:00.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe7041ff700 1 -- 172.21.15.136:0/3804554227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 msgr2=0x7fe6fc0d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe7041ff700 1 --2- 172.21.15.136:0/3804554227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 0x7fe6fc0d0bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc08bd60 tx=0x7fe6f400b330 comp rx=0 tx=0).stop 2023-06-23T19:01:00.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe7041ff700 1 -- 172.21.15.136:0/3804554227 shutdown_connections 2023-06-23T19:01:00.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe7041ff700 1 --2- 172.21.15.136:0/3804554227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 0x7fe6fc0d0bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe7041ff700 1 --2- 172.21.15.136:0/3804554227 >> v2:172.21.15.178:3300/0 conn(0x7fe6fc15c570 0x7fe6fc0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe7041ff700 1 -- 172.21.15.136:0/3804554227 >> 172.21.15.136:0/3804554227 conn(0x7fe6fc071620 msgr2=0x7fe6fc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:00.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe7041ff700 1 -- 172.21.15.136:0/3804554227 shutdown_connections 2023-06-23T19:01:00.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.043+0000 7fe7041ff700 1 -- 172.21.15.136:0/3804554227 wait complete. 2023-06-23T19:01:00.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.045+0000 7fe7041ff700 1 Processor -- start 2023-06-23T19:01:00.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.045+0000 7fe7041ff700 1 -- start start 2023-06-23T19:01:00.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.046+0000 7fe7041ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc0cd660 0x7fe6fc151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.046+0000 7fe7041ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6fc15c570 0x7fe6fc0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.046+0000 7fe7041ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 0x7fe6fc0c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.046+0000 7fe7041ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0b59b0 con 0x7fe6fc160a50 2023-06-23T19:01:00.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.046+0000 7fe7041ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc1f56c0 con 0x7fe6fc0cd660 2023-06-23T19:01:00.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.046+0000 7fe7041ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc1f59a0 con 0x7fe6fc15c570 2023-06-23T19:01:00.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe701f9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc0cd660 0x7fe6fc151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe70279c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 0x7fe6fc0c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe701f9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc0cd660 0x7fe6fc151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:57348/0 (socket says 172.21.15.136:57348) 2023-06-23T19:01:00.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe701f9b700 1 -- 172.21.15.136:0/2088453631 learned_addr learned my addr 172.21.15.136:0/2088453631 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:00.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe70179a700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6fc15c570 0x7fe6fc0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe70279c700 1 -- 172.21.15.136:0/2088453631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6fc15c570 msgr2=0x7fe6fc0b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe70279c700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6fc15c570 0x7fe6fc0b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe70279c700 1 -- 172.21.15.136:0/2088453631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc0cd660 msgr2=0x7fe6fc151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe70279c700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc0cd660 0x7fe6fc151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe70279c700 1 -- 172.21.15.136:0/2088453631 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4009b30 con 0x7fe6fc160a50 2023-06-23T19:01:00.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe70279c700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 0x7fe6fc0c6c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4015000 tx=0x7fe6f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:00.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe6f27fc700 1 -- 172.21.15.136:0/2088453631 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4004880 con 0x7fe6fc160a50 2023-06-23T19:01:00.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe6f27fc700 1 -- 172.21.15.136:0/2088453631 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f40092e0 con 0x7fe6fc160a50 2023-06-23T19:01:00.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc1f5c80 con 0x7fe6fc160a50 2023-06-23T19:01:00.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.047+0000 7fe6f27fc700 1 -- 172.21.15.136:0/2088453631 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f401b650 con 0x7fe6fc160a50 2023-06-23T19:01:00.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.048+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc1516b0 con 0x7fe6fc160a50 2023-06-23T19:01:00.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.049+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc0b5bd0 con 0x7fe6fc160a50 2023-06-23T19:01:00.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.050+0000 7fe6f27fc700 1 -- 172.21.15.136:0/2088453631 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6f401b7b0 con 0x7fe6fc160a50 2023-06-23T19:01:00.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.051+0000 7fe6f27fc700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe6e006ace0 0x7fe6e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.051+0000 7fe6f27fc700 1 -- 172.21.15.136:0/2088453631 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe6f408a620 con 0x7fe6fc160a50 2023-06-23T19:01:00.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.051+0000 7fe701f9b700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe6e006ace0 0x7fe6e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.052+0000 7fe701f9b700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe6e006ace0 0x7fe6e006d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009a90 tx=0x7fe6f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:00.059 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.055+0000 7fe6f27fc700 1 -- 172.21.15.136:0/2088453631 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6f4055a10 con 0x7fe6fc160a50 2023-06-23T19:01:00.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.258+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6fc073910 con 0x7fe6fc160a50 2023-06-23T19:01:00.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.259+0000 7fe6f27fc700 1 -- 172.21.15.136:0/2088453631 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14660 (secure 0 0 0) 0x7fe6f4059030 con 0x7fe6fc160a50 2023-06-23T19:01:00.263 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:00.263 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":21,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:00:59.026118+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:00.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe6e006ace0 msgr2=0x7fe6e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe6e006ace0 0x7fe6e006d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009a90 tx=0x7fe6f8008040 comp rx=0 tx=0).stop 2023-06-23T19:01:00.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 msgr2=0x7fe6fc0c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 0x7fe6fc0c6c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4015000 tx=0x7fe6f4004ad0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 shutdown_connections 2023-06-23T19:01:00.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe6e006ace0 0x7fe6e006d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc0cd660 0x7fe6fc151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc160a50 0x7fe6fc0c6c70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 --2- 172.21.15.136:0/2088453631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6fc15c570 0x7fe6fc0b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 >> 172.21.15.136:0/2088453631 conn(0x7fe6fc071620 msgr2=0x7fe6fc15e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:00.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 shutdown_connections 2023-06-23T19:01:00.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.262+0000 7fe7041ff700 1 -- 172.21.15.136:0/2088453631 wait complete. 2023-06-23T19:01:00.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T19:01:00.285 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:01:00.479 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.476+0000 7f216ddff700 1 Processor -- start 2023-06-23T19:01:00.480 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.476+0000 7f216ddff700 1 -- start start 2023-06-23T19:01:00.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.477+0000 7f216ddff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f21680709f0 0x7f21680b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.477+0000 7f216ddff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f21680b2b40 0x7f216806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.477+0000 7f216ddff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216806d130 con 0x7f216815a5a0 2023-06-23T19:01:00.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.477+0000 7f216ddff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21680cf6a0 con 0x7f21680b2b40 2023-06-23T19:01:00.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.477+0000 7f216ddff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216806c520 con 0x7f21680709f0 2023-06-23T19:01:00.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.477+0000 7f2167fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f21680b2b40 0x7f216806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.477+0000 7f2167fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f21680b2b40 0x7f216806d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38064/0 (socket says 172.21.15.136:38064) 2023-06-23T19:01:00.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.477+0000 7f2167fff700 1 -- 172.21.15.136:0/1794175342 learned_addr learned my addr 172.21.15.136:0/1794175342 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:00.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.477+0000 7f21677fe700 1 --1- 172.21.15.136:0/1794175342 >> v1:172.21.15.136:6789/0 conn(0x7f216815a5a0 0x7f21680702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53308/0 (socket says 172.21.15.136:53308) 2023-06-23T19:01:00.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f2166ffd700 1 --2- 172.21.15.136:0/1794175342 >> v2:172.21.15.178:3300/0 conn(0x7f21680709f0 0x7f21680b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f2167fff700 1 -- 172.21.15.136:0/1794175342 >> v2:172.21.15.178:3300/0 conn(0x7f21680709f0 msgr2=0x7f21680b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:00.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f2167fff700 1 --2- 172.21.15.136:0/1794175342 >> v2:172.21.15.178:3300/0 conn(0x7f21680709f0 0x7f21680b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f2167fff700 1 -- 172.21.15.136:0/1794175342 >> v1:172.21.15.136:6789/0 conn(0x7f216815a5a0 legacy=0x7f21680702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f2167fff700 1 -- 172.21.15.136:0/1794175342 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216806c800 con 0x7f21680b2b40 2023-06-23T19:01:00.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f2166ffd700 1 --2- 172.21.15.136:0/1794175342 >> v2:172.21.15.178:3300/0 conn(0x7f21680709f0 0x7f21680b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:00.484 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f2167fff700 1 --2- 172.21.15.136:0/1794175342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21680b2b40 0x7f216806d5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21680b39c0 tx=0x7f216000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d6e622bbe37dc2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f21667fc700 1 -- 172.21.15.136:0/1794175342 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216000e070 con 0x7f21680b2b40 2023-06-23T19:01:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f21667fc700 1 -- 172.21.15.136:0/1794175342 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216000b9c0 con 0x7f21680b2b40 2023-06-23T19:01:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.478+0000 7f21667fc700 1 -- 172.21.15.136:0/1794175342 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216000bd70 con 0x7f21680b2b40 2023-06-23T19:01:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.479+0000 7f216ddff700 1 -- 172.21.15.136:0/1794175342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21680b2b40 msgr2=0x7f216806d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.479+0000 7f216ddff700 1 --2- 172.21.15.136:0/1794175342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21680b2b40 0x7f216806d5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21680b39c0 tx=0x7f216000b330 comp rx=0 tx=0).stop 2023-06-23T19:01:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.479+0000 7f216ddff700 1 -- 172.21.15.136:0/1794175342 shutdown_connections 2023-06-23T19:01:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.479+0000 7f216ddff700 1 --2- 172.21.15.136:0/1794175342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21680b2b40 0x7f216806d5c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.479+0000 7f216ddff700 1 --2- 172.21.15.136:0/1794175342 >> v2:172.21.15.178:3300/0 conn(0x7f21680709f0 0x7f21680b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.479+0000 7f216ddff700 1 -- 172.21.15.136:0/1794175342 >> 172.21.15.136:0/1794175342 conn(0x7f216806ab80 msgr2=0x7f21680ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.479+0000 7f216ddff700 1 -- 172.21.15.136:0/1794175342 shutdown_connections 2023-06-23T19:01:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.479+0000 7f216ddff700 1 -- 172.21.15.136:0/1794175342 wait complete. 2023-06-23T19:01:00.487 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.481+0000 7f216ddff700 1 Processor -- start 2023-06-23T19:01:00.487 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.481+0000 7f216ddff700 1 -- start start 2023-06-23T19:01:00.488 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f216ddff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21680709f0 0x7f2168150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.489 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f216ddff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21680b2b40 0x7f2168144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.489 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f216ddff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f216815a5a0 0x7f21680c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.489 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f216ddff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21680c8e90 con 0x7f216815a5a0 2023-06-23T19:01:00.489 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f216ddff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21680c9170 con 0x7f21680b2b40 2023-06-23T19:01:00.489 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f216ddff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21680c9450 con 0x7f21680709f0 2023-06-23T19:01:00.489 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f2167fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f216815a5a0 0x7f21680c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f2167fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f216815a5a0 0x7f21680c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38068/0 (socket says 172.21.15.136:38068) 2023-06-23T19:01:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f2167fff700 1 -- 172.21.15.136:0/1691829337 learned_addr learned my addr 172.21.15.136:0/1691829337 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f2167fff700 1 -- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21680709f0 msgr2=0x7f2168150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f21677fe700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21680709f0 0x7f2168150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f2166ffd700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21680b2b40 0x7f2168144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f2167fff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21680709f0 0x7f2168150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f2167fff700 1 -- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21680b2b40 msgr2=0x7f2168144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f2167fff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21680b2b40 0x7f2168144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f2167fff700 1 -- 172.21.15.136:0/1691829337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160009b30 con 0x7f216815a5a0 2023-06-23T19:01:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.482+0000 7f21677fe700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21680709f0 0x7f2168150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.483+0000 7f2166ffd700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21680b2b40 0x7f2168144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.483+0000 7f2167fff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f216815a5a0 0x7f21680c9f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2160012000 tx=0x7f2160004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.483+0000 7f214ffff700 1 -- 172.21.15.136:0/1691829337 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21600099b0 con 0x7f216815a5a0 2023-06-23T19:01:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.483+0000 7f214ffff700 1 -- 172.21.15.136:0/1691829337 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21600092e0 con 0x7f216815a5a0 2023-06-23T19:01:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.483+0000 7f214ffff700 1 -- 172.21.15.136:0/1691829337 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216001c640 con 0x7f216815a5a0 2023-06-23T19:01:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.483+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21680c9730 con 0x7f216815a5a0 2023-06-23T19:01:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.483+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2168151450 con 0x7f216815a5a0 2023-06-23T19:01:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.484+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21681515e0 con 0x7f216815a5a0 2023-06-23T19:01:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.485+0000 7f214ffff700 1 -- 172.21.15.136:0/1691829337 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f216001c7a0 con 0x7f216815a5a0 2023-06-23T19:01:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.486+0000 7f214ffff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f215406ace0 0x7f215406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.486+0000 7f214ffff700 1 -- 172.21.15.136:0/1691829337 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f216008ab70 con 0x7f216815a5a0 2023-06-23T19:01:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.486+0000 7f21677fe700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f215406ace0 0x7f215406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.487+0000 7f21677fe700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f215406ace0 0x7f215406d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f60 tx=0x7f2158009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.490+0000 7f214ffff700 1 -- 172.21.15.136:0/1691829337 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2160055f60 con 0x7f216815a5a0 2023-06-23T19:01:00.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.685+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21680c9bf0 con 0x7f216815a5a0 2023-06-23T19:01:00.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.685+0000 7f214ffff700 1 -- 172.21.15.136:0/1691829337 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2160059580 con 0x7f216815a5a0 2023-06-23T19:01:00.689 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:01:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f215406ace0 msgr2=0x7f215406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f215406ace0 0x7f215406d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f60 tx=0x7f2158009040 comp rx=0 tx=0).stop 2023-06-23T19:01:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f216815a5a0 msgr2=0x7f21680c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f216815a5a0 0x7f21680c9f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2160012000 tx=0x7f2160004ad0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 shutdown_connections 2023-06-23T19:01:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f215406ace0 0x7f215406d190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f216815a5a0 0x7f21680c9f30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21680709f0 0x7f2168150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 --2- 172.21.15.136:0/1691829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21680b2b40 0x7f2168144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.687+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 >> 172.21.15.136:0/1691829337 conn(0x7f216806ab80 msgr2=0x7f21680b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:00.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.688+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 shutdown_connections 2023-06-23T19:01:00.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.688+0000 7f216ddff700 1 -- 172.21.15.136:0/1691829337 wait complete. 2023-06-23T19:01:00.710 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:01:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.903+0000 7f6055bff700 1 Processor -- start 2023-06-23T19:01:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.904+0000 7f6055bff700 1 -- start start 2023-06-23T19:01:00.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6055bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f60500b5a70 0x7f60500b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6055bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 0x7f60500d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6055bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60500b5ec0 con 0x7f60500d0a60 2023-06-23T19:01:00.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6055bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60500d0060 con 0x7f60500b5a70 2023-06-23T19:01:00.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6055bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60500cd9d0 con 0x7f60500cf910 2023-06-23T19:01:00.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6047fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f60500b5a70 0x7f60500b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6047fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f60500b5a70 0x7f60500b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38070/0 (socket says 172.21.15.136:38070) 2023-06-23T19:01:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6047fff700 1 -- 172.21.15.136:0/2626889984 learned_addr learned my addr 172.21.15.136:0/2626889984 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f604f7fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f60500d0a60 0x7f60500d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:41122/0 (socket says 172.21.15.136:41122) 2023-06-23T19:01:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f604ffff700 1 --2- 172.21.15.136:0/2626889984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 0x7f60500d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6047fff700 1 -- 172.21.15.136:0/2626889984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 msgr2=0x7f60500d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6047fff700 1 --2- 172.21.15.136:0/2626889984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 0x7f60500d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6047fff700 1 -- 172.21.15.136:0/2626889984 >> v1:172.21.15.178:6789/0 conn(0x7f60500d0a60 legacy=0x7f60500d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f6047fff700 1 -- 172.21.15.136:0/2626889984 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500cfd90 con 0x7f60500b5a70 2023-06-23T19:01:00.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.905+0000 7f604effd700 1 -- 172.21.15.136:0/2626889984 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312606218 0 0) 0x7f60500b5ec0 con 0x7f60500d0a60 2023-06-23T19:01:00.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.906+0000 7f6047fff700 1 --2- 172.21.15.136:0/2626889984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500b5a70 0x7f60500b51d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f60380098f0 tx=0x7f6038009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfaa9021ef1285be server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:00.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.906+0000 7f604effd700 1 -- 172.21.15.136:0/2626889984 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038011830 con 0x7f60500b5a70 2023-06-23T19:01:00.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.906+0000 7f604effd700 1 -- 172.21.15.136:0/2626889984 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6038011990 con 0x7f60500b5a70 2023-06-23T19:01:00.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.906+0000 7f604effd700 1 -- 172.21.15.136:0/2626889984 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038011d20 con 0x7f60500b5a70 2023-06-23T19:01:00.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.906+0000 7f6055bff700 1 -- 172.21.15.136:0/2626889984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500b5a70 msgr2=0x7f60500b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.906+0000 7f6055bff700 1 --2- 172.21.15.136:0/2626889984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500b5a70 0x7f60500b51d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f60380098f0 tx=0x7f6038009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:00.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.907+0000 7f6055bff700 1 -- 172.21.15.136:0/2626889984 shutdown_connections 2023-06-23T19:01:00.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.907+0000 7f6055bff700 1 --2- 172.21.15.136:0/2626889984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 0x7f60500d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.907+0000 7f6055bff700 1 --2- 172.21.15.136:0/2626889984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500b5a70 0x7f60500b51d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.907+0000 7f6055bff700 1 -- 172.21.15.136:0/2626889984 >> 172.21.15.136:0/2626889984 conn(0x7f6050071620 msgr2=0x7f60500719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:00.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.907+0000 7f6055bff700 1 -- 172.21.15.136:0/2626889984 shutdown_connections 2023-06-23T19:01:00.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.907+0000 7f6055bff700 1 -- 172.21.15.136:0/2626889984 wait complete. 2023-06-23T19:01:00.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.908+0000 7f6055bff700 1 Processor -- start 2023-06-23T19:01:00.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.908+0000 7f6055bff700 1 -- start start 2023-06-23T19:01:00.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.909+0000 7f6055bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500b5a70 0x7f60500c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.909+0000 7f6055bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 0x7f605015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.909+0000 7f6055bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500d0a60 0x7f605015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.909+0000 7f6055bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605015f8d0 con 0x7f60500d0a60 2023-06-23T19:01:00.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.909+0000 7f6055bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60500c7b10 con 0x7f60500b5a70 2023-06-23T19:01:00.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.909+0000 7f6055bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60500c8610 con 0x7f60500cf910 2023-06-23T19:01:00.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500d0a60 0x7f605015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500d0a60 0x7f605015eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38072/0 (socket says 172.21.15.136:38072) 2023-06-23T19:01:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604ffff700 1 -- 172.21.15.136:0/328030645 learned_addr learned my addr 172.21.15.136:0/328030645 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f6047fff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 0x7f605015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604f7fe700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500b5a70 0x7f60500c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604ffff700 1 -- 172.21.15.136:0/328030645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 msgr2=0x7f605015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604ffff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 0x7f605015b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604ffff700 1 -- 172.21.15.136:0/328030645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500b5a70 msgr2=0x7f60500c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604ffff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500b5a70 0x7f60500c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:00.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604ffff700 1 -- 172.21.15.136:0/328030645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038009550 con 0x7f60500d0a60 2023-06-23T19:01:00.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604f7fe700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500b5a70 0x7f60500c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:00.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.910+0000 7f604ffff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500d0a60 0x7f605015eaa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f604800efc0 tx=0x7f604800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:00.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.911+0000 7f604cff9700 1 -- 172.21.15.136:0/328030645 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048009ea0 con 0x7f60500d0a60 2023-06-23T19:01:00.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.911+0000 7f604cff9700 1 -- 172.21.15.136:0/328030645 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800f040 con 0x7f60500d0a60 2023-06-23T19:01:00.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.911+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60500c7d70 con 0x7f60500d0a60 2023-06-23T19:01:00.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.911+0000 7f604cff9700 1 -- 172.21.15.136:0/328030645 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048014480 con 0x7f60500d0a60 2023-06-23T19:01:00.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.911+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60500c8330 con 0x7f60500d0a60 2023-06-23T19:01:00.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.912+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605004ea20 con 0x7f60500d0a60 2023-06-23T19:01:00.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.913+0000 7f604cff9700 1 -- 172.21.15.136:0/328030645 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60480145e0 con 0x7f60500d0a60 2023-06-23T19:01:00.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.913+0000 7f604cff9700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f603006ace0 0x7f603006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:00.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.914+0000 7f604cff9700 1 -- 172.21.15.136:0/328030645 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6048089a00 con 0x7f60500d0a60 2023-06-23T19:01:00.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.914+0000 7f604f7fe700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f603006ace0 0x7f603006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:00.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.914+0000 7f604f7fe700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f603006ace0 0x7f603006d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6040000f60 tx=0x7f6040007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:00.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:00.918+0000 7f604cff9700 1 -- 172.21.15.136:0/328030645 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6048054df0 con 0x7f60500d0a60 2023-06-23T19:01:01.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.114+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f60500d01a0 con 0x7f60500d0a60 2023-06-23T19:01:01.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.115+0000 7f604cff9700 1 -- 172.21.15.136:0/328030645 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6048018020 con 0x7f60500d0a60 2023-06-23T19:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:01:01.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f603006ace0 msgr2=0x7f603006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f603006ace0 0x7f603006d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6040000f60 tx=0x7f6040007d30 comp rx=0 tx=0).stop 2023-06-23T19:01:01.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500d0a60 msgr2=0x7f605015eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500d0a60 0x7f605015eaa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f604800efc0 tx=0x7f604800c3a0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 shutdown_connections 2023-06-23T19:01:01.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f603006ace0 0x7f603006d190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500b5a70 0x7f60500c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60500d0a60 0x7f605015eaa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 --2- 172.21.15.136:0/328030645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500cf910 0x7f605015b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 >> 172.21.15.136:0/328030645 conn(0x7f6050071620 msgr2=0x7f60500b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:01.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 shutdown_connections 2023-06-23T19:01:01.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.117+0000 7f6055bff700 1 -- 172.21.15.136:0/328030645 wait complete. 2023-06-23T19:01:01.139 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-23T19:01:01.333 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.329+0000 7fc0c3dff700 1 Processor -- start 2023-06-23T19:01:01.333 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.329+0000 7fc0c3dff700 1 -- start start 2023-06-23T19:01:01.334 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c3dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.334 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c3dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc1610a0 con 0x7fc0bc0cd830 2023-06-23T19:01:01.335 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c3dff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc15da90 con 0x7fc0bc15c570 2023-06-23T19:01:01.335 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c3dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc15d670 con 0x7fc0bc160a50 2023-06-23T19:01:01.335 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c139a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc0bc0cd830 0x7fc0bc160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53316/0 (socket says 172.21.15.136:53316) 2023-06-23T19:01:01.335 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c139a700 1 -- 172.21.15.136:0/3521542504 learned_addr learned my addr 172.21.15.136:0/3521542504 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:01.335 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c239c700 1 --2- 172.21.15.136:0/3521542504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.336 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c0b99700 1 -- 172.21.15.136:0/3521542504 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226961515 0 0) 0x7fc0bc1610a0 con 0x7fc0bc0cd830 2023-06-23T19:01:01.336 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c0b99700 1 -- 172.21.15.136:0/3521542504 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a80035b0 con 0x7fc0bc0cd830 2023-06-23T19:01:01.337 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c0b99700 1 -- 172.21.15.136:0/3521542504 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397529274 0 0) 0x7fc0bc15da90 con 0x7fc0bc15c570 2023-06-23T19:01:01.337 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c0b99700 1 -- 172.21.15.136:0/3521542504 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0bc1610a0 con 0x7fc0bc15c570 2023-06-23T19:01:01.337 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c239c700 1 -- 172.21.15.136:0/3521542504 >> v1:172.21.15.178:6789/0 conn(0x7fc0bc15c570 legacy=0x7fc0bc0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.337 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c0b99700 1 -- 172.21.15.136:0/3521542504 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2128113383 0 0) 0x7fc0a80035b0 con 0x7fc0bc0cd830 2023-06-23T19:01:01.337 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c239c700 1 -- 172.21.15.136:0/3521542504 >> v1:172.21.15.136:6789/0 conn(0x7fc0bc0cd830 legacy=0x7fc0bc160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.337 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.331+0000 7fc0c239c700 1 -- 172.21.15.136:0/3521542504 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc15ccd0 con 0x7fc0bc160a50 2023-06-23T19:01:01.337 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.332+0000 7fc0c239c700 1 --2- 172.21.15.136:0/3521542504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1674d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009dc0 tx=0x7fc0b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37c7269788516ace server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:01.338 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.332+0000 7fc0c0b99700 1 -- 172.21.15.136:0/3521542504 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b400e070 con 0x7fc0bc160a50 2023-06-23T19:01:01.338 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.332+0000 7fc0c0b99700 1 -- 172.21.15.136:0/3521542504 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4003a20 con 0x7fc0bc160a50 2023-06-23T19:01:01.338 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.332+0000 7fc0c0b99700 1 -- 172.21.15.136:0/3521542504 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac001670 con 0x7fc0bc160a50 2023-06-23T19:01:01.338 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.333+0000 7fc0c3dff700 1 -- 172.21.15.136:0/3521542504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 msgr2=0x7fc0bc1674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.338 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.333+0000 7fc0c3dff700 1 --2- 172.21.15.136:0/3521542504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1674d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009dc0 tx=0x7fc0b400b330 comp rx=0 tx=0).stop 2023-06-23T19:01:01.338 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.333+0000 7fc0c3dff700 1 -- 172.21.15.136:0/3521542504 shutdown_connections 2023-06-23T19:01:01.339 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.333+0000 7fc0c3dff700 1 --2- 172.21.15.136:0/3521542504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1674d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.339 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.333+0000 7fc0c3dff700 1 -- 172.21.15.136:0/3521542504 >> 172.21.15.136:0/3521542504 conn(0x7fc0bc071620 msgr2=0x7fc0bc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:01.339 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.333+0000 7fc0c3dff700 1 -- 172.21.15.136:0/3521542504 shutdown_connections 2023-06-23T19:01:01.339 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.333+0000 7fc0c3dff700 1 -- 172.21.15.136:0/3521542504 wait complete. 2023-06-23T19:01:01.341 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.334+0000 7fc0c3dff700 1 Processor -- start 2023-06-23T19:01:01.341 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.335+0000 7fc0c3dff700 1 -- start start 2023-06-23T19:01:01.341 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.335+0000 7fc0c3dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0bc0cd830 0x7fc0bc0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.341 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.335+0000 7fc0c3dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0bc15c570 0x7fc0bc14fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.342 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.335+0000 7fc0c3dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.342 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c3dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc150620 con 0x7fc0bc15c570 2023-06-23T19:01:01.342 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c3dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc0b4450 con 0x7fc0bc0cd830 2023-06-23T19:01:01.342 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c3dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc0b4730 con 0x7fc0bc160a50 2023-06-23T19:01:01.342 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c139a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0bc15c570 0x7fc0bc14fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.342 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c139a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0bc15c570 0x7fc0bc14fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38076/0 (socket says 172.21.15.136:38076) 2023-06-23T19:01:01.342 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c139a700 1 -- 172.21.15.136:0/2344210599 learned_addr learned my addr 172.21.15.136:0/2344210599 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:01.343 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c1b9b700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0bc0cd830 0x7fc0bc0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.343 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c239c700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.343 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c139a700 1 -- 172.21.15.136:0/2344210599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 msgr2=0x7fc0bc1500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.343 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c139a700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.343 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c139a700 1 -- 172.21.15.136:0/2344210599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0bc0cd830 msgr2=0x7fc0bc0ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.343 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c139a700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0bc0cd830 0x7fc0bc0ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.343 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c139a700 1 -- 172.21.15.136:0/2344210599 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4009a70 con 0x7fc0bc15c570 2023-06-23T19:01:01.343 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c239c700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:01.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.336+0000 7fc0c139a700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0bc15c570 0x7fc0bc14fba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c750 tx=0x7fc0ac00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:01.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.337+0000 7fc0b27fc700 1 -- 172.21.15.136:0/2344210599 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac004c80 con 0x7fc0bc15c570 2023-06-23T19:01:01.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.337+0000 7fc0b27fc700 1 -- 172.21.15.136:0/2344210599 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac004de0 con 0x7fc0bc15c570 2023-06-23T19:01:01.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.337+0000 7fc0b27fc700 1 -- 172.21.15.136:0/2344210599 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac007310 con 0x7fc0bc15c570 2023-06-23T19:01:01.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.337+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0bc0c74e0 con 0x7fc0bc15c570 2023-06-23T19:01:01.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.337+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0bc0c7aa0 con 0x7fc0bc15c570 2023-06-23T19:01:01.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.338+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0bc0b48f0 con 0x7fc0bc15c570 2023-06-23T19:01:01.345 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.339+0000 7fc0b27fc700 1 -- 172.21.15.136:0/2344210599 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc0ac007470 con 0x7fc0bc15c570 2023-06-23T19:01:01.345 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.340+0000 7fc0b27fc700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0a006ace0 0x7fc0a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.340+0000 7fc0b27fc700 1 -- 172.21.15.136:0/2344210599 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc0ac088ff0 con 0x7fc0bc15c570 2023-06-23T19:01:01.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.340+0000 7fc0c1b9b700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0a006ace0 0x7fc0a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.340+0000 7fc0c1b9b700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0a006ace0 0x7fc0a006d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80011e0 tx=0x7fc0b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:01.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.344+0000 7fc0b27fc700 1 -- 172.21.15.136:0/2344210599 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc0ac054350 con 0x7fc0bc15c570 2023-06-23T19:01:01.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.545+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc0bc0c7c90 con 0x7fc0bc15c570 2023-06-23T19:01:01.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.545+0000 7fc0b27fc700 1 -- 172.21.15.136:0/2344210599 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc0ac057970 con 0x7fc0bc15c570 2023-06-23T19:01:01.549 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:01.549 INFO:teuthology.orchestra.run.smithi136.stdout:[ 2023-06-23T19:01:01.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:01:01.550 INFO:teuthology.orchestra.run.smithi136.stdout: "poolnum": 1, 2023-06-23T19:01:01.550 INFO:teuthology.orchestra.run.smithi136.stdout: "poolname": ".mgr" 2023-06-23T19:01:01.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:01:01.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:01:01.550 INFO:teuthology.orchestra.run.smithi136.stdout: "poolnum": 2, 2023-06-23T19:01:01.550 INFO:teuthology.orchestra.run.smithi136.stdout: "poolname": "rbd" 2023-06-23T19:01:01.551 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:01:01.551 INFO:teuthology.orchestra.run.smithi136.stdout:] 2023-06-23T19:01:01.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0a006ace0 msgr2=0x7fc0a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0a006ace0 0x7fc0a006d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80011e0 tx=0x7fc0b8009040 comp rx=0 tx=0).stop 2023-06-23T19:01:01.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0bc15c570 msgr2=0x7fc0bc14fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0bc15c570 0x7fc0bc14fba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c750 tx=0x7fc0ac00ca60 comp rx=0 tx=0).stop 2023-06-23T19:01:01.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 shutdown_connections 2023-06-23T19:01:01.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0a006ace0 0x7fc0a006d190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0bc0cd830 0x7fc0bc0ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0bc160a50 0x7fc0bc1500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 --2- 172.21.15.136:0/2344210599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0bc15c570 0x7fc0bc14fba0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 >> 172.21.15.136:0/2344210599 conn(0x7fc0bc071620 msgr2=0x7fc0bc15e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:01.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.548+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 shutdown_connections 2023-06-23T19:01:01.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.549+0000 7fc0c3dff700 1 -- 172.21.15.136:0/2344210599 wait complete. 2023-06-23T19:01:01.571 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-23T19:01:01.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-23T19:01:01.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.768+0000 7fb472dff700 1 Processor -- start 2023-06-23T19:01:01.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.768+0000 7fb472dff700 1 -- start start 2023-06-23T19:01:01.774 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb472dff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb46c0cd890 0x7fb46c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb472dff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb46c0cfa30 0x7fb46c0b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb472dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c0cfe60 con 0x7fb46c0b1fe0 2023-06-23T19:01:01.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb472dff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c0b5c90 con 0x7fb46c0cfa30 2023-06-23T19:01:01.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb472dff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c0b5980 con 0x7fb46c0cd890 2023-06-23T19:01:01.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb47139c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb46c0cfa30 0x7fb46c0b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb47139c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb46c0cfa30 0x7fb46c0b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38092/0 (socket says 172.21.15.136:38092) 2023-06-23T19:01:01.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb470b9b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb46c0b1fe0 0x7fb46c0cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53332/0 (socket says 172.21.15.136:53332) 2023-06-23T19:01:01.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb47139c700 1 -- 172.21.15.136:0/307989811 learned_addr learned my addr 172.21.15.136:0/307989811 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:01.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb46bfff700 1 --2- 172.21.15.136:0/307989811 >> v2:172.21.15.178:3300/0 conn(0x7fb46c0cd890 0x7fb46c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb47139c700 1 -- 172.21.15.136:0/307989811 >> v2:172.21.15.178:3300/0 conn(0x7fb46c0cd890 msgr2=0x7fb46c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:01.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb47139c700 1 --2- 172.21.15.136:0/307989811 >> v2:172.21.15.178:3300/0 conn(0x7fb46c0cd890 0x7fb46c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb47139c700 1 -- 172.21.15.136:0/307989811 >> v1:172.21.15.136:6789/0 conn(0x7fb46c0b1fe0 legacy=0x7fb46c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.771+0000 7fb47139c700 1 -- 172.21.15.136:0/307989811 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c0d1320 con 0x7fb46c0cfa30 2023-06-23T19:01:01.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.770+0000 7fb46b7fe700 1 -- 172.21.15.136:0/307989811 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090285403 0 0) 0x7fb46c0cfe60 con 0x7fb46c0b1fe0 2023-06-23T19:01:01.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.771+0000 7fb47139c700 1 --2- 172.21.15.136:0/307989811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 0x7fb46c0b60b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb46c08b3b0 tx=0x7fb46400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead2d182c22a1a3a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:01.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.771+0000 7fb46b7fe700 1 -- 172.21.15.136:0/307989811 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400e070 con 0x7fb46c0cfa30 2023-06-23T19:01:01.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.771+0000 7fb46b7fe700 1 -- 172.21.15.136:0/307989811 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400b910 con 0x7fb46c0cfa30 2023-06-23T19:01:01.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.771+0000 7fb46b7fe700 1 -- 172.21.15.136:0/307989811 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400bcc0 con 0x7fb46c0cfa30 2023-06-23T19:01:01.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.771+0000 7fb472dff700 1 -- 172.21.15.136:0/307989811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 msgr2=0x7fb46c0b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.771+0000 7fb472dff700 1 --2- 172.21.15.136:0/307989811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 0x7fb46c0b60b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb46c08b3b0 tx=0x7fb46400b330 comp rx=0 tx=0).stop 2023-06-23T19:01:01.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.772+0000 7fb472dff700 1 -- 172.21.15.136:0/307989811 shutdown_connections 2023-06-23T19:01:01.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.772+0000 7fb472dff700 1 --2- 172.21.15.136:0/307989811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 0x7fb46c0b60b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.772+0000 7fb472dff700 1 --2- 172.21.15.136:0/307989811 >> v2:172.21.15.178:3300/0 conn(0x7fb46c0cd890 0x7fb46c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.772+0000 7fb472dff700 1 -- 172.21.15.136:0/307989811 >> 172.21.15.136:0/307989811 conn(0x7fb46c071620 msgr2=0x7fb46c071a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:01.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.772+0000 7fb472dff700 1 -- 172.21.15.136:0/307989811 shutdown_connections 2023-06-23T19:01:01.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.772+0000 7fb472dff700 1 -- 172.21.15.136:0/307989811 wait complete. 2023-06-23T19:01:01.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.773+0000 7fb472dff700 1 Processor -- start 2023-06-23T19:01:01.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.774+0000 7fb472dff700 1 -- start start 2023-06-23T19:01:01.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.774+0000 7fb472dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb46c0b1fe0 0x7fb46c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.774+0000 7fb472dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 0x7fb46c151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb472dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb46c0b6660 0x7fb46c0b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb472dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0b7020 con 0x7fb46c0cfa30 2023-06-23T19:01:01.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb472dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0cb330 con 0x7fb46c0b1fe0 2023-06-23T19:01:01.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb472dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0c7ad0 con 0x7fb46c0b6660 2023-06-23T19:01:01.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb46bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 0x7fb46c151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb46bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 0x7fb46c151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38100/0 (socket says 172.21.15.136:38100) 2023-06-23T19:01:01.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb46bfff700 1 -- 172.21.15.136:0/1803479221 learned_addr learned my addr 172.21.15.136:0/1803479221 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:01.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb470b9b700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb46c0b1fe0 0x7fb46c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb47139c700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb46c0b6660 0x7fb46c0b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb46bfff700 1 -- 172.21.15.136:0/1803479221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb46c0b6660 msgr2=0x7fb46c0b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb46bfff700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb46c0b6660 0x7fb46c0b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb46bfff700 1 -- 172.21.15.136:0/1803479221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb46c0b1fe0 msgr2=0x7fb46c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:01.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb46bfff700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb46c0b1fe0 0x7fb46c0b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:01.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb46bfff700 1 -- 172.21.15.136:0/1803479221 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464009b30 con 0x7fb46c0cfa30 2023-06-23T19:01:01.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.775+0000 7fb46bfff700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 0x7fb46c151f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb45800e9b0 tx=0x7fb45800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:01.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.776+0000 7fb4697fa700 1 -- 172.21.15.136:0/1803479221 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4580096d0 con 0x7fb46c0cfa30 2023-06-23T19:01:01.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.776+0000 7fb4697fa700 1 -- 172.21.15.136:0/1803479221 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45800c850 con 0x7fb46c0cfa30 2023-06-23T19:01:01.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.776+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c0c7db0 con 0x7fb46c0cfa30 2023-06-23T19:01:01.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.776+0000 7fb4697fa700 1 -- 172.21.15.136:0/1803479221 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45800cbe0 con 0x7fb46c0cfa30 2023-06-23T19:01:01.785 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.776+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c0cb860 con 0x7fb46c0cfa30 2023-06-23T19:01:01.785 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.777+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c04ea20 con 0x7fb46c0cfa30 2023-06-23T19:01:01.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.778+0000 7fb4697fa700 1 -- 172.21.15.136:0/1803479221 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb45800cd40 con 0x7fb46c0cfa30 2023-06-23T19:01:01.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.779+0000 7fb4697fa700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb45006ad10 0x7fb45006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:01.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.779+0000 7fb4697fa700 1 -- 172.21.15.136:0/1803479221 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb458089100 con 0x7fb46c0cfa30 2023-06-23T19:01:01.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.779+0000 7fb470b9b700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb45006ad10 0x7fb45006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:01.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.780+0000 7fb470b9b700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb45006ad10 0x7fb45006d1c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb460000f60 tx=0x7fb460007e70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:01.787 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.783+0000 7fb4697fa700 1 -- 172.21.15.136:0/1803479221 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb458054590 con 0x7fb46c0cfa30 2023-06-23T19:01:01.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:01.980+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb46c1595e0 con 0x7fb46c0cfa30 2023-06-23T19:01:02.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.846+0000 7fb4697fa700 1 -- 172.21.15.136:0/1803479221 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb458057bb0 con 0x7fb46c0cfa30 2023-06-23T19:01:02.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.851+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb45006ad10 msgr2=0x7fb45006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:02.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.851+0000 7fb472dff700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb45006ad10 0x7fb45006d1c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb460000f60 tx=0x7fb460007e70 comp rx=0 tx=0).stop 2023-06-23T19:01:02.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.851+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 msgr2=0x7fb46c151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:02.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.851+0000 7fb472dff700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 0x7fb46c151f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb45800e9b0 tx=0x7fb45800ecc0 comp rx=0 tx=0).stop 2023-06-23T19:01:02.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.852+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 shutdown_connections 2023-06-23T19:01:02.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.852+0000 7fb472dff700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb45006ad10 0x7fb45006d1c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:02.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.852+0000 7fb472dff700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb46c0b1fe0 0x7fb46c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:02.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.852+0000 7fb472dff700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb46c0b6660 0x7fb46c0b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:02.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.852+0000 7fb472dff700 1 --2- 172.21.15.136:0/1803479221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb46c0cfa30 0x7fb46c151f30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:02.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.852+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 >> 172.21.15.136:0/1803479221 conn(0x7fb46c071620 msgr2=0x7fb46c072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:02.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.853+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 shutdown_connections 2023-06-23T19:01:02.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:02.853+0000 7fb472dff700 1 -- 172.21.15.136:0/1803479221 wait complete. 2023-06-23T19:01:02.861 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_metadata' created 2023-06-23T19:01:02.881 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-23T19:01:03.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.080+0000 7fbf7edff700 1 Processor -- start 2023-06-23T19:01:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.081+0000 7fbf7edff700 1 -- start start 2023-06-23T19:01:03.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.082+0000 7fbf7edff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbf780d0a60 0x7fbf780b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:03.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.082+0000 7fbf7edff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 0x7fbf780d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.082+0000 7fbf7edff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf780cd9d0 con 0x7fbf780b51d0 2023-06-23T19:01:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7edff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780d0060 con 0x7fbf780d0a60 2023-06-23T19:01:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7edff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780b5620 con 0x7fbf780cf910 2023-06-23T19:01:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7cb9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbf780d0a60 0x7fbf780b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7cb9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbf780d0a60 0x7fbf780b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38110/0 (socket says 172.21.15.136:38110) 2023-06-23T19:01:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7cb9b700 1 -- 172.21.15.136:0/1005231372 learned_addr learned my addr 172.21.15.136:0/1005231372 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7d39c700 1 --2- 172.21.15.136:0/1005231372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 0x7fbf780d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:03.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7cb9b700 1 -- 172.21.15.136:0/1005231372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 msgr2=0x7fbf780d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:03.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7cb9b700 1 --2- 172.21.15.136:0/1005231372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 0x7fbf780d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7cb9b700 1 -- 172.21.15.136:0/1005231372 >> v1:172.21.15.178:6789/0 conn(0x7fbf780b51d0 legacy=0x7fbf780d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:03.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7cb9b700 1 -- 172.21.15.136:0/1005231372 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780cfd90 con 0x7fbf780d0a60 2023-06-23T19:01:03.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.083+0000 7fbf7cb9b700 1 --2- 172.21.15.136:0/1005231372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 0x7fbf780b5a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0098f0 tx=0x7fbf6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbb887ccf0e2dc1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:03.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf777fe700 1 -- 172.21.15.136:0/1005231372 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c011830 con 0x7fbf780d0a60 2023-06-23T19:01:03.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf777fe700 1 -- 172.21.15.136:0/1005231372 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c011990 con 0x7fbf780d0a60 2023-06-23T19:01:03.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf777fe700 1 -- 172.21.15.136:0/1005231372 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c011d20 con 0x7fbf780d0a60 2023-06-23T19:01:03.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf7edff700 1 -- 172.21.15.136:0/1005231372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 msgr2=0x7fbf780b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:03.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf7edff700 1 --2- 172.21.15.136:0/1005231372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 0x7fbf780b5a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0098f0 tx=0x7fbf6c009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:03.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf7edff700 1 -- 172.21.15.136:0/1005231372 shutdown_connections 2023-06-23T19:01:03.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf7edff700 1 --2- 172.21.15.136:0/1005231372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 0x7fbf780b5a70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf7edff700 1 --2- 172.21.15.136:0/1005231372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 0x7fbf780d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf7edff700 1 -- 172.21.15.136:0/1005231372 >> 172.21.15.136:0/1005231372 conn(0x7fbf78071620 msgr2=0x7fbf780719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:03.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf7edff700 1 -- 172.21.15.136:0/1005231372 shutdown_connections 2023-06-23T19:01:03.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.084+0000 7fbf7edff700 1 -- 172.21.15.136:0/1005231372 wait complete. 2023-06-23T19:01:03.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.086+0000 7fbf7edff700 1 Processor -- start 2023-06-23T19:01:03.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.086+0000 7fbf7edff700 1 -- start start 2023-06-23T19:01:03.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.087+0000 7fbf7edff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780b51d0 0x7fbf780b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:03.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.087+0000 7fbf7edff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 0x7fbf780cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:03.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.087+0000 7fbf7edff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 0x7fbf780cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:03.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.087+0000 7fbf7edff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780b7d10 con 0x7fbf780d0a60 2023-06-23T19:01:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.087+0000 7fbf7edff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780b7ff0 con 0x7fbf780b51d0 2023-06-23T19:01:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.087+0000 7fbf7edff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780b82d0 con 0x7fbf780cf910 2023-06-23T19:01:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7d39c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 0x7fbf780cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7d39c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 0x7fbf780cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38124/0 (socket says 172.21.15.136:38124) 2023-06-23T19:01:03.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7d39c700 1 -- 172.21.15.136:0/353394387 learned_addr learned my addr 172.21.15.136:0/353394387 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:03.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7cb9b700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780b51d0 0x7fbf780b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:03.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf77fff700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 0x7fbf780cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:03.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7d39c700 1 -- 172.21.15.136:0/353394387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 msgr2=0x7fbf780cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:03.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7d39c700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 0x7fbf780cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7d39c700 1 -- 172.21.15.136:0/353394387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780b51d0 msgr2=0x7fbf780b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:03.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7d39c700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780b51d0 0x7fbf780b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7d39c700 1 -- 172.21.15.136:0/353394387 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c009550 con 0x7fbf780d0a60 2023-06-23T19:01:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7d39c700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 0x7fbf780cbe50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000efc0 tx=0x7fbf7000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf757fa700 1 -- 172.21.15.136:0/353394387 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70009ea0 con 0x7fbf780d0a60 2023-06-23T19:01:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf757fa700 1 -- 172.21.15.136:0/353394387 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7000f040 con 0x7fbf780d0a60 2023-06-23T19:01:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf757fa700 1 -- 172.21.15.136:0/353394387 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7000ced0 con 0x7fbf780d0a60 2023-06-23T19:01:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.088+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf780b85b0 con 0x7fbf780d0a60 2023-06-23T19:01:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.089+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf780b6140 con 0x7fbf780d0a60 2023-06-23T19:01:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.090+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf780b8ad0 con 0x7fbf780d0a60 2023-06-23T19:01:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.091+0000 7fbf757fa700 1 -- 172.21.15.136:0/353394387 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf70014480 con 0x7fbf780d0a60 2023-06-23T19:01:03.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.092+0000 7fbf757fa700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbf5c06ace0 0x7fbf5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:03.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.092+0000 7fbf757fa700 1 -- 172.21.15.136:0/353394387 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fbf70089d20 con 0x7fbf780d0a60 2023-06-23T19:01:03.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.092+0000 7fbf7cb9b700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbf5c06ace0 0x7fbf5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:03.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.093+0000 7fbf7cb9b700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbf5c06ace0 0x7fbf5c06d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c014040 tx=0x7fbf6c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:03.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.097+0000 7fbf757fa700 1 -- 172.21.15.136:0/353394387 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbf780b8ad0 con 0x7fbf780d0a60 2023-06-23T19:01:03.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.292+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fbf780b8ad0 con 0x7fbf780d0a60 2023-06-23T19:01:03.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.852+0000 7fbf757fa700 1 -- 172.21.15.136:0/353394387 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v23) v1 ==== 171+0+0 (secure 0 0 0) 0x7fbf780b8ad0 con 0x7fbf780d0a60 2023-06-23T19:01:03.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.856+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbf5c06ace0 msgr2=0x7fbf5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:03.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.856+0000 7fbf7edff700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbf5c06ace0 0x7fbf5c06d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c014040 tx=0x7fbf6c008030 comp rx=0 tx=0).stop 2023-06-23T19:01:03.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.856+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 msgr2=0x7fbf780cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:03.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.856+0000 7fbf7edff700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 0x7fbf780cbe50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000efc0 tx=0x7fbf7000c3a0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.857+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 shutdown_connections 2023-06-23T19:01:03.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.857+0000 7fbf7edff700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbf5c06ace0 0x7fbf5c06d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.857+0000 7fbf7edff700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780b51d0 0x7fbf780b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.857+0000 7fbf7edff700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf780d0a60 0x7fbf780cbe50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.857+0000 7fbf7edff700 1 --2- 172.21.15.136:0/353394387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780cf910 0x7fbf780cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:03.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.857+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 >> 172.21.15.136:0/353394387 conn(0x7fbf78071620 msgr2=0x7fbf78072990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:03.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.858+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 shutdown_connections 2023-06-23T19:01:03.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:03.858+0000 7fbf7edff700 1 -- 172.21.15.136:0/353394387 wait complete. 2023-06-23T19:01:03.868 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data' created 2023-06-23T19:01:03.894 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-23T19:01:04.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.088+0000 7f28bd7ff700 1 Processor -- start 2023-06-23T19:01:04.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.088+0000 7f28bd7ff700 1 -- start start 2023-06-23T19:01:04.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.089+0000 7f28bd7ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f28b80d0a60 0x7f28b80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.089+0000 7f28bd7ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28b80b51d0 0x7f28b80cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.089+0000 7f28bd7ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b80cd9d0 con 0x7f28b80d0e30 2023-06-23T19:01:04.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.089+0000 7f28bd7ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b80d0060 con 0x7f28b80d0a60 2023-06-23T19:01:04.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.089+0000 7f28bd7ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b80cfe50 con 0x7f28b80b51d0 2023-06-23T19:01:04.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.089+0000 7f28b6ffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f28b80d0a60 0x7f28b80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.089+0000 7f28b6ffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f28b80d0a60 0x7f28b80b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38128/0 (socket says 172.21.15.136:38128) 2023-06-23T19:01:04.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.089+0000 7f28b6ffd700 1 -- 172.21.15.136:0/653288611 learned_addr learned my addr 172.21.15.136:0/653288611 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:04.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.089+0000 7f28b67fc700 1 --2- 172.21.15.136:0/653288611 >> v2:172.21.15.178:3300/0 conn(0x7f28b80b51d0 0x7f28b80cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.090+0000 7f28b6ffd700 1 -- 172.21.15.136:0/653288611 >> v2:172.21.15.178:3300/0 conn(0x7f28b80b51d0 msgr2=0x7f28b80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:04.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.090+0000 7f28b6ffd700 1 --2- 172.21.15.136:0/653288611 >> v2:172.21.15.178:3300/0 conn(0x7f28b80b51d0 0x7f28b80cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.090+0000 7f28b6ffd700 1 -- 172.21.15.136:0/653288611 >> v1:172.21.15.178:6789/0 conn(0x7f28b80d0e30 legacy=0x7f28b80d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.090+0000 7f28b6ffd700 1 -- 172.21.15.136:0/653288611 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80b5620 con 0x7f28b80d0a60 2023-06-23T19:01:04.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.090+0000 7f28b6ffd700 1 --2- 172.21.15.136:0/653288611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80d0a60 0x7f28b80b5a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28b80d07a0 tx=0x7f28a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fb5a3511d1e8e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:04.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.090+0000 7f28b5ffb700 1 -- 172.21.15.136:0/653288611 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800b870 con 0x7f28b80d0a60 2023-06-23T19:01:04.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.090+0000 7f28b5ffb700 1 -- 172.21.15.136:0/653288611 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a800b9d0 con 0x7f28b80d0a60 2023-06-23T19:01:04.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.090+0000 7f28b5ffb700 1 -- 172.21.15.136:0/653288611 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800bd60 con 0x7f28b80d0a60 2023-06-23T19:01:04.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.091+0000 7f28bd7ff700 1 -- 172.21.15.136:0/653288611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80d0a60 msgr2=0x7f28b80b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.091+0000 7f28bd7ff700 1 --2- 172.21.15.136:0/653288611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80d0a60 0x7f28b80b5a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28b80d07a0 tx=0x7f28a8009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.091+0000 7f28bd7ff700 1 -- 172.21.15.136:0/653288611 shutdown_connections 2023-06-23T19:01:04.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.091+0000 7f28bd7ff700 1 --2- 172.21.15.136:0/653288611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80d0a60 0x7f28b80b5a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.091+0000 7f28bd7ff700 1 --2- 172.21.15.136:0/653288611 >> v2:172.21.15.178:3300/0 conn(0x7f28b80b51d0 0x7f28b80cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.091+0000 7f28bd7ff700 1 -- 172.21.15.136:0/653288611 >> 172.21.15.136:0/653288611 conn(0x7f28b8071620 msgr2=0x7f28b80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:04.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.091+0000 7f28bd7ff700 1 -- 172.21.15.136:0/653288611 shutdown_connections 2023-06-23T19:01:04.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.091+0000 7f28bd7ff700 1 -- 172.21.15.136:0/653288611 wait complete. 2023-06-23T19:01:04.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.093+0000 7f28bd7ff700 1 Processor -- start 2023-06-23T19:01:04.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.093+0000 7f28bd7ff700 1 -- start start 2023-06-23T19:01:04.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28bd7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80b51d0 0x7f28b8159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28bd7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b80d0a60 0x7f28b8158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28bd7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b80d0e30 0x7f28b815c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28bd7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b815cfe0 con 0x7f28b80b51d0 2023-06-23T19:01:04.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28bd7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b815d2c0 con 0x7f28b80d0e30 2023-06-23T19:01:04.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28bd7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b815d5a0 con 0x7f28b80d0a60 2023-06-23T19:01:04.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80b51d0 0x7f28b8159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80b51d0 0x7f28b8159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38140/0 (socket says 172.21.15.136:38140) 2023-06-23T19:01:04.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b6ffd700 1 -- 172.21.15.136:0/288159583 learned_addr learned my addr 172.21.15.136:0/288159583 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:04.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b6ffd700 1 -- 172.21.15.136:0/288159583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b80d0a60 msgr2=0x7f28b8158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b6ffd700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b80d0a60 0x7f28b8158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b6ffd700 1 -- 172.21.15.136:0/288159583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b80d0e30 msgr2=0x7f28b815c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b77fe700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b80d0e30 0x7f28b815c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b6ffd700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b80d0e30 0x7f28b815c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b6ffd700 1 -- 172.21.15.136:0/288159583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a8009550 con 0x7f28b80b51d0 2023-06-23T19:01:04.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b77fe700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b80d0e30 0x7f28b815c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:04.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.094+0000 7f28b6ffd700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80b51d0 0x7f28b8159480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28a8000c00 tx=0x7f28a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:04.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.095+0000 7f289f7fe700 1 -- 172.21.15.136:0/288159583 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8011760 con 0x7f28b80b51d0 2023-06-23T19:01:04.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.095+0000 7f289f7fe700 1 -- 172.21.15.136:0/288159583 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a801f070 con 0x7f28b80b51d0 2023-06-23T19:01:04.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.095+0000 7f289f7fe700 1 -- 172.21.15.136:0/288159583 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8011ae0 con 0x7f28b80b51d0 2023-06-23T19:01:04.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.095+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b815d880 con 0x7f28b80b51d0 2023-06-23T19:01:04.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.095+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b80b6c50 con 0x7f28b80b51d0 2023-06-23T19:01:04.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.096+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b815dda0 con 0x7f28b80b51d0 2023-06-23T19:01:04.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.097+0000 7f289f7fe700 1 -- 172.21.15.136:0/288159583 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28a8021030 con 0x7f28b80b51d0 2023-06-23T19:01:04.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.098+0000 7f289f7fe700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f28a406ace0 0x7f28a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.098+0000 7f289f7fe700 1 -- 172.21.15.136:0/288159583 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f28a808a9c0 con 0x7f28b80b51d0 2023-06-23T19:01:04.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.099+0000 7f28b67fc700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f28a406ace0 0x7f28a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.099+0000 7f28b67fc700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f28a406ace0 0x7f28a406d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28b815a660 tx=0x7f28ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:04.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.103+0000 7f289f7fe700 1 -- 172.21.15.136:0/288159583 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28b815dda0 con 0x7f28b80b51d0 2023-06-23T19:01:04.350 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.346+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f28b815dda0 con 0x7f28b80b51d0 2023-06-23T19:01:04.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.352+0000 7f289f7fe700 1 -- 172.21.15.136:0/288159583 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f28b815dda0 con 0x7f28b80b51d0 2023-06-23T19:01:04.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.355+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f28a406ace0 msgr2=0x7f28a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.355+0000 7f28bd7ff700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f28a406ace0 0x7f28a406d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28b815a660 tx=0x7f28ac008040 comp rx=0 tx=0).stop 2023-06-23T19:01:04.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.355+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80b51d0 msgr2=0x7f28b8159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.355+0000 7f28bd7ff700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80b51d0 0x7f28b8159480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28a8000c00 tx=0x7f28a8004750 comp rx=0 tx=0).stop 2023-06-23T19:01:04.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.356+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 shutdown_connections 2023-06-23T19:01:04.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.356+0000 7f28bd7ff700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f28a406ace0 0x7f28a406d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.356+0000 7f28bd7ff700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b80d0e30 0x7f28b815c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.356+0000 7f28bd7ff700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28b80b51d0 0x7f28b8159480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.356+0000 7f28bd7ff700 1 --2- 172.21.15.136:0/288159583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b80d0a60 0x7f28b8158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.356+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 >> 172.21.15.136:0/288159583 conn(0x7f28b8071620 msgr2=0x7f28b80d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:04.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.356+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 shutdown_connections 2023-06-23T19:01:04.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.356+0000 7f28bd7ff700 1 -- 172.21.15.136:0/288159583 wait complete. 2023-06-23T19:01:04.362 INFO:teuthology.orchestra.run.smithi136.stderr:new fs with metadata pool 3 and data pool 4 2023-06-23T19:01:04.390 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-23T19:01:04.391 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-23T19:01:04.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.585+0000 7feea2dff700 1 Processor -- start 2023-06-23T19:01:04.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.585+0000 7feea2dff700 1 -- start start 2023-06-23T19:01:04.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7feea2dff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee9c0b51d0 0x7fee9c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7feea2dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c0b5ec0 con 0x7fee9c0d0a60 2023-06-23T19:01:04.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7feea2dff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c0cd9d0 con 0x7fee9c0b5a70 2023-06-23T19:01:04.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7feea2dff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c0d0060 con 0x7fee9c0b51d0 2023-06-23T19:01:04.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7feea0b9b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fee9c0d0a60 0x7fee9c0d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53342/0 (socket says 172.21.15.136:53342) 2023-06-23T19:01:04.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7feea0b9b700 1 -- 172.21.15.136:0/1503637485 learned_addr learned my addr 172.21.15.136:0/1503637485 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:04.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7feea139c700 1 --2- 172.21.15.136:0/1503637485 >> v2:172.21.15.178:3300/0 conn(0x7fee9c0b51d0 0x7fee9c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7fee9b7fe700 1 -- 172.21.15.136:0/1503637485 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153186967 0 0) 0x7fee9c0b5ec0 con 0x7fee9c0d0a60 2023-06-23T19:01:04.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7fee9b7fe700 1 -- 172.21.15.136:0/1503637485 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee8c0035b0 con 0x7fee9c0d0a60 2023-06-23T19:01:04.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7fee9b7fe700 1 -- 172.21.15.136:0/1503637485 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658152390 0 0) 0x7fee9c0cd9d0 con 0x7fee9c0b5a70 2023-06-23T19:01:04.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.587+0000 7fee9b7fe700 1 -- 172.21.15.136:0/1503637485 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee9c0b5ec0 con 0x7fee9c0b5a70 2023-06-23T19:01:04.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.588+0000 7fee9b7fe700 1 -- 172.21.15.136:0/1503637485 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1195315417 0 0) 0x7fee8c0035b0 con 0x7fee9c0d0a60 2023-06-23T19:01:04.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.588+0000 7feea139c700 1 -- 172.21.15.136:0/1503637485 >> v1:172.21.15.178:6789/0 conn(0x7fee9c0b5a70 legacy=0x7fee9c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.588+0000 7feea139c700 1 -- 172.21.15.136:0/1503637485 >> v1:172.21.15.136:6789/0 conn(0x7fee9c0d0a60 legacy=0x7fee9c0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.588+0000 7feea139c700 1 -- 172.21.15.136:0/1503637485 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0b5610 con 0x7fee9c0b51d0 2023-06-23T19:01:04.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.588+0000 7feea139c700 1 --2- 172.21.15.136:0/1503637485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee9c0b51d0 0x7fee9c0cf910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee94009d90 tx=0x7fee9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58f805eea2e7fe3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:04.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.588+0000 7fee9b7fe700 1 -- 172.21.15.136:0/1503637485 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400e070 con 0x7fee9c0b51d0 2023-06-23T19:01:04.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.588+0000 7fee9b7fe700 1 -- 172.21.15.136:0/1503637485 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94003a20 con 0x7fee9c0b51d0 2023-06-23T19:01:04.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.588+0000 7fee9b7fe700 1 -- 172.21.15.136:0/1503637485 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90001670 con 0x7fee9c0b51d0 2023-06-23T19:01:04.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.589+0000 7feea2dff700 1 -- 172.21.15.136:0/1503637485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee9c0b51d0 msgr2=0x7fee9c0cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.589+0000 7feea2dff700 1 --2- 172.21.15.136:0/1503637485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee9c0b51d0 0x7fee9c0cf910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee94009d90 tx=0x7fee9400b330 comp rx=0 tx=0).stop 2023-06-23T19:01:04.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.589+0000 7feea2dff700 1 -- 172.21.15.136:0/1503637485 shutdown_connections 2023-06-23T19:01:04.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.589+0000 7feea2dff700 1 --2- 172.21.15.136:0/1503637485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee9c0b51d0 0x7fee9c0cf910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.589+0000 7feea2dff700 1 -- 172.21.15.136:0/1503637485 >> 172.21.15.136:0/1503637485 conn(0x7fee9c071620 msgr2=0x7fee9c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:04.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.589+0000 7feea2dff700 1 -- 172.21.15.136:0/1503637485 shutdown_connections 2023-06-23T19:01:04.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.589+0000 7feea2dff700 1 -- 172.21.15.136:0/1503637485 wait complete. 2023-06-23T19:01:04.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.591+0000 7feea2dff700 1 Processor -- start 2023-06-23T19:01:04.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.591+0000 7feea2dff700 1 -- start start 2023-06-23T19:01:04.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7feea2dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee9c0b51d0 0x7fee9c0c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7feea2dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee9c0b5a70 0x7fee9c15c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7feea2dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee9c0d0a60 0x7fee9c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7feea2dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c15e560 con 0x7fee9c0b5a70 2023-06-23T19:01:04.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7feea2dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c15d4c0 con 0x7fee9c0d0a60 2023-06-23T19:01:04.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7feea2dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c15d7a0 con 0x7fee9c0b51d0 2023-06-23T19:01:04.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7fee9bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee9c0b5a70 0x7fee9c15c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7fee9bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee9c0b5a70 0x7fee9c15c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38142/0 (socket says 172.21.15.136:38142) 2023-06-23T19:01:04.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7fee9bfff700 1 -- 172.21.15.136:0/4260338282 learned_addr learned my addr 172.21.15.136:0/4260338282 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:04.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7feea139c700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee9c0d0a60 0x7fee9c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7feea0b9b700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee9c0b51d0 0x7fee9c0c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7fee9bfff700 1 -- 172.21.15.136:0/4260338282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee9c0b51d0 msgr2=0x7fee9c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7fee9bfff700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee9c0b51d0 0x7fee9c0c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7fee9bfff700 1 -- 172.21.15.136:0/4260338282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee9c0d0a60 msgr2=0x7fee9c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:04.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7fee9bfff700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee9c0d0a60 0x7fee9c15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:04.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.592+0000 7fee9bfff700 1 -- 172.21.15.136:0/4260338282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94009a70 con 0x7fee9c0b5a70 2023-06-23T19:01:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.593+0000 7fee9bfff700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee9c0b5a70 0x7fee9c15c950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee8800c520 tx=0x7fee8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.593+0000 7fee997fa700 1 -- 172.21.15.136:0/4260338282 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee880052d0 con 0x7fee9c0b5a70 2023-06-23T19:01:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.593+0000 7fee997fa700 1 -- 172.21.15.136:0/4260338282 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee88005430 con 0x7fee9c0b5a70 2023-06-23T19:01:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.593+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c15da80 con 0x7fee9c0b5a70 2023-06-23T19:01:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.593+0000 7fee997fa700 1 -- 172.21.15.136:0/4260338282 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee880038c0 con 0x7fee9c0b5a70 2023-06-23T19:01:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.593+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c15e040 con 0x7fee9c0b5a70 2023-06-23T19:01:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.594+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c04ea20 con 0x7fee9c0b5a70 2023-06-23T19:01:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.595+0000 7fee997fa700 1 -- 172.21.15.136:0/4260338282 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee88003a20 con 0x7fee9c0b5a70 2023-06-23T19:01:04.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.596+0000 7fee997fa700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee8006ace0 0x7fee8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:04.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.596+0000 7fee997fa700 1 -- 172.21.15.136:0/4260338282 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee88088ad0 con 0x7fee9c0b5a70 2023-06-23T19:01:04.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.596+0000 7feea0b9b700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee8006ace0 0x7fee8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:04.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.597+0000 7feea0b9b700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee8006ace0 0x7fee8006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee900011e0 tx=0x7fee90001490 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:04.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.600+0000 7fee997fa700 1 -- 172.21.15.136:0/4260338282 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fee88053ae0 con 0x7fee9c0b5a70 2023-06-23T19:01:04.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:04.807+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fee9c15e200 con 0x7fee9c0b5a70 2023-06-23T19:01:05.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.356+0000 7fee997fa700 1 -- 172.21.15.136:0/4260338282 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7fee88057100 con 0x7fee9c0b5a70 2023-06-23T19:01:05.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.359+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee8006ace0 msgr2=0x7fee8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:05.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.359+0000 7feea2dff700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee8006ace0 0x7fee8006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee900011e0 tx=0x7fee90001490 comp rx=0 tx=0).stop 2023-06-23T19:01:05.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.359+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee9c0b5a70 msgr2=0x7fee9c15c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:05.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.359+0000 7feea2dff700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee9c0b5a70 0x7fee9c15c950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee8800c520 tx=0x7fee8800c8e0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.359+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 shutdown_connections 2023-06-23T19:01:05.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.359+0000 7feea2dff700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee8006ace0 0x7fee8006d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.359+0000 7feea2dff700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee9c0d0a60 0x7fee9c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.359+0000 7feea2dff700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee9c0b51d0 0x7fee9c0c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.360+0000 7feea2dff700 1 --2- 172.21.15.136:0/4260338282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee9c0b5a70 0x7fee9c15c950 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.360+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 >> 172.21.15.136:0/4260338282 conn(0x7fee9c071620 msgr2=0x7fee9c0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:05.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.360+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 shutdown_connections 2023-06-23T19:01:05.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.360+0000 7feea2dff700 1 -- 172.21.15.136:0/4260338282 wait complete. 2023-06-23T19:01:05.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-23T19:01:05.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.585+0000 7f2ea73ff700 1 Processor -- start 2023-06-23T19:01:05.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.585+0000 7f2ea73ff700 1 -- start start 2023-06-23T19:01:05.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.586+0000 7f2ea73ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2ea00d0a60 0x7f2ea00b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:05.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.586+0000 7f2ea73ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ea00b51d0 0x7f2ea00cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:05.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.586+0000 7f2ea73ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 0x7f2ea00d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:05.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.586+0000 7f2ea73ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea00d0060 con 0x7f2ea00d0a60 2023-06-23T19:01:05.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.586+0000 7f2ea73ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea00cfe50 con 0x7f2ea00b51d0 2023-06-23T19:01:05.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.586+0000 7f2ea73ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00cd9d0 con 0x7f2ea00d0e30 2023-06-23T19:01:05.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.586+0000 7f2ea519b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2ea00d0a60 0x7f2ea00b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:05.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.586+0000 7f2ea519b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2ea00d0a60 0x7f2ea00b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46152/0 (socket says 172.21.15.136:46152) 2023-06-23T19:01:05.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.586+0000 7f2ea519b700 1 -- 172.21.15.136:0/3466728207 learned_addr learned my addr 172.21.15.136:0/3466728207 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:05.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.587+0000 7f2ea499a700 1 --2- 172.21.15.136:0/3466728207 >> v2:172.21.15.178:3300/0 conn(0x7f2ea00b51d0 0x7f2ea00cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:05.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.587+0000 7f2ea599c700 1 --2- 172.21.15.136:0/3466728207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 0x7f2ea00d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:05.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.587+0000 7f2ea519b700 1 -- 172.21.15.136:0/3466728207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 msgr2=0x7f2ea00d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:05.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.587+0000 7f2ea519b700 1 --2- 172.21.15.136:0/3466728207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 0x7f2ea00d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.587+0000 7f2ea519b700 1 -- 172.21.15.136:0/3466728207 >> v2:172.21.15.178:3300/0 conn(0x7f2ea00b51d0 msgr2=0x7f2ea00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:05.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.587+0000 7f2ea519b700 1 --2- 172.21.15.136:0/3466728207 >> v2:172.21.15.178:3300/0 conn(0x7f2ea00b51d0 0x7f2ea00cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.587+0000 7f2ea519b700 1 -- 172.21.15.136:0/3466728207 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea00b5620 con 0x7f2ea00d0a60 2023-06-23T19:01:05.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.587+0000 7f2ea519b700 1 --2- 172.21.15.136:0/3466728207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 0x7f2ea00b5a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00d07a0 tx=0x7f2e9c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b60beb16bc22bc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:05.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.587+0000 7f2e97fff700 1 -- 172.21.15.136:0/3466728207 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c011830 con 0x7f2ea00d0a60 2023-06-23T19:01:05.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2e97fff700 1 -- 172.21.15.136:0/3466728207 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c011990 con 0x7f2ea00d0a60 2023-06-23T19:01:05.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2e97fff700 1 -- 172.21.15.136:0/3466728207 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c011d20 con 0x7f2ea00d0a60 2023-06-23T19:01:05.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3466728207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 msgr2=0x7f2ea00b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:05.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3466728207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 0x7f2ea00b5a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00d07a0 tx=0x7f2e9c009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3466728207 shutdown_connections 2023-06-23T19:01:05.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3466728207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 0x7f2ea00d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3466728207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 0x7f2ea00b5a70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3466728207 >> v2:172.21.15.178:3300/0 conn(0x7f2ea00b51d0 0x7f2ea00cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3466728207 >> 172.21.15.136:0/3466728207 conn(0x7f2ea0071620 msgr2=0x7f2ea00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:05.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3466728207 shutdown_connections 2023-06-23T19:01:05.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.588+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3466728207 wait complete. 2023-06-23T19:01:05.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.590+0000 7f2ea73ff700 1 Processor -- start 2023-06-23T19:01:05.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.590+0000 7f2ea73ff700 1 -- start start 2023-06-23T19:01:05.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea73ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00b51d0 0x7f2ea00c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:05.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea73ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 0x7f2ea0147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:05.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea73ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 0x7f2ea01e9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:05.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea73ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0148fe0 con 0x7f2ea00d0a60 2023-06-23T19:01:05.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea73ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0148360 con 0x7f2ea00b51d0 2023-06-23T19:01:05.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea73ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0148640 con 0x7f2ea00d0e30 2023-06-23T19:01:05.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea499a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 0x7f2ea0147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:05.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea499a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 0x7f2ea0147b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46164/0 (socket says 172.21.15.136:46164) 2023-06-23T19:01:05.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea499a700 1 -- 172.21.15.136:0/3175623694 learned_addr learned my addr 172.21.15.136:0/3175623694 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:05.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea519b700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00b51d0 0x7f2ea00c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:05.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.591+0000 7f2ea599c700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 0x7f2ea01e9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:05.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2ea499a700 1 -- 172.21.15.136:0/3175623694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 msgr2=0x7f2ea01e9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:05.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2ea499a700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 0x7f2ea01e9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2ea499a700 1 -- 172.21.15.136:0/3175623694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00b51d0 msgr2=0x7f2ea00c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:05.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2ea499a700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00b51d0 0x7f2ea00c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:05.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2ea499a700 1 -- 172.21.15.136:0/3175623694 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c009550 con 0x7f2ea00d0a60 2023-06-23T19:01:05.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2ea499a700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 0x7f2ea0147b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000e930 tx=0x7f2e9000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:05.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2e95ffb700 1 -- 172.21.15.136:0/3175623694 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90013680 con 0x7f2ea00d0a60 2023-06-23T19:01:05.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2e95ffb700 1 -- 172.21.15.136:0/3175623694 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e900137e0 con 0x7f2ea00d0a60 2023-06-23T19:01:05.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea0148920 con 0x7f2ea00d0a60 2023-06-23T19:01:05.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2e95ffb700 1 -- 172.21.15.136:0/3175623694 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90013b70 con 0x7f2ea00d0a60 2023-06-23T19:01:05.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.592+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea014d630 con 0x7f2ea00d0a60 2023-06-23T19:01:05.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.593+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea004ea20 con 0x7f2ea00d0a60 2023-06-23T19:01:05.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.594+0000 7f2e95ffb700 1 -- 172.21.15.136:0/3175623694 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e90013cd0 con 0x7f2ea00d0a60 2023-06-23T19:01:05.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.595+0000 7f2e95ffb700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2e8406ace0 0x7f2e8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:05.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.595+0000 7f2e95ffb700 1 -- 172.21.15.136:0/3175623694 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f2e90089480 con 0x7f2ea00d0a60 2023-06-23T19:01:05.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.596+0000 7f2ea519b700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2e8406ace0 0x7f2e8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:05.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.596+0000 7f2ea519b700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2e8406ace0 0x7f2e8406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009c10 tx=0x7f2e9c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:05.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.599+0000 7f2e95ffb700 1 -- 172.21.15.136:0/3175623694 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2e90054450 con 0x7f2ea00d0a60 2023-06-23T19:01:05.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:05.796+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2ea00741b0 con 0x7f2ea00d0a60 2023-06-23T19:01:07.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.367+0000 7f2e95ffb700 1 -- 172.21.15.136:0/3175623694 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7f2e90057a70 con 0x7f2ea00d0a60 2023-06-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.375+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2e8406ace0 msgr2=0x7f2e8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.375+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2e8406ace0 0x7f2e8406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009c10 tx=0x7f2e9c008030 comp rx=0 tx=0).stop 2023-06-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.375+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 msgr2=0x7f2ea0147b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.375+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 0x7f2ea0147b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000e930 tx=0x7f2e9000ec40 comp rx=0 tx=0).stop 2023-06-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.379+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 shutdown_connections 2023-06-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.379+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2e8406ace0 0x7f2e8406d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.379+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00b51d0 0x7f2ea00c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.379+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00d0e30 0x7f2ea01e9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.379+0000 7f2ea73ff700 1 --2- 172.21.15.136:0/3175623694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ea00d0a60 0x7f2ea0147b20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.379+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 >> 172.21.15.136:0/3175623694 conn(0x7f2ea0071620 msgr2=0x7f2ea00d1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.379+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 shutdown_connections 2023-06-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.379+0000 7f2ea73ff700 1 -- 172.21.15.136:0/3175623694 wait complete. 2023-06-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data_ec' created 2023-06-23T19:01:07.404 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-23T19:01:07.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.598+0000 7fabb73ff700 1 Processor -- start 2023-06-23T19:01:07.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.598+0000 7fabb73ff700 1 -- start start 2023-06-23T19:01:07.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7fabb73ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fabb00b5a70 0x7fabb00b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:07.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7fabb73ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb00cf910 0x7fabb00d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:07.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7fabb73ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb00b5ec0 con 0x7fabb00d0a60 2023-06-23T19:01:07.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7fabb73ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb00d0060 con 0x7fabb00b5a70 2023-06-23T19:01:07.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7fabb73ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00cd9d0 con 0x7fabb00cf910 2023-06-23T19:01:07.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7fabb519b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fabb00d0a60 0x7fabb00d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41250/0 (socket says 172.21.15.136:41250) 2023-06-23T19:01:07.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7fabb519b700 1 -- 172.21.15.136:0/2263036756 learned_addr learned my addr 172.21.15.136:0/2263036756 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:07.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7fabb499a700 1 --2- 172.21.15.136:0/2263036756 >> v2:172.21.15.178:3300/0 conn(0x7fabb00b5a70 0x7fabb00b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:07.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7fabb599c700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb00cf910 0x7fabb00d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:07.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821799106 0 0) 0x7fabb00b5ec0 con 0x7fabb00d0a60 2023-06-23T19:01:07.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab9c0035b0 con 0x7fabb00d0a60 2023-06-23T19:01:07.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.600+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454757664 0 0) 0x7fab9c0035b0 con 0x7fabb00d0a60 2023-06-23T19:01:07.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb00cf910 msgr2=0x7fabb00d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:07.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb00cf910 0x7fabb00d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 >> v2:172.21.15.178:3300/0 conn(0x7fabb00b5a70 msgr2=0x7fabb00b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:07.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 --2- 172.21.15.136:0/2263036756 >> v2:172.21.15.178:3300/0 conn(0x7fabb00b5a70 0x7fabb00b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00cfd90 con 0x7fabb00d0a60 2023-06-23T19:01:07.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fabac001670 con 0x7fabb00d0a60 2023-06-23T19:01:07.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 >> v1:172.21.15.136:6789/0 conn(0x7fabb00d0a60 legacy=0x7fabb00d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:07.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab9c003a00 0x7fab9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:07.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c004430 0x7fab9c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:07.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb00cf910 0x7fab9c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:07.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00d0060 con 0x7fab9c003a00 2023-06-23T19:01:07.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00cd9d0 con 0x7fab9c004430 2023-06-23T19:01:07.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c00ba10 con 0x7fabb00cf910 2023-06-23T19:01:07.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb519b700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab9c003a00 0x7fab9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:07.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb499a700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c004430 0x7fab9c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:07.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb599c700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb00cf910 0x7fab9c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:07.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb519b700 1 -- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb00cf910 msgr2=0x7fab9c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:07.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb519b700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb00cf910 0x7fab9c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb519b700 1 -- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c004430 msgr2=0x7fab9c0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:07.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb519b700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c004430 0x7fab9c0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb519b700 1 -- 172.21.15.136:0/2263036756 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0035b0 con 0x7fab9c003a00 2023-06-23T19:01:07.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb499a700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c004430 0x7fab9c0048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:07.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.601+0000 7fabb519b700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab9c003a00 0x7fab9c003e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c320 tx=0x7fab9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33365b3b1e6647e2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:07.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac00ce60 con 0x7fab9c003a00 2023-06-23T19:01:07.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac005960 con 0x7fab9c003a00 2023-06-23T19:01:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7faba7fff700 1 -- 172.21.15.136:0/2263036756 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac005cf0 con 0x7fab9c003a00 2023-06-23T19:01:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7fabb73ff700 1 -- 172.21.15.136:0/2263036756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab9c003a00 msgr2=0x7fab9c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7fabb73ff700 1 --2- 172.21.15.136:0/2263036756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab9c003a00 0x7fab9c003e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c320 tx=0x7fab9c005880 comp rx=0 tx=0).stop 2023-06-23T19:01:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7fabb599c700 1 -- 172.21.15.136:0/2263036756 reap_dead start 2023-06-23T19:01:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7fabb73ff700 1 -- 172.21.15.136:0/2263036756 shutdown_connections 2023-06-23T19:01:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7fabb73ff700 1 -- 172.21.15.136:0/2263036756 >> 172.21.15.136:0/2263036756 conn(0x7fabb0071620 msgr2=0x7fabb00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7fabb73ff700 1 -- 172.21.15.136:0/2263036756 shutdown_connections 2023-06-23T19:01:07.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.602+0000 7fabb73ff700 1 -- 172.21.15.136:0/2263036756 wait complete. 2023-06-23T19:01:07.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.605+0000 7fabb73ff700 1 Processor -- start 2023-06-23T19:01:07.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.605+0000 7fabb73ff700 1 -- start start 2023-06-23T19:01:07.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb73ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c003a00 0x7fabb00c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:07.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb73ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb015ebb0 0x7fabb01f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:07.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb73ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabb01f5760 0x7fabb01f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:07.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb73ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00c9800 con 0x7fabb01f5760 2023-06-23T19:01:07.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb73ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb015f020 con 0x7fab9c003a00 2023-06-23T19:01:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb73ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00c8bf0 con 0x7fabb015ebb0 2023-06-23T19:01:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb599c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabb01f5760 0x7fabb01f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb599c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabb01f5760 0x7fabb01f5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46194/0 (socket says 172.21.15.136:46194) 2023-06-23T19:01:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb599c700 1 -- 172.21.15.136:0/3961944659 learned_addr learned my addr 172.21.15.136:0/3961944659 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb499a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb015ebb0 0x7fabb01f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.606+0000 7fabb519b700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c003a00 0x7fabb00c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7fabb599c700 1 -- 172.21.15.136:0/3961944659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb015ebb0 msgr2=0x7fabb01f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:07.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7fabb599c700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb015ebb0 0x7fabb01f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7fabb599c700 1 -- 172.21.15.136:0/3961944659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c003a00 msgr2=0x7fabb00c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:07.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7fabb599c700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c003a00 0x7fabb00c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:07.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7fabb599c700 1 -- 172.21.15.136:0/3961944659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00c8ed0 con 0x7fabb01f5760 2023-06-23T19:01:07.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7fabb599c700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabb01f5760 0x7fabb01f5c00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabb00d3cc0 tx=0x7faba80114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:07.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7faba5ffb700 1 -- 172.21.15.136:0/3961944659 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba800e070 con 0x7fabb01f5760 2023-06-23T19:01:07.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7faba5ffb700 1 -- 172.21.15.136:0/3961944659 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba8003cf0 con 0x7fabb01f5760 2023-06-23T19:01:07.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7faba5ffb700 1 -- 172.21.15.136:0/3961944659 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8003ea0 con 0x7fabb01f5760 2023-06-23T19:01:07.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb00c91b0 con 0x7fabb01f5760 2023-06-23T19:01:07.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.607+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb0152200 con 0x7fabb01f5760 2023-06-23T19:01:07.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.608+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb00c9970 con 0x7fabb01f5760 2023-06-23T19:01:07.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.609+0000 7faba5ffb700 1 -- 172.21.15.136:0/3961944659 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faba8011960 con 0x7fabb01f5760 2023-06-23T19:01:07.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.610+0000 7faba5ffb700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fab9406ace0 0x7fab9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:07.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.610+0000 7faba5ffb700 1 -- 172.21.15.136:0/3961944659 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7faba8089b60 con 0x7fabb01f5760 2023-06-23T19:01:07.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.610+0000 7fabb519b700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fab9406ace0 0x7fab9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:07.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.611+0000 7fabb519b700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fab9406ace0 0x7fab9406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fabac008fd0 tx=0x7fabac00a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:07.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.615+0000 7faba5ffb700 1 -- 172.21.15.136:0/3961944659 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faba80548a0 con 0x7fabb01f5760 2023-06-23T19:01:07.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:07.809+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fabb004ea20 con 0x7fabb01f5760 2023-06-23T19:01:08.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.372+0000 7faba5ffb700 1 -- 172.21.15.136:0/3961944659 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7faba8057ec0 con 0x7fabb01f5760 2023-06-23T19:01:08.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.379+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fab9406ace0 msgr2=0x7fab9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:08.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.379+0000 7fabb73ff700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fab9406ace0 0x7fab9406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fabac008fd0 tx=0x7fabac00a000 comp rx=0 tx=0).stop 2023-06-23T19:01:08.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.379+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabb01f5760 msgr2=0x7fabb01f5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:08.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.379+0000 7fabb73ff700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabb01f5760 0x7fabb01f5c00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabb00d3cc0 tx=0x7faba80114b0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.381+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 shutdown_connections 2023-06-23T19:01:08.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.381+0000 7fabb73ff700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fab9406ace0 0x7fab9406d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.381+0000 7fabb73ff700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9c003a00 0x7fabb00c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.381+0000 7fabb73ff700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabb01f5760 0x7fabb01f5c00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.381+0000 7fabb73ff700 1 --2- 172.21.15.136:0/3961944659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabb015ebb0 0x7fabb01f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.381+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 >> 172.21.15.136:0/3961944659 conn(0x7fabb0071620 msgr2=0x7fabb00b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:08.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.381+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 shutdown_connections 2023-06-23T19:01:08.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.381+0000 7fabb73ff700 1 -- 172.21.15.136:0/3961944659 wait complete. 2023-06-23T19:01:08.392 INFO:teuthology.orchestra.run.smithi136.stderr:set pool 5 allow_ec_overwrites to true 2023-06-23T19:01:08.419 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-23T19:01:08.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.610+0000 7f6a06bff700 1 Processor -- start 2023-06-23T19:01:08.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.610+0000 7f6a06bff700 1 -- start start 2023-06-23T19:01:08.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.611+0000 7f6a06bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6a000cf590 0x7f6a000d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:08.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.611+0000 7f6a06bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a000cd1d0 0x7f6a0015d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:08.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.611+0000 7f6a06bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0015d7c0 con 0x7f6a000cf960 2023-06-23T19:01:08.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.611+0000 7f6a06bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a000cd9b0 con 0x7f6a000cf590 2023-06-23T19:01:08.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.611+0000 7f6a06bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000b55b0 con 0x7f6a000cd1d0 2023-06-23T19:01:08.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.611+0000 7f6a0499b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6a000cf590 0x7f6a000d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:08.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.611+0000 7f6a0499b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6a000cf590 0x7f6a000d3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46200/0 (socket says 172.21.15.136:46200) 2023-06-23T19:01:08.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f6a0499b700 1 -- 172.21.15.136:0/1037925663 learned_addr learned my addr 172.21.15.136:0/1037925663 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:08.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f69fffff700 1 --2- 172.21.15.136:0/1037925663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a000cd1d0 0x7f6a0015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:08.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f6a0499b700 1 -- 172.21.15.136:0/1037925663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a000cd1d0 msgr2=0x7f6a0015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:08.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f6a0499b700 1 --2- 172.21.15.136:0/1037925663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a000cd1d0 0x7f6a0015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f6a0499b700 1 -- 172.21.15.136:0/1037925663 >> v1:172.21.15.178:6789/0 conn(0x7f6a000cf960 legacy=0x7f6a000d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:08.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f6a0499b700 1 -- 172.21.15.136:0/1037925663 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a000cd6d0 con 0x7f6a000cf590 2023-06-23T19:01:08.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f6a0499b700 1 --2- 172.21.15.136:0/1037925663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cf590 0x7f6a000d3600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69f40098f0 tx=0x7f69f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8e4984bac163f3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:08.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f69ff7fe700 1 -- 172.21.15.136:0/1037925663 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f400b8a0 con 0x7f6a000cf590 2023-06-23T19:01:08.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f69ff7fe700 1 -- 172.21.15.136:0/1037925663 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f400ba00 con 0x7f6a000cf590 2023-06-23T19:01:08.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.612+0000 7f69ff7fe700 1 -- 172.21.15.136:0/1037925663 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f400bd90 con 0x7f6a000cf590 2023-06-23T19:01:08.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.613+0000 7f6a06bff700 1 -- 172.21.15.136:0/1037925663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cf590 msgr2=0x7f6a000d3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:08.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.613+0000 7f6a06bff700 1 --2- 172.21.15.136:0/1037925663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cf590 0x7f6a000d3600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69f40098f0 tx=0x7f69f4009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:08.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.613+0000 7f6a06bff700 1 -- 172.21.15.136:0/1037925663 shutdown_connections 2023-06-23T19:01:08.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.613+0000 7f6a06bff700 1 --2- 172.21.15.136:0/1037925663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cf590 0x7f6a000d3600 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.613+0000 7f6a06bff700 1 --2- 172.21.15.136:0/1037925663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a000cd1d0 0x7f6a0015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.613+0000 7f6a06bff700 1 -- 172.21.15.136:0/1037925663 >> 172.21.15.136:0/1037925663 conn(0x7f6a0006b3b0 msgr2=0x7f6a0006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:08.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.613+0000 7f6a06bff700 1 -- 172.21.15.136:0/1037925663 shutdown_connections 2023-06-23T19:01:08.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.613+0000 7f6a06bff700 1 -- 172.21.15.136:0/1037925663 wait complete. 2023-06-23T19:01:08.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.615+0000 7f6a06bff700 1 Processor -- start 2023-06-23T19:01:08.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.615+0000 7f6a06bff700 1 -- start start 2023-06-23T19:01:08.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a06bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cd1d0 0x7f6a00156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:08.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a06bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a000cf590 0x7f6a000c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:08.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a06bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a000cf960 0x7f6a0015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:08.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a06bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000b6ef0 con 0x7f6a000cd1d0 2023-06-23T19:01:08.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a06bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a00156550 con 0x7f6a000cf590 2023-06-23T19:01:08.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a06bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000b7140 con 0x7f6a000cf960 2023-06-23T19:01:08.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a0499b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cd1d0 0x7f6a00156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:08.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a0499b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cd1d0 0x7f6a00156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46206/0 (socket says 172.21.15.136:46206) 2023-06-23T19:01:08.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a0499b700 1 -- 172.21.15.136:0/3064746863 learned_addr learned my addr 172.21.15.136:0/3064746863 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:08.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a0499b700 1 -- 172.21.15.136:0/3064746863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a000cf960 msgr2=0x7f6a0015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:08.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a0499b700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a000cf960 0x7f6a0015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a0499b700 1 -- 172.21.15.136:0/3064746863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a000cf590 msgr2=0x7f6a000c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:08.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a0499b700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a000cf590 0x7f6a000c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.616+0000 7f6a0499b700 1 -- 172.21.15.136:0/3064746863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009550 con 0x7f6a000cd1d0 2023-06-23T19:01:08.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.617+0000 7f6a0499b700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cd1d0 0x7f6a00156010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009c40 tx=0x7f69f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:08.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.617+0000 7f69fd7fa700 1 -- 172.21.15.136:0/3064746863 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4004400 con 0x7f6a000cd1d0 2023-06-23T19:01:08.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.617+0000 7f69fd7fa700 1 -- 172.21.15.136:0/3064746863 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f401f070 con 0x7f6a000cd1d0 2023-06-23T19:01:08.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.617+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a000b7420 con 0x7f6a000cd1d0 2023-06-23T19:01:08.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.617+0000 7f69fd7fa700 1 -- 172.21.15.136:0/3064746863 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f40038a0 con 0x7f6a000cd1d0 2023-06-23T19:01:08.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.617+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a000b79e0 con 0x7f6a000cd1d0 2023-06-23T19:01:08.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.618+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0004ea20 con 0x7f6a000cd1d0 2023-06-23T19:01:08.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.619+0000 7f69fd7fa700 1 -- 172.21.15.136:0/3064746863 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f69f4021030 con 0x7f6a000cd1d0 2023-06-23T19:01:08.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.620+0000 7f69fd7fa700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f69e406ace0 0x7f69e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:08.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.620+0000 7f69fd7fa700 1 -- 172.21.15.136:0/3064746863 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f69f408ad70 con 0x7f6a000cd1d0 2023-06-23T19:01:08.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.620+0000 7f69fffff700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f69e406ace0 0x7f69e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:08.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.621+0000 7f69fffff700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f69e406ace0 0x7f69e406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a00160b00 tx=0x7f69ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:08.628 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.624+0000 7f69fd7fa700 1 -- 172.21.15.136:0/3064746863 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f69f4055c60 con 0x7f6a000cd1d0 2023-06-23T19:01:08.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.863+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f6a000b4fe0 con 0x7f6a000cd1d0 2023-06-23T19:01:08.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.868+0000 7f69fd7fa700 1 -- 172.21.15.136:0/3064746863 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f69f4059280 con 0x7f6a000cd1d0 2023-06-23T19:01:08.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f69e406ace0 msgr2=0x7f69e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:08.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f69e406ace0 0x7f69e406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a00160b00 tx=0x7f69ec008040 comp rx=0 tx=0).stop 2023-06-23T19:01:08.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cd1d0 msgr2=0x7f6a00156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:08.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cd1d0 0x7f6a00156010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009c40 tx=0x7f69f4004750 comp rx=0 tx=0).stop 2023-06-23T19:01:08.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 shutdown_connections 2023-06-23T19:01:08.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f69e406ace0 0x7f69e406d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a000cf960 0x7f6a0015dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a000cd1d0 0x7f6a00156010 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 --2- 172.21.15.136:0/3064746863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a000cf590 0x7f6a000c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:08.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.872+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 >> 172.21.15.136:0/3064746863 conn(0x7f6a0006b3b0 msgr2=0x7f6a000b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:08.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.873+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 shutdown_connections 2023-06-23T19:01:08.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:08.873+0000 7f6a06bff700 1 -- 172.21.15.136:0/3064746863 wait complete. 2023-06-23T19:01:08.878 INFO:teuthology.orchestra.run.smithi136.stderr:added data pool 5 to fsmap 2023-06-23T19:01:08.895 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:01:09.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.086+0000 7f0fd8bff700 1 Processor -- start 2023-06-23T19:01:09.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.086+0000 7f0fd8bff700 1 -- start start 2023-06-23T19:01:09.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fd8bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd415c570 0x7f0fd40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fd8bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0fd40cd660 0x7f0fd4160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fd8bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd41610a0 con 0x7f0fd4160880 2023-06-23T19:01:09.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fd8bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd415d670 con 0x7f0fd40cd660 2023-06-23T19:01:09.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fd8bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40cdad0 con 0x7f0fd415c570 2023-06-23T19:01:09.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fcbfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0fd40cd660 0x7f0fd4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fd2d9d700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0fd4160880 0x7f0fd406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41260/0 (socket says 172.21.15.136:41260) 2023-06-23T19:01:09.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fcbfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0fd40cd660 0x7f0fd4160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46208/0 (socket says 172.21.15.136:46208) 2023-06-23T19:01:09.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fd2d9d700 1 -- 172.21.15.136:0/318546243 learned_addr learned my addr 172.21.15.136:0/318546243 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:09.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.087+0000 7f0fd259c700 1 --2- 172.21.15.136:0/318546243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd415c570 0x7f0fd40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.088+0000 7f0fcbfff700 1 -- 172.21.15.136:0/318546243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd415c570 msgr2=0x7f0fd40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:09.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.088+0000 7f0fcbfff700 1 --2- 172.21.15.136:0/318546243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd415c570 0x7f0fd40cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.088+0000 7f0fcbfff700 1 -- 172.21.15.136:0/318546243 >> v1:172.21.15.136:6789/0 conn(0x7f0fd4160880 legacy=0x7f0fd406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.088+0000 7f0fcbfff700 1 -- 172.21.15.136:0/318546243 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd415da90 con 0x7f0fd40cd660 2023-06-23T19:01:09.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.088+0000 7f0fcbfff700 1 --2- 172.21.15.136:0/318546243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 0x7f0fd4160340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009870 tx=0x7f0fbc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69bf7147887a184 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:09.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.088+0000 7f0fd1d9b700 1 -- 172.21.15.136:0/318546243 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc011830 con 0x7f0fd40cd660 2023-06-23T19:01:09.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.088+0000 7f0fd1d9b700 1 -- 172.21.15.136:0/318546243 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc011990 con 0x7f0fd40cd660 2023-06-23T19:01:09.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.088+0000 7f0fd1d9b700 1 -- 172.21.15.136:0/318546243 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc011d20 con 0x7f0fd40cd660 2023-06-23T19:01:09.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.089+0000 7f0fd8bff700 1 -- 172.21.15.136:0/318546243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 msgr2=0x7f0fd4160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.089+0000 7f0fd8bff700 1 --2- 172.21.15.136:0/318546243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 0x7f0fd4160340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009870 tx=0x7f0fbc009b80 comp rx=0 tx=0).stop 2023-06-23T19:01:09.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.089+0000 7f0fd8bff700 1 -- 172.21.15.136:0/318546243 shutdown_connections 2023-06-23T19:01:09.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.089+0000 7f0fd8bff700 1 --2- 172.21.15.136:0/318546243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd415c570 0x7f0fd40cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.089+0000 7f0fd8bff700 1 --2- 172.21.15.136:0/318546243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 0x7f0fd4160340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.089+0000 7f0fd8bff700 1 -- 172.21.15.136:0/318546243 >> 172.21.15.136:0/318546243 conn(0x7f0fd4071620 msgr2=0x7f0fd40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:09.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.089+0000 7f0fd8bff700 1 -- 172.21.15.136:0/318546243 shutdown_connections 2023-06-23T19:01:09.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.089+0000 7f0fd8bff700 1 -- 172.21.15.136:0/318546243 wait complete. 2023-06-23T19:01:09.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.091+0000 7f0fd8bff700 1 Processor -- start 2023-06-23T19:01:09.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.091+0000 7f0fd8bff700 1 -- start start 2023-06-23T19:01:09.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd8bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 0x7f0fd414fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd8bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd415c570 0x7f0fd40cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd8bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd4160880 0x7f0fd40cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd8bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40c9c40 con 0x7f0fd40cd660 2023-06-23T19:01:09.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd8bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40c9f20 con 0x7f0fd415c570 2023-06-23T19:01:09.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd8bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40ca200 con 0x7f0fd4160880 2023-06-23T19:01:09.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 0x7f0fd414fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 0x7f0fd414fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46218/0 (socket says 172.21.15.136:46218) 2023-06-23T19:01:09.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd259c700 1 -- 172.21.15.136:0/3813038573 learned_addr learned my addr 172.21.15.136:0/3813038573 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:09.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd2d9d700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd4160880 0x7f0fd40cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fcbfff700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd415c570 0x7f0fd40cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd259c700 1 -- 172.21.15.136:0/3813038573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd4160880 msgr2=0x7f0fd40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd259c700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd4160880 0x7f0fd40cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd259c700 1 -- 172.21.15.136:0/3813038573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd415c570 msgr2=0x7f0fd40cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd259c700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd415c570 0x7f0fd40cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.092+0000 7f0fd259c700 1 -- 172.21.15.136:0/3813038573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0094a0 con 0x7f0fd40cd660 2023-06-23T19:01:09.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.093+0000 7f0fd259c700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 0x7f0fd414fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400e810 tx=0x7f0fc400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:09.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.093+0000 7f0fcaffd700 1 -- 172.21.15.136:0/3813038573 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4013610 con 0x7f0fd40cd660 2023-06-23T19:01:09.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.093+0000 7f0fcaffd700 1 -- 172.21.15.136:0/3813038573 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc4013770 con 0x7f0fd40cd660 2023-06-23T19:01:09.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.093+0000 7f0fcaffd700 1 -- 172.21.15.136:0/3813038573 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4013b20 con 0x7f0fd40cd660 2023-06-23T19:01:09.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.093+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd40ca4e0 con 0x7f0fd40cd660 2023-06-23T19:01:09.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.093+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd40cc900 con 0x7f0fd40cd660 2023-06-23T19:01:09.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.094+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd4073910 con 0x7f0fd40cd660 2023-06-23T19:01:09.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.095+0000 7f0fcaffd700 1 -- 172.21.15.136:0/3813038573 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fc4013c80 con 0x7f0fd40cd660 2023-06-23T19:01:09.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.096+0000 7f0fcaffd700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0fb406ace0 0x7f0fb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.096+0000 7f0fcaffd700 1 -- 172.21.15.136:0/3813038573 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0fc40894c0 con 0x7f0fd40cd660 2023-06-23T19:01:09.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.096+0000 7f0fcbfff700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0fb406ace0 0x7f0fb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.096+0000 7f0fcbfff700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0fb406ace0 0x7f0fb406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc000c00 tx=0x7f0fbc01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:09.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.100+0000 7f0fcaffd700 1 -- 172.21.15.136:0/3813038573 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0fc40541f0 con 0x7f0fd40cd660 2023-06-23T19:01:09.226 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T19:01:09.222+0000 7f6091df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T19:01:09.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.341+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fd40d1e00 con 0x7f0fd40cd660 2023-06-23T19:01:09.345 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.341+0000 7f0fcaffd700 1 -- 172.21.15.136:0/3813038573 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f0fc4057810 con 0x7f0fd40cd660 2023-06-23T19:01:09.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:09.345 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:08.865463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-23T19:01:09.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0fb406ace0 msgr2=0x7f0fb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0fb406ace0 0x7f0fb406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc000c00 tx=0x7f0fbc01c040 comp rx=0 tx=0).stop 2023-06-23T19:01:09.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 msgr2=0x7f0fd414fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 0x7f0fd414fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400e810 tx=0x7f0fc400ebd0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 shutdown_connections 2023-06-23T19:01:09.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0fb406ace0 0x7f0fb406d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fd4160880 0x7f0fd40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fd40cd660 0x7f0fd414fca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 --2- 172.21.15.136:0/3813038573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd415c570 0x7f0fd40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 >> 172.21.15.136:0/3813038573 conn(0x7f0fd4071620 msgr2=0x7f0fd40d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:09.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 shutdown_connections 2023-06-23T19:01:09.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.344+0000 7f0fd8bff700 1 -- 172.21.15.136:0/3813038573 wait complete. 2023-06-23T19:01:09.349 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 7 2023-06-23T19:01:09.365 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:09.558 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.554+0000 7f91c3bff700 1 Processor -- start 2023-06-23T19:01:09.558 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.554+0000 7f91c3bff700 1 -- start start 2023-06-23T19:01:09.561 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.555+0000 7f91c3bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91bc15c570 0x7f91bc0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.555+0000 7f91c3bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc0cd660 0x7f91bc160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.555+0000 7f91c3bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91bc0cdab0 con 0x7f91bc160880 2023-06-23T19:01:09.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.555+0000 7f91c3bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc15d670 con 0x7f91bc15c570 2023-06-23T19:01:09.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.555+0000 7f91c3bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc1610a0 con 0x7f91bc0cd660 2023-06-23T19:01:09.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c199b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91bc15c570 0x7f91bc0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c199b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91bc15c570 0x7f91bc0cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46232/0 (socket says 172.21.15.136:46232) 2023-06-23T19:01:09.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c199b700 1 -- 172.21.15.136:0/1065078952 learned_addr learned my addr 172.21.15.136:0/1065078952 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:09.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c119a700 1 --2- 172.21.15.136:0/1065078952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc0cd660 0x7f91bc160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c199b700 1 -- 172.21.15.136:0/1065078952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc0cd660 msgr2=0x7f91bc160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:09.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c199b700 1 --2- 172.21.15.136:0/1065078952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc0cd660 0x7f91bc160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c199b700 1 -- 172.21.15.136:0/1065078952 >> v1:172.21.15.178:6789/0 conn(0x7f91bc160880 legacy=0x7f91bc06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c199b700 1 -- 172.21.15.136:0/1065078952 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc15da90 con 0x7f91bc15c570 2023-06-23T19:01:09.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c199b700 1 --2- 172.21.15.136:0/1065078952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc15c570 0x7f91bc0cd120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f91b80098f0 tx=0x7f91b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d237e6815f204e0e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:09.564 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.556+0000 7f91c0999700 1 -- 172.21.15.136:0/1065078952 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800b8a0 con 0x7f91bc15c570 2023-06-23T19:01:09.564 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c0999700 1 -- 172.21.15.136:0/1065078952 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b800ba00 con 0x7f91bc15c570 2023-06-23T19:01:09.564 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c0999700 1 -- 172.21.15.136:0/1065078952 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800bd90 con 0x7f91bc15c570 2023-06-23T19:01:09.564 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c3bff700 1 -- 172.21.15.136:0/1065078952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc15c570 msgr2=0x7f91bc0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.564 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c3bff700 1 --2- 172.21.15.136:0/1065078952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc15c570 0x7f91bc0cd120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f91b80098f0 tx=0x7f91b8009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:09.564 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c3bff700 1 -- 172.21.15.136:0/1065078952 shutdown_connections 2023-06-23T19:01:09.564 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c3bff700 1 --2- 172.21.15.136:0/1065078952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc15c570 0x7f91bc0cd120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.565 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c3bff700 1 --2- 172.21.15.136:0/1065078952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc0cd660 0x7f91bc160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.565 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c3bff700 1 -- 172.21.15.136:0/1065078952 >> 172.21.15.136:0/1065078952 conn(0x7f91bc071620 msgr2=0x7f91bc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:09.565 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c3bff700 1 -- 172.21.15.136:0/1065078952 shutdown_connections 2023-06-23T19:01:09.565 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.557+0000 7f91c3bff700 1 -- 172.21.15.136:0/1065078952 wait complete. 2023-06-23T19:01:09.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.559+0000 7f91c3bff700 1 Processor -- start 2023-06-23T19:01:09.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.559+0000 7f91c3bff700 1 -- start start 2023-06-23T19:01:09.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c3bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc0cd660 0x7f91bc0b7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c3bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc15c570 0x7f91bc0b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c3bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91bc160880 0x7f91bc0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c3bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0b8010 con 0x7f91bc0cd660 2023-06-23T19:01:09.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c3bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc1e5f80 con 0x7f91bc160880 2023-06-23T19:01:09.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c3bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc150410 con 0x7f91bc15c570 2023-06-23T19:01:09.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c199b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc0cd660 0x7f91bc0b7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c199b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc0cd660 0x7f91bc0b7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46242/0 (socket says 172.21.15.136:46242) 2023-06-23T19:01:09.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c199b700 1 -- 172.21.15.136:0/285733669 learned_addr learned my addr 172.21.15.136:0/285733669 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:09.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c119a700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc15c570 0x7f91bc0b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c219c700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91bc160880 0x7f91bc0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.560+0000 7f91c199b700 1 -- 172.21.15.136:0/285733669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc15c570 msgr2=0x7f91bc0b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91c199b700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc15c570 0x7f91bc0b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91c199b700 1 -- 172.21.15.136:0/285733669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91bc160880 msgr2=0x7f91bc0c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91c199b700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91bc160880 0x7f91bc0c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91c199b700 1 -- 172.21.15.136:0/285733669 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8009550 con 0x7f91bc0cd660 2023-06-23T19:01:09.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91c119a700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc15c570 0x7f91bc0b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:09.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91c199b700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc0cd660 0x7f91bc0b7ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000c00 tx=0x7f91b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:09.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91b27fc700 1 -- 172.21.15.136:0/285733669 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8004480 con 0x7f91bc0cd660 2023-06-23T19:01:09.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91b27fc700 1 -- 172.21.15.136:0/285733669 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b801f070 con 0x7f91bc0cd660 2023-06-23T19:01:09.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91b27fc700 1 -- 172.21.15.136:0/285733669 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80038c0 con 0x7f91bc0cd660 2023-06-23T19:01:09.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc1e6190 con 0x7f91bc0cd660 2023-06-23T19:01:09.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.561+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc1e6750 con 0x7f91bc0cd660 2023-06-23T19:01:09.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.562+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc073910 con 0x7f91bc0cd660 2023-06-23T19:01:09.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.563+0000 7f91b27fc700 1 -- 172.21.15.136:0/285733669 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91b8021030 con 0x7f91bc0cd660 2023-06-23T19:01:09.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.564+0000 7f91b27fc700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f91a006ace0 0x7f91a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.564+0000 7f91b27fc700 1 -- 172.21.15.136:0/285733669 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f91b808ad30 con 0x7f91bc0cd660 2023-06-23T19:01:09.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.564+0000 7f91c119a700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f91a006ace0 0x7f91a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.565+0000 7f91c119a700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f91a006ace0 0x7f91a006d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0099f0 tx=0x7f91ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:09.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.568+0000 7f91b27fc700 1 -- 172.21.15.136:0/285733669 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f91b8055c00 con 0x7f91bc0cd660 2023-06-23T19:01:09.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.767+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91bc15cf80 con 0x7f91bc0cd660 2023-06-23T19:01:09.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.768+0000 7f91b27fc700 1 -- 172.21.15.136:0/285733669 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f91b8061e60 con 0x7f91bc0cd660 2023-06-23T19:01:09.772 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:09.773 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:09.774 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f91a006ace0 msgr2=0x7f91a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f91a006ace0 0x7f91a006d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0099f0 tx=0x7f91ac008040 comp rx=0 tx=0).stop 2023-06-23T19:01:09.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc0cd660 msgr2=0x7f91bc0b7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc0cd660 0x7f91bc0b7ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000c00 tx=0x7f91b8004750 comp rx=0 tx=0).stop 2023-06-23T19:01:09.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 shutdown_connections 2023-06-23T19:01:09.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f91a006ace0 0x7f91a006d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91bc160880 0x7f91bc0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91bc0cd660 0x7f91bc0b7ad0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 --2- 172.21.15.136:0/285733669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91bc15c570 0x7f91bc0b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:09.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 >> 172.21.15.136:0/285733669 conn(0x7f91bc071620 msgr2=0x7f91bc15ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:09.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 shutdown_connections 2023-06-23T19:01:09.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.771+0000 7f91c3bff700 1 -- 172.21.15.136:0/285733669 wait complete. 2023-06-23T19:01:09.793 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:09.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.984+0000 7f2c4abff700 1 Processor -- start 2023-06-23T19:01:09.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.984+0000 7f2c4abff700 1 -- start start 2023-06-23T19:01:09.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.985+0000 7f2c4abff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c440cd830 0x7f2c44160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:09.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.985+0000 7f2c4abff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c441610a0 con 0x7f2c44160880 2023-06-23T19:01:09.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.985+0000 7f2c4abff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4415da90 con 0x7f2c4415c570 2023-06-23T19:01:09.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.985+0000 7f2c4abff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4415d670 con 0x7f2c440cd830 2023-06-23T19:01:09.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c4919c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2c44160880 0x7f2c440d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41262/0 (socket says 172.21.15.136:41262) 2023-06-23T19:01:09.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c4919c700 1 -- 172.21.15.136:0/2494214375 learned_addr learned my addr 172.21.15.136:0/2494214375 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:09.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c43fff700 1 --2- 172.21.15.136:0/2494214375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c440cd830 0x7f2c44160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:09.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c437fe700 1 -- 172.21.15.136:0/2494214375 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218446917 0 0) 0x7f2c441610a0 con 0x7f2c44160880 2023-06-23T19:01:09.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c437fe700 1 -- 172.21.15.136:0/2494214375 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c340035b0 con 0x7f2c44160880 2023-06-23T19:01:09.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c437fe700 1 -- 172.21.15.136:0/2494214375 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098133846 0 0) 0x7f2c4415da90 con 0x7f2c4415c570 2023-06-23T19:01:09.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c437fe700 1 -- 172.21.15.136:0/2494214375 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c441610a0 con 0x7f2c4415c570 2023-06-23T19:01:09.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c43fff700 1 -- 172.21.15.136:0/2494214375 >> v1:172.21.15.178:6789/0 conn(0x7f2c4415c570 legacy=0x7f2c440cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c43fff700 1 -- 172.21.15.136:0/2494214375 >> v1:172.21.15.136:6789/0 conn(0x7f2c44160880 legacy=0x7f2c440d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:09.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.986+0000 7f2c43fff700 1 -- 172.21.15.136:0/2494214375 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4415ccd0 con 0x7f2c440cd830 2023-06-23T19:01:09.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c43fff700 1 --2- 172.21.15.136:0/2494214375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c440cd830 0x7f2c44160340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009870 tx=0x7f2c30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=965e2e17a8d200b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:09.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c437fe700 1 -- 172.21.15.136:0/2494214375 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30011830 con 0x7f2c440cd830 2023-06-23T19:01:09.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c437fe700 1 -- 172.21.15.136:0/2494214375 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c30011990 con 0x7f2c440cd830 2023-06-23T19:01:09.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c437fe700 1 -- 172.21.15.136:0/2494214375 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30011d00 con 0x7f2c440cd830 2023-06-23T19:01:09.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c4abff700 1 -- 172.21.15.136:0/2494214375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c440cd830 msgr2=0x7f2c44160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c4abff700 1 --2- 172.21.15.136:0/2494214375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c440cd830 0x7f2c44160340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009870 tx=0x7f2c30009b80 comp rx=0 tx=0).stop 2023-06-23T19:01:10.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c4abff700 1 -- 172.21.15.136:0/2494214375 shutdown_connections 2023-06-23T19:01:10.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c4abff700 1 --2- 172.21.15.136:0/2494214375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c440cd830 0x7f2c44160340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c4abff700 1 -- 172.21.15.136:0/2494214375 >> 172.21.15.136:0/2494214375 conn(0x7f2c44071620 msgr2=0x7f2c440719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:10.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.987+0000 7f2c4abff700 1 -- 172.21.15.136:0/2494214375 shutdown_connections 2023-06-23T19:01:10.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.988+0000 7f2c4abff700 1 -- 172.21.15.136:0/2494214375 wait complete. 2023-06-23T19:01:10.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.989+0000 7f2c4abff700 1 Processor -- start 2023-06-23T19:01:10.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.989+0000 7f2c4abff700 1 -- start start 2023-06-23T19:01:10.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.990+0000 7f2c4abff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c440cd830 0x7f2c44151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.990+0000 7f2c4abff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4415c570 0x7f2c440c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.990+0000 7f2c4abff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c44160880 0x7f2c440cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.990+0000 7f2c4abff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440cad20 con 0x7f2c440cd830 2023-06-23T19:01:10.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.990+0000 7f2c4abff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44151c90 con 0x7f2c44160880 2023-06-23T19:01:10.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.990+0000 7f2c4abff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440b61e0 con 0x7f2c4415c570 2023-06-23T19:01:10.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.990+0000 7f2c4899b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c440cd830 0x7f2c44151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.990+0000 7f2c4899b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c440cd830 0x7f2c44151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46258/0 (socket says 172.21.15.136:46258) 2023-06-23T19:01:10.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.990+0000 7f2c4899b700 1 -- 172.21.15.136:0/1909768395 learned_addr learned my addr 172.21.15.136:0/1909768395 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:10.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c43fff700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4415c570 0x7f2c440c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4919c700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c44160880 0x7f2c440cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4899b700 1 -- 172.21.15.136:0/1909768395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4415c570 msgr2=0x7f2c440c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4899b700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4415c570 0x7f2c440c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4899b700 1 -- 172.21.15.136:0/1909768395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c44160880 msgr2=0x7f2c440cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4899b700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c44160880 0x7f2c440cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4899b700 1 -- 172.21.15.136:0/1909768395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c300094a0 con 0x7f2c440cd830 2023-06-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4919c700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c44160880 0x7f2c440cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4899b700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c440cd830 0x7f2c44151750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800c520 tx=0x7f2c3800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c417fa700 1 -- 172.21.15.136:0/1909768395 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c380052d0 con 0x7f2c440cd830 2023-06-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c417fa700 1 -- 172.21.15.136:0/1909768395 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38005430 con 0x7f2c440cd830 2023-06-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c417fa700 1 -- 172.21.15.136:0/1909768395 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c380038a0 con 0x7f2c440cd830 2023-06-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c440b64c0 con 0x7f2c440cd830 2023-06-23T19:01:10.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.991+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c440b6a80 con 0x7f2c440cd830 2023-06-23T19:01:10.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.992+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4404ea20 con 0x7f2c440cd830 2023-06-23T19:01:10.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.993+0000 7f2c417fa700 1 -- 172.21.15.136:0/1909768395 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c38003a00 con 0x7f2c440cd830 2023-06-23T19:01:10.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.994+0000 7f2c417fa700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2c2806ace0 0x7f2c2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.995+0000 7f2c417fa700 1 -- 172.21.15.136:0/1909768395 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2c38088cb0 con 0x7f2c440cd830 2023-06-23T19:01:10.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.995+0000 7f2c43fff700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2c2806ace0 0x7f2c2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.995+0000 7f2c43fff700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2c2806ace0 0x7f2c2806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c440cdc20 tx=0x7f2c3001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:10.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:09.998+0000 7f2c417fa700 1 -- 172.21.15.136:0/1909768395 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2c38053a60 con 0x7f2c440cd830 2023-06-23T19:01:10.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.200+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c44073910 con 0x7f2c440cd830 2023-06-23T19:01:10.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.202+0000 7f2c417fa700 1 -- 172.21.15.136:0/1909768395 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f2c38003cb0 con 0x7f2c440cd830 2023-06-23T19:01:10.205 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:10.206 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:10.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2c2806ace0 msgr2=0x7f2c2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2c2806ace0 0x7f2c2806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c440cdc20 tx=0x7f2c3001c040 comp rx=0 tx=0).stop 2023-06-23T19:01:10.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c440cd830 msgr2=0x7f2c44151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c440cd830 0x7f2c44151750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800c520 tx=0x7f2c3800c830 comp rx=0 tx=0).stop 2023-06-23T19:01:10.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 shutdown_connections 2023-06-23T19:01:10.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2c2806ace0 0x7f2c2806d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c44160880 0x7f2c440cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c440cd830 0x7f2c44151750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 --2- 172.21.15.136:0/1909768395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4415c570 0x7f2c440c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 >> 172.21.15.136:0/1909768395 conn(0x7f2c44071620 msgr2=0x7f2c4415e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:10.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 shutdown_connections 2023-06-23T19:01:10.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.204+0000 7f2c4abff700 1 -- 172.21.15.136:0/1909768395 wait complete. 2023-06-23T19:01:10.250 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:01:10.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.443+0000 7f0699b9d700 1 Processor -- start 2023-06-23T19:01:10.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.443+0000 7f0699b9d700 1 -- start start 2023-06-23T19:01:10.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.444+0000 7f0699b9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06940cfa50 0x7f06940d0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.444+0000 7f0699b9d700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940cd470 con 0x7f069406cb20 2023-06-23T19:01:10.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.444+0000 7f0699b9d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940d10a0 con 0x7f06940b1dc0 2023-06-23T19:01:10.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.444+0000 7f0699b9d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06940b2190 con 0x7f06940cfa50 2023-06-23T19:01:10.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.445+0000 7f069939c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f069406cb20 0x7f06940cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41276/0 (socket says 172.21.15.136:41276) 2023-06-23T19:01:10.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.445+0000 7f069939c700 1 -- 172.21.15.136:0/1481951576 learned_addr learned my addr 172.21.15.136:0/1481951576 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:10.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.445+0000 7f0693fff700 1 --2- 172.21.15.136:0/1481951576 >> v2:172.21.15.178:3300/0 conn(0x7f06940cfa50 0x7f06940d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.445+0000 7f06937fe700 1 -- 172.21.15.136:0/1481951576 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197647937 0 0) 0x7f06940cd470 con 0x7f069406cb20 2023-06-23T19:01:10.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.445+0000 7f06937fe700 1 -- 172.21.15.136:0/1481951576 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06840035b0 con 0x7f069406cb20 2023-06-23T19:01:10.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.445+0000 7f0693fff700 1 -- 172.21.15.136:0/1481951576 >> v1:172.21.15.178:6789/0 conn(0x7f06940b1dc0 legacy=0x7f06940cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.445+0000 7f0693fff700 1 -- 172.21.15.136:0/1481951576 >> v1:172.21.15.136:6789/0 conn(0x7f069406cb20 legacy=0x7f06940cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.445+0000 7f0693fff700 1 -- 172.21.15.136:0/1481951576 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940d0ae0 con 0x7f06940cfa50 2023-06-23T19:01:10.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.446+0000 7f0693fff700 1 --2- 172.21.15.136:0/1481951576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06940cfa50 0x7f06940d0500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0680009840 tx=0x7f0680009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29f88438cd7fd02e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:10.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.446+0000 7f06937fe700 1 -- 172.21.15.136:0/1481951576 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680011830 con 0x7f06940cfa50 2023-06-23T19:01:10.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.446+0000 7f06937fe700 1 -- 172.21.15.136:0/1481951576 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0680011990 con 0x7f06940cfa50 2023-06-23T19:01:10.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.446+0000 7f06937fe700 1 -- 172.21.15.136:0/1481951576 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680011d20 con 0x7f06940cfa50 2023-06-23T19:01:10.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.446+0000 7f0699b9d700 1 -- 172.21.15.136:0/1481951576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06940cfa50 msgr2=0x7f06940d0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.446+0000 7f0699b9d700 1 --2- 172.21.15.136:0/1481951576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06940cfa50 0x7f06940d0500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0680009840 tx=0x7f0680009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:10.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.447+0000 7f0699b9d700 1 -- 172.21.15.136:0/1481951576 shutdown_connections 2023-06-23T19:01:10.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.447+0000 7f0699b9d700 1 --2- 172.21.15.136:0/1481951576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06940cfa50 0x7f06940d0500 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.447+0000 7f0699b9d700 1 -- 172.21.15.136:0/1481951576 >> 172.21.15.136:0/1481951576 conn(0x7f069409bbf0 msgr2=0x7f06940d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:10.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.447+0000 7f0699b9d700 1 -- 172.21.15.136:0/1481951576 shutdown_connections 2023-06-23T19:01:10.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.447+0000 7f0699b9d700 1 -- 172.21.15.136:0/1481951576 wait complete. 2023-06-23T19:01:10.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.448+0000 7f0699b9d700 1 Processor -- start 2023-06-23T19:01:10.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.448+0000 7f0699b9d700 1 -- start start 2023-06-23T19:01:10.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.449+0000 7f0699b9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f069406cb20 0x7f0694156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.449+0000 7f0699b9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06940b1dc0 0x7f0694158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.449+0000 7f0699b9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06940cfa50 0x7f0694159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.449+0000 7f0699b9d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940c9880 con 0x7f06940cfa50 2023-06-23T19:01:10.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.449+0000 7f0699b9d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0694156d70 con 0x7f06940b1dc0 2023-06-23T19:01:10.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.449+0000 7f0699b9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06941597a0 con 0x7f069406cb20 2023-06-23T19:01:10.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f069939c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06940cfa50 0x7f0694159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f069939c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06940cfa50 0x7f0694159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46260/0 (socket says 172.21.15.136:46260) 2023-06-23T19:01:10.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f069939c700 1 -- 172.21.15.136:0/3183521598 learned_addr learned my addr 172.21.15.136:0/3183521598 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:10.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f0698b9b700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f069406cb20 0x7f0694156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f0693fff700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06940b1dc0 0x7f0694158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f069939c700 1 -- 172.21.15.136:0/3183521598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f069406cb20 msgr2=0x7f0694156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f069939c700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f069406cb20 0x7f0694156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f069939c700 1 -- 172.21.15.136:0/3183521598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06940b1dc0 msgr2=0x7f0694158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f069939c700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06940b1dc0 0x7f0694158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f069939c700 1 -- 172.21.15.136:0/3183521598 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800094a0 con 0x7f06940cfa50 2023-06-23T19:01:10.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f069939c700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06940cfa50 0x7f0694159260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f068c00cb40 tx=0x7f068c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:10.458 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.450+0000 7f06917fa700 1 -- 172.21.15.136:0/3183521598 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00a980 con 0x7f06940cfa50 2023-06-23T19:01:10.458 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.451+0000 7f06917fa700 1 -- 172.21.15.136:0/3183521598 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00aae0 con 0x7f06940cfa50 2023-06-23T19:01:10.458 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.451+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06941577b0 con 0x7f06940cfa50 2023-06-23T19:01:10.458 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.451+0000 7f06917fa700 1 -- 172.21.15.136:0/3183521598 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00ae50 con 0x7f06940cfa50 2023-06-23T19:01:10.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.451+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0694156a90 con 0x7f06940cfa50 2023-06-23T19:01:10.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.452+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06940b67a0 con 0x7f06940cfa50 2023-06-23T19:01:10.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.453+0000 7f06917fa700 1 -- 172.21.15.136:0/3183521598 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f068c01b3b0 con 0x7f06940cfa50 2023-06-23T19:01:10.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.454+0000 7f06917fa700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f067806ace0 0x7f067806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.454+0000 7f06917fa700 1 -- 172.21.15.136:0/3183521598 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f068c0892d0 con 0x7f06940cfa50 2023-06-23T19:01:10.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.454+0000 7f0698b9b700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f067806ace0 0x7f067806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.454+0000 7f0698b9b700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f067806ace0 0x7f067806d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06940cca00 tx=0x7f0688009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:10.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.458+0000 7f06917fa700 1 -- 172.21.15.136:0/3183521598 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06940b67a0 con 0x7f06940cfa50 2023-06-23T19:01:10.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.697+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06940b67a0 con 0x7f06940cfa50 2023-06-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.698+0000 7f06917fa700 1 -- 172.21.15.136:0/3183521598 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f06940b67a0 con 0x7f06940cfa50 2023-06-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:08.865463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f067806ace0 msgr2=0x7f067806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f067806ace0 0x7f067806d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06940cca00 tx=0x7f0688009040 comp rx=0 tx=0).stop 2023-06-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06940cfa50 msgr2=0x7f0694159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06940cfa50 0x7f0694159260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f068c00cb40 tx=0x7f068c00ce50 comp rx=0 tx=0).stop 2023-06-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 shutdown_connections 2023-06-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f067806ace0 0x7f067806d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06940cfa50 0x7f0694159260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f069406cb20 0x7f0694156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 --2- 172.21.15.136:0/3183521598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06940b1dc0 0x7f0694158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.700+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 >> 172.21.15.136:0/3183521598 conn(0x7f069409bbf0 msgr2=0x7f069406c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.701+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 shutdown_connections 2023-06-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.701+0000 7f0699b9d700 1 -- 172.21.15.136:0/3183521598 wait complete. 2023-06-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 7 2023-06-23T19:01:10.722 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:10.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.913+0000 7f6d84bff700 1 Processor -- start 2023-06-23T19:01:10.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.913+0000 7f6d84bff700 1 -- start start 2023-06-23T19:01:10.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.914+0000 7f6d84bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6d8015c570 0x7f6d800cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.914+0000 7f6d84bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d80160a50 0x7f6d800d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.914+0000 7f6d84bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d801610a0 con 0x7f6d800cd660 2023-06-23T19:01:10.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.914+0000 7f6d84bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8015d670 con 0x7f6d8015c570 2023-06-23T19:01:10.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.914+0000 7f6d84bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80160eb0 con 0x7f6d80160a50 2023-06-23T19:01:10.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.914+0000 7f6d7e59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6d8015c570 0x7f6d800cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.914+0000 7f6d7e59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6d8015c570 0x7f6d800cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46270/0 (socket says 172.21.15.136:46270) 2023-06-23T19:01:10.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.914+0000 7f6d7e59c700 1 -- 172.21.15.136:0/4050762010 learned_addr learned my addr 172.21.15.136:0/4050762010 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:10.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.915+0000 7f6d7ed9d700 1 --2- 172.21.15.136:0/4050762010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d80160a50 0x7f6d800d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.915+0000 7f6d7e59c700 1 -- 172.21.15.136:0/4050762010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d80160a50 msgr2=0x7f6d800d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:10.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.915+0000 7f6d7e59c700 1 --2- 172.21.15.136:0/4050762010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d80160a50 0x7f6d800d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.915+0000 7f6d7e59c700 1 -- 172.21.15.136:0/4050762010 >> v1:172.21.15.178:6789/0 conn(0x7f6d800cd660 legacy=0x7f6d80160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.915+0000 7f6d7e59c700 1 -- 172.21.15.136:0/4050762010 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8015da90 con 0x7f6d8015c570 2023-06-23T19:01:10.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.915+0000 7f6d7e59c700 1 --2- 172.21.15.136:0/4050762010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 0x7f6d800cd120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009920 tx=0x7f6d70009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4bfcb59c489ba6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:10.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.915+0000 7f6d7d59a700 1 -- 172.21.15.136:0/4050762010 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7000ba20 con 0x7f6d8015c570 2023-06-23T19:01:10.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.915+0000 7f6d7d59a700 1 -- 172.21.15.136:0/4050762010 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7000bb80 con 0x7f6d8015c570 2023-06-23T19:01:10.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.915+0000 7f6d7d59a700 1 -- 172.21.15.136:0/4050762010 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70009e70 con 0x7f6d8015c570 2023-06-23T19:01:10.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.916+0000 7f6d84bff700 1 -- 172.21.15.136:0/4050762010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 msgr2=0x7f6d800cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.916+0000 7f6d84bff700 1 --2- 172.21.15.136:0/4050762010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 0x7f6d800cd120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009920 tx=0x7f6d70009c30 comp rx=0 tx=0).stop 2023-06-23T19:01:10.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.916+0000 7f6d84bff700 1 -- 172.21.15.136:0/4050762010 shutdown_connections 2023-06-23T19:01:10.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.916+0000 7f6d84bff700 1 --2- 172.21.15.136:0/4050762010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 0x7f6d800cd120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.916+0000 7f6d84bff700 1 --2- 172.21.15.136:0/4050762010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d80160a50 0x7f6d800d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.916+0000 7f6d84bff700 1 -- 172.21.15.136:0/4050762010 >> 172.21.15.136:0/4050762010 conn(0x7f6d80071620 msgr2=0x7f6d800719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:10.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.916+0000 7f6d84bff700 1 -- 172.21.15.136:0/4050762010 shutdown_connections 2023-06-23T19:01:10.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.916+0000 7f6d84bff700 1 -- 172.21.15.136:0/4050762010 wait complete. 2023-06-23T19:01:10.924 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.918+0000 7f6d84bff700 1 Processor -- start 2023-06-23T19:01:10.924 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.918+0000 7f6d84bff700 1 -- start start 2023-06-23T19:01:10.924 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d84bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d800cd660 0x7f6d800c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.924 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d84bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 0x7f6d80149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.924 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d84bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d80160a50 0x7f6d801e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.925 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d84bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8014a4b0 con 0x7f6d8015c570 2023-06-23T19:01:10.925 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d84bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d801e6dd0 con 0x7f6d80160a50 2023-06-23T19:01:10.925 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d84bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80157420 con 0x7f6d800cd660 2023-06-23T19:01:10.925 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 0x7f6d80149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.925 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 0x7f6d80149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46282/0 (socket says 172.21.15.136:46282) 2023-06-23T19:01:10.925 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7dd9b700 1 -- 172.21.15.136:0/3032704657 learned_addr learned my addr 172.21.15.136:0/3032704657 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:10.925 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7e59c700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d800cd660 0x7f6d800c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.925 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7ed9d700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d80160a50 0x7f6d801e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.926 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7dd9b700 1 -- 172.21.15.136:0/3032704657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d800cd660 msgr2=0x7f6d800c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.926 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7dd9b700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d800cd660 0x7f6d800c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.926 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7dd9b700 1 -- 172.21.15.136:0/3032704657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d80160a50 msgr2=0x7f6d801e5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:10.926 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7dd9b700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d80160a50 0x7f6d801e5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:10.926 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.919+0000 7f6d7dd9b700 1 -- 172.21.15.136:0/3032704657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70009550 con 0x7f6d8015c570 2023-06-23T19:01:10.926 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.920+0000 7f6d7dd9b700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 0x7f6d80149f70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c4e0 tx=0x7f6d7400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:10.926 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.920+0000 7f6d6effd700 1 -- 172.21.15.136:0/3032704657 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d740052d0 con 0x7f6d8015c570 2023-06-23T19:01:10.927 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.920+0000 7f6d6effd700 1 -- 172.21.15.136:0/3032704657 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d74005430 con 0x7f6d8015c570 2023-06-23T19:01:10.927 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.920+0000 7f6d6effd700 1 -- 172.21.15.136:0/3032704657 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d740038c0 con 0x7f6d8015c570 2023-06-23T19:01:10.927 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.920+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d801e6af0 con 0x7f6d8015c570 2023-06-23T19:01:10.927 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.920+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d800c6a10 con 0x7f6d8015c570 2023-06-23T19:01:10.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.921+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d800ce3d0 con 0x7f6d8015c570 2023-06-23T19:01:10.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.922+0000 7f6d6effd700 1 -- 172.21.15.136:0/3032704657 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d74003a20 con 0x7f6d8015c570 2023-06-23T19:01:10.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.923+0000 7f6d6effd700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f6d6006ace0 0x7f6d6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:10.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.923+0000 7f6d6effd700 1 -- 172.21.15.136:0/3032704657 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6d74088ae0 con 0x7f6d8015c570 2023-06-23T19:01:10.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.923+0000 7f6d7e59c700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f6d6006ace0 0x7f6d6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:10.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.924+0000 7f6d7e59c700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f6d6006ace0 0x7f6d6006d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d70000c00 tx=0x7f6d70008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:10.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:10.928+0000 7f6d6effd700 1 -- 172.21.15.136:0/3032704657 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6d74053890 con 0x7f6d8015c570 2023-06-23T19:01:11.131 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.128+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d800b5150 con 0x7f6d8015c570 2023-06-23T19:01:11.132 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.129+0000 7f6d6effd700 1 -- 172.21.15.136:0/3032704657 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f6d74056eb0 con 0x7f6d8015c570 2023-06-23T19:01:11.133 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:11.133 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:11.135 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f6d6006ace0 msgr2=0x7f6d6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.135 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f6d6006ace0 0x7f6d6006d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d70000c00 tx=0x7f6d70008030 comp rx=0 tx=0).stop 2023-06-23T19:01:11.135 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 msgr2=0x7f6d80149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.135 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 0x7f6d80149f70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c4e0 tx=0x7f6d7400c7f0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.136 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 shutdown_connections 2023-06-23T19:01:11.136 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f6d6006ace0 0x7f6d6006d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.136 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d80160a50 0x7f6d801e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.136 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d800cd660 0x7f6d800c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.136 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 --2- 172.21.15.136:0/3032704657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d8015c570 0x7f6d80149f70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.136 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 >> 172.21.15.136:0/3032704657 conn(0x7f6d80071620 msgr2=0x7f6d800d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:11.136 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 shutdown_connections 2023-06-23T19:01:11.137 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.131+0000 7f6d84bff700 1 -- 172.21.15.136:0/3032704657 wait complete. 2023-06-23T19:01:11.555 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-23T19:01:04.348357+0000', 'modified': '2023-06-23T19:01:08.865463+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/329757975', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 329757975}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 329757975}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-06-23T19:01:11.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-23T19:01:11.556 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-23T19:01:11.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.752+0000 7f5e789ff700 1 Processor -- start 2023-06-23T19:01:11.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.752+0000 7f5e789ff700 1 -- start start 2023-06-23T19:01:11.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.753+0000 7f5e789ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5e74160a50 0x7f5e741674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.753+0000 7f5e789ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e74160e70 con 0x7f5e740cd830 2023-06-23T19:01:11.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.753+0000 7f5e789ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e741610a0 con 0x7f5e7415c570 2023-06-23T19:01:11.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.753+0000 7f5e789ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7415d670 con 0x7f5e74160a50 2023-06-23T19:01:11.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.753+0000 7f5e72d9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5e74160a50 0x7f5e741674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.753+0000 7f5e72d9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5e74160a50 0x7f5e741674d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46292/0 (socket says 172.21.15.136:46292) 2023-06-23T19:01:11.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.753+0000 7f5e72d9d700 1 -- 172.21.15.136:0/2951012498 learned_addr learned my addr 172.21.15.136:0/2951012498 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:11.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.754+0000 7f5e72d9d700 1 -- 172.21.15.136:0/2951012498 >> v1:172.21.15.178:6789/0 conn(0x7f5e7415c570 legacy=0x7f5e740cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:11.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.754+0000 7f5e72d9d700 1 -- 172.21.15.136:0/2951012498 >> v1:172.21.15.136:6789/0 conn(0x7f5e740cd830 legacy=0x7f5e74160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.754+0000 7f5e72d9d700 1 -- 172.21.15.136:0/2951012498 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7415da90 con 0x7f5e74160a50 2023-06-23T19:01:11.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.754+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/2951012498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 0x7f5e741674d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009e50 tx=0x7f5e6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c83d1e2129a7fc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:11.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.754+0000 7f5e71d9b700 1 -- 172.21.15.136:0/2951012498 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00e070 con 0x7f5e74160a50 2023-06-23T19:01:11.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.754+0000 7f5e71d9b700 1 -- 172.21.15.136:0/2951012498 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c003a20 con 0x7f5e74160a50 2023-06-23T19:01:11.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.754+0000 7f5e71d9b700 1 -- 172.21.15.136:0/2951012498 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c003dd0 con 0x7f5e74160a50 2023-06-23T19:01:11.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.754+0000 7f5e789ff700 1 -- 172.21.15.136:0/2951012498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 msgr2=0x7f5e741674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.755+0000 7f5e789ff700 1 --2- 172.21.15.136:0/2951012498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 0x7f5e741674d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009e50 tx=0x7f5e6c00b330 comp rx=0 tx=0).stop 2023-06-23T19:01:11.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.755+0000 7f5e789ff700 1 -- 172.21.15.136:0/2951012498 shutdown_connections 2023-06-23T19:01:11.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.755+0000 7f5e789ff700 1 --2- 172.21.15.136:0/2951012498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 0x7f5e741674d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.755+0000 7f5e789ff700 1 -- 172.21.15.136:0/2951012498 >> 172.21.15.136:0/2951012498 conn(0x7f5e74071620 msgr2=0x7f5e740719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.755+0000 7f5e789ff700 1 -- 172.21.15.136:0/2951012498 shutdown_connections 2023-06-23T19:01:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.755+0000 7f5e789ff700 1 -- 172.21.15.136:0/2951012498 wait complete. 2023-06-23T19:01:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.756+0000 7f5e789ff700 1 Processor -- start 2023-06-23T19:01:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.757+0000 7f5e789ff700 1 -- start start 2023-06-23T19:01:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.757+0000 7f5e789ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e740cd830 0x7f5e7415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.757+0000 7f5e789ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7415c570 0x7f5e74149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.757+0000 7f5e789ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 0x7f5e7414a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e789ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741e8180 con 0x7f5e74160a50 2023-06-23T19:01:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e789ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740c8970 con 0x7f5e7415c570 2023-06-23T19:01:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e789ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740b5f00 con 0x7f5e740cd830 2023-06-23T19:01:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e72d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 0x7f5e7414a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e72d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 0x7f5e7414a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46308/0 (socket says 172.21.15.136:46308) 2023-06-23T19:01:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e72d9d700 1 -- 172.21.15.136:0/2808945698 learned_addr learned my addr 172.21.15.136:0/2808945698 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e7259c700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e740cd830 0x7f5e7415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e6bfff700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7415c570 0x7f5e74149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e72d9d700 1 -- 172.21.15.136:0/2808945698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e740cd830 msgr2=0x7f5e7415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e740cd830 0x7f5e7415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e72d9d700 1 -- 172.21.15.136:0/2808945698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7415c570 msgr2=0x7f5e74149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7415c570 0x7f5e74149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e72d9d700 1 -- 172.21.15.136:0/2808945698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009b30 con 0x7f5e74160a50 2023-06-23T19:01:11.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.758+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 0x7f5e7414a0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c015040 tx=0x7f5e6c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:11.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.759+0000 7f5e6affd700 1 -- 172.21.15.136:0/2808945698 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c004440 con 0x7f5e74160a50 2023-06-23T19:01:11.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.759+0000 7f5e6affd700 1 -- 172.21.15.136:0/2808945698 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0045c0 con 0x7f5e74160a50 2023-06-23T19:01:11.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.759+0000 7f5e789ff700 1 -- 172.21.15.136:0/2808945698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e741e7570 con 0x7f5e74160a50 2023-06-23T19:01:11.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.759+0000 7f5e6affd700 1 -- 172.21.15.136:0/2808945698 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c004970 con 0x7f5e74160a50 2023-06-23T19:01:11.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.759+0000 7f5e789ff700 1 -- 172.21.15.136:0/2808945698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e741e7b30 con 0x7f5e74160a50 2023-06-23T19:01:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.761+0000 7f5e6affd700 1 -- 172.21.15.136:0/2808945698 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e6c012430 con 0x7f5e74160a50 2023-06-23T19:01:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.762+0000 7f5e6affd700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e5406ace0 0x7f5e5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.762+0000 7f5e6affd700 1 -- 172.21.15.136:0/2808945698 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e6c08adb0 con 0x7f5e74160a50 2023-06-23T19:01:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.762+0000 7f5e7259c700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e5406ace0 0x7f5e5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.762+0000 7f5e7259c700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e5406ace0 0x7f5e5406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e64004f30 tx=0x7f5e64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.764+0000 7f5e8c3d7b80 1 Processor -- start 2023-06-23T19:01:11.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.764+0000 7f5e8c3d7b80 1 -- start start 2023-06-23T19:01:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e5bf50 0x55f950e5c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950e82820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e59740 0x55f950e86440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950d60c60 con 0x55f950e5bf50 2023-06-23T19:01:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950db39f0 con 0x55f950e59740 2023-06-23T19:01:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f950dace80 con 0x55f950e83d80 2023-06-23T19:01:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e7259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e5bf50 0x55f950e5c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e7259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e5bf50 0x55f950e5c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46314/0 (socket says 172.21.15.136:46314) 2023-06-23T19:01:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e7259c700 1 -- 172.21.15.136:0/3260484886 learned_addr learned my addr 172.21.15.136:0/3260484886 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e59740 0x55f950e86440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e6bfff700 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950e82820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e7259c700 1 -- 172.21.15.136:0/3260484886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 msgr2=0x55f950e82820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e7259c700 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950e82820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e7259c700 1 -- 172.21.15.136:0/3260484886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e59740 msgr2=0x55f950e86440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e7259c700 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e59740 0x55f950e86440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e7259c700 1 -- 172.21.15.136:0/3260484886 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f950c2e5e0 con 0x55f950e5bf50 2023-06-23T19:01:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.765+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e59740 0x55f950e86440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.766+0000 7f5e7259c700 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e5bf50 0x55f950e5c320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e64007bb0 tx=0x7f5e64011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce72e40e782fab server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.766+0000 7f5e53fff700 1 -- 172.21.15.136:0/3260484886 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640135f0 con 0x55f950e5bf50 2023-06-23T19:01:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.766+0000 7f5e53fff700 1 -- 172.21.15.136:0/3260484886 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64013750 con 0x55f950e5bf50 2023-06-23T19:01:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.766+0000 7f5e53fff700 1 -- 172.21.15.136:0/3260484886 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64013ac0 con 0x55f950e5bf50 2023-06-23T19:01:11.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.767+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3260484886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e5bf50 msgr2=0x55f950e5c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.767+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e5bf50 0x55f950e5c320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e64007bb0 tx=0x7f5e64011000 comp rx=0 tx=0).stop 2023-06-23T19:01:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.767+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3260484886 shutdown_connections 2023-06-23T19:01:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.767+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e59740 0x55f950e86440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.767+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e5bf50 0x55f950e5c320 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.767+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3260484886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950e82820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.767+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3260484886 >> 172.21.15.136:0/3260484886 conn(0x55f950e50fc0 msgr2=0x55f950ea11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.767+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3260484886 shutdown_connections 2023-06-23T19:01:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.767+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3260484886 wait complete. 2023-06-23T19:01:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.768+0000 7f5e8c3d7b80 1 -- start start 2023-06-23T19:01:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.768+0000 7f5e8c3d7b80 1 Processor -- start 2023-06-23T19:01:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eb03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e5bf50 0x55f950ea4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950ea2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950d4ca70 con 0x55f950e59740 2023-06-23T19:01:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950d4c770 con 0x55f950e5bf50 2023-06-23T19:01:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f950c308d0 con 0x55f950e83d80 2023-06-23T19:01:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e8c3d7b80 10 client.0 _ll_register_callbacks cb 0x55f950d52210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T19:01:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e7259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eb03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e7259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eb03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46318/0 (socket says 172.21.15.136:46318) 2023-06-23T19:01:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e7259c700 1 -- 172.21.15.136:0/3716869682 learned_addr learned my addr 172.21.15.136:0/3716869682 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950ea2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e7259c700 1 -- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 msgr2=0x55f950ea2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e7259c700 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950ea2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e7259c700 1 -- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e5bf50 msgr2=0x55f950ea4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e7259c700 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e5bf50 0x55f950ea4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.769+0000 7f5e7259c700 1 -- 172.21.15.136:0/3716869682 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6400f040 con 0x55f950e59740 2023-06-23T19:01:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e7259c700 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eb03a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e64007b80 tx=0x7f5e64003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4a5cab86ebdee0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e517fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-06-23T19:01:11.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e517fa700 1 -- 172.21.15.136:0/3716869682 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640135f0 con 0x55f950e59740 2023-06-23T19:01:11.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e517fa700 1 -- 172.21.15.136:0/3716869682 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e64006860 con 0x55f950e59740 2023-06-23T19:01:11.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3716869682 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f950e4e780 con 0x55f950e59740 2023-06-23T19:01:11.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e517fa700 1 -- 172.21.15.136:0/3716869682 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e64013e50 con 0x55f950e59740 2023-06-23T19:01:11.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e8c3d7b80 10 client.4440 fetch_fsmap learned FSMap version 7 2023-06-23T19:01:11.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3716869682 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f950bdad90 con 0x55f950e59740 2023-06-23T19:01:11.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e517fa700 1 -- 172.21.15.136:0/3716869682 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f950e4e780 con 0x55f950e59740 2023-06-23T19:01:11.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e517fa700 1 -- 172.21.15.136:0/3716869682 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5e6402f020 con 0x55f950e59740 2023-06-23T19:01:11.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e8c3d7b80 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2023-06-23T19:01:11.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e8c3d7b80 10 client.4440 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-23T19:01:11.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e8c3d7b80 20 client.4440 populate_metadata read hostname 'smithi136' 2023-06-23T19:01:11.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x55f950e850a0 0x55f950e85470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e8c3d7b80 4 client.4440 mds_command: new command op to 4296 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-23T19:01:11.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.770+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3716869682 --> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f950da5e60 con 0x55f950e850a0 2023-06-23T19:01:11.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.771+0000 7f5e6bfff700 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x55f950e850a0 0x55f950e85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.771+0000 7f5e517fa700 10 client.4440 ms_handle_connect on v2:172.21.15.178:6834/329757975 2023-06-23T19:01:11.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.771+0000 7f5e6bfff700 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x55f950e850a0 0x55f950e85470 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca9e619d1dbeeeb5 server_cookie=874bd9c0ec5d0b1d in_seq=0 out_seq=0 2023-06-23T19:01:11.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.772+0000 7f5e517fa700 1 -- 172.21.15.136:0/3716869682 <== mds.0 v2:172.21.15.178:6834/329757975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f950da5e60 con 0x55f950e850a0 2023-06-23T19:01:11.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.772+0000 7f5e517fa700 10 client.4440 handle_command_reply: tid=0 2023-06-23T19:01:11.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.772+0000 7f5e8c3d7b80 1 client.4440 shutdown 2023-06-23T19:01:11.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.772+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3716869682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 msgr2=0x55f950eb03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.772+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eb03a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e64007b80 tx=0x7f5e64003780 comp rx=0 tx=0).stop 2023-06-23T19:01:11.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3716869682 shutdown_connections 2023-06-23T19:01:11.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x55f950e850a0 0x55f950e85470 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950ea2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eb03a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/3716869682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e5bf50 0x55f950ea4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3716869682 >> 172.21.15.136:0/3716869682 conn(0x55f950e50fc0 msgr2=0x55f950e7ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:11.785 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e517fa700 0 client.4440 ms_handle_reset on v2:172.21.15.178:6834/329757975 2023-06-23T19:01:11.785 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3716869682 shutdown_connections 2023-06-23T19:01:11.785 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/3716869682 wait complete. 2023-06-23T19:01:11.785 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.773+0000 7f5e8c3d7b80 20 client.4440 trim_cache size 0 max 16384 2023-06-23T19:01:11.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.791+0000 7f5e8c3d7b80 1 Processor -- start 2023-06-23T19:01:11.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.791+0000 7f5e8c3d7b80 1 -- start start 2023-06-23T19:01:11.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eaffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e5bf50 0x55f950e82d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950e832a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950e59420 con 0x55f950e59740 2023-06-23T19:01:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950e8a4c0 con 0x55f950e5bf50 2023-06-23T19:01:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f950ea1260 con 0x55f950e83d80 2023-06-23T19:01:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e7259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eaffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e7259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eaffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46334/0 (socket says 172.21.15.136:46334) 2023-06-23T19:01:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e7259c700 1 -- 172.21.15.136:0/98969324 learned_addr learned my addr 172.21.15.136:0/98969324 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e6bfff700 1 --2- 172.21.15.136:0/98969324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e5bf50 0x55f950e82d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/98969324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950e832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e7259c700 1 -- 172.21.15.136:0/98969324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 msgr2=0x55f950e832a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:11.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e7259c700 1 --2- 172.21.15.136:0/98969324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950e832a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e7259c700 1 -- 172.21.15.136:0/98969324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e5bf50 msgr2=0x55f950e82d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:11.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e7259c700 1 --2- 172.21.15.136:0/98969324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e5bf50 0x55f950e82d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.792+0000 7f5e7259c700 1 -- 172.21.15.136:0/98969324 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f950bc3c10 con 0x55f950e59740 2023-06-23T19:01:11.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e7259c700 1 --2- 172.21.15.136:0/98969324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eaffc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5e64015d90 tx=0x7f5e64029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9359654456abb5fd server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:11.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e68ff9700 1 -- 172.21.15.136:0/98969324 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64013cd0 con 0x55f950e59740 2023-06-23T19:01:11.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e68ff9700 1 -- 172.21.15.136:0/98969324 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64019030 con 0x55f950e59740 2023-06-23T19:01:11.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e68ff9700 1 -- 172.21.15.136:0/98969324 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64006a60 con 0x55f950e59740 2023-06-23T19:01:11.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/98969324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 msgr2=0x55f950eaffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/98969324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eaffc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5e64015d90 tx=0x7f5e64029000 comp rx=0 tx=0).stop 2023-06-23T19:01:11.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/98969324 shutdown_connections 2023-06-23T19:01:11.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/98969324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e83d80 0x55f950e832a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/98969324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950eaffc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/98969324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e5bf50 0x55f950e82d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.793+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/98969324 >> 172.21.15.136:0/98969324 conn(0x55f950e50fc0 msgr2=0x55f950e5d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:11.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.794+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/98969324 shutdown_connections 2023-06-23T19:01:11.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.794+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/98969324 wait complete. 2023-06-23T19:01:11.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.794+0000 7f5e8c3d7b80 1 -- start start 2023-06-23T19:01:11.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.794+0000 7f5e8c3d7b80 1 Processor -- start 2023-06-23T19:01:11.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.795+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950e82760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.795+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e5bf50 0x55f950e5b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.795+0000 7f5e8c3d7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e83d80 0x55f950e5b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.795+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950f07aa0 con 0x55f950e59740 2023-06-23T19:01:11.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.795+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950e7e8a0 con 0x55f950e83d80 2023-06-23T19:01:11.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.795+0000 7f5e8c3d7b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f950e9e2c0 con 0x55f950e5bf50 2023-06-23T19:01:11.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.795+0000 7f5e8c3d7b80 10 client.0 _ll_register_callbacks cb 0x7f5e64015620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T19:01:11.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e7259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950e82760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e7259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950e82760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46344/0 (socket says 172.21.15.136:46344) 2023-06-23T19:01:11.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e7259c700 1 -- 172.21.15.136:0/2561602928 learned_addr learned my addr 172.21.15.136:0/2561602928 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:11.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e83d80 0x55f950e5b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e6bfff700 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e5bf50 0x55f950e5b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e7259c700 1 -- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e5bf50 msgr2=0x55f950e5b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:11.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e7259c700 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e5bf50 0x55f950e5b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e7259c700 1 -- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e83d80 msgr2=0x55f950e5b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:11.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e7259c700 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e83d80 0x55f950e5b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e7259c700 1 -- 172.21.15.136:0/2561602928 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f950bdad90 con 0x55f950e59740 2023-06-23T19:01:11.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e72d9d700 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e83d80 0x55f950e5b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:11.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e6bfff700 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e5bf50 0x55f950e5b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:11.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e7259c700 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950e82760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e64015d90 tx=0x7f5e64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b1bee8d0147c5c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:11.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e517fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-06-23T19:01:11.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e517fa700 1 -- 172.21.15.136:0/2561602928 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64006e40 con 0x55f950e59740 2023-06-23T19:01:11.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.796+0000 7f5e517fa700 1 -- 172.21.15.136:0/2561602928 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e64007150 con 0x55f950e59740 2023-06-23T19:01:11.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/2561602928 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e64013750 con 0x55f950e59740 2023-06-23T19:01:11.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e517fa700 1 -- 172.21.15.136:0/2561602928 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e64006fa0 con 0x55f950e59740 2023-06-23T19:01:11.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e8c3d7b80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-06-23T19:01:11.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/2561602928 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f950c01200 con 0x55f950e59740 2023-06-23T19:01:11.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e517fa700 1 -- 172.21.15.136:0/2561602928 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64013750 con 0x55f950e59740 2023-06-23T19:01:11.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e517fa700 1 -- 172.21.15.136:0/2561602928 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5e64015ab0 con 0x55f950e59740 2023-06-23T19:01:11.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e8c3d7b80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-06-23T19:01:11.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e8c3d7b80 10 client.4446 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-23T19:01:11.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e8c3d7b80 20 client.4446 populate_metadata read hostname 'smithi136' 2023-06-23T19:01:11.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x55f950e9d9f0 0x55f950f06dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:11.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e8c3d7b80 4 client.4446 mds_command: new command op to 4296 tid=0[{"prefix": "status"}] 2023-06-23T19:01:11.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/2561602928 --> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f950d68000 con 0x55f950e9d9f0 2023-06-23T19:01:11.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.797+0000 7f5e6bfff700 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x55f950e9d9f0 0x55f950f06dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:11.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e517fa700 10 client.4446 ms_handle_connect on v2:172.21.15.178:6834/329757975 2023-06-23T19:01:11.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e6bfff700 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x55f950e9d9f0 0x55f950f06dc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d3940315e8e55 server_cookie=e74e26025a0dc1f9 in_seq=0 out_seq=0 2023-06-23T19:01:11.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e517fa700 1 -- 172.21.15.136:0/2561602928 <== mds.0 v2:172.21.15.178:6834/329757975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f950d68000 con 0x55f950e9d9f0 2023-06-23T19:01:11.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e517fa700 10 client.4446 handle_command_reply: tid=0 2023-06-23T19:01:11.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e8c3d7b80 1 client.4446 shutdown 2023-06-23T19:01:11.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/2561602928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 msgr2=0x55f950e82760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950e82760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e64015d90 tx=0x7f5e64014000 comp rx=0 tx=0).stop 2023-06-23T19:01:11.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/2561602928 shutdown_connections 2023-06-23T19:01:11.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x55f950e9d9f0 0x55f950f06dc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f950e83d80 0x55f950e5b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f950e59740 0x55f950e82760 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e517fa700 0 client.4446 ms_handle_reset on v2:172.21.15.178:6834/329757975 2023-06-23T19:01:11.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e8c3d7b80 1 --2- 172.21.15.136:0/2561602928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f950e5bf50 0x55f950e5b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.798+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/2561602928 >> 172.21.15.136:0/2561602928 conn(0x55f950e50fc0 msgr2=0x55f950e5d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:11.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/2561602928 shutdown_connections 2023-06-23T19:01:11.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e8c3d7b80 1 -- 172.21.15.136:0/2561602928 wait complete. 2023-06-23T19:01:11.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e8c3d7b80 20 client.4446 trim_cache size 0 max 16384 2023-06-23T19:01:11.812 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2023-06-23T19:01:11.812 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "ad363bec-53b9-481a-9d11-1e4839eb0e65", 2023-06-23T19:01:11.812 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 0, 2023-06-23T19:01:11.813 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4296, 2023-06-23T19:01:11.813 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2023-06-23T19:01:11.813 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2023-06-23T19:01:11.813 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2023-06-23T19:01:11.813 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 7.4482845800000002, 2023-06-23T19:01:11.813 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 7, 2023-06-23T19:01:11.813 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 29, 2023-06-23T19:01:11.814 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 28, 2023-06-23T19:01:11.814 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 13.573961656 2023-06-23T19:01:11.814 INFO:teuthology.orchestra.run.smithi136.stdout:} 2023-06-23T19:01:11.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 -- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e5406ace0 msgr2=0x7f5e5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e5406ace0 0x7f5e5406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e64004f30 tx=0x7f5e64009040 comp rx=0 tx=0).stop 2023-06-23T19:01:11.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 -- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 msgr2=0x7f5e7414a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:11.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 0x7f5e7414a0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c015040 tx=0x7f5e6c004ad0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 -- 172.21.15.136:0/2808945698 shutdown_connections 2023-06-23T19:01:11.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e5406ace0 0x7f5e5406d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e74160a50 0x7f5e7414a0a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e740cd830 0x7f5e7415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 --2- 172.21.15.136:0/2808945698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7415c570 0x7f5e74149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:11.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 -- 172.21.15.136:0/2808945698 >> 172.21.15.136:0/2808945698 conn(0x7f5e74071620 msgr2=0x7f5e7415e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:11.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 -- 172.21.15.136:0/2808945698 shutdown_connections 2023-06-23T19:01:11.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:11.799+0000 7f5e789ff700 1 -- 172.21.15.136:0/2808945698 wait complete. 2023-06-23T19:01:11.820 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T19:01:11.821 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-23T19:01:11.821 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.012+0000 7f4b4b3ff700 1 Processor -- start 2023-06-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.013+0000 7f4b4b3ff700 1 -- start start 2023-06-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4b3ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4b4415c570 0x7f4b440cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4b3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 0x7f4b440d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4b3ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b441610a0 con 0x7f4b440cd660 2023-06-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4b3ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4415d670 con 0x7f4b4415c570 2023-06-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4b3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b44160eb0 con 0x7f4b44160a50 2023-06-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4919b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4b4415c570 0x7f4b440cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4899a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f4b440cd660 0x7f4b44160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41294/0 (socket says 172.21.15.136:41294) 2023-06-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4899a700 1 -- 172.21.15.136:0/450580933 learned_addr learned my addr 172.21.15.136:0/450580933 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4999c700 1 --2- 172.21.15.136:0/450580933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 0x7f4b440d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4919b700 1 -- 172.21.15.136:0/450580933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 msgr2=0x7f4b440d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4919b700 1 --2- 172.21.15.136:0/450580933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 0x7f4b440d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4919b700 1 -- 172.21.15.136:0/450580933 >> v1:172.21.15.136:6789/0 conn(0x7f4b440cd660 legacy=0x7f4b44160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b4919b700 1 -- 172.21.15.136:0/450580933 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4415da90 con 0x7f4b4415c570 2023-06-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.014+0000 7f4b3bfff700 1 -- 172.21.15.136:0/450580933 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338307907 0 0) 0x7f4b441610a0 con 0x7f4b440cd660 2023-06-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.015+0000 7f4b4919b700 1 --2- 172.21.15.136:0/450580933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b4415c570 0x7f4b440cd120 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009870 tx=0x7f4b40009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c4745874544694 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.015+0000 7f4b3bfff700 1 -- 172.21.15.136:0/450580933 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40011830 con 0x7f4b4415c570 2023-06-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.015+0000 7f4b3bfff700 1 -- 172.21.15.136:0/450580933 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40011990 con 0x7f4b4415c570 2023-06-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.015+0000 7f4b3bfff700 1 -- 172.21.15.136:0/450580933 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40011d20 con 0x7f4b4415c570 2023-06-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.015+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/450580933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b4415c570 msgr2=0x7f4b440cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.015+0000 7f4b4b3ff700 1 --2- 172.21.15.136:0/450580933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b4415c570 0x7f4b440cd120 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009870 tx=0x7f4b40009b80 comp rx=0 tx=0).stop 2023-06-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.016+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/450580933 shutdown_connections 2023-06-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.016+0000 7f4b4b3ff700 1 --2- 172.21.15.136:0/450580933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b4415c570 0x7f4b440cd120 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.016+0000 7f4b4b3ff700 1 --2- 172.21.15.136:0/450580933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 0x7f4b440d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.016+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/450580933 >> 172.21.15.136:0/450580933 conn(0x7f4b44071620 msgr2=0x7f4b440719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.016+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/450580933 shutdown_connections 2023-06-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.016+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/450580933 wait complete. 2023-06-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.017+0000 7f4b4b3ff700 1 Processor -- start 2023-06-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.017+0000 7f4b4b3ff700 1 -- start start 2023-06-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.018+0000 7f4b4b3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b440cd660 0x7f4b441f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.018+0000 7f4b4b3ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b4415c570 0x7f4b44156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.018+0000 7f4b4b3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 0x7f4b44156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.018+0000 7f4b4b3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b440b26d0 con 0x7f4b440cd660 2023-06-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.018+0000 7f4b4b3ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b440b29b0 con 0x7f4b4415c570 2023-06-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.018+0000 7f4b4b3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b440b2c90 con 0x7f4b44160a50 2023-06-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4919b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b440cd660 0x7f4b441f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4919b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b440cd660 0x7f4b441f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46374/0 (socket says 172.21.15.136:46374) 2023-06-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4919b700 1 -- 172.21.15.136:0/2740998893 learned_addr learned my addr 172.21.15.136:0/2740998893 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4899a700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b4415c570 0x7f4b44156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4999c700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 0x7f4b44156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4919b700 1 -- 172.21.15.136:0/2740998893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 msgr2=0x7f4b44156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4919b700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 0x7f4b44156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4919b700 1 -- 172.21.15.136:0/2740998893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b4415c570 msgr2=0x7f4b44156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4919b700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b4415c570 0x7f4b44156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4919b700 1 -- 172.21.15.136:0/2740998893 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b400094a0 con 0x7f4b440cd660 2023-06-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4919b700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b440cd660 0x7f4b441f1630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4b400097c0 tx=0x7f4b40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b39ffb700 1 -- 172.21.15.136:0/2740998893 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b400036a0 con 0x7f4b440cd660 2023-06-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b39ffb700 1 -- 172.21.15.136:0/2740998893 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4001f070 con 0x7f4b440cd660 2023-06-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b39ffb700 1 -- 172.21.15.136:0/2740998893 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40003a60 con 0x7f4b440cd660 2023-06-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.019+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b440b2f70 con 0x7f4b440cd660 2023-06-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.020+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b441f1b70 con 0x7f4b440cd660 2023-06-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.021+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b44073910 con 0x7f4b440cd660 2023-06-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.022+0000 7f4b39ffb700 1 -- 172.21.15.136:0/2740998893 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b40003bc0 con 0x7f4b440cd660 2023-06-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.022+0000 7f4b39ffb700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b2806ace0 0x7f4b2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.023+0000 7f4b39ffb700 1 -- 172.21.15.136:0/2740998893 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b40021070 con 0x7f4b440cd660 2023-06-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.023+0000 7f4b4899a700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b2806ace0 0x7f4b2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.023+0000 7f4b4899a700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b2806ace0 0x7f4b2806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b440b81c0 tx=0x7f4b34007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.027+0000 7f4b39ffb700 1 -- 172.21.15.136:0/2740998893 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b40055da0 con 0x7f4b440cd660 2023-06-23T19:01:12.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.265+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b440b5360 con 0x7f4b440cd660 2023-06-23T19:01:12.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.266+0000 7f4b39ffb700 1 -- 172.21.15.136:0/2740998893 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4b40015070 con 0x7f4b440cd660 2023-06-23T19:01:12.270 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T19:01:12.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b2806ace0 msgr2=0x7f4b2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:12.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b2806ace0 0x7f4b2806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b440b81c0 tx=0x7f4b34007be0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b440cd660 msgr2=0x7f4b441f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:12.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b440cd660 0x7f4b441f1630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4b400097c0 tx=0x7f4b40004750 comp rx=0 tx=0).stop 2023-06-23T19:01:12.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 shutdown_connections 2023-06-23T19:01:12.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b2806ace0 0x7f4b2806d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b44160a50 0x7f4b44156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b440cd660 0x7f4b441f1630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 --2- 172.21.15.136:0/2740998893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b4415c570 0x7f4b44156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:12.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 >> 172.21.15.136:0/2740998893 conn(0x7f4b44071620 msgr2=0x7f4b440d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:12.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.268+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 shutdown_connections 2023-06-23T19:01:12.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:12.269+0000 7f4b4b3ff700 1 -- 172.21.15.136:0/2740998893 wait complete. 2023-06-23T19:01:12.290 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-23T19:01:12.290 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T19:01:12.290 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2023-06-23T19:01:12.290 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-23T19:01:12.291 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-23T19:01:12.291 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-23T19:01:12.291 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T19:01:12.291 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T19:01:12.292 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-23T19:01:12.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:12.292 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2023-06-23T19:01:12.334 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:01:12.334 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-06-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2023-06-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:12.336 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:12.336 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2023-06-23T19:01:12.336 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:12.336 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:12.336 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T19:01:12.336 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:12.336 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-23T19:01:12.337 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42092sec preferred_lft 42092sec 2023-06-23T19:01:12.337 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::535c:5530:7d0:e32d/64 scope link noprefixroute 2023-06-23T19:01:12.337 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:12.338 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-23T19:01:12.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:12.339 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:12.339 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:12.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2023-06-23T19:01:12.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2023-06-23T19:01:12.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2023-06-23T19:01:12.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-23T19:01:12.340 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:12.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:12.789 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T19:01:12.858 INFO:teuthology.orchestra.run.smithi136.stdout:1 2023-06-23T19:01:12.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:12.861 DEBUG:teuthology.orchestra.run.smithi136:> route 2023-06-23T19:01:12.917 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2023-06-23T19:01:12.917 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T19:01:12.918 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T19:01:12.918 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T19:01:12.918 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T19:01:12.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:12.919 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:12.920 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:12.920 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T19:01:12.920 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T19:01:12.920 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T19:01:12.921 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:13.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:13.590 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-06-23T19:01:13.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:13.633 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2023-06-23T19:01:13.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:13.718 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:13.718 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:13.719 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-23T19:01:13.720 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-23T19:01:13.720 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:13.896 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-23T19:01:13.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:13.898 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:13.898 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:13.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-23T19:01:13.900 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-23T19:01:13.900 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-23T19:01:13.901 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-23T19:01:13.901 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-23T19:01:13.902 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:14.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:14.171 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:14.171 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:14.172 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2023-06-23T19:01:14.172 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2023-06-23T19:01:14.172 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:14.350 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-23T19:01:14.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:14.351 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-23T19:01:14.393 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-23T19:01:14.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:14.394 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-23T19:01:14.475 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2023-06-23T19:01:14.582 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T19:01:14.583 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T19:01:14.649 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T19:01:14.651 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T19:01:14.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:14.652 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2023-06-23T19:01:14.695 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-23T19:01:14.696 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-23T19:01:14.741 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2023-06-23T19:01:14.811 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T19:01:14.812 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T19:01:14.881 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T19:01:14.884 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T19:01:14.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:14.885 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2023-06-23T19:01:14.914 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:2023-06-23T19:01:14.910+0000 7f21ff5d25c0 -1 init, newargv = 0x556abf183630 newargc=15 2023-06-23T19:01:14.914 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:ceph-fuse[136152]: starting ceph client 2023-06-23T19:01:14.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:ceph-fuse[136152]: starting fuse 2023-06-23T19:01:14.930 INFO:teuthology.orchestra.run.smithi136.stdout:42 2023-06-23T19:01:14.930 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-06-23T19:01:14.931 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-23T19:01:14.931 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2023-06-23T19:01:14.931 DEBUG:teuthology.orchestra.run.smithi136:> import re 2023-06-23T19:01:14.932 DEBUG:teuthology.orchestra.run.smithi136:> import os 2023-06-23T19:01:14.932 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2023-06-23T19:01:14.932 DEBUG:teuthology.orchestra.run.smithi136:> 2023-06-23T19:01:14.933 DEBUG:teuthology.orchestra.run.smithi136:> def _find_admin_socket(client_name): 2023-06-23T19:01:14.933 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-23T19:01:14.933 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2023-06-23T19:01:14.933 DEBUG:teuthology.orchestra.run.smithi136:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-23T19:01:14.934 DEBUG:teuthology.orchestra.run.smithi136:> 2023-06-23T19:01:14.934 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2023-06-23T19:01:14.934 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2023-06-23T19:01:14.934 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2023-06-23T19:01:14.935 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2023-06-23T19:01:14.935 DEBUG:teuthology.orchestra.run.smithi136:> 2023-06-23T19:01:14.935 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2023-06-23T19:01:14.936 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-23T19:01:14.938 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-23T19:01:14.938 DEBUG:teuthology.orchestra.run.smithi136:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-23T19:01:14.939 DEBUG:teuthology.orchestra.run.smithi136:> contents = proc_f.read() 2023-06-23T19:01:14.939 DEBUG:teuthology.orchestra.run.smithi136:> if mountpoint in contents: 2023-06-23T19:01:14.939 DEBUG:teuthology.orchestra.run.smithi136:> return f 2023-06-23T19:01:14.939 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-23T19:01:14.940 DEBUG:teuthology.orchestra.run.smithi136:> 2023-06-23T19:01:14.940 DEBUG:teuthology.orchestra.run.smithi136:> print(_find_admin_socket("client.admin")) 2023-06-23T19:01:14.940 DEBUG:teuthology.orchestra.run.smithi136:> ' 2023-06-23T19:01:15.112 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.admin.136152.asok 2023-06-23T19:01:15.291 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.136152.asok 2023-06-23T19:01:15.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:15.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.136152.asok status 2023-06-23T19:01:15.512 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2023-06-23T19:01:15.512 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2023-06-23T19:01:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "8627af3e0adcb765a3c249fcc209cba9f4873e1b", 2023-06-23T19:01:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev)", 2023-06-23T19:01:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "admin", 2023-06-23T19:01:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2023-06-23T19:01:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-23T19:01:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "136152", 2023-06-23T19:01:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2023-06-23T19:01:15.514 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:01:15.514 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2023-06-23T19:01:15.514 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2023-06-23T19:01:15.514 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4461, 2023-06-23T19:01:15.514 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2023-06-23T19:01:15.514 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2023-06-23T19:01:15.514 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2023-06-23T19:01:15.515 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 4461 2023-06-23T19:01:15.515 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:01:15.515 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2023-06-23T19:01:15.515 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2023-06-23T19:01:15.515 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2023-06-23T19:01:15.515 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1771135334 2023-06-23T19:01:15.515 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:01:15.516 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:01:15.516 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2023-06-23T19:01:15.516 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2023-06-23T19:01:15.516 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2023-06-23T19:01:15.516 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1771135334 2023-06-23T19:01:15.516 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:01:15.516 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.4461 172.21.15.136:0/1771135334", 2023-06-23T19:01:15.517 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/1771135334", 2023-06-23T19:01:15.517 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2023-06-23T19:01:15.517 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 7, 2023-06-23T19:01:15.517 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 29, 2023-06-23T19:01:15.517 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2023-06-23T19:01:15.517 INFO:teuthology.orchestra.run.smithi136.stdout: "blocklisted": false, 2023-06-23T19:01:15.517 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2023-06-23T19:01:15.518 INFO:teuthology.orchestra.run.smithi136.stdout:} 2023-06-23T19:01:15.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:15.527 DEBUG:teuthology.orchestra.run.smithi136:> stat --file-system '--printf=%T 2023-06-23T19:01:15.527 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2023-06-23T19:01:15.571 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-23T19:01:15.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:15.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-23T19:01:15.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:15.681 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-23T19:01:15.814 INFO:teuthology.orchestra.run.smithi136.stdout:# file: . 2023-06-23T19:01:15.814 INFO:teuthology.orchestra.run.smithi136.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-23T19:01:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:15.815 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:01:15.816 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:01:15.859 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:16.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.090+0000 7f33497ff700 1 Processor -- start 2023-06-23T19:01:16.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.090+0000 7f33497ff700 1 -- start start 2023-06-23T19:01:16.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.091+0000 7f33497ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f33440cd830 0x7f3344160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.091+0000 7f33497ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 0x7f33440d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.091+0000 7f33497ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33441610a0 con 0x7f334415c570 2023-06-23T19:01:16.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.091+0000 7f33497ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334415d670 con 0x7f33440cd830 2023-06-23T19:01:16.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.091+0000 7f33497ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334415da90 con 0x7f3344160880 2023-06-23T19:01:16.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f3342ffd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f334415c570 0x7f33440cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33216/0 (socket says 172.21.15.136:33216) 2023-06-23T19:01:16.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f33427fc700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f33440cd830 0x7f3344160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f3342ffd700 1 -- 172.21.15.136:0/1119044797 learned_addr learned my addr 172.21.15.136:0/1119044797 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:16.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f33437fe700 1 --2- 172.21.15.136:0/1119044797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 0x7f33440d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f3341ffb700 1 -- 172.21.15.136:0/1119044797 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848214195 0 0) 0x7f33441610a0 con 0x7f334415c570 2023-06-23T19:01:16.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f3341ffb700 1 -- 172.21.15.136:0/1119044797 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f332c0035b0 con 0x7f334415c570 2023-06-23T19:01:16.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f33427fc700 1 -- 172.21.15.136:0/1119044797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 msgr2=0x7f33440d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:16.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f33427fc700 1 --2- 172.21.15.136:0/1119044797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 0x7f33440d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f33427fc700 1 -- 172.21.15.136:0/1119044797 >> v1:172.21.15.136:6789/0 conn(0x7f334415c570 legacy=0x7f33440cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f33427fc700 1 -- 172.21.15.136:0/1119044797 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334415ccd0 con 0x7f33440cd830 2023-06-23T19:01:16.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.092+0000 7f33427fc700 1 --2- 172.21.15.136:0/1119044797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 0x7f3344160340 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3338009840 tx=0x7f3338009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a33d8e11af87237 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:16.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f3341ffb700 1 -- 172.21.15.136:0/1119044797 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338011830 con 0x7f33440cd830 2023-06-23T19:01:16.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f3341ffb700 1 -- 172.21.15.136:0/1119044797 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338011990 con 0x7f33440cd830 2023-06-23T19:01:16.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f3341ffb700 1 -- 172.21.15.136:0/1119044797 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338011d20 con 0x7f33440cd830 2023-06-23T19:01:16.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f33497ff700 1 -- 172.21.15.136:0/1119044797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 msgr2=0x7f3344160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f33497ff700 1 --2- 172.21.15.136:0/1119044797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 0x7f3344160340 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3338009840 tx=0x7f3338009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:16.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f33497ff700 1 -- 172.21.15.136:0/1119044797 shutdown_connections 2023-06-23T19:01:16.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f33497ff700 1 --2- 172.21.15.136:0/1119044797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 0x7f33440d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f33497ff700 1 --2- 172.21.15.136:0/1119044797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 0x7f3344160340 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f33497ff700 1 -- 172.21.15.136:0/1119044797 >> 172.21.15.136:0/1119044797 conn(0x7f3344071620 msgr2=0x7f33440719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:16.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f33497ff700 1 -- 172.21.15.136:0/1119044797 shutdown_connections 2023-06-23T19:01:16.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.093+0000 7f33497ff700 1 -- 172.21.15.136:0/1119044797 wait complete. 2023-06-23T19:01:16.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.095+0000 7f33497ff700 1 Processor -- start 2023-06-23T19:01:16.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.095+0000 7f33497ff700 1 -- start start 2023-06-23T19:01:16.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.096+0000 7f33497ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 0x7f33441500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.096+0000 7f33497ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f334415c570 0x7f3344158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.096+0000 7f33497ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 0x7f3344159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.096+0000 7f33497ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3344150610 con 0x7f33440cd830 2023-06-23T19:01:16.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.096+0000 7f33497ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c9d40 con 0x7f334415c570 2023-06-23T19:01:16.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.096+0000 7f33497ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440ca020 con 0x7f3344160880 2023-06-23T19:01:16.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.096+0000 7f3342ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 0x7f33441500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.096+0000 7f3342ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 0x7f33441500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54742/0 (socket says 172.21.15.136:54742) 2023-06-23T19:01:16.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.096+0000 7f3342ffd700 1 -- 172.21.15.136:0/1786292646 learned_addr learned my addr 172.21.15.136:0/1786292646 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:16.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f33437fe700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 0x7f3344159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f33427fc700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f334415c570 0x7f3344158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f3342ffd700 1 -- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 msgr2=0x7f3344159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f3342ffd700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 0x7f3344159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f3342ffd700 1 -- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f334415c570 msgr2=0x7f3344158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f3342ffd700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f334415c570 0x7f3344158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f3342ffd700 1 -- 172.21.15.136:0/1786292646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33380094a0 con 0x7f33440cd830 2023-06-23T19:01:16.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f33427fc700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f334415c570 0x7f3344158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:16.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f33437fe700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 0x7f3344159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:16.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f3342ffd700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 0x7f33441500d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f333400c700 tx=0x7f333400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:16.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f332b7fe700 1 -- 172.21.15.136:0/1786292646 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334005d70 con 0x7f33440cd830 2023-06-23T19:01:16.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f332b7fe700 1 -- 172.21.15.136:0/1786292646 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33340070d0 con 0x7f33440cd830 2023-06-23T19:01:16.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f332b7fe700 1 -- 172.21.15.136:0/1786292646 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334007460 con 0x7f33440cd830 2023-06-23T19:01:16.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33440ca300 con 0x7f33440cd830 2023-06-23T19:01:16.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.097+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33440ca8c0 con 0x7f33440cd830 2023-06-23T19:01:16.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.098+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3344073910 con 0x7f33440cd830 2023-06-23T19:01:16.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.099+0000 7f332b7fe700 1 -- 172.21.15.136:0/1786292646 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33340075c0 con 0x7f33440cd830 2023-06-23T19:01:16.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.100+0000 7f332b7fe700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f333006ace0 0x7f333006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.100+0000 7f332b7fe700 1 -- 172.21.15.136:0/1786292646 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3334088dc0 con 0x7f33440cd830 2023-06-23T19:01:16.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.100+0000 7f33427fc700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f333006ace0 0x7f333006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.101+0000 7f33427fc700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f333006ace0 0x7f333006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33440cb100 tx=0x7f3338008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:16.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.105+0000 7f332b7fe700 1 -- 172.21.15.136:0/1786292646 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3334053b90 con 0x7f33440cd830 2023-06-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.304+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33440b5360 con 0x7f33440cd830 2023-06-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.306+0000 7f332b7fe700 1 -- 172.21.15.136:0/1786292646 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f33340571b0 con 0x7f33440cd830 2023-06-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f333006ace0 msgr2=0x7f333006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f333006ace0 0x7f333006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33440cb100 tx=0x7f3338008030 comp rx=0 tx=0).stop 2023-06-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 msgr2=0x7f33441500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 0x7f33441500d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f333400c700 tx=0x7f333400cac0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 shutdown_connections 2023-06-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f333006ace0 0x7f333006d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3344160880 0x7f3344159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33440cd830 0x7f33441500d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 --2- 172.21.15.136:0/1786292646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f334415c570 0x7f3344158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 >> 172.21.15.136:0/1786292646 conn(0x7f3344071620 msgr2=0x7f33440cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 shutdown_connections 2023-06-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.308+0000 7f33497ff700 1 -- 172.21.15.136:0/1786292646 wait complete. 2023-06-23T19:01:16.330 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:01:16.331 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:01:16.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.525+0000 7f20423ff700 1 Processor -- start 2023-06-23T19:01:16.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.526+0000 7f20423ff700 1 -- start start 2023-06-23T19:01:16.531 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.527+0000 7f20423ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f203c0d0a60 0x7f203c0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.527+0000 7f20423ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cf910 0x7f203c0d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.527+0000 7f20423ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c0cd9d0 con 0x7f203c0b51d0 2023-06-23T19:01:16.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.527+0000 7f20423ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c0d0060 con 0x7f203c0d0a60 2023-06-23T19:01:16.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.527+0000 7f20423ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0b5620 con 0x7f203c0cf910 2023-06-23T19:01:16.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f203b7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f203c0b51d0 0x7f203c0d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33226/0 (socket says 172.21.15.136:33226) 2023-06-23T19:01:16.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f203b7fe700 1 -- 172.21.15.136:0/2666533177 learned_addr learned my addr 172.21.15.136:0/2666533177 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:16.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f203bfff700 1 --2- 172.21.15.136:0/2666533177 >> v2:172.21.15.136:3300/0 conn(0x7f203c0d0a60 0x7f203c0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f204099c700 1 --2- 172.21.15.136:0/2666533177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cf910 0x7f203c0d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f203affd700 1 -- 172.21.15.136:0/2666533177 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823671555 0 0) 0x7f203c0cd9d0 con 0x7f203c0b51d0 2023-06-23T19:01:16.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f203affd700 1 -- 172.21.15.136:0/2666533177 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20240035b0 con 0x7f203c0b51d0 2023-06-23T19:01:16.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f203bfff700 1 -- 172.21.15.136:0/2666533177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cf910 msgr2=0x7f203c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:16.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f203bfff700 1 --2- 172.21.15.136:0/2666533177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cf910 0x7f203c0d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f203bfff700 1 -- 172.21.15.136:0/2666533177 >> v1:172.21.15.136:6789/0 conn(0x7f203c0b51d0 legacy=0x7f203c0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.528+0000 7f203bfff700 1 -- 172.21.15.136:0/2666533177 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c0cfd90 con 0x7f203c0d0a60 2023-06-23T19:01:16.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f203bfff700 1 --2- 172.21.15.136:0/2666533177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 0x7f203c0b5a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f202c009840 tx=0x7f202c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f951a9dedb8edb8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:16.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f203affd700 1 -- 172.21.15.136:0/2666533177 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c011830 con 0x7f203c0d0a60 2023-06-23T19:01:16.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f203affd700 1 -- 172.21.15.136:0/2666533177 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c011990 con 0x7f203c0d0a60 2023-06-23T19:01:16.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f203affd700 1 -- 172.21.15.136:0/2666533177 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c011d20 con 0x7f203c0d0a60 2023-06-23T19:01:16.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f20423ff700 1 -- 172.21.15.136:0/2666533177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 msgr2=0x7f203c0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f20423ff700 1 --2- 172.21.15.136:0/2666533177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 0x7f203c0b5a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f202c009840 tx=0x7f202c009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:16.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f20423ff700 1 -- 172.21.15.136:0/2666533177 shutdown_connections 2023-06-23T19:01:16.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f20423ff700 1 --2- 172.21.15.136:0/2666533177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 0x7f203c0b5a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f20423ff700 1 --2- 172.21.15.136:0/2666533177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cf910 0x7f203c0d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f20423ff700 1 -- 172.21.15.136:0/2666533177 >> 172.21.15.136:0/2666533177 conn(0x7f203c071620 msgr2=0x7f203c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:16.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f20423ff700 1 -- 172.21.15.136:0/2666533177 shutdown_connections 2023-06-23T19:01:16.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.529+0000 7f20423ff700 1 -- 172.21.15.136:0/2666533177 wait complete. 2023-06-23T19:01:16.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.531+0000 7f20423ff700 1 Processor -- start 2023-06-23T19:01:16.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.531+0000 7f20423ff700 1 -- start start 2023-06-23T19:01:16.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.532+0000 7f20423ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0b51d0 0x7f203c15d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.532+0000 7f20423ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c0cf910 0x7f203c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.532+0000 7f20423ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 0x7f203c0b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.532+0000 7f20423ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0b6fa0 con 0x7f203c0d0a60 2023-06-23T19:01:16.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.532+0000 7f20423ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0b7280 con 0x7f203c0cf910 2023-06-23T19:01:16.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.532+0000 7f20423ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0b7560 con 0x7f203c0b51d0 2023-06-23T19:01:16.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.532+0000 7f204099c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 0x7f203c0b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f204099c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 0x7f203c0b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54752/0 (socket says 172.21.15.136:54752) 2023-06-23T19:01:16.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f204099c700 1 -- 172.21.15.136:0/1706771350 learned_addr learned my addr 172.21.15.136:0/1706771350 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:16.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f203b7fe700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c0cf910 0x7f203c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f203bfff700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0b51d0 0x7f203c15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f204099c700 1 -- 172.21.15.136:0/1706771350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0b51d0 msgr2=0x7f203c15d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f204099c700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0b51d0 0x7f203c15d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.540 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f204099c700 1 -- 172.21.15.136:0/1706771350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c0cf910 msgr2=0x7f203c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.540 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f204099c700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c0cf910 0x7f203c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.540 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f204099c700 1 -- 172.21.15.136:0/1706771350 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0094a0 con 0x7f203c0d0a60 2023-06-23T19:01:16.540 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f204099c700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 0x7f203c0b44c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f203400efc0 tx=0x7f203400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:16.540 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f2038ff9700 1 -- 172.21.15.136:0/1706771350 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034009ea0 con 0x7f203c0d0a60 2023-06-23T19:01:16.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f2038ff9700 1 -- 172.21.15.136:0/1706771350 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203400f040 con 0x7f203c0d0a60 2023-06-23T19:01:16.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c0b7840 con 0x7f203c0d0a60 2023-06-23T19:01:16.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.533+0000 7f2038ff9700 1 -- 172.21.15.136:0/1706771350 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400ced0 con 0x7f203c0d0a60 2023-06-23T19:01:16.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.534+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c0b1460 con 0x7f203c0d0a60 2023-06-23T19:01:16.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.535+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c04ea20 con 0x7f203c0d0a60 2023-06-23T19:01:16.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.536+0000 7f2038ff9700 1 -- 172.21.15.136:0/1706771350 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2034014480 con 0x7f203c0d0a60 2023-06-23T19:01:16.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.537+0000 7f2038ff9700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f202806ace0 0x7f202806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.537+0000 7f2038ff9700 1 -- 172.21.15.136:0/1706771350 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f203408a310 con 0x7f203c0d0a60 2023-06-23T19:01:16.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.537+0000 7f203bfff700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f202806ace0 0x7f202806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.538+0000 7f203bfff700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f202806ace0 0x7f202806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f202c000c00 tx=0x7f202c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:16.545 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.542+0000 7f2038ff9700 1 -- 172.21.15.136:0/1706771350 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2034055030 con 0x7f203c0d0a60 2023-06-23T19:01:16.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.736+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f203c0b2aa0 con 0x7f203c0d0a60 2023-06-23T19:01:16.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.736+0000 7f2038ff9700 1 -- 172.21.15.136:0/1706771350 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2034058650 con 0x7f203c0d0a60 2023-06-23T19:01:16.741 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:01:16.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f202806ace0 msgr2=0x7f202806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f202806ace0 0x7f202806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f202c000c00 tx=0x7f202c01c040 comp rx=0 tx=0).stop 2023-06-23T19:01:16.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 msgr2=0x7f203c0b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 0x7f203c0b44c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f203400efc0 tx=0x7f203400c3a0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 shutdown_connections 2023-06-23T19:01:16.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f202806ace0 0x7f202806d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f203c0d0a60 0x7f203c0b44c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.744 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0b51d0 0x7f203c15d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.744 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 --2- 172.21.15.136:0/1706771350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c0cf910 0x7f203c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.744 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 >> 172.21.15.136:0/1706771350 conn(0x7f203c071620 msgr2=0x7f203c0c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:16.744 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 shutdown_connections 2023-06-23T19:01:16.744 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.739+0000 7f20423ff700 1 -- 172.21.15.136:0/1706771350 wait complete. 2023-06-23T19:01:16.761 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:01:16.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.952+0000 7f5f7c3ff700 1 Processor -- start 2023-06-23T19:01:16.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.953+0000 7f5f7c3ff700 1 -- start start 2023-06-23T19:01:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.954+0000 7f5f7c3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740d0a60 0x7f5f740b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.954+0000 7f5f7c3ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5f740b51d0 0x7f5f740cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.954+0000 7f5f7c3ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f740cd9d0 con 0x7f5f740d0e30 2023-06-23T19:01:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.954+0000 7f5f7c3ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f740d0060 con 0x7f5f740b51d0 2023-06-23T19:01:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.954+0000 7f5f7c3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740cfe50 con 0x7f5f740d0a60 2023-06-23T19:01:16.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f7999a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5f740b51d0 0x7f5f740cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f7a99c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f5f740d0e30 0x7f5f740d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:43132/0 (socket says 172.21.15.136:43132) 2023-06-23T19:01:16.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f7a99c700 1 -- 172.21.15.136:0/191262239 learned_addr learned my addr 172.21.15.136:0/191262239 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:16.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f7a19b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740d0a60 0x7f5f740b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f79199700 1 -- 172.21.15.136:0/191262239 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319747229 0 0) 0x7f5f740cd9d0 con 0x7f5f740d0e30 2023-06-23T19:01:16.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f79199700 1 -- 172.21.15.136:0/191262239 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f600035b0 con 0x7f5f740d0e30 2023-06-23T19:01:16.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f7a19b700 1 -- 172.21.15.136:0/191262239 >> v2:172.21.15.178:3300/0 conn(0x7f5f740b51d0 msgr2=0x7f5f740cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:16.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f7a19b700 1 --2- 172.21.15.136:0/191262239 >> v2:172.21.15.178:3300/0 conn(0x7f5f740b51d0 0x7f5f740cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f7a19b700 1 -- 172.21.15.136:0/191262239 >> v1:172.21.15.178:6789/0 conn(0x7f5f740d0e30 legacy=0x7f5f740d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f7a19b700 1 -- 172.21.15.136:0/191262239 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740b5640 con 0x7f5f740d0a60 2023-06-23T19:01:16.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.955+0000 7f5f7999a700 1 --2- 172.21.15.136:0/191262239 >> v2:172.21.15.178:3300/0 conn(0x7f5f740b51d0 0x7f5f740cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:16.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f7a19b700 1 --2- 172.21.15.136:0/191262239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740d0a60 0x7f5f740b5a70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009840 tx=0x7f5f70009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f83b87fa37d4764 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:16.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f79199700 1 -- 172.21.15.136:0/191262239 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70011830 con 0x7f5f740d0a60 2023-06-23T19:01:16.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f79199700 1 -- 172.21.15.136:0/191262239 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70011990 con 0x7f5f740d0a60 2023-06-23T19:01:16.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f79199700 1 -- 172.21.15.136:0/191262239 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70011d20 con 0x7f5f740d0a60 2023-06-23T19:01:16.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/191262239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740d0a60 msgr2=0x7f5f740b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f7c3ff700 1 --2- 172.21.15.136:0/191262239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740d0a60 0x7f5f740b5a70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009840 tx=0x7f5f70009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:16.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/191262239 shutdown_connections 2023-06-23T19:01:16.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f7c3ff700 1 --2- 172.21.15.136:0/191262239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740d0a60 0x7f5f740b5a70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f7c3ff700 1 --2- 172.21.15.136:0/191262239 >> v2:172.21.15.178:3300/0 conn(0x7f5f740b51d0 0x7f5f740cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/191262239 >> 172.21.15.136:0/191262239 conn(0x7f5f74071620 msgr2=0x7f5f740719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:16.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/191262239 shutdown_connections 2023-06-23T19:01:16.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.956+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/191262239 wait complete. 2023-06-23T19:01:16.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.959+0000 7f5f7c3ff700 1 Processor -- start 2023-06-23T19:01:16.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.959+0000 7f5f7c3ff700 1 -- start start 2023-06-23T19:01:16.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.960+0000 7f5f7c3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740b51d0 0x7f5f740a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.960+0000 7f5f7c3ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f740d0a60 0x7f5f74159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.960+0000 7f5f7c3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740d0e30 0x7f5f7415cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.960+0000 7f5f7c3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74159a60 con 0x7f5f740d0e30 2023-06-23T19:01:16.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.960+0000 7f5f7c3ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7415d400 con 0x7f5f740d0a60 2023-06-23T19:01:16.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.960+0000 7f5f7c3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7415d6e0 con 0x7f5f740b51d0 2023-06-23T19:01:16.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.960+0000 7f5f7a99c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740d0e30 0x7f5f7415cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.960+0000 7f5f7a19b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740b51d0 0x7f5f740a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f7999a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f740d0a60 0x7f5f74159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f7a19b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740b51d0 0x7f5f740a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54924/0 (socket says 172.21.15.136:54924) 2023-06-23T19:01:16.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f7a19b700 1 -- 172.21.15.136:0/2506725944 learned_addr learned my addr 172.21.15.136:0/2506725944 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:16.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f7a19b700 1 -- 172.21.15.136:0/2506725944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f740d0a60 msgr2=0x7f5f74159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f7a19b700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f740d0a60 0x7f5f74159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f7a19b700 1 -- 172.21.15.136:0/2506725944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740d0e30 msgr2=0x7f5f7415cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:16.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f7a19b700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740d0e30 0x7f5f7415cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:16.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f7a19b700 1 -- 172.21.15.136:0/2506725944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640094a0 con 0x7f5f740b51d0 2023-06-23T19:01:16.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f7a19b700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740b51d0 0x7f5f740a9ff0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f700090b0 tx=0x7f5f70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:16.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.961+0000 7f5f6affd700 1 -- 172.21.15.136:0/2506725944 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70004590 con 0x7f5f740b51d0 2023-06-23T19:01:16.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.962+0000 7f5f6affd700 1 -- 172.21.15.136:0/2506725944 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7001f070 con 0x7f5f740b51d0 2023-06-23T19:01:16.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.962+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f700094a0 con 0x7f5f740b51d0 2023-06-23T19:01:16.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.962+0000 7f5f6affd700 1 -- 172.21.15.136:0/2506725944 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f700038e0 con 0x7f5f740b51d0 2023-06-23T19:01:16.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.962+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7415dca0 con 0x7f5f740b51d0 2023-06-23T19:01:16.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.963+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7404ea20 con 0x7f5f740b51d0 2023-06-23T19:01:16.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.964+0000 7f5f6affd700 1 -- 172.21.15.136:0/2506725944 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f70003a40 con 0x7f5f740b51d0 2023-06-23T19:01:16.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.965+0000 7f5f6affd700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5f5806ace0 0x7f5f5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:16.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.965+0000 7f5f6affd700 1 -- 172.21.15.136:0/2506725944 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f70021070 con 0x7f5f740b51d0 2023-06-23T19:01:16.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.965+0000 7f5f7999a700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5f5806ace0 0x7f5f5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:16.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.965+0000 7f5f7999a700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5f5806ace0 0x7f5f5806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f74072f00 tx=0x7f5f64009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:16.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:16.970+0000 7f5f6affd700 1 -- 172.21.15.136:0/2506725944 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5f70055c70 con 0x7f5f740b51d0 2023-06-23T19:01:17.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.172+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f740cc370 con 0x7f5f740b51d0 2023-06-23T19:01:17.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.173+0000 7f5f6affd700 1 -- 172.21.15.136:0/2506725944 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f700253e0 con 0x7f5f740b51d0 2023-06-23T19:01:17.179 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:01:17.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5f5806ace0 msgr2=0x7f5f5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5f5806ace0 0x7f5f5806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f74072f00 tx=0x7f5f64009210 comp rx=0 tx=0).stop 2023-06-23T19:01:17.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740b51d0 msgr2=0x7f5f740a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740b51d0 0x7f5f740a9ff0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f700090b0 tx=0x7f5f70004750 comp rx=0 tx=0).stop 2023-06-23T19:01:17.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 shutdown_connections 2023-06-23T19:01:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5f5806ace0 0x7f5f5806d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740d0e30 0x7f5f7415cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f740b51d0 0x7f5f740a9ff0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 --2- 172.21.15.136:0/2506725944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f740d0a60 0x7f5f74159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 >> 172.21.15.136:0/2506725944 conn(0x7f5f74071620 msgr2=0x7f5f740d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 shutdown_connections 2023-06-23T19:01:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.175+0000 7f5f7c3ff700 1 -- 172.21.15.136:0/2506725944 wait complete. 2023-06-23T19:01:17.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:01:17.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.391+0000 7fc5ba1ff700 1 Processor -- start 2023-06-23T19:01:17.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.392+0000 7fc5ba1ff700 1 -- start start 2023-06-23T19:01:17.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5ba1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40d0a60 0x7fc5b40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5ba1ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc5b40b51d0 0x7fc5b40cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5ba1ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc5b40d0e30 0x7fc5b40d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5ba1ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40d0060 con 0x7fc5b40d0e30 2023-06-23T19:01:17.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5ba1ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40cfe50 con 0x7fc5b40b51d0 2023-06-23T19:01:17.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5ba1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40cd9d0 con 0x7fc5b40d0a60 2023-06-23T19:01:17.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5b3fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc5b40d0e30 0x7fc5b40d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5b3fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc5b40d0e30 0x7fc5b40d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54766/0 (socket says 172.21.15.136:54766) 2023-06-23T19:01:17.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5b3fff700 1 -- 172.21.15.136:0/4042687816 learned_addr learned my addr 172.21.15.136:0/4042687816 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:17.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5b37fe700 1 --2- 172.21.15.136:0/4042687816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40d0a60 0x7fc5b40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5abfff700 1 --2- 172.21.15.136:0/4042687816 >> v2:172.21.15.178:3300/0 conn(0x7fc5b40b51d0 0x7fc5b40cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.393+0000 7fc5b3fff700 1 -- 172.21.15.136:0/4042687816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40d0a60 msgr2=0x7fc5b40b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:17.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5b3fff700 1 --2- 172.21.15.136:0/4042687816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40d0a60 0x7fc5b40b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5b3fff700 1 -- 172.21.15.136:0/4042687816 >> v2:172.21.15.178:3300/0 conn(0x7fc5b40b51d0 msgr2=0x7fc5b40cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:17.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5b3fff700 1 --2- 172.21.15.136:0/4042687816 >> v2:172.21.15.178:3300/0 conn(0x7fc5b40b51d0 0x7fc5b40cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5b3fff700 1 -- 172.21.15.136:0/4042687816 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b40b5640 con 0x7fc5b40d0e30 2023-06-23T19:01:17.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5b3fff700 1 --2- 172.21.15.136:0/4042687816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0e30 0x7fc5b40d12b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40d3cf0 tx=0x7fc5ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e4b936b2e56b88 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:17.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5b2ffd700 1 -- 172.21.15.136:0/4042687816 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00e070 con 0x7fc5b40d0e30 2023-06-23T19:01:17.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5b2ffd700 1 -- 172.21.15.136:0/4042687816 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac00b9c0 con 0x7fc5b40d0e30 2023-06-23T19:01:17.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5b2ffd700 1 -- 172.21.15.136:0/4042687816 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00bd70 con 0x7fc5b40d0e30 2023-06-23T19:01:17.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/4042687816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0e30 msgr2=0x7fc5b40d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.394+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/4042687816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0e30 0x7fc5b40d12b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40d3cf0 tx=0x7fc5ac00b330 comp rx=0 tx=0).stop 2023-06-23T19:01:17.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.395+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/4042687816 shutdown_connections 2023-06-23T19:01:17.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.395+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/4042687816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0e30 0x7fc5b40d12b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.395+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/4042687816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40d0a60 0x7fc5b40b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.395+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/4042687816 >> v2:172.21.15.178:3300/0 conn(0x7fc5b40b51d0 0x7fc5b40cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.395+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/4042687816 >> 172.21.15.136:0/4042687816 conn(0x7fc5b4071620 msgr2=0x7fc5b40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:17.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.395+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/4042687816 shutdown_connections 2023-06-23T19:01:17.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.395+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/4042687816 wait complete. 2023-06-23T19:01:17.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.396+0000 7fc5ba1ff700 1 Processor -- start 2023-06-23T19:01:17.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.397+0000 7fc5ba1ff700 1 -- start start 2023-06-23T19:01:17.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.397+0000 7fc5ba1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40b51d0 0x7fc5b415b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.397+0000 7fc5ba1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0a60 0x7fc5b41f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5ba1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5b40d0e30 0x7fc5b41f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5ba1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40a9530 con 0x7fc5b40d0a60 2023-06-23T19:01:17.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5ba1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41f2610 con 0x7fc5b40d0e30 2023-06-23T19:01:17.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5ba1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41f28f0 con 0x7fc5b40b51d0 2023-06-23T19:01:17.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0a60 0x7fc5b41f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0a60 0x7fc5b41f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54782/0 (socket says 172.21.15.136:54782) 2023-06-23T19:01:17.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5abfff700 1 -- 172.21.15.136:0/3694088304 learned_addr learned my addr 172.21.15.136:0/3694088304 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:17.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5b37fe700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40b51d0 0x7fc5b415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5b3fff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5b40d0e30 0x7fc5b41f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5abfff700 1 -- 172.21.15.136:0/3694088304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40b51d0 msgr2=0x7fc5b415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5abfff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40b51d0 0x7fc5b415b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5abfff700 1 -- 172.21.15.136:0/3694088304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5b40d0e30 msgr2=0x7fc5b41f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5abfff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5b40d0e30 0x7fc5b41f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5abfff700 1 -- 172.21.15.136:0/3694088304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac009b30 con 0x7fc5b40d0a60 2023-06-23T19:01:17.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.398+0000 7fc5abfff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0a60 0x7fc5b41f1d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00e810 tx=0x7fc59c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:17.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.399+0000 7fc5b0ff9700 1 -- 172.21.15.136:0/3694088304 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c013610 con 0x7fc5b40d0a60 2023-06-23T19:01:17.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.399+0000 7fc5b0ff9700 1 -- 172.21.15.136:0/3694088304 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c013770 con 0x7fc5b40d0a60 2023-06-23T19:01:17.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.399+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b41f2bd0 con 0x7fc5b40d0a60 2023-06-23T19:01:17.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.399+0000 7fc5b0ff9700 1 -- 172.21.15.136:0/3694088304 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c013b00 con 0x7fc5b40d0a60 2023-06-23T19:01:17.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.399+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b415b660 con 0x7fc5b40d0a60 2023-06-23T19:01:17.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.400+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b404ea20 con 0x7fc5b40d0a60 2023-06-23T19:01:17.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.401+0000 7fc5b0ff9700 1 -- 172.21.15.136:0/3694088304 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc59c013c60 con 0x7fc5b40d0a60 2023-06-23T19:01:17.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.401+0000 7fc5b0ff9700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc59406ace0 0x7fc59406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.402+0000 7fc5b0ff9700 1 -- 172.21.15.136:0/3694088304 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc59c089460 con 0x7fc5b40d0a60 2023-06-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.402+0000 7fc5b37fe700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc59406ace0 0x7fc59406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.402+0000 7fc5b37fe700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc59406ace0 0x7fc59406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40d36d0 tx=0x7fc5a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.406+0000 7fc5b0ff9700 1 -- 172.21.15.136:0/3694088304 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc59c054180 con 0x7fc5b40d0a60 2023-06-23T19:01:17.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.600+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5b40b37e0 con 0x7fc5b40d0a60 2023-06-23T19:01:17.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.601+0000 7fc5b0ff9700 1 -- 172.21.15.136:0/3694088304 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc59c0577a0 con 0x7fc5b40d0a60 2023-06-23T19:01:17.606 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:01:17.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.603+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc59406ace0 msgr2=0x7fc59406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.603+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc59406ace0 0x7fc59406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40d36d0 tx=0x7fc5a4008040 comp rx=0 tx=0).stop 2023-06-23T19:01:17.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.603+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0a60 msgr2=0x7fc5b41f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.603+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0a60 0x7fc5b41f1d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00e810 tx=0x7fc59c00ebd0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.604+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 shutdown_connections 2023-06-23T19:01:17.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.604+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc59406ace0 0x7fc59406d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.604+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5b40d0e30 0x7fc5b41f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.604+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5b40b51d0 0x7fc5b415b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.604+0000 7fc5ba1ff700 1 --2- 172.21.15.136:0/3694088304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b40d0a60 0x7fc5b41f1d00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.604+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 >> 172.21.15.136:0/3694088304 conn(0x7fc5b4071620 msgr2=0x7fc5b40b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:17.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.604+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 shutdown_connections 2023-06-23T19:01:17.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.604+0000 7fc5ba1ff700 1 -- 172.21.15.136:0/3694088304 wait complete. 2023-06-23T19:01:17.625 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:01:17.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.819+0000 7f9ad93ff700 1 Processor -- start 2023-06-23T19:01:17.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.819+0000 7f9ad93ff700 1 -- start start 2023-06-23T19:01:17.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad93ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9ad40b5a70 0x7f9ad40b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad93ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9ad40cf910 0x7f9ad40d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad93ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad40b5ec0 con 0x7f9ad40d0a60 2023-06-23T19:01:17.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad93ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40d0060 con 0x7f9ad40cf910 2023-06-23T19:01:17.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad93ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40cd9d0 con 0x7f9ad40b5a70 2023-06-23T19:01:17.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad37fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9ad40cf910 0x7f9ad40d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad2ffd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f9ad40d0a60 0x7f9ad40d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33234/0 (socket says 172.21.15.136:33234) 2023-06-23T19:01:17.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad2ffd700 1 -- 172.21.15.136:0/3111274198 learned_addr learned my addr 172.21.15.136:0/3111274198 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:17.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9acbfff700 1 --2- 172.21.15.136:0/3111274198 >> v2:172.21.15.178:3300/0 conn(0x7f9ad40b5a70 0x7f9ad40b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad37fe700 1 -- 172.21.15.136:0/3111274198 >> v2:172.21.15.178:3300/0 conn(0x7f9ad40b5a70 msgr2=0x7f9ad40b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:17.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad37fe700 1 --2- 172.21.15.136:0/3111274198 >> v2:172.21.15.178:3300/0 conn(0x7f9ad40b5a70 0x7f9ad40b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad37fe700 1 -- 172.21.15.136:0/3111274198 >> v1:172.21.15.136:6789/0 conn(0x7f9ad40d0a60 legacy=0x7f9ad40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad37fe700 1 -- 172.21.15.136:0/3111274198 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad40cd410 con 0x7f9ad40cf910 2023-06-23T19:01:17.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.821+0000 7f9ad27fc700 1 -- 172.21.15.136:0/3111274198 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669786061 0 0) 0x7f9ad40b5ec0 con 0x7f9ad40d0a60 2023-06-23T19:01:17.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.822+0000 7f9ad37fe700 1 --2- 172.21.15.136:0/3111274198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 0x7f9ad40d2e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40d07a0 tx=0x7f9acc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5261a483c8262c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:17.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.822+0000 7f9ad27fc700 1 -- 172.21.15.136:0/3111274198 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00e070 con 0x7f9ad40cf910 2023-06-23T19:01:17.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.822+0000 7f9ad27fc700 1 -- 172.21.15.136:0/3111274198 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc00bb20 con 0x7f9ad40cf910 2023-06-23T19:01:17.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.822+0000 7f9ad27fc700 1 -- 172.21.15.136:0/3111274198 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc012430 con 0x7f9ad40cf910 2023-06-23T19:01:17.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.822+0000 7f9ad93ff700 1 -- 172.21.15.136:0/3111274198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 msgr2=0x7f9ad40d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.822+0000 7f9ad93ff700 1 --2- 172.21.15.136:0/3111274198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 0x7f9ad40d2e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40d07a0 tx=0x7f9acc00b330 comp rx=0 tx=0).stop 2023-06-23T19:01:17.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.823+0000 7f9ad93ff700 1 -- 172.21.15.136:0/3111274198 shutdown_connections 2023-06-23T19:01:17.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.823+0000 7f9ad93ff700 1 --2- 172.21.15.136:0/3111274198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 0x7f9ad40d2e00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.823+0000 7f9ad93ff700 1 --2- 172.21.15.136:0/3111274198 >> v2:172.21.15.178:3300/0 conn(0x7f9ad40b5a70 0x7f9ad40b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.823+0000 7f9ad93ff700 1 -- 172.21.15.136:0/3111274198 >> 172.21.15.136:0/3111274198 conn(0x7f9ad4071620 msgr2=0x7f9ad40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:17.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.823+0000 7f9ad93ff700 1 -- 172.21.15.136:0/3111274198 shutdown_connections 2023-06-23T19:01:17.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.823+0000 7f9ad93ff700 1 -- 172.21.15.136:0/3111274198 wait complete. 2023-06-23T19:01:17.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.824+0000 7f9ad93ff700 1 Processor -- start 2023-06-23T19:01:17.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.825+0000 7f9ad93ff700 1 -- start start 2023-06-23T19:01:17.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.825+0000 7f9ad93ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40b5a70 0x7f9ad4148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9ad93ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 0x7f9ad40ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9ad93ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40d0a60 0x7f9ad40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9ad93ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad415c6d0 con 0x7f9ad40cf910 2023-06-23T19:01:17.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9ad93ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad415bda0 con 0x7f9ad40d0a60 2023-06-23T19:01:17.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9ad93ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad415c080 con 0x7f9ad40b5a70 2023-06-23T19:01:17.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9acbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 0x7f9ad40ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9acbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 0x7f9ad40ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54812/0 (socket says 172.21.15.136:54812) 2023-06-23T19:01:17.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9acbfff700 1 -- 172.21.15.136:0/608278340 learned_addr learned my addr 172.21.15.136:0/608278340 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:17.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9ad2ffd700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40b5a70 0x7f9ad4148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9ad37fe700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40d0a60 0x7f9ad40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9acbfff700 1 -- 172.21.15.136:0/608278340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40b5a70 msgr2=0x7f9ad4148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9acbfff700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40b5a70 0x7f9ad4148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9acbfff700 1 -- 172.21.15.136:0/608278340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40d0a60 msgr2=0x7f9ad40c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:17.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9acbfff700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40d0a60 0x7f9ad40c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:17.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9acbfff700 1 -- 172.21.15.136:0/608278340 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc009a70 con 0x7f9ad40cf910 2023-06-23T19:01:17.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9ad37fe700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40d0a60 0x7f9ad40c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:17.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.826+0000 7f9acbfff700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 0x7f9ad40ca650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00e9b0 tx=0x7f9abc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:17.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.827+0000 7f9acb7fe700 1 -- 172.21.15.136:0/608278340 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc009710 con 0x7f9ad40cf910 2023-06-23T19:01:17.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.827+0000 7f9acb7fe700 1 -- 172.21.15.136:0/608278340 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc00c850 con 0x7f9ad40cf910 2023-06-23T19:01:17.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.827+0000 7f9acb7fe700 1 -- 172.21.15.136:0/608278340 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00cbc0 con 0x7f9ad40cf910 2023-06-23T19:01:17.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.827+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad415c360 con 0x7f9ad40cf910 2023-06-23T19:01:17.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.827+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad4149300 con 0x7f9ad40cf910 2023-06-23T19:01:17.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.828+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad415c880 con 0x7f9ad40cf910 2023-06-23T19:01:17.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.829+0000 7f9acb7fe700 1 -- 172.21.15.136:0/608278340 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9abc00cd20 con 0x7f9ad40cf910 2023-06-23T19:01:17.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.830+0000 7f9acb7fe700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9ab406ace0 0x7f9ab406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:17.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.830+0000 7f9acb7fe700 1 -- 172.21.15.136:0/608278340 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9abc089820 con 0x7f9ad40cf910 2023-06-23T19:01:17.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.830+0000 7f9ad2ffd700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9ab406ace0 0x7f9ab406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:17.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.831+0000 7f9ad2ffd700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9ab406ace0 0x7f9ab406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000f60 tx=0x7f9ac4007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:17.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:17.835+0000 7f9acb7fe700 1 -- 172.21.15.136:0/608278340 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9ad415c880 con 0x7f9ad40cf910 2023-06-23T19:01:18.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.035+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ad415c4f0 con 0x7f9ad40cf910 2023-06-23T19:01:18.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.035+0000 7f9acb7fe700 1 -- 172.21.15.136:0/608278340 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9abc058100 con 0x7f9ad40cf910 2023-06-23T19:01:18.039 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:01:18.041 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9ab406ace0 msgr2=0x7f9ab406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.041 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9ab406ace0 0x7f9ab406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000f60 tx=0x7f9ac4007c90 comp rx=0 tx=0).stop 2023-06-23T19:01:18.041 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 msgr2=0x7f9ad40ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.041 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 0x7f9ad40ca650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00e9b0 tx=0x7f9abc00ed70 comp rx=0 tx=0).stop 2023-06-23T19:01:18.042 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 shutdown_connections 2023-06-23T19:01:18.042 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9ab406ace0 0x7f9ab406d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.042 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40d0a60 0x7f9ad40c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.043 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40b5a70 0x7f9ad4148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.043 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 --2- 172.21.15.136:0/608278340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad40cf910 0x7f9ad40ca650 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.043 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 >> 172.21.15.136:0/608278340 conn(0x7f9ad4071620 msgr2=0x7f9ad40d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:18.043 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 shutdown_connections 2023-06-23T19:01:18.043 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.038+0000 7f9ad93ff700 1 -- 172.21.15.136:0/608278340 wait complete. 2023-06-23T19:01:18.060 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:01:18.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.255+0000 7f58461ff700 1 Processor -- start 2023-06-23T19:01:18.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.255+0000 7f58461ff700 1 -- start start 2023-06-23T19:01:18.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.256+0000 7f58461ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f58400d0a60 0x7f58400b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.256+0000 7f58461ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f58400b51d0 0x7f58400cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f58461ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58400cd9d0 con 0x7f58400d0e30 2023-06-23T19:01:18.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f58461ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58400d0060 con 0x7f58400b51d0 2023-06-23T19:01:18.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f58461ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58400cfe50 con 0x7f58400d0a60 2023-06-23T19:01:18.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f583effd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f58400b51d0 0x7f58400cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f583ffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f58400d0e30 0x7f58400d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33236/0 (socket says 172.21.15.136:33236) 2023-06-23T19:01:18.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f583ffff700 1 -- 172.21.15.136:0/2217477764 learned_addr learned my addr 172.21.15.136:0/2217477764 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:18.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f583f7fe700 1 --2- 172.21.15.136:0/2217477764 >> v2:172.21.15.178:3300/0 conn(0x7f58400d0a60 0x7f58400b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f583e7fc700 1 -- 172.21.15.136:0/2217477764 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008297986 0 0) 0x7f58400cd9d0 con 0x7f58400d0e30 2023-06-23T19:01:18.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f583effd700 1 -- 172.21.15.136:0/2217477764 >> v2:172.21.15.178:3300/0 conn(0x7f58400d0a60 msgr2=0x7f58400b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:18.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f583effd700 1 --2- 172.21.15.136:0/2217477764 >> v2:172.21.15.178:3300/0 conn(0x7f58400d0a60 0x7f58400b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f583effd700 1 -- 172.21.15.136:0/2217477764 >> v1:172.21.15.136:6789/0 conn(0x7f58400d0e30 legacy=0x7f58400d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.257+0000 7f583effd700 1 -- 172.21.15.136:0/2217477764 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400b5620 con 0x7f58400b51d0 2023-06-23T19:01:18.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f583effd700 1 --2- 172.21.15.136:0/2217477764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400b51d0 0x7f58400cf910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f584006c6e0 tx=0x7f5834009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5586c6ff30cba2af server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:18.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f583e7fc700 1 -- 172.21.15.136:0/2217477764 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834011830 con 0x7f58400b51d0 2023-06-23T19:01:18.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f583e7fc700 1 -- 172.21.15.136:0/2217477764 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834011990 con 0x7f58400b51d0 2023-06-23T19:01:18.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f583e7fc700 1 -- 172.21.15.136:0/2217477764 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834011d20 con 0x7f58400b51d0 2023-06-23T19:01:18.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f58461ff700 1 -- 172.21.15.136:0/2217477764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400b51d0 msgr2=0x7f58400cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f58461ff700 1 --2- 172.21.15.136:0/2217477764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400b51d0 0x7f58400cf910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f584006c6e0 tx=0x7f5834009b20 comp rx=0 tx=0).stop 2023-06-23T19:01:18.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f58461ff700 1 -- 172.21.15.136:0/2217477764 shutdown_connections 2023-06-23T19:01:18.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f58461ff700 1 --2- 172.21.15.136:0/2217477764 >> v2:172.21.15.178:3300/0 conn(0x7f58400d0a60 0x7f58400b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f58461ff700 1 --2- 172.21.15.136:0/2217477764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400b51d0 0x7f58400cf910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.258+0000 7f58461ff700 1 -- 172.21.15.136:0/2217477764 >> 172.21.15.136:0/2217477764 conn(0x7f5840071620 msgr2=0x7f58400719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:18.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.259+0000 7f58461ff700 1 -- 172.21.15.136:0/2217477764 shutdown_connections 2023-06-23T19:01:18.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.259+0000 7f58461ff700 1 -- 172.21.15.136:0/2217477764 wait complete. 2023-06-23T19:01:18.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.260+0000 7f58461ff700 1 Processor -- start 2023-06-23T19:01:18.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.260+0000 7f58461ff700 1 -- start start 2023-06-23T19:01:18.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.261+0000 7f58461ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58400b51d0 0x7f584015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.261+0000 7f58461ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58400d0a60 0x7f5840148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.261+0000 7f58461ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400d0e30 0x7f5840145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.261+0000 7f58461ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5840146510 con 0x7f58400d0e30 2023-06-23T19:01:18.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.261+0000 7f58461ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58401494f0 con 0x7f58400d0a60 2023-06-23T19:01:18.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.261+0000 7f58461ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584015edf0 con 0x7f58400b51d0 2023-06-23T19:01:18.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400d0e30 0x7f5840145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400d0e30 0x7f5840145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54822/0 (socket says 172.21.15.136:54822) 2023-06-23T19:01:18.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583ffff700 1 -- 172.21.15.136:0/1704908579 learned_addr learned my addr 172.21.15.136:0/1704908579 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:18.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583f7fe700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58400b51d0 0x7f584015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583effd700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58400d0a60 0x7f5840148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583ffff700 1 -- 172.21.15.136:0/1704908579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58400b51d0 msgr2=0x7f584015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583ffff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58400b51d0 0x7f584015e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583ffff700 1 -- 172.21.15.136:0/1704908579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58400d0a60 msgr2=0x7f5840148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583ffff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58400d0a60 0x7f5840148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583ffff700 1 -- 172.21.15.136:0/1704908579 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58340094a0 con 0x7f58400d0e30 2023-06-23T19:01:18.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f583ffff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400d0e30 0x7f5840145ba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f583800cba0 tx=0x7f583800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:18.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f5827fff700 1 -- 172.21.15.136:0/1704908579 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583800ab80 con 0x7f58400d0e30 2023-06-23T19:01:18.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.262+0000 7f5827fff700 1 -- 172.21.15.136:0/1704908579 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583800ad00 con 0x7f58400d0e30 2023-06-23T19:01:18.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.263+0000 7f5827fff700 1 -- 172.21.15.136:0/1704908579 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838007310 con 0x7f58400d0e30 2023-06-23T19:01:18.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.263+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584015f0d0 con 0x7f58400d0e30 2023-06-23T19:01:18.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.263+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584015f690 con 0x7f58400d0e30 2023-06-23T19:01:18.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.264+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584004ea20 con 0x7f58400d0e30 2023-06-23T19:01:18.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.265+0000 7f5827fff700 1 -- 172.21.15.136:0/1704908579 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5838007470 con 0x7f58400d0e30 2023-06-23T19:01:18.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.265+0000 7f5827fff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f582c06ace0 0x7f582c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.266+0000 7f5827fff700 1 -- 172.21.15.136:0/1704908579 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5838089340 con 0x7f58400d0e30 2023-06-23T19:01:18.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.266+0000 7f583f7fe700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f582c06ace0 0x7f582c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.266+0000 7f583f7fe700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f582c06ace0 0x7f582c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5830009930 tx=0x7f5830008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:18.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.270+0000 7f5827fff700 1 -- 172.21.15.136:0/1704908579 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5838054060 con 0x7f58400d0e30 2023-06-23T19:01:18.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.464+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f584006a2b0 con 0x7f58400d0e30 2023-06-23T19:01:18.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.465+0000 7f5827fff700 1 -- 172.21.15.136:0/1704908579 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5838057680 con 0x7f58400d0e30 2023-06-23T19:01:18.469 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:01:18.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f582c06ace0 msgr2=0x7f582c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f582c06ace0 0x7f582c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5830009930 tx=0x7f5830008040 comp rx=0 tx=0).stop 2023-06-23T19:01:18.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400d0e30 msgr2=0x7f5840145ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400d0e30 0x7f5840145ba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f583800cba0 tx=0x7f583800cf60 comp rx=0 tx=0).stop 2023-06-23T19:01:18.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 shutdown_connections 2023-06-23T19:01:18.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f582c06ace0 0x7f582c06d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.474 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58400d0e30 0x7f5840145ba0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.474 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58400b51d0 0x7f584015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.474 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 --2- 172.21.15.136:0/1704908579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58400d0a60 0x7f5840148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.474 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 >> 172.21.15.136:0/1704908579 conn(0x7f5840071620 msgr2=0x7f58400b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:18.474 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 shutdown_connections 2023-06-23T19:01:18.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.467+0000 7f58461ff700 1 -- 172.21.15.136:0/1704908579 wait complete. 2023-06-23T19:01:18.489 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T19:01:18.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.678+0000 7f49afbff700 1 Processor -- start 2023-06-23T19:01:18.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.678+0000 7f49afbff700 1 -- start start 2023-06-23T19:01:18.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49afbff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f49a815c570 0x7f49a80cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49afbff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a8160e70 con 0x7f49a80cd660 2023-06-23T19:01:18.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49afbff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a81610a0 con 0x7f49a8160a50 2023-06-23T19:01:18.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49afbff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a815d670 con 0x7f49a815c570 2023-06-23T19:01:18.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49ad19a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f49a80cd660 0x7f49a8160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33252/0 (socket says 172.21.15.136:33252) 2023-06-23T19:01:18.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49ad19a700 1 -- 172.21.15.136:0/2905552259 learned_addr learned my addr 172.21.15.136:0/2905552259 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:18.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49ad99b700 1 --2- 172.21.15.136:0/2905552259 >> v2:172.21.15.136:3300/0 conn(0x7f49a815c570 0x7f49a80cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49ac999700 1 -- 172.21.15.136:0/2905552259 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060734982 0 0) 0x7f49a8160e70 con 0x7f49a80cd660 2023-06-23T19:01:18.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49ac999700 1 -- 172.21.15.136:0/2905552259 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49940035b0 con 0x7f49a80cd660 2023-06-23T19:01:18.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49ad99b700 1 -- 172.21.15.136:0/2905552259 >> v1:172.21.15.178:6789/0 conn(0x7f49a8160a50 legacy=0x7f49a80d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49ad99b700 1 -- 172.21.15.136:0/2905552259 >> v1:172.21.15.136:6789/0 conn(0x7f49a80cd660 legacy=0x7f49a8160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.680+0000 7f49ad99b700 1 -- 172.21.15.136:0/2905552259 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a815da90 con 0x7f49a815c570 2023-06-23T19:01:18.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.681+0000 7f49ad99b700 1 --2- 172.21.15.136:0/2905552259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a815c570 0x7f49a80cd120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009840 tx=0x7f49a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ea52817bf77c83 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:18.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.681+0000 7f49ac999700 1 -- 172.21.15.136:0/2905552259 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4011830 con 0x7f49a815c570 2023-06-23T19:01:18.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.681+0000 7f49ac999700 1 -- 172.21.15.136:0/2905552259 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a4011990 con 0x7f49a815c570 2023-06-23T19:01:18.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.681+0000 7f49ac999700 1 -- 172.21.15.136:0/2905552259 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4011d20 con 0x7f49a815c570 2023-06-23T19:01:18.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.681+0000 7f49afbff700 1 -- 172.21.15.136:0/2905552259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a815c570 msgr2=0x7f49a80cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.681+0000 7f49afbff700 1 --2- 172.21.15.136:0/2905552259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a815c570 0x7f49a80cd120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009840 tx=0x7f49a4009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:18.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.682+0000 7f49afbff700 1 -- 172.21.15.136:0/2905552259 shutdown_connections 2023-06-23T19:01:18.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.682+0000 7f49afbff700 1 --2- 172.21.15.136:0/2905552259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a815c570 0x7f49a80cd120 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.682+0000 7f49afbff700 1 -- 172.21.15.136:0/2905552259 >> 172.21.15.136:0/2905552259 conn(0x7f49a8071620 msgr2=0x7f49a80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:18.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.682+0000 7f49afbff700 1 -- 172.21.15.136:0/2905552259 shutdown_connections 2023-06-23T19:01:18.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.682+0000 7f49afbff700 1 -- 172.21.15.136:0/2905552259 wait complete. 2023-06-23T19:01:18.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.683+0000 7f49afbff700 1 Processor -- start 2023-06-23T19:01:18.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.683+0000 7f49afbff700 1 -- start start 2023-06-23T19:01:18.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.684+0000 7f49afbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a80cd660 0x7f49a81f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.684+0000 7f49afbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49a815c570 0x7f49a80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.684+0000 7f49afbff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49a8160a50 0x7f49a80cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.684+0000 7f49afbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a814b340 con 0x7f49a80cd660 2023-06-23T19:01:18.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.684+0000 7f49afbff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80c9ba0 con 0x7f49a8160a50 2023-06-23T19:01:18.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.684+0000 7f49afbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a81f1cb0 con 0x7f49a815c570 2023-06-23T19:01:18.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad99b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a80cd660 0x7f49a81f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad99b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a80cd660 0x7f49a81f1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54836/0 (socket says 172.21.15.136:54836) 2023-06-23T19:01:18.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad99b700 1 -- 172.21.15.136:0/510515107 learned_addr learned my addr 172.21.15.136:0/510515107 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:18.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad19a700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49a815c570 0x7f49a80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad99b700 1 -- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49a815c570 msgr2=0x7f49a80cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ae19c700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49a8160a50 0x7f49a80cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad99b700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49a815c570 0x7f49a80cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad99b700 1 -- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49a8160a50 msgr2=0x7f49a80cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad99b700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49a8160a50 0x7f49a80cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad99b700 1 -- 172.21.15.136:0/510515107 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40094a0 con 0x7f49a80cd660 2023-06-23T19:01:18.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad19a700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49a815c570 0x7f49a80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:18.704 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ae19c700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49a8160a50 0x7f49a80cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:18.704 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.685+0000 7f49ad99b700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a80cd660 0x7f49a81f1770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009fd0 tx=0x7f49a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:18.704 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.686+0000 7f499e7fc700 1 -- 172.21.15.136:0/510515107 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a40038a0 con 0x7f49a80cd660 2023-06-23T19:01:18.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.686+0000 7f499e7fc700 1 -- 172.21.15.136:0/510515107 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a401f070 con 0x7f49a80cd660 2023-06-23T19:01:18.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.686+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a80c8f00 con 0x7f49a80cd660 2023-06-23T19:01:18.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.686+0000 7f499e7fc700 1 -- 172.21.15.136:0/510515107 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4003c40 con 0x7f49a80cd660 2023-06-23T19:01:18.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.686+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a814af60 con 0x7f49a80cd660 2023-06-23T19:01:18.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.687+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a814aae0 con 0x7f49a80cd660 2023-06-23T19:01:18.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.688+0000 7f499e7fc700 1 -- 172.21.15.136:0/510515107 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49a4026480 con 0x7f49a80cd660 2023-06-23T19:01:18.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.688+0000 7f499e7fc700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f498c06ace0 0x7f498c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:18.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.689+0000 7f499e7fc700 1 -- 172.21.15.136:0/510515107 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f49a4021070 con 0x7f49a80cd660 2023-06-23T19:01:18.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.689+0000 7f49ad19a700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f498c06ace0 0x7f498c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:18.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.689+0000 7f49ad19a700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f498c06ace0 0x7f498c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49a81f5300 tx=0x7f4998009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:18.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.693+0000 7f499e7fc700 1 -- 172.21.15.136:0/510515107 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49a814aae0 con 0x7f49a80cd660 2023-06-23T19:01:18.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.904+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f49a814b480 con 0x7f49a80cd660 2023-06-23T19:01:18.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.904+0000 7f499e7fc700 1 -- 172.21.15.136:0/510515107 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f49a814b480 con 0x7f49a80cd660 2023-06-23T19:01:18.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f498c06ace0 msgr2=0x7f498c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f498c06ace0 0x7f498c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49a81f5300 tx=0x7f4998009040 comp rx=0 tx=0).stop 2023-06-23T19:01:18.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a80cd660 msgr2=0x7f49a81f1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:18.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a80cd660 0x7f49a81f1770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009fd0 tx=0x7f49a4004750 comp rx=0 tx=0).stop 2023-06-23T19:01:18.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 shutdown_connections 2023-06-23T19:01:18.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f498c06ace0 0x7f498c06d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49a8160a50 0x7f49a80cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a80cd660 0x7f49a81f1770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 --2- 172.21.15.136:0/510515107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49a815c570 0x7f49a80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:18.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 >> 172.21.15.136:0/510515107 conn(0x7f49a8071620 msgr2=0x7f49a815ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:18.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 shutdown_connections 2023-06-23T19:01:18.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:18.907+0000 7f49afbff700 1 -- 172.21.15.136:0/510515107 wait complete. 2023-06-23T19:01:18.913 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2023-06-23T19:01:18.929 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:01:18.929 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:01:18.973 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:19.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.202+0000 7fced07ff700 1 Processor -- start 2023-06-23T19:01:19.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.203+0000 7fced07ff700 1 -- start start 2023-06-23T19:01:19.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fced07ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcec815c3e0 0x7fcec80d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fced07ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec80cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fced07ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec80cfe90 con 0x7fcec815fe00 2023-06-23T19:01:19.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fced07ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec80cd150 con 0x7fcec815c3e0 2023-06-23T19:01:19.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fced07ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80d0870 con 0x7fcec80cf4e0 2023-06-23T19:01:19.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fcecdd9a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec80cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fcece59b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcec815c3e0 0x7fcec80d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fcecdd9a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec80cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54986/0 (socket says 172.21.15.136:54986) 2023-06-23T19:01:19.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fcecdd9a700 1 -- 172.21.15.136:0/2688764442 learned_addr learned my addr 172.21.15.136:0/2688764442 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:19.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.204+0000 7fceced9c700 1 --1- 172.21.15.136:0/2688764442 >> v1:172.21.15.178:6789/0 conn(0x7fcec815fe00 0x7fcec8160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:43160/0 (socket says 172.21.15.136:43160) 2023-06-23T19:01:19.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.205+0000 7fcece59b700 1 -- 172.21.15.136:0/2688764442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 msgr2=0x7fcec80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:19.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.205+0000 7fcece59b700 1 --2- 172.21.15.136:0/2688764442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec80cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.205+0000 7fcece59b700 1 -- 172.21.15.136:0/2688764442 >> v1:172.21.15.178:6789/0 conn(0x7fcec815fe00 legacy=0x7fcec8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.205+0000 7fcece59b700 1 -- 172.21.15.136:0/2688764442 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec80cd920 con 0x7fcec815c3e0 2023-06-23T19:01:19.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.205+0000 7fcecdd9a700 1 --2- 172.21.15.136:0/2688764442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec80cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:19.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.205+0000 7fcece59b700 1 --2- 172.21.15.136:0/2688764442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcec815c3e0 0x7fcec80d3310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009840 tx=0x7fcec4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99c081d9f41bc89 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:19.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.205+0000 7fcecd599700 1 -- 172.21.15.136:0/2688764442 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4011830 con 0x7fcec815c3e0 2023-06-23T19:01:19.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.205+0000 7fcecd599700 1 -- 172.21.15.136:0/2688764442 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec4011990 con 0x7fcec815c3e0 2023-06-23T19:01:19.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.205+0000 7fcecd599700 1 -- 172.21.15.136:0/2688764442 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4011d20 con 0x7fcec815c3e0 2023-06-23T19:01:19.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.206+0000 7fced07ff700 1 -- 172.21.15.136:0/2688764442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcec815c3e0 msgr2=0x7fcec80d3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.206+0000 7fced07ff700 1 --2- 172.21.15.136:0/2688764442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcec815c3e0 0x7fcec80d3310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009840 tx=0x7fcec4009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:19.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.206+0000 7fced07ff700 1 -- 172.21.15.136:0/2688764442 shutdown_connections 2023-06-23T19:01:19.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.206+0000 7fced07ff700 1 --2- 172.21.15.136:0/2688764442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcec815c3e0 0x7fcec80d3310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.206+0000 7fced07ff700 1 --2- 172.21.15.136:0/2688764442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec80cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.206+0000 7fced07ff700 1 -- 172.21.15.136:0/2688764442 >> 172.21.15.136:0/2688764442 conn(0x7fcec806b340 msgr2=0x7fcec806b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:19.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.206+0000 7fced07ff700 1 -- 172.21.15.136:0/2688764442 shutdown_connections 2023-06-23T19:01:19.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.206+0000 7fced07ff700 1 -- 172.21.15.136:0/2688764442 wait complete. 2023-06-23T19:01:19.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.208+0000 7fced07ff700 1 Processor -- start 2023-06-23T19:01:19.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.208+0000 7fced07ff700 1 -- start start 2023-06-23T19:01:19.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fced07ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec815b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fced07ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec815c3e0 0x7fcec80c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fced07ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcec815fe00 0x7fcec80c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fced07ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec815bc60 con 0x7fcec815c3e0 2023-06-23T19:01:19.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fced07ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80cb8a0 con 0x7fcec815fe00 2023-06-23T19:01:19.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fced07ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80cbb80 con 0x7fcec80cf4e0 2023-06-23T19:01:19.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fcecdd9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec815c3e0 0x7fcec80c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fcecdd9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec815c3e0 0x7fcec80c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54838/0 (socket says 172.21.15.136:54838) 2023-06-23T19:01:19.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fcecdd9a700 1 -- 172.21.15.136:0/1034093795 learned_addr learned my addr 172.21.15.136:0/1034093795 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:19.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fcece59b700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.209+0000 7fceced9c700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcec815fe00 0x7fcec80c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fcecdd9a700 1 -- 172.21.15.136:0/1034093795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 msgr2=0x7fcec815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fcecdd9a700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec815b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fcecdd9a700 1 -- 172.21.15.136:0/1034093795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcec815fe00 msgr2=0x7fcec80c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fcecdd9a700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcec815fe00 0x7fcec80c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fcecdd9a700 1 -- 172.21.15.136:0/1034093795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8009550 con 0x7fcec815c3e0 2023-06-23T19:01:19.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fcecdd9a700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec815c3e0 0x7fcec80c6630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e9b0 tx=0x7fceb800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:19.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fcebeffd700 1 -- 172.21.15.136:0/1034093795 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb800ee50 con 0x7fcec815c3e0 2023-06-23T19:01:19.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fcebeffd700 1 -- 172.21.15.136:0/1034093795 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb800c850 con 0x7fcec815c3e0 2023-06-23T19:01:19.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fcebeffd700 1 -- 172.21.15.136:0/1034093795 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb800cbc0 con 0x7fcec815c3e0 2023-06-23T19:01:19.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec40094a0 con 0x7fcec815c3e0 2023-06-23T19:01:19.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.210+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec80cc140 con 0x7fcec815c3e0 2023-06-23T19:01:19.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.211+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec8073910 con 0x7fcec815c3e0 2023-06-23T19:01:19.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.212+0000 7fcebeffd700 1 -- 172.21.15.136:0/1034093795 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fceb800cd20 con 0x7fcec815c3e0 2023-06-23T19:01:19.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.214+0000 7fcebeffd700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fceac06ad10 0x7fceac06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.214+0000 7fcebeffd700 1 -- 172.21.15.136:0/1034093795 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fceb8089680 con 0x7fcec815c3e0 2023-06-23T19:01:19.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.214+0000 7fcece59b700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fceac06ad10 0x7fceac06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.215+0000 7fcece59b700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fceac06ad10 0x7fceac06d1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009fd0 tx=0x7fcec4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:19.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.218+0000 7fcebeffd700 1 -- 172.21.15.136:0/1034093795 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fceb80544d0 con 0x7fcec815c3e0 2023-06-23T19:01:19.422 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.419+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcec80b4f60 con 0x7fcec815c3e0 2023-06-23T19:01:19.423 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.420+0000 7fcebeffd700 1 -- 172.21.15.136:0/1034093795 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7fceb8057af0 con 0x7fcec815c3e0 2023-06-23T19:01:19.424 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:19.424 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:19.426 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fceac06ad10 msgr2=0x7fceac06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.426 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fceac06ad10 0x7fceac06d1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009fd0 tx=0x7fcec4008030 comp rx=0 tx=0).stop 2023-06-23T19:01:19.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec815c3e0 msgr2=0x7fcec80c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec815c3e0 0x7fcec80c6630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e9b0 tx=0x7fceb800ecc0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 shutdown_connections 2023-06-23T19:01:19.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fceac06ad10 0x7fceac06d1c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcec815fe00 0x7fcec80c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcec80cf4e0 0x7fcec815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 --2- 172.21.15.136:0/1034093795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec815c3e0 0x7fcec80c6630 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 >> 172.21.15.136:0/1034093795 conn(0x7fcec806b340 msgr2=0x7fcec8160200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:19.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 shutdown_connections 2023-06-23T19:01:19.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.423+0000 7fced07ff700 1 -- 172.21.15.136:0/1034093795 wait complete. 2023-06-23T19:01:19.445 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:01:19.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:01:19.642 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.638+0000 7f61be7ff700 1 Processor -- start 2023-06-23T19:01:19.642 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.638+0000 7f61be7ff700 1 -- start start 2023-06-23T19:01:19.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.640+0000 7f61be7ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f61b80d0a60 0x7f61b80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.640+0000 7f61be7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 0x7f61b80d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.640+0000 7f61be7ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b80cd9d0 con 0x7f61b80b51d0 2023-06-23T19:01:19.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.640+0000 7f61be7ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b80d0060 con 0x7f61b80d0a60 2023-06-23T19:01:19.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.640+0000 7f61be7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80b5620 con 0x7f61b80cf910 2023-06-23T19:01:19.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.640+0000 7f61b7fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f61b80d0a60 0x7f61b80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.640+0000 7f61b7fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f61b80d0a60 0x7f61b80b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54840/0 (socket says 172.21.15.136:54840) 2023-06-23T19:01:19.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.640+0000 7f61b7fff700 1 -- 172.21.15.136:0/1183479720 learned_addr learned my addr 172.21.15.136:0/1183479720 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:19.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.640+0000 7f61bcd9c700 1 --2- 172.21.15.136:0/1183479720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 0x7f61b80d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.641+0000 7f61b7fff700 1 -- 172.21.15.136:0/1183479720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 msgr2=0x7f61b80d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:19.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.641+0000 7f61b7fff700 1 --2- 172.21.15.136:0/1183479720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 0x7f61b80d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.641+0000 7f61b7fff700 1 -- 172.21.15.136:0/1183479720 >> v1:172.21.15.178:6789/0 conn(0x7f61b80b51d0 legacy=0x7f61b80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.641+0000 7f61b7fff700 1 -- 172.21.15.136:0/1183479720 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b80cfd90 con 0x7f61b80d0a60 2023-06-23T19:01:19.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.641+0000 7f61b7fff700 1 --2- 172.21.15.136:0/1183479720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 0x7f61b80b5a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f61a80098f0 tx=0x7f61a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1add96d328a2c5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:19.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.641+0000 7f61b6ffd700 1 -- 172.21.15.136:0/1183479720 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800b8a0 con 0x7f61b80d0a60 2023-06-23T19:01:19.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.641+0000 7f61b6ffd700 1 -- 172.21.15.136:0/1183479720 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a800ba00 con 0x7f61b80d0a60 2023-06-23T19:01:19.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.641+0000 7f61b6ffd700 1 -- 172.21.15.136:0/1183479720 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800bd90 con 0x7f61b80d0a60 2023-06-23T19:01:19.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.642+0000 7f61be7ff700 1 -- 172.21.15.136:0/1183479720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 msgr2=0x7f61b80b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.642+0000 7f61be7ff700 1 --2- 172.21.15.136:0/1183479720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 0x7f61b80b5a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f61a80098f0 tx=0x7f61a8009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:19.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.642+0000 7f61be7ff700 1 -- 172.21.15.136:0/1183479720 shutdown_connections 2023-06-23T19:01:19.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.642+0000 7f61be7ff700 1 --2- 172.21.15.136:0/1183479720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 0x7f61b80b5a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.642+0000 7f61be7ff700 1 --2- 172.21.15.136:0/1183479720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 0x7f61b80d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.642+0000 7f61be7ff700 1 -- 172.21.15.136:0/1183479720 >> 172.21.15.136:0/1183479720 conn(0x7f61b8071620 msgr2=0x7f61b80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:19.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.642+0000 7f61be7ff700 1 -- 172.21.15.136:0/1183479720 shutdown_connections 2023-06-23T19:01:19.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.642+0000 7f61be7ff700 1 -- 172.21.15.136:0/1183479720 wait complete. 2023-06-23T19:01:19.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.644+0000 7f61be7ff700 1 Processor -- start 2023-06-23T19:01:19.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.644+0000 7f61be7ff700 1 -- start start 2023-06-23T19:01:19.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61be7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b80b51d0 0x7f61b81f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61be7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 0x7f61b8157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61be7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 0x7f61b81f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61be7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b81f2ba0 con 0x7f61b80d0a60 2023-06-23T19:01:19.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61be7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b81f56d0 con 0x7f61b80b51d0 2023-06-23T19:01:19.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61be7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b81f60a0 con 0x7f61b80cf910 2023-06-23T19:01:19.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61bcd9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 0x7f61b81f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61bcd9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 0x7f61b81f1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54854/0 (socket says 172.21.15.136:54854) 2023-06-23T19:01:19.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61bcd9c700 1 -- 172.21.15.136:0/2880720062 learned_addr learned my addr 172.21.15.136:0/2880720062 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:19.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61b7fff700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b80b51d0 0x7f61b81f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61b77fe700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 0x7f61b8157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61bcd9c700 1 -- 172.21.15.136:0/2880720062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 msgr2=0x7f61b8157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61bcd9c700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 0x7f61b8157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61bcd9c700 1 -- 172.21.15.136:0/2880720062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b80b51d0 msgr2=0x7f61b81f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61bcd9c700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b80b51d0 0x7f61b81f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.646+0000 7f61bcd9c700 1 -- 172.21.15.136:0/2880720062 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8009550 con 0x7f61b80d0a60 2023-06-23T19:01:19.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.647+0000 7f61bcd9c700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 0x7f61b81f1bd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f61b0007e40 tx=0x7f61b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:19.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.647+0000 7f61b4ff9700 1 -- 172.21.15.136:0/2880720062 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b000ede0 con 0x7f61b80d0a60 2023-06-23T19:01:19.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.647+0000 7f61b4ff9700 1 -- 172.21.15.136:0/2880720062 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b0014420 con 0x7f61b80d0a60 2023-06-23T19:01:19.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.647+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b81f25e0 con 0x7f61b80d0a60 2023-06-23T19:01:19.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.647+0000 7f61b4ff9700 1 -- 172.21.15.136:0/2880720062 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b00147d0 con 0x7f61b80d0a60 2023-06-23T19:01:19.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.647+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b81f5360 con 0x7f61b80d0a60 2023-06-23T19:01:19.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.648+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b81f51c0 con 0x7f61b80d0a60 2023-06-23T19:01:19.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.649+0000 7f61b4ff9700 1 -- 172.21.15.136:0/2880720062 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61b0014930 con 0x7f61b80d0a60 2023-06-23T19:01:19.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.650+0000 7f61b4ff9700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f61a406ace0 0x7f61a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:19.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.650+0000 7f61b4ff9700 1 -- 172.21.15.136:0/2880720062 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f61b0089fb0 con 0x7f61b80d0a60 2023-06-23T19:01:19.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.650+0000 7f61b7fff700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f61a406ace0 0x7f61a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:19.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.651+0000 7f61b7fff700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f61a406ace0 0x7f61a406d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f61a8014040 tx=0x7f61a8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:19.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.655+0000 7f61b4ff9700 1 -- 172.21.15.136:0/2880720062 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61b81f51c0 con 0x7f61b80d0a60 2023-06-23T19:01:19.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.849+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61b81f51c0 con 0x7f61b80d0a60 2023-06-23T19:01:19.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.850+0000 7f61b4ff9700 1 -- 172.21.15.136:0/2880720062 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61b81f51c0 con 0x7f61b80d0a60 2023-06-23T19:01:19.854 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:01:19.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f61a406ace0 msgr2=0x7f61a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f61a406ace0 0x7f61a406d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f61a8014040 tx=0x7f61a8008030 comp rx=0 tx=0).stop 2023-06-23T19:01:19.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 msgr2=0x7f61b81f1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:19.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 0x7f61b81f1bd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f61b0007e40 tx=0x7f61b000e3c0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 shutdown_connections 2023-06-23T19:01:19.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f61a406ace0 0x7f61a406d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b80b51d0 0x7f61b81f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61b80d0a60 0x7f61b81f1bd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 --2- 172.21.15.136:0/2880720062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b80cf910 0x7f61b8157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:19.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 >> 172.21.15.136:0/2880720062 conn(0x7f61b8071620 msgr2=0x7f61b8072990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:19.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 shutdown_connections 2023-06-23T19:01:19.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:19.852+0000 7f61be7ff700 1 -- 172.21.15.136:0/2880720062 wait complete. 2023-06-23T19:01:19.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:01:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.068+0000 7f40c97ff700 1 Processor -- start 2023-06-23T19:01:20.073 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.069+0000 7f40c97ff700 1 -- start start 2023-06-23T19:01:20.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c97ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40c40b5a70 0x7f40c40b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c97ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40cf910 0x7f40c40d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c97ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c40b5ec0 con 0x7f40c40d0a60 2023-06-23T19:01:20.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c97ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c40d0060 con 0x7f40c40b5a70 2023-06-23T19:01:20.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c97ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40cd9d0 con 0x7f40c40cf910 2023-06-23T19:01:20.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c27fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40c40b5a70 0x7f40c40b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c37fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40cf910 0x7f40c40d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c2ffd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f40c40d0a60 0x7f40c40d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:43184/0 (socket says 172.21.15.136:43184) 2023-06-23T19:01:20.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c37fe700 1 --2- 172.21.15.136:0/1820689981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40cf910 0x7f40c40d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:55030/0 (socket says 172.21.15.136:55030) 2023-06-23T19:01:20.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.070+0000 7f40c2ffd700 1 -- 172.21.15.136:0/1820689981 learned_addr learned my addr 172.21.15.136:0/1820689981 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:20.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.071+0000 7f40c27fc700 1 -- 172.21.15.136:0/1820689981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40cf910 msgr2=0x7f40c40d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:20.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.071+0000 7f40c27fc700 1 --2- 172.21.15.136:0/1820689981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40cf910 0x7f40c40d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.071+0000 7f40c27fc700 1 -- 172.21.15.136:0/1820689981 >> v1:172.21.15.178:6789/0 conn(0x7f40c40d0a60 legacy=0x7f40c40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.077 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.071+0000 7f40c27fc700 1 -- 172.21.15.136:0/1820689981 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c40cfd90 con 0x7f40c40b5a70 2023-06-23T19:01:20.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.071+0000 7f40c27fc700 1 --2- 172.21.15.136:0/1820689981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c40b5a70 0x7f40c40b51d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009840 tx=0x7f40b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=129c6425e874b9ba server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:20.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.071+0000 7f40c1ffb700 1 -- 172.21.15.136:0/1820689981 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8011830 con 0x7f40c40b5a70 2023-06-23T19:01:20.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.071+0000 7f40c1ffb700 1 -- 172.21.15.136:0/1820689981 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b8011990 con 0x7f40c40b5a70 2023-06-23T19:01:20.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.071+0000 7f40c1ffb700 1 -- 172.21.15.136:0/1820689981 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8011d20 con 0x7f40c40b5a70 2023-06-23T19:01:20.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.072+0000 7f40c97ff700 1 -- 172.21.15.136:0/1820689981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c40b5a70 msgr2=0x7f40c40b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.072+0000 7f40c97ff700 1 --2- 172.21.15.136:0/1820689981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c40b5a70 0x7f40c40b51d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009840 tx=0x7f40b8009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:20.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.072+0000 7f40c97ff700 1 -- 172.21.15.136:0/1820689981 shutdown_connections 2023-06-23T19:01:20.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.072+0000 7f40c97ff700 1 --2- 172.21.15.136:0/1820689981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40cf910 0x7f40c40d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.072+0000 7f40c97ff700 1 --2- 172.21.15.136:0/1820689981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c40b5a70 0x7f40c40b51d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.072+0000 7f40c97ff700 1 -- 172.21.15.136:0/1820689981 >> 172.21.15.136:0/1820689981 conn(0x7f40c4071620 msgr2=0x7f40c40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:20.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.072+0000 7f40c97ff700 1 -- 172.21.15.136:0/1820689981 shutdown_connections 2023-06-23T19:01:20.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.072+0000 7f40c97ff700 1 -- 172.21.15.136:0/1820689981 wait complete. 2023-06-23T19:01:20.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.074+0000 7f40c97ff700 1 Processor -- start 2023-06-23T19:01:20.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.074+0000 7f40c97ff700 1 -- start start 2023-06-23T19:01:20.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c97ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40b5a70 0x7f40c415e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c97ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c40cf910 0x7f40c40cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c97ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0a60 0x7f40c40a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c97ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40caf90 con 0x7f40c40d0a60 2023-06-23T19:01:20.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c97ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40cb4f0 con 0x7f40c40cf910 2023-06-23T19:01:20.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c97ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40cb7d0 con 0x7f40c40b5a70 2023-06-23T19:01:20.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0a60 0x7f40c40a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0a60 0x7f40c40a9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54862/0 (socket says 172.21.15.136:54862) 2023-06-23T19:01:20.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c37fe700 1 -- 172.21.15.136:0/2431594477 learned_addr learned my addr 172.21.15.136:0/2431594477 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:20.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c2ffd700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40b5a70 0x7f40c415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.075+0000 7f40c27fc700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c40cf910 0x7f40c40cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40c37fe700 1 -- 172.21.15.136:0/2431594477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40b5a70 msgr2=0x7f40c415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40c37fe700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40b5a70 0x7f40c415e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40c37fe700 1 -- 172.21.15.136:0/2431594477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c40cf910 msgr2=0x7f40c40cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40c37fe700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c40cf910 0x7f40c40cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40c37fe700 1 -- 172.21.15.136:0/2431594477 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b80094a0 con 0x7f40c40d0a60 2023-06-23T19:01:20.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40c37fe700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0a60 0x7f40c40a9530 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00efc0 tx=0x7f40bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:20.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40ab7fe700 1 -- 172.21.15.136:0/2431594477 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc009ea0 con 0x7f40c40d0a60 2023-06-23T19:01:20.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40ab7fe700 1 -- 172.21.15.136:0/2431594477 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc00f040 con 0x7f40c40d0a60 2023-06-23T19:01:20.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40ab7fe700 1 -- 172.21.15.136:0/2431594477 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc00ced0 con 0x7f40c40d0a60 2023-06-23T19:01:20.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c40cbab0 con 0x7f40c40d0a60 2023-06-23T19:01:20.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.076+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c40cb1f0 con 0x7f40c40d0a60 2023-06-23T19:01:20.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.077+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c404ea20 con 0x7f40c40d0a60 2023-06-23T19:01:20.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.078+0000 7f40ab7fe700 1 -- 172.21.15.136:0/2431594477 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40bc014480 con 0x7f40c40d0a60 2023-06-23T19:01:20.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.079+0000 7f40ab7fe700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f40b006ace0 0x7f40b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.079+0000 7f40ab7fe700 1 -- 172.21.15.136:0/2431594477 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f40bc08a010 con 0x7f40c40d0a60 2023-06-23T19:01:20.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.079+0000 7f40c2ffd700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f40b006ace0 0x7f40b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.080+0000 7f40c2ffd700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f40b006ace0 0x7f40b006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40b4005910 tx=0x7f40b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:20.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.083+0000 7f40ab7fe700 1 -- 172.21.15.136:0/2431594477 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f40bc054d30 con 0x7f40c40d0a60 2023-06-23T19:01:20.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.278+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f40c40b19e0 con 0x7f40c40d0a60 2023-06-23T19:01:20.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.279+0000 7f40ab7fe700 1 -- 172.21.15.136:0/2431594477 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f40bc0180a0 con 0x7f40c40d0a60 2023-06-23T19:01:20.283 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:01:20.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f40b006ace0 msgr2=0x7f40b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f40b006ace0 0x7f40b006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40b4005910 tx=0x7f40b4009040 comp rx=0 tx=0).stop 2023-06-23T19:01:20.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0a60 msgr2=0x7f40c40a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0a60 0x7f40c40a9530 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00efc0 tx=0x7f40bc00c3a0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 shutdown_connections 2023-06-23T19:01:20.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f40b006ace0 0x7f40b006d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0a60 0x7f40c40a9530 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40b5a70 0x7f40c415e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 --2- 172.21.15.136:0/2431594477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c40cf910 0x7f40c40cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 >> 172.21.15.136:0/2431594477 conn(0x7f40c4071620 msgr2=0x7f40c40b62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:20.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 shutdown_connections 2023-06-23T19:01:20.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.281+0000 7f40c97ff700 1 -- 172.21.15.136:0/2431594477 wait complete. 2023-06-23T19:01:20.303 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:01:20.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.498+0000 7f655f5ff700 1 Processor -- start 2023-06-23T19:01:20.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.498+0000 7f655f5ff700 1 -- start start 2023-06-23T19:01:20.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.499+0000 7f655f5ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f65580b5a70 0x7f65580b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.499+0000 7f655f5ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65580b5ec0 con 0x7f65580d0a60 2023-06-23T19:01:20.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.499+0000 7f655f5ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65580cd9d0 con 0x7f65580cf910 2023-06-23T19:01:20.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.499+0000 7f655f5ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65580d0060 con 0x7f65580b5a70 2023-06-23T19:01:20.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.499+0000 7f655cb9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f65580b5a70 0x7f65580b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.499+0000 7f655d39b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f65580d0a60 0x7f65580d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33254/0 (socket says 172.21.15.136:33254) 2023-06-23T19:01:20.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.499+0000 7f655d39b700 1 -- 172.21.15.136:0/4002147025 learned_addr learned my addr 172.21.15.136:0/4002147025 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:20.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.500+0000 7f655cb9a700 1 -- 172.21.15.136:0/4002147025 >> v1:172.21.15.178:6789/0 conn(0x7f65580cf910 legacy=0x7f65580d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:20.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.500+0000 7f655cb9a700 1 -- 172.21.15.136:0/4002147025 >> v1:172.21.15.136:6789/0 conn(0x7f65580d0a60 legacy=0x7f65580d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.500+0000 7f655cb9a700 1 -- 172.21.15.136:0/4002147025 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65580cd410 con 0x7f65580b5a70 2023-06-23T19:01:20.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.500+0000 7f654ffff700 1 -- 172.21.15.136:0/4002147025 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450808735 0 0) 0x7f65580b5ec0 con 0x7f65580d0a60 2023-06-23T19:01:20.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.500+0000 7f655cb9a700 1 --2- 172.21.15.136:0/4002147025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 0x7f65580b51d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6548009840 tx=0x7f6548009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7ca6d49968a017 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:20.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.500+0000 7f654ffff700 1 -- 172.21.15.136:0/4002147025 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548004230 con 0x7f65580b5a70 2023-06-23T19:01:20.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.500+0000 7f654ffff700 1 -- 172.21.15.136:0/4002147025 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548004390 con 0x7f65580b5a70 2023-06-23T19:01:20.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.500+0000 7f654ffff700 1 -- 172.21.15.136:0/4002147025 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480036a0 con 0x7f65580b5a70 2023-06-23T19:01:20.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.501+0000 7f655f5ff700 1 -- 172.21.15.136:0/4002147025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 msgr2=0x7f65580b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.501+0000 7f655f5ff700 1 --2- 172.21.15.136:0/4002147025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 0x7f65580b51d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6548009840 tx=0x7f6548009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:20.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.501+0000 7f655f5ff700 1 -- 172.21.15.136:0/4002147025 shutdown_connections 2023-06-23T19:01:20.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.501+0000 7f655f5ff700 1 --2- 172.21.15.136:0/4002147025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 0x7f65580b51d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.501+0000 7f655f5ff700 1 -- 172.21.15.136:0/4002147025 >> 172.21.15.136:0/4002147025 conn(0x7f6558071620 msgr2=0x7f65580719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:20.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.501+0000 7f655f5ff700 1 -- 172.21.15.136:0/4002147025 shutdown_connections 2023-06-23T19:01:20.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.501+0000 7f655f5ff700 1 -- 172.21.15.136:0/4002147025 wait complete. 2023-06-23T19:01:20.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.503+0000 7f655f5ff700 1 Processor -- start 2023-06-23T19:01:20.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.503+0000 7f655f5ff700 1 -- start start 2023-06-23T19:01:20.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655f5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 0x7f6558153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655f5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65580cf910 0x7f655815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655f5ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65580d0a60 0x7f65580c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655f5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65580c9510 con 0x7f65580b5a70 2023-06-23T19:01:20.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655f5ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655815f860 con 0x7f65580d0a60 2023-06-23T19:01:20.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655f5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655815efc0 con 0x7f65580cf910 2023-06-23T19:01:20.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655d39b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 0x7f6558153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655d39b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 0x7f6558153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54880/0 (socket says 172.21.15.136:54880) 2023-06-23T19:01:20.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655d39b700 1 -- 172.21.15.136:0/3515202997 learned_addr learned my addr 172.21.15.136:0/3515202997 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:20.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655cb9a700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65580cf910 0x7f655815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655db9c700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65580d0a60 0x7f65580c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655d39b700 1 -- 172.21.15.136:0/3515202997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65580cf910 msgr2=0x7f655815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655d39b700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65580cf910 0x7f655815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655d39b700 1 -- 172.21.15.136:0/3515202997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65580d0a60 msgr2=0x7f65580c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655d39b700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65580d0a60 0x7f65580c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655d39b700 1 -- 172.21.15.136:0/3515202997 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65480094a0 con 0x7f65580b5a70 2023-06-23T19:01:20.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.504+0000 7f655cb9a700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65580cf910 0x7f655815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:20.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.505+0000 7f655d39b700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 0x7f6558153370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f655400c550 tx=0x7f655400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:20.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.505+0000 7f654dffb700 1 -- 172.21.15.136:0/3515202997 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554004c80 con 0x7f65580b5a70 2023-06-23T19:01:20.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.505+0000 7f654dffb700 1 -- 172.21.15.136:0/3515202997 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6554004e00 con 0x7f65580b5a70 2023-06-23T19:01:20.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.505+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655815f2a0 con 0x7f65580b5a70 2023-06-23T19:01:20.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.505+0000 7f654dffb700 1 -- 172.21.15.136:0/3515202997 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554007310 con 0x7f65580b5a70 2023-06-23T19:01:20.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.505+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65580caf70 con 0x7f65580b5a70 2023-06-23T19:01:20.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.506+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655804ea20 con 0x7f65580b5a70 2023-06-23T19:01:20.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.507+0000 7f654dffb700 1 -- 172.21.15.136:0/3515202997 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6554007470 con 0x7f65580b5a70 2023-06-23T19:01:20.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.508+0000 7f654dffb700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f653c06ace0 0x7f653c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.508+0000 7f654dffb700 1 -- 172.21.15.136:0/3515202997 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f65540894c0 con 0x7f65580b5a70 2023-06-23T19:01:20.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.508+0000 7f655cb9a700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f653c06ace0 0x7f653c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.509+0000 7f655cb9a700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f653c06ace0 0x7f653c06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6548000c00 tx=0x7f654801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:20.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.512+0000 7f654dffb700 1 -- 172.21.15.136:0/3515202997 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6554054270 con 0x7f65580b5a70 2023-06-23T19:01:20.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.706+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f655815c4c0 con 0x7f65580b5a70 2023-06-23T19:01:20.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.707+0000 7f654dffb700 1 -- 172.21.15.136:0/3515202997 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6554057890 con 0x7f65580b5a70 2023-06-23T19:01:20.711 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:01:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f653c06ace0 msgr2=0x7f653c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f653c06ace0 0x7f653c06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6548000c00 tx=0x7f654801c040 comp rx=0 tx=0).stop 2023-06-23T19:01:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 msgr2=0x7f6558153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 0x7f6558153370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f655400c550 tx=0x7f655400c910 comp rx=0 tx=0).stop 2023-06-23T19:01:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 shutdown_connections 2023-06-23T19:01:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f653c06ace0 0x7f653c06d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65580d0a60 0x7f65580c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580b5a70 0x7f6558153370 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 --2- 172.21.15.136:0/3515202997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65580cf910 0x7f655815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 >> 172.21.15.136:0/3515202997 conn(0x7f6558071620 msgr2=0x7f65580d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 shutdown_connections 2023-06-23T19:01:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.709+0000 7f655f5ff700 1 -- 172.21.15.136:0/3515202997 wait complete. 2023-06-23T19:01:20.731 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.925+0000 7f5e0adff700 1 Processor -- start 2023-06-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.925+0000 7f5e0adff700 1 -- start start 2023-06-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.926+0000 7f5e0adff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5e040b5a70 0x7f5e040b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.926+0000 7f5e0adff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040cf910 0x7f5e040d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.926+0000 7f5e0adff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e040b5ec0 con 0x7f5e040d0a60 2023-06-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.926+0000 7f5e0adff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e040d0060 con 0x7f5e040b5a70 2023-06-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.926+0000 7f5e0adff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040cd9d0 con 0x7f5e040cf910 2023-06-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.926+0000 7f5e08b9b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5e040d0a60 0x7f5e040d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33268/0 (socket says 172.21.15.136:33268) 2023-06-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.926+0000 7f5e08b9b700 1 -- 172.21.15.136:0/1062870158 learned_addr learned my addr 172.21.15.136:0/1062870158 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.926+0000 7f5e03fff700 1 --2- 172.21.15.136:0/1062870158 >> v2:172.21.15.136:3300/0 conn(0x7f5e040b5a70 0x7f5e040b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.927+0000 7f5e0939c700 1 --2- 172.21.15.136:0/1062870158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040cf910 0x7f5e040d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.927+0000 7f5e037fe700 1 -- 172.21.15.136:0/1062870158 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627703439 0 0) 0x7f5e040b5ec0 con 0x7f5e040d0a60 2023-06-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.927+0000 7f5e037fe700 1 -- 172.21.15.136:0/1062870158 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df40035b0 con 0x7f5e040d0a60 2023-06-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.927+0000 7f5e03fff700 1 -- 172.21.15.136:0/1062870158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040cf910 msgr2=0x7f5e040d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.927+0000 7f5e03fff700 1 --2- 172.21.15.136:0/1062870158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040cf910 0x7f5e040d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.927+0000 7f5e03fff700 1 -- 172.21.15.136:0/1062870158 >> v1:172.21.15.136:6789/0 conn(0x7f5e040d0a60 legacy=0x7f5e040d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.927+0000 7f5e03fff700 1 -- 172.21.15.136:0/1062870158 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040cfd90 con 0x7f5e040b5a70 2023-06-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.927+0000 7f5e03fff700 1 --2- 172.21.15.136:0/1062870158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040b5a70 0x7f5e040b51d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009840 tx=0x7f5df0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f74f6b5f210e1b7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e037fe700 1 -- 172.21.15.136:0/1062870158 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0011830 con 0x7f5e040b5a70 2023-06-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e037fe700 1 -- 172.21.15.136:0/1062870158 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0011990 con 0x7f5e040b5a70 2023-06-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e037fe700 1 -- 172.21.15.136:0/1062870158 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0011d20 con 0x7f5e040b5a70 2023-06-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e0adff700 1 -- 172.21.15.136:0/1062870158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040b5a70 msgr2=0x7f5e040b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e0adff700 1 --2- 172.21.15.136:0/1062870158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040b5a70 0x7f5e040b51d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009840 tx=0x7f5df0009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e0adff700 1 -- 172.21.15.136:0/1062870158 shutdown_connections 2023-06-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e0adff700 1 --2- 172.21.15.136:0/1062870158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040cf910 0x7f5e040d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e0adff700 1 --2- 172.21.15.136:0/1062870158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040b5a70 0x7f5e040b51d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e0adff700 1 -- 172.21.15.136:0/1062870158 >> 172.21.15.136:0/1062870158 conn(0x7f5e04071620 msgr2=0x7f5e040719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e0adff700 1 -- 172.21.15.136:0/1062870158 shutdown_connections 2023-06-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.928+0000 7f5e0adff700 1 -- 172.21.15.136:0/1062870158 wait complete. 2023-06-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.931+0000 7f5e0adff700 1 Processor -- start 2023-06-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.931+0000 7f5e0adff700 1 -- start start 2023-06-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e0adff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040b5a70 0x7f5e0415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e0adff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040cf910 0x7f5e0415eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e0adff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e040d0a60 0x7f5e040cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e0adff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040cad40 con 0x7f5e040cf910 2023-06-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e0adff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040caf90 con 0x7f5e040d0a60 2023-06-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e0adff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040cb270 con 0x7f5e040b5a70 2023-06-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e03fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040cf910 0x7f5e0415eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e08b9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040b5a70 0x7f5e0415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e03fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040cf910 0x7f5e0415eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54898/0 (socket says 172.21.15.136:54898) 2023-06-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.932+0000 7f5e03fff700 1 -- 172.21.15.136:0/878426607 learned_addr learned my addr 172.21.15.136:0/878426607 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e0939c700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e040d0a60 0x7f5e040cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e03fff700 1 -- 172.21.15.136:0/878426607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040b5a70 msgr2=0x7f5e0415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e03fff700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040b5a70 0x7f5e0415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e03fff700 1 -- 172.21.15.136:0/878426607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e040d0a60 msgr2=0x7f5e040cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e03fff700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e040d0a60 0x7f5e040cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e03fff700 1 -- 172.21.15.136:0/878426607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00094a0 con 0x7f5e040cf910 2023-06-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e0939c700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e040d0a60 0x7f5e040cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e03fff700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040cf910 0x7f5e0415eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5df00090b0 tx=0x7f5df0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e017fa700 1 -- 172.21.15.136:0/878426607 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00036a0 con 0x7f5e040cf910 2023-06-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e017fa700 1 -- 172.21.15.136:0/878426607 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df001f070 con 0x7f5e040cf910 2023-06-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e040cb550 con 0x7f5e040cf910 2023-06-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e017fa700 1 -- 172.21.15.136:0/878426607 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0003a60 con 0x7f5e040cf910 2023-06-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.933+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e040cbb10 con 0x7f5e040cf910 2023-06-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.935+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e040cde60 con 0x7f5e040cf910 2023-06-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.935+0000 7f5e017fa700 1 -- 172.21.15.136:0/878426607 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5df0003bc0 con 0x7f5e040cf910 2023-06-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.937+0000 7f5e017fa700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5de806ace0 0x7f5de806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.937+0000 7f5e017fa700 1 -- 172.21.15.136:0/878426607 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5df0021070 con 0x7f5e040cf910 2023-06-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.937+0000 7f5e08b9b700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5de806ace0 0x7f5de806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.937+0000 7f5e08b9b700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5de806ace0 0x7f5de806d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5df8007fd0 tx=0x7f5df8007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:20.941+0000 7f5e017fa700 1 -- 172.21.15.136:0/878426607 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5df0055dd0 con 0x7f5e040cf910 2023-06-23T19:01:21.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.139+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e0404ea20 con 0x7f5e040cf910 2023-06-23T19:01:21.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.139+0000 7f5e017fa700 1 -- 172.21.15.136:0/878426607 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5df00593f0 con 0x7f5e040cf910 2023-06-23T19:01:21.143 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:01:21.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5de806ace0 msgr2=0x7f5de806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5de806ace0 0x7f5de806d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5df8007fd0 tx=0x7f5df8007dc0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040cf910 msgr2=0x7f5e0415eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040cf910 0x7f5e0415eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5df00090b0 tx=0x7f5df0004750 comp rx=0 tx=0).stop 2023-06-23T19:01:21.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 shutdown_connections 2023-06-23T19:01:21.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5de806ace0 0x7f5de806d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e040d0a60 0x7f5e040cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e040b5a70 0x7f5e0415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 --2- 172.21.15.136:0/878426607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e040cf910 0x7f5e0415eb30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 >> 172.21.15.136:0/878426607 conn(0x7f5e04071620 msgr2=0x7f5e040b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:21.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 shutdown_connections 2023-06-23T19:01:21.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.142+0000 7f5e0adff700 1 -- 172.21.15.136:0/878426607 wait complete. 2023-06-23T19:01:21.164 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:01:21.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.356+0000 7fbd21bff700 1 Processor -- start 2023-06-23T19:01:21.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.356+0000 7fbd21bff700 1 -- start start 2023-06-23T19:01:21.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.357+0000 7fbd21bff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbd1c0b0e80 0x7fbd1c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.357+0000 7fbd21bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c0c55e0 con 0x7fbd1c0709f0 2023-06-23T19:01:21.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.357+0000 7fbd21bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c0b4420 con 0x7fbd1c158ad0 2023-06-23T19:01:21.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.357+0000 7fbd21bff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c15d0e0 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd13fff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fbd1c0709f0 0x7fbd1c0b2930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33270/0 (socket says 172.21.15.136:33270) 2023-06-23T19:01:21.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd13fff700 1 -- 172.21.15.136:0/1828549255 learned_addr learned my addr 172.21.15.136:0/1828549255 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:21.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd1bfff700 1 --2- 172.21.15.136:0/1828549255 >> v2:172.21.15.178:3300/0 conn(0x7fbd1c0b0e80 0x7fbd1c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd1affd700 1 -- 172.21.15.136:0/1828549255 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990574 0 0) 0x7fbd1c0c55e0 con 0x7fbd1c0709f0 2023-06-23T19:01:21.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd1affd700 1 -- 172.21.15.136:0/1828549255 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd080046c0 con 0x7fbd1c0709f0 2023-06-23T19:01:21.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd1affd700 1 -- 172.21.15.136:0/1828549255 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045387662 0 0) 0x7fbd1c0b4420 con 0x7fbd1c158ad0 2023-06-23T19:01:21.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd1affd700 1 -- 172.21.15.136:0/1828549255 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd1c0c55e0 con 0x7fbd1c158ad0 2023-06-23T19:01:21.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd1bfff700 1 -- 172.21.15.136:0/1828549255 >> v1:172.21.15.178:6789/0 conn(0x7fbd1c158ad0 legacy=0x7fbd1c0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd1bfff700 1 -- 172.21.15.136:0/1828549255 >> v1:172.21.15.136:6789/0 conn(0x7fbd1c0709f0 legacy=0x7fbd1c0b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.358+0000 7fbd1bfff700 1 -- 172.21.15.136:0/1828549255 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c15d570 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.359+0000 7fbd1bfff700 1 --2- 172.21.15.136:0/1828549255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1c0b0e80 0x7fbd1c0b3040 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009d90 tx=0x7fbd1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae2f2f72feee501a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:21.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.359+0000 7fbd1affd700 1 -- 172.21.15.136:0/1828549255 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400e070 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.359+0000 7fbd1affd700 1 -- 172.21.15.136:0/1828549255 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1400bb20 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.359+0000 7fbd1affd700 1 -- 172.21.15.136:0/1828549255 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14012430 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.359+0000 7fbd21bff700 1 -- 172.21.15.136:0/1828549255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1c0b0e80 msgr2=0x7fbd1c0b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.359+0000 7fbd21bff700 1 --2- 172.21.15.136:0/1828549255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1c0b0e80 0x7fbd1c0b3040 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009d90 tx=0x7fbd1400b330 comp rx=0 tx=0).stop 2023-06-23T19:01:21.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.359+0000 7fbd21bff700 1 -- 172.21.15.136:0/1828549255 shutdown_connections 2023-06-23T19:01:21.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.359+0000 7fbd21bff700 1 --2- 172.21.15.136:0/1828549255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1c0b0e80 0x7fbd1c0b3040 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.359+0000 7fbd21bff700 1 -- 172.21.15.136:0/1828549255 >> 172.21.15.136:0/1828549255 conn(0x7fbd1c06ab80 msgr2=0x7fbd1c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:21.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.360+0000 7fbd21bff700 1 -- 172.21.15.136:0/1828549255 shutdown_connections 2023-06-23T19:01:21.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.360+0000 7fbd21bff700 1 -- 172.21.15.136:0/1828549255 wait complete. 2023-06-23T19:01:21.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.361+0000 7fbd21bff700 1 Processor -- start 2023-06-23T19:01:21.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.361+0000 7fbd21bff700 1 -- start start 2023-06-23T19:01:21.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.362+0000 7fbd21bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd1c0709f0 0x7fbd1c149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.362+0000 7fbd21bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1c0b0e80 0x7fbd1c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.362+0000 7fbd21bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1c158ad0 0x7fbd1c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.362+0000 7fbd21bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c14a290 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.362+0000 7fbd21bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c15aee0 con 0x7fbd1c158ad0 2023-06-23T19:01:21.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.362+0000 7fbd21bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c15ac00 con 0x7fbd1c0709f0 2023-06-23T19:01:21.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd13fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1c0b0e80 0x7fbd1c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd13fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1c0b0e80 0x7fbd1c0cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54906/0 (socket says 172.21.15.136:54906) 2023-06-23T19:01:21.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd13fff700 1 -- 172.21.15.136:0/565915671 learned_addr learned my addr 172.21.15.136:0/565915671 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:21.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd1b7fe700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd1c0709f0 0x7fbd1c149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd1bfff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1c158ad0 0x7fbd1c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd13fff700 1 -- 172.21.15.136:0/565915671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd1c0709f0 msgr2=0x7fbd1c149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd13fff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd1c0709f0 0x7fbd1c149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd13fff700 1 -- 172.21.15.136:0/565915671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1c158ad0 msgr2=0x7fbd1c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd13fff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1c158ad0 0x7fbd1c0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd13fff700 1 -- 172.21.15.136:0/565915671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14009a70 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd13fff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1c0b0e80 0x7fbd1c0cc6d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400c700 tx=0x7fbd0400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:21.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.363+0000 7fbd18ff9700 1 -- 172.21.15.136:0/565915671 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04005d70 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.364+0000 7fbd18ff9700 1 -- 172.21.15.136:0/565915671 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd040070d0 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.364+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c149bd0 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.364+0000 7fbd18ff9700 1 -- 172.21.15.136:0/565915671 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04007480 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.364+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c149760 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.365+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c0b4110 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.366+0000 7fbd18ff9700 1 -- 172.21.15.136:0/565915671 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd040075e0 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.367+0000 7fbd18ff9700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcfc06ace0 0x7fbcfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.367+0000 7fbd18ff9700 1 -- 172.21.15.136:0/565915671 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbd04088be0 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.367+0000 7fbd1b7fe700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcfc06ace0 0x7fbcfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.368+0000 7fbd1b7fe700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcfc06ace0 0x7fbcfc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0011e0 tx=0x7fbd0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:21.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.371+0000 7fbd18ff9700 1 -- 172.21.15.136:0/565915671 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd04053980 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.565+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbd1c04ea20 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.566+0000 7fbd18ff9700 1 -- 172.21.15.136:0/565915671 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbd040170a0 con 0x7fbd1c0b0e80 2023-06-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcfc06ace0 msgr2=0x7fbcfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcfc06ace0 0x7fbcfc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0011e0 tx=0x7fbd0c009040 comp rx=0 tx=0).stop 2023-06-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1c0b0e80 msgr2=0x7fbd1c0cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1c0b0e80 0x7fbd1c0cc6d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400c700 tx=0x7fbd0400ca10 comp rx=0 tx=0).stop 2023-06-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 shutdown_connections 2023-06-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcfc06ace0 0x7fbcfc06d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1c158ad0 0x7fbd1c0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd1c0709f0 0x7fbd1c149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 --2- 172.21.15.136:0/565915671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1c0b0e80 0x7fbd1c0cc6d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 >> 172.21.15.136:0/565915671 conn(0x7fbd1c06ab80 msgr2=0x7fbd1c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 shutdown_connections 2023-06-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.568+0000 7fbd21bff700 1 -- 172.21.15.136:0/565915671 wait complete. 2023-06-23T19:01:21.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T19:01:21.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.780+0000 7fd6249ff700 1 Processor -- start 2023-06-23T19:01:21.784 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.780+0000 7fd6249ff700 1 -- start start 2023-06-23T19:01:21.785 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd6249ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd62015c570 0x7fd6200cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd6249ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd6200cd660 0x7fd620160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd6249ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd620160880 0x7fd62006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd6249ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62015d670 con 0x7fd620160880 2023-06-23T19:01:21.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd6249ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6200cdad0 con 0x7fd6200cd660 2023-06-23T19:01:21.786 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd6249ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6201610a0 con 0x7fd62015c570 2023-06-23T19:01:21.787 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61ed9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd620160880 0x7fd62006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.787 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61e59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd62015c570 0x7fd6200cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.787 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61dd9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd6200cd660 0x7fd620160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.787 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61ed9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd620160880 0x7fd62006b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54918/0 (socket says 172.21.15.136:54918) 2023-06-23T19:01:21.787 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61ed9d700 1 -- 172.21.15.136:0/2938613479 learned_addr learned my addr 172.21.15.136:0/2938613479 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:21.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61ed9d700 1 -- 172.21.15.136:0/2938613479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd62015c570 msgr2=0x7fd6200cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:21.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61ed9d700 1 --2- 172.21.15.136:0/2938613479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd62015c570 0x7fd6200cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61ed9d700 1 -- 172.21.15.136:0/2938613479 >> v2:172.21.15.178:3300/0 conn(0x7fd6200cd660 msgr2=0x7fd620160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:21.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61ed9d700 1 --2- 172.21.15.136:0/2938613479 >> v2:172.21.15.178:3300/0 conn(0x7fd6200cd660 0x7fd620160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.782+0000 7fd61ed9d700 1 -- 172.21.15.136:0/2938613479 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62015da90 con 0x7fd620160880 2023-06-23T19:01:21.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.783+0000 7fd61ed9d700 1 --2- 172.21.15.136:0/2938613479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd620160880 0x7fd62006b200 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd6200723d0 tx=0x7fd610009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecf91cbdf9c4cb2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:21.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.783+0000 7fd61d59a700 1 -- 172.21.15.136:0/2938613479 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd610011830 con 0x7fd620160880 2023-06-23T19:01:21.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.783+0000 7fd61d59a700 1 -- 172.21.15.136:0/2938613479 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd610011990 con 0x7fd620160880 2023-06-23T19:01:21.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.783+0000 7fd61d59a700 1 -- 172.21.15.136:0/2938613479 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd610011d20 con 0x7fd620160880 2023-06-23T19:01:21.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.784+0000 7fd6249ff700 1 -- 172.21.15.136:0/2938613479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd620160880 msgr2=0x7fd62006b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.784+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2938613479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd620160880 0x7fd62006b200 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd6200723d0 tx=0x7fd610009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:21.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.784+0000 7fd6249ff700 1 -- 172.21.15.136:0/2938613479 shutdown_connections 2023-06-23T19:01:21.791 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.784+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2938613479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd620160880 0x7fd62006b200 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.784+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2938613479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd62015c570 0x7fd6200cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.784+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2938613479 >> v2:172.21.15.178:3300/0 conn(0x7fd6200cd660 0x7fd620160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.784+0000 7fd6249ff700 1 -- 172.21.15.136:0/2938613479 >> 172.21.15.136:0/2938613479 conn(0x7fd620071620 msgr2=0x7fd6200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:21.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.784+0000 7fd6249ff700 1 -- 172.21.15.136:0/2938613479 shutdown_connections 2023-06-23T19:01:21.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.784+0000 7fd6249ff700 1 -- 172.21.15.136:0/2938613479 wait complete. 2023-06-23T19:01:21.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.786+0000 7fd6249ff700 1 Processor -- start 2023-06-23T19:01:21.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.786+0000 7fd6249ff700 1 -- start start 2023-06-23T19:01:21.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd6249ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6200cd660 0x7fd6201f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd6249ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd62015c570 0x7fd620150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd6249ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd620160880 0x7fd6200b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd6249ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200c6600 con 0x7fd6200cd660 2023-06-23T19:01:21.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd6249ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200c6850 con 0x7fd62015c570 2023-06-23T19:01:21.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd6249ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200c6b30 con 0x7fd620160880 2023-06-23T19:01:21.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6200cd660 0x7fd6201f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6200cd660 0x7fd6201f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54928/0 (socket says 172.21.15.136:54928) 2023-06-23T19:01:21.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61e59c700 1 -- 172.21.15.136:0/2732420995 learned_addr learned my addr 172.21.15.136:0/2732420995 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:21.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61dd9b700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd62015c570 0x7fd620150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61e59c700 1 -- 172.21.15.136:0/2732420995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd620160880 msgr2=0x7fd6200b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61e59c700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd620160880 0x7fd6200b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61e59c700 1 -- 172.21.15.136:0/2732420995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd62015c570 msgr2=0x7fd620150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:21.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61e59c700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd62015c570 0x7fd620150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:21.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61e59c700 1 -- 172.21.15.136:0/2732420995 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610009550 con 0x7fd6200cd660 2023-06-23T19:01:21.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.787+0000 7fd61dd9b700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd62015c570 0x7fd620150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:21.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.788+0000 7fd61e59c700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6200cd660 0x7fd6201f3360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd61800efc0 tx=0x7fd61800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:21.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.788+0000 7fd60effd700 1 -- 172.21.15.136:0/2732420995 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618009b80 con 0x7fd6200cd660 2023-06-23T19:01:21.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.788+0000 7fd60effd700 1 -- 172.21.15.136:0/2732420995 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61800f040 con 0x7fd6200cd660 2023-06-23T19:01:21.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.788+0000 7fd60effd700 1 -- 172.21.15.136:0/2732420995 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618014480 con 0x7fd6200cd660 2023-06-23T19:01:21.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.788+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6200c6e10 con 0x7fd6200cd660 2023-06-23T19:01:21.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.788+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6201f38a0 con 0x7fd6200cd660 2023-06-23T19:01:21.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.789+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6200c7330 con 0x7fd6200cd660 2023-06-23T19:01:21.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.790+0000 7fd60effd700 1 -- 172.21.15.136:0/2732420995 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6180145e0 con 0x7fd6200cd660 2023-06-23T19:01:21.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.791+0000 7fd60effd700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd60006ace0 0x7fd60006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:21.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.791+0000 7fd60effd700 1 -- 172.21.15.136:0/2732420995 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd61808a380 con 0x7fd6200cd660 2023-06-23T19:01:21.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.791+0000 7fd61dd9b700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd60006ace0 0x7fd60006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:21.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.792+0000 7fd61dd9b700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd60006ace0 0x7fd60006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd6200b81f0 tx=0x7fd614008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:21.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:21.795+0000 7fd60effd700 1 -- 172.21.15.136:0/2732420995 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd6200c7330 con 0x7fd6200cd660 2023-06-23T19:01:22.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.007+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6200c7330 con 0x7fd6200cd660 2023-06-23T19:01:22.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.008+0000 7fd60effd700 1 -- 172.21.15.136:0/2732420995 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd6200c7330 con 0x7fd6200cd660 2023-06-23T19:01:22.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd60006ace0 msgr2=0x7fd60006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:22.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd60006ace0 0x7fd60006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd6200b81f0 tx=0x7fd614008040 comp rx=0 tx=0).stop 2023-06-23T19:01:22.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6200cd660 msgr2=0x7fd6201f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:22.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6200cd660 0x7fd6201f3360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd61800efc0 tx=0x7fd61800c3a0 comp rx=0 tx=0).stop 2023-06-23T19:01:22.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 shutdown_connections 2023-06-23T19:01:22.015 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd60006ace0 0x7fd60006d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:22.015 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd620160880 0x7fd6200b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:22.015 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6200cd660 0x7fd6201f3360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:22.015 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 --2- 172.21.15.136:0/2732420995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd62015c570 0x7fd620150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:22.015 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 >> 172.21.15.136:0/2732420995 conn(0x7fd620071620 msgr2=0x7fd62015ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:22.015 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 shutdown_connections 2023-06-23T19:01:22.015 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:22.010+0000 7fd6249ff700 1 -- 172.21.15.136:0/2732420995 wait complete. 2023-06-23T19:01:22.016 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2023-06-23T19:01:22.032 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2023-06-23T19:01:22.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:22.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-23T19:01:22.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:ceph-fuse[136152]: fuse finished with error 0 and tester_r 0 2023-06-23T19:01:22.102 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T19:01:26.203 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:01:26.208 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:01:28.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2023-06-23T19:01:28.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:28.205 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-23T19:01:28.324 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:28.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.520+0000 7f51c49ff700 1 Processor -- start 2023-06-23T19:01:28.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.520+0000 7f51c49ff700 1 -- start start 2023-06-23T19:01:28.525 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51c49ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 0x7f51c00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51c49ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f51c00cd660 0x7f51c0160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51c49ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c01610a0 con 0x7f51c0160880 2023-06-23T19:01:28.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51c49ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c015d670 con 0x7f51c00cd660 2023-06-23T19:01:28.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51c49ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00cdad0 con 0x7f51c015c570 2023-06-23T19:01:28.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51bdd9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f51c00cd660 0x7f51c0160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51bed9d700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f51c0160880 0x7f51c006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52948/0 (socket says 172.21.15.136:52948) 2023-06-23T19:01:28.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51bed9d700 1 -- 172.21.15.136:0/850337321 learned_addr learned my addr 172.21.15.136:0/850337321 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:28.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51be59c700 1 --2- 172.21.15.136:0/850337321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 0x7f51c00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51bdd9b700 1 -- 172.21.15.136:0/850337321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 msgr2=0x7f51c00cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:28.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51bdd9b700 1 --2- 172.21.15.136:0/850337321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 0x7f51c00cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51bdd9b700 1 -- 172.21.15.136:0/850337321 >> v1:172.21.15.136:6789/0 conn(0x7f51c0160880 legacy=0x7f51c006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.522+0000 7f51bdd9b700 1 -- 172.21.15.136:0/850337321 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c015da90 con 0x7f51c00cd660 2023-06-23T19:01:28.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.523+0000 7f51bdd9b700 1 --2- 172.21.15.136:0/850337321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c00cd660 0x7f51c0160340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009870 tx=0x7f51b4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e859e69c2b023d90 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:28.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.523+0000 7f51bd59a700 1 -- 172.21.15.136:0/850337321 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4011830 con 0x7f51c00cd660 2023-06-23T19:01:28.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.523+0000 7f51bd59a700 1 -- 172.21.15.136:0/850337321 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4011990 con 0x7f51c00cd660 2023-06-23T19:01:28.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.523+0000 7f51bd59a700 1 -- 172.21.15.136:0/850337321 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4011d20 con 0x7f51c00cd660 2023-06-23T19:01:28.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.523+0000 7f51c49ff700 1 -- 172.21.15.136:0/850337321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c00cd660 msgr2=0x7f51c0160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.523+0000 7f51c49ff700 1 --2- 172.21.15.136:0/850337321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c00cd660 0x7f51c0160340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009870 tx=0x7f51b4009b80 comp rx=0 tx=0).stop 2023-06-23T19:01:28.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.523+0000 7f51c49ff700 1 -- 172.21.15.136:0/850337321 shutdown_connections 2023-06-23T19:01:28.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.524+0000 7f51c49ff700 1 --2- 172.21.15.136:0/850337321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 0x7f51c00cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.524+0000 7f51c49ff700 1 --2- 172.21.15.136:0/850337321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c00cd660 0x7f51c0160340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.524+0000 7f51c49ff700 1 -- 172.21.15.136:0/850337321 >> 172.21.15.136:0/850337321 conn(0x7f51c0071620 msgr2=0x7f51c00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:28.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.524+0000 7f51c49ff700 1 -- 172.21.15.136:0/850337321 shutdown_connections 2023-06-23T19:01:28.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.524+0000 7f51c49ff700 1 -- 172.21.15.136:0/850337321 wait complete. 2023-06-23T19:01:28.531 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.525+0000 7f51c49ff700 1 Processor -- start 2023-06-23T19:01:28.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.525+0000 7f51c49ff700 1 -- start start 2023-06-23T19:01:28.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.526+0000 7f51c49ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c00cd660 0x7f51c014fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.526+0000 7f51c49ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 0x7f51c00cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.526+0000 7f51c49ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c0160880 0x7f51c00cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.526+0000 7f51c49ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c9c40 con 0x7f51c0160880 2023-06-23T19:01:28.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.526+0000 7f51c49ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c9f20 con 0x7f51c00cd660 2023-06-23T19:01:28.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.526+0000 7f51c49ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00ca200 con 0x7f51c015c570 2023-06-23T19:01:28.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c0160880 0x7f51c00cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c0160880 0x7f51c00cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45888/0 (socket says 172.21.15.136:45888) 2023-06-23T19:01:28.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bed9d700 1 -- 172.21.15.136:0/4026605846 learned_addr learned my addr 172.21.15.136:0/4026605846 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:28.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51be59c700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c00cd660 0x7f51c014fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bdd9b700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 0x7f51c00cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bed9d700 1 -- 172.21.15.136:0/4026605846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 msgr2=0x7f51c00cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bed9d700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 0x7f51c00cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bed9d700 1 -- 172.21.15.136:0/4026605846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c00cd660 msgr2=0x7f51c014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bed9d700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c00cd660 0x7f51c014fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bed9d700 1 -- 172.21.15.136:0/4026605846 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b40094a0 con 0x7f51c0160880 2023-06-23T19:01:28.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51bed9d700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c0160880 0x7f51c00cace0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51b800cbc0 tx=0x7f51b800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:28.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.527+0000 7f51aeffd700 1 -- 172.21.15.136:0/4026605846 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b800a9e0 con 0x7f51c0160880 2023-06-23T19:01:28.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.528+0000 7f51aeffd700 1 -- 172.21.15.136:0/4026605846 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b800ab40 con 0x7f51c0160880 2023-06-23T19:01:28.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.528+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c00ca4e0 con 0x7f51c0160880 2023-06-23T19:01:28.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.528+0000 7f51aeffd700 1 -- 172.21.15.136:0/4026605846 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8012400 con 0x7f51c0160880 2023-06-23T19:01:28.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.528+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c00cc900 con 0x7f51c0160880 2023-06-23T19:01:28.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.529+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c00caa00 con 0x7f51c0160880 2023-06-23T19:01:28.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.530+0000 7f51aeffd700 1 -- 172.21.15.136:0/4026605846 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51b801b3b0 con 0x7f51c0160880 2023-06-23T19:01:28.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.531+0000 7f51aeffd700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f51a006ace0 0x7f51a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.531+0000 7f51aeffd700 1 -- 172.21.15.136:0/4026605846 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f51b8089280 con 0x7f51c0160880 2023-06-23T19:01:28.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.531+0000 7f51be59c700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f51a006ace0 0x7f51a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.532+0000 7f51be59c700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f51a006ace0 0x7f51a006d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51c01f59c0 tx=0x7f51b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:28.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.536+0000 7f51aeffd700 1 -- 172.21.15.136:0/4026605846 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f51c00caa00 con 0x7f51c0160880 2023-06-23T19:01:28.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.734+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51c00caa00 con 0x7f51c0160880 2023-06-23T19:01:28.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.735+0000 7f51aeffd700 1 -- 172.21.15.136:0/4026605846 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f51c00caa00 con 0x7f51c0160880 2023-06-23T19:01:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:28.739 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:28.741 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.737+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f51a006ace0 msgr2=0x7f51a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.737+0000 7f51c49ff700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f51a006ace0 0x7f51a006d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51c01f59c0 tx=0x7f51b0008040 comp rx=0 tx=0).stop 2023-06-23T19:01:28.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.737+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c0160880 msgr2=0x7f51c00cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.737+0000 7f51c49ff700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c0160880 0x7f51c00cace0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51b800cbc0 tx=0x7f51b800ced0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.738+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 shutdown_connections 2023-06-23T19:01:28.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.738+0000 7f51c49ff700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f51a006ace0 0x7f51a006d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.738+0000 7f51c49ff700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c00cd660 0x7f51c014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.738+0000 7f51c49ff700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51c0160880 0x7f51c00cace0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.738+0000 7f51c49ff700 1 --2- 172.21.15.136:0/4026605846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c015c570 0x7f51c00cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.738+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 >> 172.21.15.136:0/4026605846 conn(0x7f51c0071620 msgr2=0x7f51c00d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:28.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.738+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 shutdown_connections 2023-06-23T19:01:28.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.738+0000 7f51c49ff700 1 -- 172.21.15.136:0/4026605846 wait complete. 2023-06-23T19:01:28.760 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:28.954 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.951+0000 7fc88d1ff700 1 Processor -- start 2023-06-23T19:01:28.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.951+0000 7fc88d1ff700 1 -- start start 2023-06-23T19:01:28.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.952+0000 7fc88d1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc888069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.952+0000 7fc88d1ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8880cae00 0x7fc88806a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.952+0000 7fc88d1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880cf2a0 con 0x7fc8880b08d0 2023-06-23T19:01:28.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.952+0000 7fc88d1ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880ce690 con 0x7fc8880cae00 2023-06-23T19:01:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.952+0000 7fc88d1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880ce970 con 0x7fc88815c420 2023-06-23T19:01:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.952+0000 7fc886d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc888069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc886d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc888069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54622/0 (socket says 172.21.15.136:54622) 2023-06-23T19:01:28.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc886d9d700 1 -- 172.21.15.136:0/1366112292 learned_addr learned my addr 172.21.15.136:0/1366112292 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:28.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc88759e700 1 --2- 172.21.15.136:0/1366112292 >> v2:172.21.15.178:3300/0 conn(0x7fc8880cae00 0x7fc88806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc88659c700 1 --1- 172.21.15.136:0/1366112292 >> v1:172.21.15.178:6789/0 conn(0x7fc8880b08d0 0x7fc8880cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:39752/0 (socket says 172.21.15.136:39752) 2023-06-23T19:01:28.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc886d9d700 1 -- 172.21.15.136:0/1366112292 >> v2:172.21.15.178:3300/0 conn(0x7fc8880cae00 msgr2=0x7fc88806a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:28.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc886d9d700 1 --2- 172.21.15.136:0/1366112292 >> v2:172.21.15.178:3300/0 conn(0x7fc8880cae00 0x7fc88806a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc886d9d700 1 -- 172.21.15.136:0/1366112292 >> v1:172.21.15.178:6789/0 conn(0x7fc8880b08d0 legacy=0x7fc8880cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc886d9d700 1 -- 172.21.15.136:0/1366112292 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880cec50 con 0x7fc88815c420 2023-06-23T19:01:28.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc886d9d700 1 --2- 172.21.15.136:0/1366112292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc888069ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc8780098f0 tx=0x7fc878009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f18b65cc27669ade server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:28.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc885d9b700 1 -- 172.21.15.136:0/1366112292 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878011830 con 0x7fc88815c420 2023-06-23T19:01:28.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.953+0000 7fc885d9b700 1 -- 172.21.15.136:0/1366112292 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc878011990 con 0x7fc88815c420 2023-06-23T19:01:28.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.954+0000 7fc885d9b700 1 -- 172.21.15.136:0/1366112292 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878011d20 con 0x7fc88815c420 2023-06-23T19:01:28.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.954+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1366112292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 msgr2=0x7fc888069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.954+0000 7fc88d1ff700 1 --2- 172.21.15.136:0/1366112292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc888069ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc8780098f0 tx=0x7fc878009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:28.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.954+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1366112292 shutdown_connections 2023-06-23T19:01:28.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.954+0000 7fc88d1ff700 1 --2- 172.21.15.136:0/1366112292 >> v2:172.21.15.178:3300/0 conn(0x7fc8880cae00 0x7fc88806a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.954+0000 7fc88d1ff700 1 --2- 172.21.15.136:0/1366112292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc888069ef0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.954+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1366112292 >> 172.21.15.136:0/1366112292 conn(0x7fc88806b920 msgr2=0x7fc8880cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:28.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.954+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1366112292 shutdown_connections 2023-06-23T19:01:28.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.954+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1366112292 wait complete. 2023-06-23T19:01:28.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.956+0000 7fc88d1ff700 1 Processor -- start 2023-06-23T19:01:28.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.956+0000 7fc88d1ff700 1 -- start start 2023-06-23T19:01:28.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc88d1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8880b08d0 0x7fc88815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc88d1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880cae00 0x7fc8880ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc88d1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc8880aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc88d1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88815a5b0 con 0x7fc8880b08d0 2023-06-23T19:01:28.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc88d1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8881f62b0 con 0x7fc8880cae00 2023-06-23T19:01:28.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc88d1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8881f21a0 con 0x7fc88815c420 2023-06-23T19:01:28.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc886d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8880b08d0 0x7fc88815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc886d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8880b08d0 0x7fc88815a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45900/0 (socket says 172.21.15.136:45900) 2023-06-23T19:01:28.971 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc886d9d700 1 -- 172.21.15.136:0/1612346649 learned_addr learned my addr 172.21.15.136:0/1612346649 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:28.971 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc88659c700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880cae00 0x7fc8880ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.971 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.957+0000 7fc88759e700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc8880aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.972 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc886d9d700 1 -- 172.21.15.136:0/1612346649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 msgr2=0x7fc8880aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.972 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc886d9d700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc8880aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.972 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc886d9d700 1 -- 172.21.15.136:0/1612346649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880cae00 msgr2=0x7fc8880ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:28.972 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc886d9d700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880cae00 0x7fc8880ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:28.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc886d9d700 1 -- 172.21.15.136:0/1612346649 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878009550 con 0x7fc8880b08d0 2023-06-23T19:01:28.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc886d9d700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8880b08d0 0x7fc88815a070 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc878009c40 tx=0x7fc878004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:28.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc86f7fe700 1 -- 172.21.15.136:0/1612346649 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878004400 con 0x7fc8880b08d0 2023-06-23T19:01:28.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc86f7fe700 1 -- 172.21.15.136:0/1612346649 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87801f070 con 0x7fc8880b08d0 2023-06-23T19:01:28.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc86f7fe700 1 -- 172.21.15.136:0/1612346649 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780038e0 con 0x7fc8880b08d0 2023-06-23T19:01:28.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8881f2480 con 0x7fc8880b08d0 2023-06-23T19:01:28.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.958+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8881f1eb0 con 0x7fc8880b08d0 2023-06-23T19:01:28.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.959+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc888073910 con 0x7fc8880b08d0 2023-06-23T19:01:28.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.960+0000 7fc86f7fe700 1 -- 172.21.15.136:0/1612346649 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc878021030 con 0x7fc8880b08d0 2023-06-23T19:01:28.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.961+0000 7fc86f7fe700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc87406ace0 0x7fc87406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:28.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.961+0000 7fc86f7fe700 1 -- 172.21.15.136:0/1612346649 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc87808abb0 con 0x7fc8880b08d0 2023-06-23T19:01:28.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.961+0000 7fc88659c700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc87406ace0 0x7fc87406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:28.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.962+0000 7fc88659c700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc87406ace0 0x7fc87406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc88809d2a0 tx=0x7fc87c007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:28.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:28.965+0000 7fc86f7fe700 1 -- 172.21.15.136:0/1612346649 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc878055a80 con 0x7fc8880b08d0 2023-06-23T19:01:29.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.167+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc88806ab40 con 0x7fc8880b08d0 2023-06-23T19:01:29.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.168+0000 7fc86f7fe700 1 -- 172.21.15.136:0/1612346649 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7fc878015090 con 0x7fc8880b08d0 2023-06-23T19:01:29.173 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:29.173 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:29.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc87406ace0 msgr2=0x7fc87406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:29.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc87406ace0 0x7fc87406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc88809d2a0 tx=0x7fc87c007ed0 comp rx=0 tx=0).stop 2023-06-23T19:01:29.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8880b08d0 msgr2=0x7fc88815a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:29.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8880b08d0 0x7fc88815a070 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc878009c40 tx=0x7fc878004750 comp rx=0 tx=0).stop 2023-06-23T19:01:29.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 shutdown_connections 2023-06-23T19:01:29.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc87406ace0 0x7fc87406d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:29.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88815c420 0x7fc8880aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:29.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8880b08d0 0x7fc88815a070 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:29.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 --2- 172.21.15.136:0/1612346649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880cae00 0x7fc8880ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:29.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.170+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 >> 172.21.15.136:0/1612346649 conn(0x7fc88806b920 msgr2=0x7fc88806ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:29.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.171+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 shutdown_connections 2023-06-23T19:01:29.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.171+0000 7fc88d1ff700 1 -- 172.21.15.136:0/1612346649 wait complete. 2023-06-23T19:01:29.192 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.385+0000 7f3bd95ff700 1 Processor -- start 2023-06-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.385+0000 7f3bd95ff700 1 -- start start 2023-06-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.386+0000 7f3bd95ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40d0a60 0x7f3bd40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.386+0000 7f3bd95ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd40cd9d0 con 0x7f3bd40b51d0 2023-06-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd95ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd40b5640 con 0x7f3bd40cf910 2023-06-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd95ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40d0060 con 0x7f3bd40d0a60 2023-06-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bcbfff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3bd40b51d0 0x7f3bd40d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52962/0 (socket says 172.21.15.136:52962) 2023-06-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bcbfff700 1 -- 172.21.15.136:0/2754501607 learned_addr learned my addr 172.21.15.136:0/2754501607 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd2ffd700 1 --2- 172.21.15.136:0/2754501607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40d0a60 0x7f3bd40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd27fc700 1 -- 172.21.15.136:0/2754501607 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998013327 0 0) 0x7f3bd40cd9d0 con 0x7f3bd40b51d0 2023-06-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd27fc700 1 -- 172.21.15.136:0/2754501607 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc00035b0 con 0x7f3bd40b51d0 2023-06-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd27fc700 1 -- 172.21.15.136:0/2754501607 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221114135 0 0) 0x7f3bd40b5640 con 0x7f3bd40cf910 2023-06-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd27fc700 1 -- 172.21.15.136:0/2754501607 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd40cd9d0 con 0x7f3bd40cf910 2023-06-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd2ffd700 1 -- 172.21.15.136:0/2754501607 >> v1:172.21.15.178:6789/0 conn(0x7f3bd40cf910 legacy=0x7f3bd40d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd2ffd700 1 -- 172.21.15.136:0/2754501607 >> v1:172.21.15.136:6789/0 conn(0x7f3bd40b51d0 legacy=0x7f3bd40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.387+0000 7f3bd2ffd700 1 -- 172.21.15.136:0/2754501607 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40cfd90 con 0x7f3bd40d0a60 2023-06-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.388+0000 7f3bd2ffd700 1 --2- 172.21.15.136:0/2754501607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40d0a60 0x7f3bd40b5a70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009870 tx=0x7f3bc4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=258627cd7f2653b1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.388+0000 7f3bd27fc700 1 -- 172.21.15.136:0/2754501607 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011830 con 0x7f3bd40d0a60 2023-06-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.388+0000 7f3bd27fc700 1 -- 172.21.15.136:0/2754501607 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4011990 con 0x7f3bd40d0a60 2023-06-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.388+0000 7f3bd27fc700 1 -- 172.21.15.136:0/2754501607 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011d20 con 0x7f3bd40d0a60 2023-06-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.388+0000 7f3bd95ff700 1 -- 172.21.15.136:0/2754501607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40d0a60 msgr2=0x7f3bd40b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:29.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.388+0000 7f3bd95ff700 1 --2- 172.21.15.136:0/2754501607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40d0a60 0x7f3bd40b5a70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009870 tx=0x7f3bc4009b80 comp rx=0 tx=0).stop 2023-06-23T19:01:29.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.389+0000 7f3bd95ff700 1 -- 172.21.15.136:0/2754501607 shutdown_connections 2023-06-23T19:01:29.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.389+0000 7f3bd95ff700 1 --2- 172.21.15.136:0/2754501607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40d0a60 0x7f3bd40b5a70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:29.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.389+0000 7f3bd95ff700 1 -- 172.21.15.136:0/2754501607 >> 172.21.15.136:0/2754501607 conn(0x7f3bd4071620 msgr2=0x7f3bd40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:29.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.389+0000 7f3bd95ff700 1 -- 172.21.15.136:0/2754501607 shutdown_connections 2023-06-23T19:01:29.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.389+0000 7f3bd95ff700 1 -- 172.21.15.136:0/2754501607 wait complete. 2023-06-23T19:01:29.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.390+0000 7f3bd95ff700 1 Processor -- start 2023-06-23T19:01:29.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.390+0000 7f3bd95ff700 1 -- start start 2023-06-23T19:01:29.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.391+0000 7f3bd95ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40b51d0 0x7f3bd4159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:29.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.391+0000 7f3bd95ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bd40cf910 0x7f3bd41507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.391+0000 7f3bd95ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bd40d0a60 0x7f3bd4154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.391+0000 7f3bd95ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4154980 con 0x7f3bd40d0a60 2023-06-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.391+0000 7f3bd95ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd415f420 con 0x7f3bd40cf910 2023-06-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.391+0000 7f3bd95ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4153d00 con 0x7f3bd40b51d0 2023-06-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bd40d0a60 0x7f3bd4154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bd40d0a60 0x7f3bd4154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45906/0 (socket says 172.21.15.136:45906) 2023-06-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd37fe700 1 -- 172.21.15.136:0/3576628190 learned_addr learned my addr 172.21.15.136:0/3576628190 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bcbfff700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bd40cf910 0x7f3bd41507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd2ffd700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40b51d0 0x7f3bd4159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd37fe700 1 -- 172.21.15.136:0/3576628190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40b51d0 msgr2=0x7f3bd4159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd37fe700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40b51d0 0x7f3bd4159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd37fe700 1 -- 172.21.15.136:0/3576628190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bd40cf910 msgr2=0x7f3bd41507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd37fe700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bd40cf910 0x7f3bd41507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd37fe700 1 -- 172.21.15.136:0/3576628190 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc40094a0 con 0x7f3bd40d0a60 2023-06-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.392+0000 7f3bd37fe700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bd40d0a60 0x7f3bd4154ff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00cc20 tx=0x7f3bcc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.393+0000 7f3bcb7fe700 1 -- 172.21.15.136:0/3576628190 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00ac20 con 0x7f3bd40d0a60 2023-06-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.393+0000 7f3bcb7fe700 1 -- 172.21.15.136:0/3576628190 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00ad80 con 0x7f3bd40d0a60 2023-06-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.393+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd4153fe0 con 0x7f3bd40d0a60 2023-06-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.393+0000 7f3bcb7fe700 1 -- 172.21.15.136:0/3576628190 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc003c20 con 0x7f3bd40d0a60 2023-06-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.393+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd41545a0 con 0x7f3bd40d0a60 2023-06-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.394+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd4154ac0 con 0x7f3bd40d0a60 2023-06-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.395+0000 7f3bcb7fe700 1 -- 172.21.15.136:0/3576628190 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bcc0050d0 con 0x7f3bd40d0a60 2023-06-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.396+0000 7f3bcb7fe700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3bb406ace0 0x7f3bb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.396+0000 7f3bcb7fe700 1 -- 172.21.15.136:0/3576628190 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3bcc089930 con 0x7f3bd40d0a60 2023-06-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.396+0000 7f3bd2ffd700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3bb406ace0 0x7f3bb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.396+0000 7f3bd2ffd700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3bb406ace0 0x7f3bb406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40097c0 tx=0x7f3bc401c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.400+0000 7f3bcb7fe700 1 -- 172.21.15.136:0/3576628190 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3bd4154ac0 con 0x7f3bd40d0a60 2023-06-23T19:01:29.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:29.641+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3bd4154ac0 con 0x7f3bd40d0a60 2023-06-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.031+0000 7f3bcb7fe700 1 -- 172.21.15.136:0/3576628190 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3bd4154ac0 con 0x7f3bd40d0a60 2023-06-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3bb406ace0 msgr2=0x7f3bb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3bb406ace0 0x7f3bb406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40097c0 tx=0x7f3bc401c040 comp rx=0 tx=0).stop 2023-06-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bd40d0a60 msgr2=0x7f3bd4154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bd40d0a60 0x7f3bd4154ff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00cc20 tx=0x7f3bcc00a060 comp rx=0 tx=0).stop 2023-06-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 shutdown_connections 2023-06-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3bb406ace0 0x7f3bb406d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bd40d0a60 0x7f3bd4154ff0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bd40b51d0 0x7f3bd4159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 --2- 172.21.15.136:0/3576628190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bd40cf910 0x7f3bd41507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 >> 172.21.15.136:0/3576628190 conn(0x7f3bd4071620 msgr2=0x7f3bd40ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 shutdown_connections 2023-06-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.034+0000 7f3bd95ff700 1 -- 172.21.15.136:0/3576628190 wait complete. 2023-06-23T19:01:30.057 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-23T19:01:30.057 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-23T19:01:30.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.250+0000 7fde4c9ff700 1 Processor -- start 2023-06-23T19:01:30.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.250+0000 7fde4c9ff700 1 -- start start 2023-06-23T19:01:30.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.251+0000 7fde4c9ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fde480d0a60 0x7fde480b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:30.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.251+0000 7fde4c9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 0x7fde480d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:30.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.251+0000 7fde4c9ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde480cd9d0 con 0x7fde480b51d0 2023-06-23T19:01:30.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.251+0000 7fde4c9ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde480d0060 con 0x7fde480d0a60 2023-06-23T19:01:30.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.251+0000 7fde4c9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde480b5620 con 0x7fde480cf910 2023-06-23T19:01:30.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.252+0000 7fde46d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 0x7fde480d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:30.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.252+0000 7fde4659c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fde480d0a60 0x7fde480b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:30.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.252+0000 7fde3ffff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fde480b51d0 0x7fde480d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:39782/0 (socket says 172.21.15.136:39782) 2023-06-23T19:01:30.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.252+0000 7fde3ffff700 1 -- 172.21.15.136:0/269970961 learned_addr learned my addr 172.21.15.136:0/269970961 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:30.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.252+0000 7fde4659c700 1 -- 172.21.15.136:0/269970961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 msgr2=0x7fde480d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:30.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.252+0000 7fde4659c700 1 --2- 172.21.15.136:0/269970961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 0x7fde480d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:30.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.252+0000 7fde4659c700 1 -- 172.21.15.136:0/269970961 >> v1:172.21.15.178:6789/0 conn(0x7fde480b51d0 legacy=0x7fde480d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:30.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.252+0000 7fde4659c700 1 -- 172.21.15.136:0/269970961 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde480cfd90 con 0x7fde480d0a60 2023-06-23T19:01:30.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.253+0000 7fde46d9d700 1 --2- 172.21.15.136:0/269970961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 0x7fde480d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:30.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.253+0000 7fde4659c700 1 --2- 172.21.15.136:0/269970961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480d0a60 0x7fde480b5a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde38009840 tx=0x7fde38009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba10873c3dfdd909 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:30.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.253+0000 7fde45d9b700 1 -- 172.21.15.136:0/269970961 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde38011830 con 0x7fde480d0a60 2023-06-23T19:01:30.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.253+0000 7fde45d9b700 1 -- 172.21.15.136:0/269970961 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde38011990 con 0x7fde480d0a60 2023-06-23T19:01:30.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.253+0000 7fde45d9b700 1 -- 172.21.15.136:0/269970961 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde38011d20 con 0x7fde480d0a60 2023-06-23T19:01:30.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.254+0000 7fde4c9ff700 1 -- 172.21.15.136:0/269970961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480d0a60 msgr2=0x7fde480b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:30.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.254+0000 7fde4c9ff700 1 --2- 172.21.15.136:0/269970961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480d0a60 0x7fde480b5a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde38009840 tx=0x7fde38009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:30.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.254+0000 7fde4c9ff700 1 -- 172.21.15.136:0/269970961 shutdown_connections 2023-06-23T19:01:30.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.254+0000 7fde4c9ff700 1 --2- 172.21.15.136:0/269970961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480d0a60 0x7fde480b5a70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:30.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.254+0000 7fde4c9ff700 1 --2- 172.21.15.136:0/269970961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 0x7fde480d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:30.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.254+0000 7fde4c9ff700 1 -- 172.21.15.136:0/269970961 >> 172.21.15.136:0/269970961 conn(0x7fde48071620 msgr2=0x7fde480719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:30.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.254+0000 7fde4c9ff700 1 -- 172.21.15.136:0/269970961 shutdown_connections 2023-06-23T19:01:30.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.254+0000 7fde4c9ff700 1 -- 172.21.15.136:0/269970961 wait complete. 2023-06-23T19:01:30.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.255+0000 7fde4c9ff700 1 Processor -- start 2023-06-23T19:01:30.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.256+0000 7fde4c9ff700 1 -- start start 2023-06-23T19:01:30.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.256+0000 7fde4c9ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480b51d0 0x7fde4814d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:30.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.256+0000 7fde4c9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 0x7fde48157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:30.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.256+0000 7fde4c9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde480d0a60 0x7fde480cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:30.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.256+0000 7fde4c9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde48158ba0 con 0x7fde480d0a60 2023-06-23T19:01:30.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.256+0000 7fde4c9ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde48157f20 con 0x7fde480b51d0 2023-06-23T19:01:30.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.256+0000 7fde4c9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde48158200 con 0x7fde480cf910 2023-06-23T19:01:30.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde46d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde480d0a60 0x7fde480cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:30.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde46d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde480d0a60 0x7fde480cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45920/0 (socket says 172.21.15.136:45920) 2023-06-23T19:01:30.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde46d9d700 1 -- 172.21.15.136:0/2607265116 learned_addr learned my addr 172.21.15.136:0/2607265116 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:30.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde4659c700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480b51d0 0x7fde4814d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:30.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde3ffff700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 0x7fde48157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:30.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde46d9d700 1 -- 172.21.15.136:0/2607265116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 msgr2=0x7fde48157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:30.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde46d9d700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 0x7fde48157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:30.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde46d9d700 1 -- 172.21.15.136:0/2607265116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480b51d0 msgr2=0x7fde4814d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:30.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde46d9d700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480b51d0 0x7fde4814d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:30.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde46d9d700 1 -- 172.21.15.136:0/2607265116 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40009a70 con 0x7fde480d0a60 2023-06-23T19:01:30.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde4659c700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480b51d0 0x7fde4814d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:30.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.257+0000 7fde46d9d700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde480d0a60 0x7fde480cc0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fde4000efc0 tx=0x7fde4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:30.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.258+0000 7fde3effd700 1 -- 172.21.15.136:0/2607265116 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40009d70 con 0x7fde480d0a60 2023-06-23T19:01:30.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.258+0000 7fde3effd700 1 -- 172.21.15.136:0/2607265116 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4000f040 con 0x7fde480d0a60 2023-06-23T19:01:30.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.258+0000 7fde3effd700 1 -- 172.21.15.136:0/2607265116 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000ce00 con 0x7fde480d0a60 2023-06-23T19:01:30.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.258+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde380094a0 con 0x7fde480d0a60 2023-06-23T19:01:30.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.258+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde481587c0 con 0x7fde480d0a60 2023-06-23T19:01:30.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.259+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde48158ce0 con 0x7fde480d0a60 2023-06-23T19:01:30.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.260+0000 7fde3effd700 1 -- 172.21.15.136:0/2607265116 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde40014480 con 0x7fde480d0a60 2023-06-23T19:01:30.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.260+0000 7fde3effd700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fde2806ace0 0x7fde2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:30.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.261+0000 7fde3effd700 1 -- 172.21.15.136:0/2607265116 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde40089ff0 con 0x7fde480d0a60 2023-06-23T19:01:30.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.261+0000 7fde4659c700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fde2806ace0 0x7fde2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:30.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.261+0000 7fde4659c700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fde2806ace0 0x7fde2806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde38000c00 tx=0x7fde3801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:30.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.265+0000 7fde3effd700 1 -- 172.21.15.136:0/2607265116 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fde400bc310 con 0x7fde480d0a60 2023-06-23T19:01:30.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:30.503+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fde4804ea20 con 0x7fde480d0a60 2023-06-23T19:01:31.041 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.037+0000 7fde3effd700 1 -- 172.21.15.136:0/2607265116 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde400180c0 con 0x7fde480d0a60 2023-06-23T19:01:31.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fde2806ace0 msgr2=0x7fde2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fde2806ace0 0x7fde2806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde38000c00 tx=0x7fde3801c040 comp rx=0 tx=0).stop 2023-06-23T19:01:31.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde480d0a60 msgr2=0x7fde480cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde480d0a60 0x7fde480cc0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fde4000efc0 tx=0x7fde4000c3a0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 shutdown_connections 2023-06-23T19:01:31.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fde2806ace0 0x7fde2806d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde480b51d0 0x7fde4814d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde480d0a60 0x7fde480cc0f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 --2- 172.21.15.136:0/2607265116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde480cf910 0x7fde48157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 >> 172.21.15.136:0/2607265116 conn(0x7fde48071620 msgr2=0x7fde480b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:31.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 shutdown_connections 2023-06-23T19:01:31.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.040+0000 7fde4c9ff700 1 -- 172.21.15.136:0/2607265116 wait complete. 2023-06-23T19:01:31.062 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-23T19:01:31.062 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.252+0000 7f0fadbff700 1 Processor -- start 2023-06-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.252+0000 7f0fadbff700 1 -- start start 2023-06-23T19:01:31.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.253+0000 7f0fadbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa815c570 0x7f0fa80cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fadbff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa81610a0 con 0x7f0fa8160a50 2023-06-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fadbff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa815da90 con 0x7f0fa80cd660 2023-06-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fadbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa815d670 con 0x7f0fa815c570 2023-06-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fa7fff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0fa8160a50 0x7f0fa80d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52968/0 (socket says 172.21.15.136:52968) 2023-06-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fa7fff700 1 -- 172.21.15.136:0/3855619504 learned_addr learned my addr 172.21.15.136:0/3855619504 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fa77fe700 1 --2- 172.21.15.136:0/3855619504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa815c570 0x7f0fa80cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fa67fc700 1 -- 172.21.15.136:0/3855619504 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991971904 0 0) 0x7f0fa81610a0 con 0x7f0fa8160a50 2023-06-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fa67fc700 1 -- 172.21.15.136:0/3855619504 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f900035b0 con 0x7f0fa8160a50 2023-06-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fa77fe700 1 -- 172.21.15.136:0/3855619504 >> v1:172.21.15.178:6789/0 conn(0x7f0fa80cd660 legacy=0x7f0fa8160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fa67fc700 1 -- 172.21.15.136:0/3855619504 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470042705 0 0) 0x7f0fa815da90 con 0x7f0fa80cd660 2023-06-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fa77fe700 1 -- 172.21.15.136:0/3855619504 >> v1:172.21.15.136:6789/0 conn(0x7f0fa8160a50 legacy=0x7f0fa80d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.254+0000 7f0fa77fe700 1 -- 172.21.15.136:0/3855619504 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa815ccd0 con 0x7f0fa815c570 2023-06-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.255+0000 7f0fa77fe700 1 --2- 172.21.15.136:0/3855619504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa815c570 0x7f0fa80cd120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009870 tx=0x7f0f98009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97166354214f5a8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.255+0000 7f0fa67fc700 1 -- 172.21.15.136:0/3855619504 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011830 con 0x7f0fa815c570 2023-06-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.255+0000 7f0fa67fc700 1 -- 172.21.15.136:0/3855619504 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f98011990 con 0x7f0fa815c570 2023-06-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.255+0000 7f0fa67fc700 1 -- 172.21.15.136:0/3855619504 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011d20 con 0x7f0fa815c570 2023-06-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.255+0000 7f0fadbff700 1 -- 172.21.15.136:0/3855619504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa815c570 msgr2=0x7f0fa80cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.255+0000 7f0fadbff700 1 --2- 172.21.15.136:0/3855619504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa815c570 0x7f0fa80cd120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009870 tx=0x7f0f98009b80 comp rx=0 tx=0).stop 2023-06-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.256+0000 7f0fadbff700 1 -- 172.21.15.136:0/3855619504 shutdown_connections 2023-06-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.256+0000 7f0fadbff700 1 --2- 172.21.15.136:0/3855619504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa815c570 0x7f0fa80cd120 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.256+0000 7f0fadbff700 1 -- 172.21.15.136:0/3855619504 >> 172.21.15.136:0/3855619504 conn(0x7f0fa8071620 msgr2=0x7f0fa80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.256+0000 7f0fadbff700 1 -- 172.21.15.136:0/3855619504 shutdown_connections 2023-06-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.256+0000 7f0fadbff700 1 -- 172.21.15.136:0/3855619504 wait complete. 2023-06-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.257+0000 7f0fadbff700 1 Processor -- start 2023-06-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.257+0000 7f0fadbff700 1 -- start start 2023-06-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.258+0000 7f0fadbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa80cd660 0x7f0fa80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.258+0000 7f0fadbff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa815c570 0x7f0fa80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.258+0000 7f0fadbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa8160a50 0x7f0fa81f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.258+0000 7f0fadbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81f5580 con 0x7f0fa80cd660 2023-06-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.258+0000 7f0fadbff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81f27c0 con 0x7f0fa815c570 2023-06-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.258+0000 7f0fadbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81f2aa0 con 0x7f0fa8160a50 2023-06-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0fa77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa80cd660 0x7f0fa80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0fa77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa80cd660 0x7f0fa80c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45928/0 (socket says 172.21.15.136:45928) 2023-06-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0fa77fe700 1 -- 172.21.15.136:0/3347825899 learned_addr learned my addr 172.21.15.136:0/3347825899 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0fa77fe700 1 -- 172.21.15.136:0/3347825899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa8160a50 msgr2=0x7f0fa81f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0fa77fe700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa8160a50 0x7f0fa81f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0fa77fe700 1 -- 172.21.15.136:0/3347825899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa815c570 msgr2=0x7f0fa80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0fa77fe700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa815c570 0x7f0fa80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0fa77fe700 1 -- 172.21.15.136:0/3347825899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f980094a0 con 0x7f0fa80cd660 2023-06-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0fa77fe700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa80cd660 0x7f0fa80c8ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f980090b0 tx=0x7f0f98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.259+0000 7f0f8ffff700 1 -- 172.21.15.136:0/3347825899 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9801a910 con 0x7f0fa80cd660 2023-06-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.260+0000 7f0f8ffff700 1 -- 172.21.15.136:0/3347825899 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9801aa70 con 0x7f0fa80cd660 2023-06-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.260+0000 7f0f8ffff700 1 -- 172.21.15.136:0/3347825899 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9801ade0 con 0x7f0fa80cd660 2023-06-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.260+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa81f2d80 con 0x7f0fa80cd660 2023-06-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.260+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa80b3ef0 con 0x7f0fa80cd660 2023-06-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.261+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa8073910 con 0x7f0fa80cd660 2023-06-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.262+0000 7f0f8ffff700 1 -- 172.21.15.136:0/3347825899 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f98022070 con 0x7f0fa80cd660 2023-06-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.262+0000 7f0f8ffff700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0f9406ace0 0x7f0f9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.262+0000 7f0f8ffff700 1 -- 172.21.15.136:0/3347825899 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f9808a590 con 0x7f0fa80cd660 2023-06-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.263+0000 7f0fa6ffd700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0f9406ace0 0x7f0f9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.263+0000 7f0fa6ffd700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0f9406ace0 0x7f0f9406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c007fd0 tx=0x7f0f9c0079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.267+0000 7f0f8ffff700 1 -- 172.21.15.136:0/3347825899 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f980553f0 con 0x7f0fa80cd660 2023-06-23T19:01:31.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.506+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fa80d1e00 con 0x7f0fa80cd660 2023-06-23T19:01:31.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.507+0000 7f0f8ffff700 1 -- 172.21.15.136:0/3347825899 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f0f98015090 con 0x7f0fa80cd660 2023-06-23T19:01:31.510 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:31.511 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:31.031767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T19:01:31.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0f9406ace0 msgr2=0x7f0f9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0f9406ace0 0x7f0f9406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c007fd0 tx=0x7f0f9c0079a0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa80cd660 msgr2=0x7f0fa80c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa80cd660 0x7f0fa80c8ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f980090b0 tx=0x7f0f98004750 comp rx=0 tx=0).stop 2023-06-23T19:01:31.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 shutdown_connections 2023-06-23T19:01:31.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0f9406ace0 0x7f0f9406d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa8160a50 0x7f0fa81f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa80cd660 0x7f0fa80c8ab0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 --2- 172.21.15.136:0/3347825899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa815c570 0x7f0fa80b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 >> 172.21.15.136:0/3347825899 conn(0x7f0fa8071620 msgr2=0x7f0fa80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:31.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 shutdown_connections 2023-06-23T19:01:31.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.509+0000 7f0fadbff700 1 -- 172.21.15.136:0/3347825899 wait complete. 2023-06-23T19:01:31.515 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2023-06-23T19:01:31.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:31.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.720+0000 7fa1363ff700 1 Processor -- start 2023-06-23T19:01:31.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.720+0000 7fa1363ff700 1 -- start start 2023-06-23T19:01:31.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.721+0000 7fa1363ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa1300cd830 0x7fa130160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.721+0000 7fa1363ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1301610a0 con 0x7fa130160880 2023-06-23T19:01:31.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.721+0000 7fa1363ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13015da90 con 0x7fa13015c570 2023-06-23T19:01:31.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.721+0000 7fa1363ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13015d670 con 0x7fa1300cd830 2023-06-23T19:01:31.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa12f7fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa1300cd830 0x7fa130160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:31.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa13499c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa130160880 0x7fa1300d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52982/0 (socket says 172.21.15.136:52982) 2023-06-23T19:01:31.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa13499c700 1 -- 172.21.15.136:0/564407667 learned_addr learned my addr 172.21.15.136:0/564407667 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:31.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa12f7fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa1300cd830 0x7fa130160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45940/0 (socket says 172.21.15.136:45940) 2023-06-23T19:01:31.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa12f7fe700 1 -- 172.21.15.136:0/564407667 >> v1:172.21.15.178:6789/0 conn(0x7fa13015c570 legacy=0x7fa1300cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa12f7fe700 1 -- 172.21.15.136:0/564407667 >> v1:172.21.15.136:6789/0 conn(0x7fa130160880 legacy=0x7fa1300d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa12f7fe700 1 -- 172.21.15.136:0/564407667 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13015ccd0 con 0x7fa1300cd830 2023-06-23T19:01:31.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa12effd700 1 -- 172.21.15.136:0/564407667 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157942106 0 0) 0x7fa1301610a0 con 0x7fa130160880 2023-06-23T19:01:31.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa12f7fe700 1 --2- 172.21.15.136:0/564407667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1300cd830 0x7fa130160340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa1240097c0 tx=0x7fa124009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40e7268f0bb933c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:31.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.722+0000 7fa12effd700 1 -- 172.21.15.136:0/564407667 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124004230 con 0x7fa1300cd830 2023-06-23T19:01:31.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.723+0000 7fa12effd700 1 -- 172.21.15.136:0/564407667 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa124004390 con 0x7fa1300cd830 2023-06-23T19:01:31.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.723+0000 7fa12effd700 1 -- 172.21.15.136:0/564407667 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240036a0 con 0x7fa1300cd830 2023-06-23T19:01:31.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.723+0000 7fa1363ff700 1 -- 172.21.15.136:0/564407667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1300cd830 msgr2=0x7fa130160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.723+0000 7fa1363ff700 1 --2- 172.21.15.136:0/564407667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1300cd830 0x7fa130160340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa1240097c0 tx=0x7fa124009ad0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.723+0000 7fa1363ff700 1 -- 172.21.15.136:0/564407667 shutdown_connections 2023-06-23T19:01:31.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.723+0000 7fa1363ff700 1 --2- 172.21.15.136:0/564407667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1300cd830 0x7fa130160340 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.723+0000 7fa1363ff700 1 -- 172.21.15.136:0/564407667 >> 172.21.15.136:0/564407667 conn(0x7fa130071620 msgr2=0x7fa1300719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:31.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.723+0000 7fa1363ff700 1 -- 172.21.15.136:0/564407667 shutdown_connections 2023-06-23T19:01:31.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.723+0000 7fa1363ff700 1 -- 172.21.15.136:0/564407667 wait complete. 2023-06-23T19:01:31.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.725+0000 7fa1363ff700 1 Processor -- start 2023-06-23T19:01:31.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.725+0000 7fa1363ff700 1 -- start start 2023-06-23T19:01:31.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.726+0000 7fa1363ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1300cd830 0x7fa1301e7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.726+0000 7fa1363ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa13015c570 0x7fa1300c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.726+0000 7fa1363ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa130160880 0x7fa1300ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.726+0000 7fa1363ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301e83f0 con 0x7fa13015c570 2023-06-23T19:01:31.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.726+0000 7fa1363ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301e77e0 con 0x7fa130160880 2023-06-23T19:01:31.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.726+0000 7fa1363ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301e7ac0 con 0x7fa1300cd830 2023-06-23T19:01:31.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.726+0000 7fa12f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa13015c570 0x7fa1300c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:31.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.726+0000 7fa12f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa13015c570 0x7fa1300c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45946/0 (socket says 172.21.15.136:45946) 2023-06-23T19:01:31.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.726+0000 7fa12f7fe700 1 -- 172.21.15.136:0/2626899567 learned_addr learned my addr 172.21.15.136:0/2626899567 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:31.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12ffff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1300cd830 0x7fa1301e7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:31.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa13499c700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa130160880 0x7fa1300ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:31.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12f7fe700 1 -- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1300cd830 msgr2=0x7fa1301e7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12f7fe700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1300cd830 0x7fa1301e7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12f7fe700 1 -- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa130160880 msgr2=0x7fa1300ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12f7fe700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa130160880 0x7fa1300ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12f7fe700 1 -- 172.21.15.136:0/2626899567 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1240094a0 con 0x7fa13015c570 2023-06-23T19:01:31.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12ffff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1300cd830 0x7fa1301e7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:31.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa13499c700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa130160880 0x7fa1300ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:31.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12f7fe700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa13015c570 0x7fa1300c9ba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa1240090b0 tx=0x7fa124004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:31.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12cff9700 1 -- 172.21.15.136:0/2626899567 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124003e70 con 0x7fa13015c570 2023-06-23T19:01:31.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12cff9700 1 -- 172.21.15.136:0/2626899567 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12401f070 con 0x7fa13015c570 2023-06-23T19:01:31.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa12cff9700 1 -- 172.21.15.136:0/2626899567 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124011890 con 0x7fa13015c570 2023-06-23T19:01:31.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.727+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1301e7da0 con 0x7fa13015c570 2023-06-23T19:01:31.735 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.728+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1301e8880 con 0x7fa13015c570 2023-06-23T19:01:31.735 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.729+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa130073910 con 0x7fa13015c570 2023-06-23T19:01:31.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.729+0000 7fa12cff9700 1 -- 172.21.15.136:0/2626899567 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa124021030 con 0x7fa13015c570 2023-06-23T19:01:31.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.730+0000 7fa12cff9700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa11c06ace0 0x7fa11c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:31.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.730+0000 7fa12cff9700 1 -- 172.21.15.136:0/2626899567 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa12408ad00 con 0x7fa13015c570 2023-06-23T19:01:31.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.731+0000 7fa12ffff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa11c06ace0 0x7fa11c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:31.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.731+0000 7fa12ffff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa11c06ace0 0x7fa11c06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa120001880 tx=0x7fa120009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:31.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.734+0000 7fa12cff9700 1 -- 172.21.15.136:0/2626899567 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa124055ab0 con 0x7fa13015c570 2023-06-23T19:01:31.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.933+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa130073910 con 0x7fa13015c570 2023-06-23T19:01:31.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.934+0000 7fa12cff9700 1 -- 172.21.15.136:0/2626899567 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7fa1240590d0 con 0x7fa13015c570 2023-06-23T19:01:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:31.938 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:31.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.936+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa11c06ace0 msgr2=0x7fa11c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.936+0000 7fa1363ff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa11c06ace0 0x7fa11c06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa120001880 tx=0x7fa120009040 comp rx=0 tx=0).stop 2023-06-23T19:01:31.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.936+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa13015c570 msgr2=0x7fa1300c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:31.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.936+0000 7fa1363ff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa13015c570 0x7fa1300c9ba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa1240090b0 tx=0x7fa124004750 comp rx=0 tx=0).stop 2023-06-23T19:01:31.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.937+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 shutdown_connections 2023-06-23T19:01:31.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.937+0000 7fa1363ff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa11c06ace0 0x7fa11c06d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.937+0000 7fa1363ff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa130160880 0x7fa1300ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.937+0000 7fa1363ff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1300cd830 0x7fa1301e7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.937+0000 7fa1363ff700 1 --2- 172.21.15.136:0/2626899567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa13015c570 0x7fa1300c9ba0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:31.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.937+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 >> 172.21.15.136:0/2626899567 conn(0x7fa130071620 msgr2=0x7fa13015f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:31.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.937+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 shutdown_connections 2023-06-23T19:01:31.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:31.937+0000 7fa1363ff700 1 -- 172.21.15.136:0/2626899567 wait complete. 2023-06-23T19:01:31.959 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-23T19:01:31.959 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T19:01:32.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.148+0000 7f03ce1ff700 1 Processor -- start 2023-06-23T19:01:32.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.148+0000 7f03ce1ff700 1 -- start start 2023-06-23T19:01:32.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.149+0000 7f03ce1ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f03c8160a50 0x7f03c81674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.149+0000 7f03ce1ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c8160e70 con 0x7f03c80cd830 2023-06-23T19:01:32.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.149+0000 7f03ce1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c81610a0 con 0x7f03c815c570 2023-06-23T19:01:32.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.149+0000 7f03ce1ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c815d670 con 0x7f03c8160a50 2023-06-23T19:01:32.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.149+0000 7f03c7fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f03c8160a50 0x7f03c81674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c7fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f03c8160a50 0x7f03c81674d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45956/0 (socket says 172.21.15.136:45956) 2023-06-23T19:01:32.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c7fff700 1 -- 172.21.15.136:0/377180711 learned_addr learned my addr 172.21.15.136:0/377180711 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:32.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c6ffd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f03c80cd830 0x7f03c8160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52986/0 (socket says 172.21.15.136:52986) 2023-06-23T19:01:32.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c7fff700 1 -- 172.21.15.136:0/377180711 >> v1:172.21.15.178:6789/0 conn(0x7f03c815c570 legacy=0x7f03c80cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c7fff700 1 -- 172.21.15.136:0/377180711 >> v1:172.21.15.136:6789/0 conn(0x7f03c80cd830 legacy=0x7f03c8160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c7fff700 1 -- 172.21.15.136:0/377180711 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c815da90 con 0x7f03c8160a50 2023-06-23T19:01:32.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c67fc700 1 -- 172.21.15.136:0/377180711 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799163423 0 0) 0x7f03c8160e70 con 0x7f03c80cd830 2023-06-23T19:01:32.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c7fff700 1 --2- 172.21.15.136:0/377180711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c8160a50 0x7f03c81674d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009e50 tx=0x7f03c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e42c79b2b73089d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:32.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c67fc700 1 -- 172.21.15.136:0/377180711 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000e070 con 0x7f03c8160a50 2023-06-23T19:01:32.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.150+0000 7f03c67fc700 1 -- 172.21.15.136:0/377180711 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c000b9c0 con 0x7f03c8160a50 2023-06-23T19:01:32.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.151+0000 7f03c67fc700 1 -- 172.21.15.136:0/377180711 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000bd70 con 0x7f03c8160a50 2023-06-23T19:01:32.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.151+0000 7f03ce1ff700 1 -- 172.21.15.136:0/377180711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c8160a50 msgr2=0x7f03c81674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.151+0000 7f03ce1ff700 1 --2- 172.21.15.136:0/377180711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c8160a50 0x7f03c81674d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009e50 tx=0x7f03c000b330 comp rx=0 tx=0).stop 2023-06-23T19:01:32.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.151+0000 7f03ce1ff700 1 -- 172.21.15.136:0/377180711 shutdown_connections 2023-06-23T19:01:32.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.151+0000 7f03ce1ff700 1 --2- 172.21.15.136:0/377180711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c8160a50 0x7f03c81674d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.151+0000 7f03ce1ff700 1 -- 172.21.15.136:0/377180711 >> 172.21.15.136:0/377180711 conn(0x7f03c8071620 msgr2=0x7f03c80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:32.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.151+0000 7f03ce1ff700 1 -- 172.21.15.136:0/377180711 shutdown_connections 2023-06-23T19:01:32.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.151+0000 7f03ce1ff700 1 -- 172.21.15.136:0/377180711 wait complete. 2023-06-23T19:01:32.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.153+0000 7f03ce1ff700 1 Processor -- start 2023-06-23T19:01:32.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.153+0000 7f03ce1ff700 1 -- start start 2023-06-23T19:01:32.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03ce1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c80cd830 0x7f03c80ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03ce1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c815c570 0x7f03c80b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03ce1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c8160a50 0x7f03c80b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03ce1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c80b23f0 con 0x7f03c815c570 2023-06-23T19:01:32.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03ce1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c80b79d0 con 0x7f03c8160a50 2023-06-23T19:01:32.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03ce1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c80b7cb0 con 0x7f03c80cd830 2023-06-23T19:01:32.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03c6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c815c570 0x7f03c80b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03c6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c815c570 0x7f03c80b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45970/0 (socket says 172.21.15.136:45970) 2023-06-23T19:01:32.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03c6ffd700 1 -- 172.21.15.136:0/2945637736 learned_addr learned my addr 172.21.15.136:0/2945637736 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:32.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03c77fe700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c80cd830 0x7f03c80ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.154+0000 7f03c7fff700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c8160a50 0x7f03c80b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03c6ffd700 1 -- 172.21.15.136:0/2945637736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c80cd830 msgr2=0x7f03c80ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03c6ffd700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c80cd830 0x7f03c80ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03c6ffd700 1 -- 172.21.15.136:0/2945637736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c8160a50 msgr2=0x7f03c80b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03c6ffd700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c8160a50 0x7f03c80b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03c6ffd700 1 -- 172.21.15.136:0/2945637736 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0009b30 con 0x7f03c815c570 2023-06-23T19:01:32.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03c6ffd700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c815c570 0x7f03c80b1970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c520 tx=0x7f03bc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:32.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03affff700 1 -- 172.21.15.136:0/2945637736 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc004c80 con 0x7f03c815c570 2023-06-23T19:01:32.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03affff700 1 -- 172.21.15.136:0/2945637736 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc004de0 con 0x7f03c815c570 2023-06-23T19:01:32.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03affff700 1 -- 172.21.15.136:0/2945637736 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc007310 con 0x7f03c815c570 2023-06-23T19:01:32.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c80b7f90 con 0x7f03c815c570 2023-06-23T19:01:32.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.155+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c814ac10 con 0x7f03c815c570 2023-06-23T19:01:32.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.156+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c814ae30 con 0x7f03c815c570 2023-06-23T19:01:32.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.157+0000 7f03affff700 1 -- 172.21.15.136:0/2945637736 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03bc007470 con 0x7f03c815c570 2023-06-23T19:01:32.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.158+0000 7f03affff700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f03b406ace0 0x7f03b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.158+0000 7f03affff700 1 -- 172.21.15.136:0/2945637736 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03bc089340 con 0x7f03c815c570 2023-06-23T19:01:32.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.158+0000 7f03c77fe700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f03b406ace0 0x7f03b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.159+0000 7f03c77fe700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f03b406ace0 0x7f03b406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03b8007fd0 tx=0x7f03b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:32.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.163+0000 7f03affff700 1 -- 172.21.15.136:0/2945637736 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03bc0540f0 con 0x7f03c815c570 2023-06-23T19:01:32.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.358+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 --> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03c815cfb0 con 0x7f03b406ace0 2023-06-23T19:01:32.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.370+0000 7f03affff700 1 -- 172.21.15.136:0/2945637736 <== mgr.4105 v2:172.21.15.136:6832/2653877961 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367337 (secure 0 0 0) 0x7f03b8001560 con 0x7f03b406ace0 2023-06-23T19:01:32.381 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:32.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.375+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f03b406ace0 msgr2=0x7f03b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f03b406ace0 0x7f03b406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03b8007fd0 tx=0x7f03b8009040 comp rx=0 tx=0).stop 2023-06-23T19:01:32.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c815c570 msgr2=0x7f03c80b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c815c570 0x7f03c80b1970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c520 tx=0x7f03bc00c830 comp rx=0 tx=0).stop 2023-06-23T19:01:32.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 shutdown_connections 2023-06-23T19:01:32.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f03b406ace0 0x7f03b406d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c8160a50 0x7f03c80b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c80cd830 0x7f03c80ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 --2- 172.21.15.136:0/2945637736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03c815c570 0x7f03c80b1970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 >> 172.21.15.136:0/2945637736 conn(0x7f03c8071620 msgr2=0x7f03c80b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:32.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 shutdown_connections 2023-06-23T19:01:32.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.376+0000 7f03ce1ff700 1 -- 172.21.15.136:0/2945637736 wait complete. 2023-06-23T19:01:32.387 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2023-06-23T19:01:32.399 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-06-23T19:01:30.937637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219240,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755480,"statfs":{"total":773094113280,"available":772869611520,"internally_reserved":0,"allocated":3710976,"data_stored":2197048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003526"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870887+0000","last_change":"2023-06-23T19:01:04.378688+0000","last_active":"2023-06-23T19:01:08.870887+0000","last_peered":"2023-06-23T19:01:08.870887+0000","last_clean":"2023-06-23T19:01:08.870887+0000","last_became_active":"2023-06-23T19:01:04.378277+0000","last_became_peered":"2023-06-23T19:01:04.378277+0000","last_unstale":"2023-06-23T19:01:08.870887+0000","last_undegraded":"2023-06-23T19:01:08.870887+0000","last_fullsized":"2023-06-23T19:01:08.870887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:32:11.850600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282720+0000","last_change":"2023-06-23T19:01:04.385368+0000","last_active":"2023-06-23T19:01:09.282720+0000","last_peered":"2023-06-23T19:01:09.282720+0000","last_clean":"2023-06-23T19:01:09.282720+0000","last_became_active":"2023-06-23T19:01:04.385091+0000","last_became_peered":"2023-06-23T19:01:04.385091+0000","last_unstale":"2023-06-23T19:01:09.282720+0000","last_undegraded":"2023-06-23T19:01:09.282720+0000","last_fullsized":"2023-06-23T19:01:09.282720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:02.533488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282796+0000","last_change":"2023-06-23T19:01:04.382104+0000","last_active":"2023-06-23T19:01:09.282796+0000","last_peered":"2023-06-23T19:01:09.282796+0000","last_clean":"2023-06-23T19:01:09.282796+0000","last_became_active":"2023-06-23T19:01:04.381827+0000","last_became_peered":"2023-06-23T19:01:04.381827+0000","last_unstale":"2023-06-23T19:01:09.282796+0000","last_undegraded":"2023-06-23T19:01:09.282796+0000","last_fullsized":"2023-06-23T19:01:09.282796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:28:01.174081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156752+0000","last_change":"2023-06-23T19:01:04.376037+0000","last_active":"2023-06-23T19:01:09.156752+0000","last_peered":"2023-06-23T19:01:09.156752+0000","last_clean":"2023-06-23T19:01:09.156752+0000","last_became_active":"2023-06-23T19:01:04.375479+0000","last_became_peered":"2023-06-23T19:01:04.375479+0000","last_unstale":"2023-06-23T19:01:09.156752+0000","last_undegraded":"2023-06-23T19:01:09.156752+0000","last_fullsized":"2023-06-23T19:01:09.156752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:42:12.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873331+0000","last_change":"2023-06-23T19:01:04.383574+0000","last_active":"2023-06-23T19:01:08.873331+0000","last_peered":"2023-06-23T19:01:08.873331+0000","last_clean":"2023-06-23T19:01:08.873331+0000","last_became_active":"2023-06-23T19:01:04.383178+0000","last_became_peered":"2023-06-23T19:01:04.383178+0000","last_unstale":"2023-06-23T19:01:08.873331+0000","last_undegraded":"2023-06-23T19:01:08.873331+0000","last_fullsized":"2023-06-23T19:01:08.873331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:08.703615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282561+0000","last_change":"2023-06-23T19:01:04.378592+0000","last_active":"2023-06-23T19:01:09.282561+0000","last_peered":"2023-06-23T19:01:09.282561+0000","last_clean":"2023-06-23T19:01:09.282561+0000","last_became_active":"2023-06-23T19:01:04.378270+0000","last_became_peered":"2023-06-23T19:01:04.378270+0000","last_unstale":"2023-06-23T19:01:09.282561+0000","last_undegraded":"2023-06-23T19:01:09.282561+0000","last_fullsized":"2023-06-23T19:01:09.282561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:03:42.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281650+0000","last_change":"2023-06-23T19:01:04.388383+0000","last_active":"2023-06-23T19:01:09.281650+0000","last_peered":"2023-06-23T19:01:09.281650+0000","last_clean":"2023-06-23T19:01:09.281650+0000","last_became_active":"2023-06-23T19:01:04.388104+0000","last_became_peered":"2023-06-23T19:01:04.388104+0000","last_unstale":"2023-06-23T19:01:09.281650+0000","last_undegraded":"2023-06-23T19:01:09.281650+0000","last_fullsized":"2023-06-23T19:01:09.281650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:59.746450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281560+0000","last_change":"2023-06-23T19:01:04.383152+0000","last_active":"2023-06-23T19:01:09.281560+0000","last_peered":"2023-06-23T19:01:09.281560+0000","last_clean":"2023-06-23T19:01:09.281560+0000","last_became_active":"2023-06-23T19:01:04.382712+0000","last_became_peered":"2023-06-23T19:01:04.382712+0000","last_unstale":"2023-06-23T19:01:09.281560+0000","last_undegraded":"2023-06-23T19:01:09.281560+0000","last_fullsized":"2023-06-23T19:01:09.281560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873324+0000","last_change":"2023-06-23T19:01:04.382700+0000","last_active":"2023-06-23T19:01:08.873324+0000","last_peered":"2023-06-23T19:01:08.873324+0000","last_clean":"2023-06-23T19:01:08.873324+0000","last_became_active":"2023-06-23T19:01:04.382201+0000","last_became_peered":"2023-06-23T19:01:04.382201+0000","last_unstale":"2023-06-23T19:01:08.873324+0000","last_undegraded":"2023-06-23T19:01:08.873324+0000","last_fullsized":"2023-06-23T19:01:08.873324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283207+0000","last_change":"2023-06-23T19:01:04.376595+0000","last_active":"2023-06-23T19:01:09.283207+0000","last_peered":"2023-06-23T19:01:09.283207+0000","last_clean":"2023-06-23T19:01:09.283207+0000","last_became_active":"2023-06-23T19:01:04.376392+0000","last_became_peered":"2023-06-23T19:01:04.376392+0000","last_unstale":"2023-06-23T19:01:09.283207+0000","last_undegraded":"2023-06-23T19:01:09.283207+0000","last_fullsized":"2023-06-23T19:01:09.283207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:30:56.096215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282762+0000","last_change":"2023-06-23T19:01:04.388979+0000","last_active":"2023-06-23T19:01:09.282762+0000","last_peered":"2023-06-23T19:01:09.282762+0000","last_clean":"2023-06-23T19:01:09.282762+0000","last_became_active":"2023-06-23T19:01:04.388676+0000","last_became_peered":"2023-06-23T19:01:04.388676+0000","last_unstale":"2023-06-23T19:01:09.282762+0000","last_undegraded":"2023-06-23T19:01:09.282762+0000","last_fullsized":"2023-06-23T19:01:09.282762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:29:33.177223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871107+0000","last_change":"2023-06-23T19:01:04.391858+0000","last_active":"2023-06-23T19:01:08.871107+0000","last_peered":"2023-06-23T19:01:08.871107+0000","last_clean":"2023-06-23T19:01:08.871107+0000","last_became_active":"2023-06-23T19:01:04.391669+0000","last_became_peered":"2023-06-23T19:01:04.391669+0000","last_unstale":"2023-06-23T19:01:08.871107+0000","last_undegraded":"2023-06-23T19:01:08.871107+0000","last_fullsized":"2023-06-23T19:01:08.871107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:03.089060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870980+0000","last_change":"2023-06-23T19:01:04.372094+0000","last_active":"2023-06-23T19:01:08.870980+0000","last_peered":"2023-06-23T19:01:08.870980+0000","last_clean":"2023-06-23T19:01:08.870980+0000","last_became_active":"2023-06-23T19:01:04.370416+0000","last_became_peered":"2023-06-23T19:01:04.370416+0000","last_unstale":"2023-06-23T19:01:08.870980+0000","last_undegraded":"2023-06-23T19:01:08.870980+0000","last_fullsized":"2023-06-23T19:01:08.870980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:50.510315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282222+0000","last_change":"2023-06-23T19:01:04.380048+0000","last_active":"2023-06-23T19:01:09.282222+0000","last_peered":"2023-06-23T19:01:09.282222+0000","last_clean":"2023-06-23T19:01:09.282222+0000","last_became_active":"2023-06-23T19:01:04.379845+0000","last_became_peered":"2023-06-23T19:01:04.379845+0000","last_unstale":"2023-06-23T19:01:09.282222+0000","last_undegraded":"2023-06-23T19:01:09.282222+0000","last_fullsized":"2023-06-23T19:01:09.282222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:34.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281323+0000","last_change":"2023-06-23T19:01:04.388881+0000","last_active":"2023-06-23T19:01:09.281323+0000","last_peered":"2023-06-23T19:01:09.281323+0000","last_clean":"2023-06-23T19:01:09.281323+0000","last_became_active":"2023-06-23T19:01:04.388417+0000","last_became_peered":"2023-06-23T19:01:04.388417+0000","last_unstale":"2023-06-23T19:01:09.281323+0000","last_undegraded":"2023-06-23T19:01:09.281323+0000","last_fullsized":"2023-06-23T19:01:09.281323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:22.486690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281157+0000","last_change":"2023-06-23T19:01:04.383317+0000","last_active":"2023-06-23T19:01:09.281157+0000","last_peered":"2023-06-23T19:01:09.281157+0000","last_clean":"2023-06-23T19:01:09.281157+0000","last_became_active":"2023-06-23T19:01:04.378678+0000","last_became_peered":"2023-06-23T19:01:04.378678+0000","last_unstale":"2023-06-23T19:01:09.281157+0000","last_undegraded":"2023-06-23T19:01:09.281157+0000","last_fullsized":"2023-06-23T19:01:09.281157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:01:47.617327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873389+0000","last_change":"2023-06-23T19:01:04.382482+0000","last_active":"2023-06-23T19:01:08.873389+0000","last_peered":"2023-06-23T19:01:08.873389+0000","last_clean":"2023-06-23T19:01:08.873389+0000","last_became_active":"2023-06-23T19:01:04.381876+0000","last_became_peered":"2023-06-23T19:01:04.381876+0000","last_unstale":"2023-06-23T19:01:08.873389+0000","last_undegraded":"2023-06-23T19:01:08.873389+0000","last_fullsized":"2023-06-23T19:01:08.873389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:34.423477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282971+0000","last_change":"2023-06-23T19:01:04.382129+0000","last_active":"2023-06-23T19:01:09.282971+0000","last_peered":"2023-06-23T19:01:09.282971+0000","last_clean":"2023-06-23T19:01:09.282971+0000","last_became_active":"2023-06-23T19:01:04.381462+0000","last_became_peered":"2023-06-23T19:01:04.381462+0000","last_unstale":"2023-06-23T19:01:09.282971+0000","last_undegraded":"2023-06-23T19:01:09.282971+0000","last_fullsized":"2023-06-23T19:01:09.282971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:51:17.974676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870818+0000","last_change":"2023-06-23T19:01:04.367952+0000","last_active":"2023-06-23T19:01:08.870818+0000","last_peered":"2023-06-23T19:01:08.870818+0000","last_clean":"2023-06-23T19:01:08.870818+0000","last_became_active":"2023-06-23T19:01:04.367677+0000","last_became_peered":"2023-06-23T19:01:04.367677+0000","last_unstale":"2023-06-23T19:01:08.870818+0000","last_undegraded":"2023-06-23T19:01:08.870818+0000","last_fullsized":"2023-06-23T19:01:08.870818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:28:28.127638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281961+0000","last_change":"2023-06-23T19:01:04.374187+0000","last_active":"2023-06-23T19:01:09.281961+0000","last_peered":"2023-06-23T19:01:09.281961+0000","last_clean":"2023-06-23T19:01:09.281961+0000","last_became_active":"2023-06-23T19:01:04.373921+0000","last_became_peered":"2023-06-23T19:01:04.373921+0000","last_unstale":"2023-06-23T19:01:09.281961+0000","last_undegraded":"2023-06-23T19:01:09.281961+0000","last_fullsized":"2023-06-23T19:01:09.281961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:14:17.383712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282957+0000","last_change":"2023-06-23T19:01:04.386537+0000","last_active":"2023-06-23T19:01:09.282957+0000","last_peered":"2023-06-23T19:01:09.282957+0000","last_clean":"2023-06-23T19:01:09.282957+0000","last_became_active":"2023-06-23T19:01:04.386192+0000","last_became_peered":"2023-06-23T19:01:04.386192+0000","last_unstale":"2023-06-23T19:01:09.282957+0000","last_undegraded":"2023-06-23T19:01:09.282957+0000","last_fullsized":"2023-06-23T19:01:09.282957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:02.220770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872398+0000","last_change":"2023-06-23T19:01:04.388749+0000","last_active":"2023-06-23T19:01:08.872398+0000","last_peered":"2023-06-23T19:01:08.872398+0000","last_clean":"2023-06-23T19:01:08.872398+0000","last_became_active":"2023-06-23T19:01:04.388450+0000","last_became_peered":"2023-06-23T19:01:04.388450+0000","last_unstale":"2023-06-23T19:01:08.872398+0000","last_undegraded":"2023-06-23T19:01:08.872398+0000","last_fullsized":"2023-06-23T19:01:08.872398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:59.683785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280402+0000","last_change":"2023-06-23T19:01:04.374228+0000","last_active":"2023-06-23T19:01:09.280402+0000","last_peered":"2023-06-23T19:01:09.280402+0000","last_clean":"2023-06-23T19:01:09.280402+0000","last_became_active":"2023-06-23T19:01:04.373934+0000","last_became_peered":"2023-06-23T19:01:04.373934+0000","last_unstale":"2023-06-23T19:01:09.280402+0000","last_undegraded":"2023-06-23T19:01:09.280402+0000","last_fullsized":"2023-06-23T19:01:09.280402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:09.120268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283074+0000","last_change":"2023-06-23T19:01:04.384671+0000","last_active":"2023-06-23T19:01:09.283074+0000","last_peered":"2023-06-23T19:01:09.283074+0000","last_clean":"2023-06-23T19:01:09.283074+0000","last_became_active":"2023-06-23T19:01:04.384373+0000","last_became_peered":"2023-06-23T19:01:04.384373+0000","last_unstale":"2023-06-23T19:01:09.283074+0000","last_undegraded":"2023-06-23T19:01:09.283074+0000","last_fullsized":"2023-06-23T19:01:09.283074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:13.294523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872724+0000","last_change":"2023-06-23T19:01:04.374136+0000","last_active":"2023-06-23T19:01:08.872724+0000","last_peered":"2023-06-23T19:01:08.872724+0000","last_clean":"2023-06-23T19:01:08.872724+0000","last_became_active":"2023-06-23T19:01:04.373867+0000","last_became_peered":"2023-06-23T19:01:04.373867+0000","last_unstale":"2023-06-23T19:01:08.872724+0000","last_undegraded":"2023-06-23T19:01:08.872724+0000","last_fullsized":"2023-06-23T19:01:08.872724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.507284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873820+0000","last_change":"2023-06-23T19:01:04.384724+0000","last_active":"2023-06-23T19:01:08.873820+0000","last_peered":"2023-06-23T19:01:08.873820+0000","last_clean":"2023-06-23T19:01:08.873820+0000","last_became_active":"2023-06-23T19:01:04.384514+0000","last_became_peered":"2023-06-23T19:01:04.384514+0000","last_unstale":"2023-06-23T19:01:08.873820+0000","last_undegraded":"2023-06-23T19:01:08.873820+0000","last_fullsized":"2023-06-23T19:01:08.873820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:59.746450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283574+0000","last_change":"2023-06-23T19:01:04.380891+0000","last_active":"2023-06-23T19:01:09.283574+0000","last_peered":"2023-06-23T19:01:09.283574+0000","last_clean":"2023-06-23T19:01:09.283574+0000","last_became_active":"2023-06-23T19:01:04.380336+0000","last_became_peered":"2023-06-23T19:01:04.380336+0000","last_unstale":"2023-06-23T19:01:09.283574+0000","last_undegraded":"2023-06-23T19:01:09.283574+0000","last_fullsized":"2023-06-23T19:01:09.283574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:00.026037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282369+0000","last_change":"2023-06-23T19:01:08.395986+0000","last_active":"2023-06-23T19:01:09.282369+0000","last_peered":"2023-06-23T19:01:09.282369+0000","last_clean":"2023-06-23T19:01:09.282369+0000","last_became_active":"2023-06-23T19:01:08.395550+0000","last_became_peered":"2023-06-23T19:01:08.395550+0000","last_unstale":"2023-06-23T19:01:09.282369+0000","last_undegraded":"2023-06-23T19:01:09.282369+0000","last_fullsized":"2023-06-23T19:01:09.282369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:55:35.582136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282386+0000","last_change":"2023-06-23T19:01:03.877831+0000","last_active":"2023-06-23T19:01:09.282386+0000","last_peered":"2023-06-23T19:01:09.282386+0000","last_clean":"2023-06-23T19:01:09.282386+0000","last_became_active":"2023-06-23T19:01:03.877541+0000","last_became_peered":"2023-06-23T19:01:03.877541+0000","last_unstale":"2023-06-23T19:01:09.282386+0000","last_undegraded":"2023-06-23T19:01:09.282386+0000","last_fullsized":"2023-06-23T19:01:09.282386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:02:36.669063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280914+0000","last_change":"2023-06-23T19:01:04.386920+0000","last_active":"2023-06-23T19:01:09.280914+0000","last_peered":"2023-06-23T19:01:09.280914+0000","last_clean":"2023-06-23T19:01:09.280914+0000","last_became_active":"2023-06-23T19:01:04.386357+0000","last_became_peered":"2023-06-23T19:01:04.386357+0000","last_unstale":"2023-06-23T19:01:09.280914+0000","last_undegraded":"2023-06-23T19:01:09.280914+0000","last_fullsized":"2023-06-23T19:01:09.280914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:47:30.538293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157090+0000","last_change":"2023-06-23T19:01:08.399323+0000","last_active":"2023-06-23T19:01:09.157090+0000","last_peered":"2023-06-23T19:01:09.157090+0000","last_clean":"2023-06-23T19:01:09.157090+0000","last_became_active":"2023-06-23T19:01:08.398808+0000","last_became_peered":"2023-06-23T19:01:08.398808+0000","last_unstale":"2023-06-23T19:01:09.157090+0000","last_undegraded":"2023-06-23T19:01:09.157090+0000","last_fullsized":"2023-06-23T19:01:09.157090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:35.871412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871893+0000","last_change":"2023-06-23T19:01:03.885277+0000","last_active":"2023-06-23T19:01:08.871893+0000","last_peered":"2023-06-23T19:01:08.871893+0000","last_clean":"2023-06-23T19:01:08.871893+0000","last_became_active":"2023-06-23T19:01:03.885059+0000","last_became_peered":"2023-06-23T19:01:03.885059+0000","last_unstale":"2023-06-23T19:01:08.871893+0000","last_undegraded":"2023-06-23T19:01:08.871893+0000","last_fullsized":"2023-06-23T19:01:08.871893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:50.138012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872568+0000","last_change":"2023-06-23T19:01:04.381825+0000","last_active":"2023-06-23T19:01:08.872568+0000","last_peered":"2023-06-23T19:01:08.872568+0000","last_clean":"2023-06-23T19:01:08.872568+0000","last_became_active":"2023-06-23T19:01:04.381313+0000","last_became_peered":"2023-06-23T19:01:04.381313+0000","last_unstale":"2023-06-23T19:01:08.872568+0000","last_undegraded":"2023-06-23T19:01:08.872568+0000","last_fullsized":"2023-06-23T19:01:08.872568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:15.464343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872863+0000","last_change":"2023-06-23T19:01:08.393931+0000","last_active":"2023-06-23T19:01:08.872863+0000","last_peered":"2023-06-23T19:01:08.872863+0000","last_clean":"2023-06-23T19:01:08.872863+0000","last_became_active":"2023-06-23T19:01:08.393556+0000","last_became_peered":"2023-06-23T19:01:08.393556+0000","last_unstale":"2023-06-23T19:01:08.872863+0000","last_undegraded":"2023-06-23T19:01:08.872863+0000","last_fullsized":"2023-06-23T19:01:08.872863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:27.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280805+0000","last_change":"2023-06-23T19:01:03.873568+0000","last_active":"2023-06-23T19:01:09.280805+0000","last_peered":"2023-06-23T19:01:09.280805+0000","last_clean":"2023-06-23T19:01:09.280805+0000","last_became_active":"2023-06-23T19:01:03.873256+0000","last_became_peered":"2023-06-23T19:01:03.873256+0000","last_unstale":"2023-06-23T19:01:09.280805+0000","last_undegraded":"2023-06-23T19:01:09.280805+0000","last_fullsized":"2023-06-23T19:01:09.280805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:22:44.177756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157154+0000","last_change":"2023-06-23T19:01:04.370281+0000","last_active":"2023-06-23T19:01:09.157154+0000","last_peered":"2023-06-23T19:01:09.157154+0000","last_clean":"2023-06-23T19:01:09.157154+0000","last_became_active":"2023-06-23T19:01:04.369996+0000","last_became_peered":"2023-06-23T19:01:04.369996+0000","last_unstale":"2023-06-23T19:01:09.157154+0000","last_undegraded":"2023-06-23T19:01:09.157154+0000","last_fullsized":"2023-06-23T19:01:09.157154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:05:09.392936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156729+0000","last_change":"2023-06-23T19:01:08.397782+0000","last_active":"2023-06-23T19:01:09.156729+0000","last_peered":"2023-06-23T19:01:09.156729+0000","last_clean":"2023-06-23T19:01:09.156729+0000","last_became_active":"2023-06-23T19:01:08.397312+0000","last_became_peered":"2023-06-23T19:01:08.397312+0000","last_unstale":"2023-06-23T19:01:09.156729+0000","last_undegraded":"2023-06-23T19:01:09.156729+0000","last_fullsized":"2023-06-23T19:01:09.156729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:38:36.950113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873470+0000","last_change":"2023-06-23T19:01:03.875654+0000","last_active":"2023-06-23T19:01:08.873470+0000","last_peered":"2023-06-23T19:01:08.873470+0000","last_clean":"2023-06-23T19:01:08.873470+0000","last_became_active":"2023-06-23T19:01:03.875197+0000","last_became_peered":"2023-06-23T19:01:03.875197+0000","last_unstale":"2023-06-23T19:01:08.873470+0000","last_undegraded":"2023-06-23T19:01:08.873470+0000","last_fullsized":"2023-06-23T19:01:08.873470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:21.482936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280620+0000","last_change":"2023-06-23T19:01:04.385872+0000","last_active":"2023-06-23T19:01:09.280620+0000","last_peered":"2023-06-23T19:01:09.280620+0000","last_clean":"2023-06-23T19:01:09.280620+0000","last_became_active":"2023-06-23T19:01:04.385605+0000","last_became_peered":"2023-06-23T19:01:04.385605+0000","last_unstale":"2023-06-23T19:01:09.280620+0000","last_undegraded":"2023-06-23T19:01:09.280620+0000","last_fullsized":"2023-06-23T19:01:09.280620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:30:07.714637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281074+0000","last_change":"2023-06-23T19:01:08.392127+0000","last_active":"2023-06-23T19:01:09.281074+0000","last_peered":"2023-06-23T19:01:09.281074+0000","last_clean":"2023-06-23T19:01:09.281074+0000","last_became_active":"2023-06-23T19:01:08.391726+0000","last_became_peered":"2023-06-23T19:01:08.391726+0000","last_unstale":"2023-06-23T19:01:09.281074+0000","last_undegraded":"2023-06-23T19:01:09.281074+0000","last_fullsized":"2023-06-23T19:01:09.281074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:03.540201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282960+0000","last_change":"2023-06-23T19:01:03.872890+0000","last_active":"2023-06-23T19:01:09.282960+0000","last_peered":"2023-06-23T19:01:09.282960+0000","last_clean":"2023-06-23T19:01:09.282960+0000","last_became_active":"2023-06-23T19:01:03.872477+0000","last_became_peered":"2023-06-23T19:01:03.872477+0000","last_unstale":"2023-06-23T19:01:09.282960+0000","last_undegraded":"2023-06-23T19:01:09.282960+0000","last_fullsized":"2023-06-23T19:01:09.282960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:16:35.893488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280412+0000","last_change":"2023-06-23T19:01:04.372079+0000","last_active":"2023-06-23T19:01:09.280412+0000","last_peered":"2023-06-23T19:01:09.280412+0000","last_clean":"2023-06-23T19:01:09.280412+0000","last_became_active":"2023-06-23T19:01:04.371764+0000","last_became_peered":"2023-06-23T19:01:04.371764+0000","last_unstale":"2023-06-23T19:01:09.280412+0000","last_undegraded":"2023-06-23T19:01:09.280412+0000","last_fullsized":"2023-06-23T19:01:09.280412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:39.705880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280820+0000","last_change":"2023-06-23T19:01:08.408231+0000","last_active":"2023-06-23T19:01:09.280820+0000","last_peered":"2023-06-23T19:01:09.280820+0000","last_clean":"2023-06-23T19:01:09.280820+0000","last_became_active":"2023-06-23T19:01:08.407872+0000","last_became_peered":"2023-06-23T19:01:08.407872+0000","last_unstale":"2023-06-23T19:01:09.280820+0000","last_undegraded":"2023-06-23T19:01:09.280820+0000","last_fullsized":"2023-06-23T19:01:09.280820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:41:47.186941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281857+0000","last_change":"2023-06-23T19:01:03.884943+0000","last_active":"2023-06-23T19:01:09.281857+0000","last_peered":"2023-06-23T19:01:09.281857+0000","last_clean":"2023-06-23T19:01:09.281857+0000","last_became_active":"2023-06-23T19:01:03.884670+0000","last_became_peered":"2023-06-23T19:01:03.884670+0000","last_unstale":"2023-06-23T19:01:09.281857+0000","last_undegraded":"2023-06-23T19:01:09.281857+0000","last_fullsized":"2023-06-23T19:01:09.281857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:01.529734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872631+0000","last_change":"2023-06-23T19:01:04.378162+0000","last_active":"2023-06-23T19:01:08.872631+0000","last_peered":"2023-06-23T19:01:08.872631+0000","last_clean":"2023-06-23T19:01:08.872631+0000","last_became_active":"2023-06-23T19:01:04.377889+0000","last_became_peered":"2023-06-23T19:01:04.377889+0000","last_unstale":"2023-06-23T19:01:08.872631+0000","last_undegraded":"2023-06-23T19:01:08.872631+0000","last_fullsized":"2023-06-23T19:01:08.872631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:15.464343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872077+0000","last_change":"2023-06-23T19:01:08.407720+0000","last_active":"2023-06-23T19:01:08.872077+0000","last_peered":"2023-06-23T19:01:08.872077+0000","last_clean":"2023-06-23T19:01:08.872077+0000","last_became_active":"2023-06-23T19:01:08.407375+0000","last_became_peered":"2023-06-23T19:01:08.407375+0000","last_unstale":"2023-06-23T19:01:08.872077+0000","last_undegraded":"2023-06-23T19:01:08.872077+0000","last_fullsized":"2023-06-23T19:01:08.872077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:52:30.461408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:22.099711+0000","last_change":"2023-06-23T19:01:03.874324+0000","last_active":"2023-06-23T19:01:22.099711+0000","last_peered":"2023-06-23T19:01:22.099711+0000","last_clean":"2023-06-23T19:01:22.099711+0000","last_became_active":"2023-06-23T19:01:03.873875+0000","last_became_peered":"2023-06-23T19:01:03.873875+0000","last_unstale":"2023-06-23T19:01:22.099711+0000","last_undegraded":"2023-06-23T19:01:22.099711+0000","last_fullsized":"2023-06-23T19:01:22.099711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:08:09.258254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281733+0000","last_change":"2023-06-23T19:01:04.386473+0000","last_active":"2023-06-23T19:01:09.281733+0000","last_peered":"2023-06-23T19:01:09.281733+0000","last_clean":"2023-06-23T19:01:09.281733+0000","last_became_active":"2023-06-23T19:01:04.386168+0000","last_became_peered":"2023-06-23T19:01:04.386168+0000","last_unstale":"2023-06-23T19:01:09.281733+0000","last_undegraded":"2023-06-23T19:01:09.281733+0000","last_fullsized":"2023-06-23T19:01:09.281733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:21.315691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283666+0000","last_change":"2023-06-23T19:01:08.403704+0000","last_active":"2023-06-23T19:01:09.283666+0000","last_peered":"2023-06-23T19:01:09.283666+0000","last_clean":"2023-06-23T19:01:09.283666+0000","last_became_active":"2023-06-23T19:01:08.401409+0000","last_became_peered":"2023-06-23T19:01:08.401409+0000","last_unstale":"2023-06-23T19:01:09.283666+0000","last_undegraded":"2023-06-23T19:01:09.283666+0000","last_fullsized":"2023-06-23T19:01:09.283666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:12.955870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281472+0000","last_change":"2023-06-23T19:01:03.879123+0000","last_active":"2023-06-23T19:01:09.281472+0000","last_peered":"2023-06-23T19:01:09.281472+0000","last_clean":"2023-06-23T19:01:09.281472+0000","last_became_active":"2023-06-23T19:01:03.878849+0000","last_became_peered":"2023-06-23T19:01:03.878849+0000","last_unstale":"2023-06-23T19:01:09.281472+0000","last_undegraded":"2023-06-23T19:01:09.281472+0000","last_fullsized":"2023-06-23T19:01:09.281472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:08.437952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280990+0000","last_change":"2023-06-23T19:01:04.386760+0000","last_active":"2023-06-23T19:01:09.280990+0000","last_peered":"2023-06-23T19:01:09.280990+0000","last_clean":"2023-06-23T19:01:09.280990+0000","last_became_active":"2023-06-23T19:01:04.386378+0000","last_became_peered":"2023-06-23T19:01:04.386378+0000","last_unstale":"2023-06-23T19:01:09.280990+0000","last_undegraded":"2023-06-23T19:01:09.280990+0000","last_fullsized":"2023-06-23T19:01:09.280990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:04:32.211071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280924+0000","last_change":"2023-06-23T19:01:08.398632+0000","last_active":"2023-06-23T19:01:09.280924+0000","last_peered":"2023-06-23T19:01:09.280924+0000","last_clean":"2023-06-23T19:01:09.280924+0000","last_became_active":"2023-06-23T19:01:08.397912+0000","last_became_peered":"2023-06-23T19:01:08.397912+0000","last_unstale":"2023-06-23T19:01:09.280924+0000","last_undegraded":"2023-06-23T19:01:09.280924+0000","last_fullsized":"2023-06-23T19:01:09.280924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:53:09.486798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872187+0000","last_change":"2023-06-23T19:01:03.868975+0000","last_active":"2023-06-23T19:01:08.872187+0000","last_peered":"2023-06-23T19:01:08.872187+0000","last_clean":"2023-06-23T19:01:08.872187+0000","last_became_active":"2023-06-23T19:01:03.868673+0000","last_became_peered":"2023-06-23T19:01:03.868673+0000","last_unstale":"2023-06-23T19:01:08.872187+0000","last_undegraded":"2023-06-23T19:01:08.872187+0000","last_fullsized":"2023-06-23T19:01:08.872187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:45:30.544760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283480+0000","last_change":"2023-06-23T19:01:04.380621+0000","last_active":"2023-06-23T19:01:09.283480+0000","last_peered":"2023-06-23T19:01:09.283480+0000","last_clean":"2023-06-23T19:01:09.283480+0000","last_became_active":"2023-06-23T19:01:04.379977+0000","last_became_peered":"2023-06-23T19:01:04.379977+0000","last_unstale":"2023-06-23T19:01:09.283480+0000","last_undegraded":"2023-06-23T19:01:09.283480+0000","last_fullsized":"2023-06-23T19:01:09.283480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:13.294523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281097+0000","last_change":"2023-06-23T19:01:08.399057+0000","last_active":"2023-06-23T19:01:09.281097+0000","last_peered":"2023-06-23T19:01:09.281097+0000","last_clean":"2023-06-23T19:01:09.281097+0000","last_became_active":"2023-06-23T19:01:08.398665+0000","last_became_peered":"2023-06-23T19:01:08.398665+0000","last_unstale":"2023-06-23T19:01:09.281097+0000","last_undegraded":"2023-06-23T19:01:09.281097+0000","last_fullsized":"2023-06-23T19:01:09.281097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:54:48.546637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281472+0000","last_change":"2023-06-23T19:01:03.876992+0000","last_active":"2023-06-23T19:01:09.281472+0000","last_peered":"2023-06-23T19:01:09.281472+0000","last_clean":"2023-06-23T19:01:09.281472+0000","last_became_active":"2023-06-23T19:01:03.876802+0000","last_became_peered":"2023-06-23T19:01:03.876802+0000","last_unstale":"2023-06-23T19:01:09.281472+0000","last_undegraded":"2023-06-23T19:01:09.281472+0000","last_fullsized":"2023-06-23T19:01:09.281472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:10.929312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872681+0000","last_change":"2023-06-23T19:01:04.382339+0000","last_active":"2023-06-23T19:01:08.872681+0000","last_peered":"2023-06-23T19:01:08.872681+0000","last_clean":"2023-06-23T19:01:08.872681+0000","last_became_active":"2023-06-23T19:01:04.382080+0000","last_became_peered":"2023-06-23T19:01:04.382080+0000","last_unstale":"2023-06-23T19:01:08.872681+0000","last_undegraded":"2023-06-23T19:01:08.872681+0000","last_fullsized":"2023-06-23T19:01:08.872681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:37:39.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282568+0000","last_change":"2023-06-23T19:01:08.405608+0000","last_active":"2023-06-23T19:01:09.282568+0000","last_peered":"2023-06-23T19:01:09.282568+0000","last_clean":"2023-06-23T19:01:09.282568+0000","last_became_active":"2023-06-23T19:01:08.405237+0000","last_became_peered":"2023-06-23T19:01:08.405237+0000","last_unstale":"2023-06-23T19:01:09.282568+0000","last_undegraded":"2023-06-23T19:01:09.282568+0000","last_fullsized":"2023-06-23T19:01:09.282568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:03.260614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156916+0000","last_change":"2023-06-23T19:01:03.869001+0000","last_active":"2023-06-23T19:01:09.156916+0000","last_peered":"2023-06-23T19:01:09.156916+0000","last_clean":"2023-06-23T19:01:09.156916+0000","last_became_active":"2023-06-23T19:01:03.868685+0000","last_became_peered":"2023-06-23T19:01:03.868685+0000","last_unstale":"2023-06-23T19:01:09.156916+0000","last_undegraded":"2023-06-23T19:01:09.156916+0000","last_fullsized":"2023-06-23T19:01:09.156916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:23:13.817453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281267+0000","last_change":"2023-06-23T19:01:04.374785+0000","last_active":"2023-06-23T19:01:09.281267+0000","last_peered":"2023-06-23T19:01:09.281267+0000","last_clean":"2023-06-23T19:01:09.281267+0000","last_became_active":"2023-06-23T19:01:04.374406+0000","last_became_peered":"2023-06-23T19:01:04.374406+0000","last_unstale":"2023-06-23T19:01:09.281267+0000","last_undegraded":"2023-06-23T19:01:09.281267+0000","last_fullsized":"2023-06-23T19:01:09.281267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:09:07.414494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282780+0000","last_change":"2023-06-23T19:01:08.393879+0000","last_active":"2023-06-23T19:01:09.282780+0000","last_peered":"2023-06-23T19:01:09.282780+0000","last_clean":"2023-06-23T19:01:09.282780+0000","last_became_active":"2023-06-23T19:01:08.393451+0000","last_became_peered":"2023-06-23T19:01:08.393451+0000","last_unstale":"2023-06-23T19:01:09.282780+0000","last_undegraded":"2023-06-23T19:01:09.282780+0000","last_fullsized":"2023-06-23T19:01:09.282780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:30:59.610379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282080+0000","last_change":"2023-06-23T19:01:03.880187+0000","last_active":"2023-06-23T19:01:09.282080+0000","last_peered":"2023-06-23T19:01:09.282080+0000","last_clean":"2023-06-23T19:01:09.282080+0000","last_became_active":"2023-06-23T19:01:03.879883+0000","last_became_peered":"2023-06-23T19:01:03.879883+0000","last_unstale":"2023-06-23T19:01:09.282080+0000","last_undegraded":"2023-06-23T19:01:09.282080+0000","last_fullsized":"2023-06-23T19:01:09.282080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:36:36.334076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281403+0000","last_change":"2023-06-23T19:01:04.374578+0000","last_active":"2023-06-23T19:01:09.281403+0000","last_peered":"2023-06-23T19:01:09.281403+0000","last_clean":"2023-06-23T19:01:09.281403+0000","last_became_active":"2023-06-23T19:01:04.374334+0000","last_became_peered":"2023-06-23T19:01:04.374334+0000","last_unstale":"2023-06-23T19:01:09.281403+0000","last_undegraded":"2023-06-23T19:01:09.281403+0000","last_fullsized":"2023-06-23T19:01:09.281403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.507284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870687+0000","last_change":"2023-06-23T19:01:08.401653+0000","last_active":"2023-06-23T19:01:08.870687+0000","last_peered":"2023-06-23T19:01:08.870687+0000","last_clean":"2023-06-23T19:01:08.870687+0000","last_became_active":"2023-06-23T19:01:08.401248+0000","last_became_peered":"2023-06-23T19:01:08.401248+0000","last_unstale":"2023-06-23T19:01:08.870687+0000","last_undegraded":"2023-06-23T19:01:08.870687+0000","last_fullsized":"2023-06-23T19:01:08.870687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:26.097068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281971+0000","last_change":"2023-06-23T19:01:03.877753+0000","last_active":"2023-06-23T19:01:09.281971+0000","last_peered":"2023-06-23T19:01:09.281971+0000","last_clean":"2023-06-23T19:01:09.281971+0000","last_became_active":"2023-06-23T19:01:03.877504+0000","last_became_peered":"2023-06-23T19:01:03.877504+0000","last_unstale":"2023-06-23T19:01:09.281971+0000","last_undegraded":"2023-06-23T19:01:09.281971+0000","last_fullsized":"2023-06-23T19:01:09.281971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:29.477822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281456+0000","last_change":"2023-06-23T19:01:04.388674+0000","last_active":"2023-06-23T19:01:09.281456+0000","last_peered":"2023-06-23T19:01:09.281456+0000","last_clean":"2023-06-23T19:01:09.281456+0000","last_became_active":"2023-06-23T19:01:04.386268+0000","last_became_peered":"2023-06-23T19:01:04.386268+0000","last_unstale":"2023-06-23T19:01:09.281456+0000","last_undegraded":"2023-06-23T19:01:09.281456+0000","last_fullsized":"2023-06-23T19:01:09.281456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:50:00.709971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870883+0000","last_change":"2023-06-23T19:01:08.403947+0000","last_active":"2023-06-23T19:01:08.870883+0000","last_peered":"2023-06-23T19:01:08.870883+0000","last_clean":"2023-06-23T19:01:08.870883+0000","last_became_active":"2023-06-23T19:01:08.403536+0000","last_became_peered":"2023-06-23T19:01:08.403536+0000","last_unstale":"2023-06-23T19:01:08.870883+0000","last_undegraded":"2023-06-23T19:01:08.870883+0000","last_fullsized":"2023-06-23T19:01:08.870883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:53:39.593981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282198+0000","last_change":"2023-06-23T19:01:03.874658+0000","last_active":"2023-06-23T19:01:09.282198+0000","last_peered":"2023-06-23T19:01:09.282198+0000","last_clean":"2023-06-23T19:01:09.282198+0000","last_became_active":"2023-06-23T19:01:03.874261+0000","last_became_peered":"2023-06-23T19:01:03.874261+0000","last_unstale":"2023-06-23T19:01:09.282198+0000","last_undegraded":"2023-06-23T19:01:09.282198+0000","last_fullsized":"2023-06-23T19:01:09.282198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:15.133048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156399+0000","last_change":"2023-06-23T19:01:04.375757+0000","last_active":"2023-06-23T19:01:09.156399+0000","last_peered":"2023-06-23T19:01:09.156399+0000","last_clean":"2023-06-23T19:01:09.156399+0000","last_became_active":"2023-06-23T19:01:04.375467+0000","last_became_peered":"2023-06-23T19:01:04.375467+0000","last_unstale":"2023-06-23T19:01:09.156399+0000","last_undegraded":"2023-06-23T19:01:09.156399+0000","last_fullsized":"2023-06-23T19:01:09.156399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:53:12.454851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870906+0000","last_change":"2023-06-23T19:01:08.400551+0000","last_active":"2023-06-23T19:01:08.870906+0000","last_peered":"2023-06-23T19:01:08.870906+0000","last_clean":"2023-06-23T19:01:08.870906+0000","last_became_active":"2023-06-23T19:01:08.400104+0000","last_became_peered":"2023-06-23T19:01:08.400104+0000","last_unstale":"2023-06-23T19:01:08.870906+0000","last_undegraded":"2023-06-23T19:01:08.870906+0000","last_fullsized":"2023-06-23T19:01:08.870906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:30:02.757178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281582+0000","last_change":"2023-06-23T19:01:03.879522+0000","last_active":"2023-06-23T19:01:09.281582+0000","last_peered":"2023-06-23T19:01:09.281582+0000","last_clean":"2023-06-23T19:01:09.281582+0000","last_became_active":"2023-06-23T19:01:03.879221+0000","last_became_peered":"2023-06-23T19:01:03.879221+0000","last_unstale":"2023-06-23T19:01:09.281582+0000","last_undegraded":"2023-06-23T19:01:09.281582+0000","last_fullsized":"2023-06-23T19:01:09.281582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:07.699862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873612+0000","last_change":"2023-06-23T19:01:04.387840+0000","last_active":"2023-06-23T19:01:08.873612+0000","last_peered":"2023-06-23T19:01:08.873612+0000","last_clean":"2023-06-23T19:01:08.873612+0000","last_became_active":"2023-06-23T19:01:04.387567+0000","last_became_peered":"2023-06-23T19:01:04.387567+0000","last_unstale":"2023-06-23T19:01:08.873612+0000","last_undegraded":"2023-06-23T19:01:08.873612+0000","last_fullsized":"2023-06-23T19:01:08.873612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:02.533488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871125+0000","last_change":"2023-06-23T19:01:08.403923+0000","last_active":"2023-06-23T19:01:08.871125+0000","last_peered":"2023-06-23T19:01:08.871125+0000","last_clean":"2023-06-23T19:01:08.871125+0000","last_became_active":"2023-06-23T19:01:08.403522+0000","last_became_peered":"2023-06-23T19:01:08.403522+0000","last_unstale":"2023-06-23T19:01:08.871125+0000","last_undegraded":"2023-06-23T19:01:08.871125+0000","last_fullsized":"2023-06-23T19:01:08.871125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:53:15.969015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280578+0000","last_change":"2023-06-23T19:01:03.873462+0000","last_active":"2023-06-23T19:01:09.280578+0000","last_peered":"2023-06-23T19:01:09.280578+0000","last_clean":"2023-06-23T19:01:09.280578+0000","last_became_active":"2023-06-23T19:01:03.873149+0000","last_became_peered":"2023-06-23T19:01:03.873149+0000","last_unstale":"2023-06-23T19:01:09.280578+0000","last_undegraded":"2023-06-23T19:01:09.280578+0000","last_fullsized":"2023-06-23T19:01:09.280578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:49:07.995821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281801+0000","last_change":"2023-06-23T19:01:04.374748+0000","last_active":"2023-06-23T19:01:09.281801+0000","last_peered":"2023-06-23T19:01:09.281801+0000","last_clean":"2023-06-23T19:01:09.281801+0000","last_became_active":"2023-06-23T19:01:04.374472+0000","last_became_peered":"2023-06-23T19:01:04.374472+0000","last_unstale":"2023-06-23T19:01:09.281801+0000","last_undegraded":"2023-06-23T19:01:09.281801+0000","last_fullsized":"2023-06-23T19:01:09.281801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:18:56.549266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872716+0000","last_change":"2023-06-23T19:01:08.401582+0000","last_active":"2023-06-23T19:01:08.872716+0000","last_peered":"2023-06-23T19:01:08.872716+0000","last_clean":"2023-06-23T19:01:08.872716+0000","last_became_active":"2023-06-23T19:01:08.401005+0000","last_became_peered":"2023-06-23T19:01:08.401005+0000","last_unstale":"2023-06-23T19:01:08.872716+0000","last_undegraded":"2023-06-23T19:01:08.872716+0000","last_fullsized":"2023-06-23T19:01:08.872716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:27.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156410+0000","last_change":"2023-06-23T19:01:03.875624+0000","last_active":"2023-06-23T19:01:09.156410+0000","last_peered":"2023-06-23T19:01:09.156410+0000","last_clean":"2023-06-23T19:01:09.156410+0000","last_became_active":"2023-06-23T19:01:03.875128+0000","last_became_peered":"2023-06-23T19:01:03.875128+0000","last_unstale":"2023-06-23T19:01:09.156410+0000","last_undegraded":"2023-06-23T19:01:09.156410+0000","last_fullsized":"2023-06-23T19:01:09.156410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:49.506561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282467+0000","last_change":"2023-06-23T19:01:04.378623+0000","last_active":"2023-06-23T19:01:09.282467+0000","last_peered":"2023-06-23T19:01:09.282467+0000","last_clean":"2023-06-23T19:01:09.282467+0000","last_became_active":"2023-06-23T19:01:04.378293+0000","last_became_peered":"2023-06-23T19:01:04.378293+0000","last_unstale":"2023-06-23T19:01:09.282467+0000","last_undegraded":"2023-06-23T19:01:09.282467+0000","last_fullsized":"2023-06-23T19:01:09.282467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:56:02.598277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282984+0000","last_change":"2023-06-23T19:01:08.401075+0000","last_active":"2023-06-23T19:01:09.282984+0000","last_peered":"2023-06-23T19:01:09.282984+0000","last_clean":"2023-06-23T19:01:09.282984+0000","last_became_active":"2023-06-23T19:01:08.400426+0000","last_became_peered":"2023-06-23T19:01:08.400426+0000","last_unstale":"2023-06-23T19:01:09.282984+0000","last_undegraded":"2023-06-23T19:01:09.282984+0000","last_fullsized":"2023-06-23T19:01:09.282984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:36:40.851994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281070+0000","last_change":"2023-06-23T19:01:03.874770+0000","last_active":"2023-06-23T19:01:09.281070+0000","last_peered":"2023-06-23T19:01:09.281070+0000","last_clean":"2023-06-23T19:01:09.281070+0000","last_became_active":"2023-06-23T19:01:03.874431+0000","last_became_peered":"2023-06-23T19:01:03.874431+0000","last_unstale":"2023-06-23T19:01:09.281070+0000","last_undegraded":"2023-06-23T19:01:09.281070+0000","last_fullsized":"2023-06-23T19:01:09.281070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:08.437952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283093+0000","last_change":"2023-06-23T19:01:04.386778+0000","last_active":"2023-06-23T19:01:09.283093+0000","last_peered":"2023-06-23T19:01:09.283093+0000","last_clean":"2023-06-23T19:01:09.283093+0000","last_became_active":"2023-06-23T19:01:04.386495+0000","last_became_peered":"2023-06-23T19:01:04.386495+0000","last_unstale":"2023-06-23T19:01:09.283093+0000","last_undegraded":"2023-06-23T19:01:09.283093+0000","last_fullsized":"2023-06-23T19:01:09.283093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:27:49.477353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282367+0000","last_change":"2023-06-23T19:01:08.404383+0000","last_active":"2023-06-23T19:01:09.282367+0000","last_peered":"2023-06-23T19:01:09.282367+0000","last_clean":"2023-06-23T19:01:09.282367+0000","last_became_active":"2023-06-23T19:01:08.404012+0000","last_became_peered":"2023-06-23T19:01:08.404012+0000","last_unstale":"2023-06-23T19:01:09.282367+0000","last_undegraded":"2023-06-23T19:01:09.282367+0000","last_fullsized":"2023-06-23T19:01:09.282367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:03:20.177798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280656+0000","last_change":"2023-06-23T19:01:03.878586+0000","last_active":"2023-06-23T19:01:09.280656+0000","last_peered":"2023-06-23T19:01:09.280656+0000","last_clean":"2023-06-23T19:01:09.280656+0000","last_became_active":"2023-06-23T19:01:03.878175+0000","last_became_peered":"2023-06-23T19:01:03.878175+0000","last_unstale":"2023-06-23T19:01:09.280656+0000","last_undegraded":"2023-06-23T19:01:09.280656+0000","last_fullsized":"2023-06-23T19:01:09.280656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:57:18.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873170+0000","last_change":"2023-06-23T19:01:04.379321+0000","last_active":"2023-06-23T19:01:08.873170+0000","last_peered":"2023-06-23T19:01:08.873170+0000","last_clean":"2023-06-23T19:01:08.873170+0000","last_became_active":"2023-06-23T19:01:04.379070+0000","last_became_peered":"2023-06-23T19:01:04.379070+0000","last_unstale":"2023-06-23T19:01:08.873170+0000","last_undegraded":"2023-06-23T19:01:08.873170+0000","last_fullsized":"2023-06-23T19:01:08.873170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:11.933066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873029+0000","last_change":"2023-06-23T19:01:08.408901+0000","last_active":"2023-06-23T19:01:08.873029+0000","last_peered":"2023-06-23T19:01:08.873029+0000","last_clean":"2023-06-23T19:01:08.873029+0000","last_became_active":"2023-06-23T19:01:08.407480+0000","last_became_peered":"2023-06-23T19:01:08.407480+0000","last_unstale":"2023-06-23T19:01:08.873029+0000","last_undegraded":"2023-06-23T19:01:08.873029+0000","last_fullsized":"2023-06-23T19:01:08.873029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:37.021448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872745+0000","last_change":"2023-06-23T19:00:58.992193+0000","last_active":"2023-06-23T19:01:08.872745+0000","last_peered":"2023-06-23T19:01:08.872745+0000","last_clean":"2023-06-23T19:01:08.872745+0000","last_became_active":"2023-06-23T19:00:58.991974+0000","last_became_peered":"2023-06-23T19:00:58.991974+0000","last_unstale":"2023-06-23T19:01:08.872745+0000","last_undegraded":"2023-06-23T19:01:08.872745+0000","last_fullsized":"2023-06-23T19:01:08.872745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:28.142431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283350+0000","last_change":"2023-06-23T19:01:03.879405+0000","last_active":"2023-06-23T19:01:09.283350+0000","last_peered":"2023-06-23T19:01:09.283350+0000","last_clean":"2023-06-23T19:01:09.283350+0000","last_became_active":"2023-06-23T19:01:03.879131+0000","last_became_peered":"2023-06-23T19:01:03.879131+0000","last_unstale":"2023-06-23T19:01:09.283350+0000","last_undegraded":"2023-06-23T19:01:09.283350+0000","last_fullsized":"2023-06-23T19:01:09.283350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:01.217016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872450+0000","last_change":"2023-06-23T19:01:04.371729+0000","last_active":"2023-06-23T19:01:08.872450+0000","last_peered":"2023-06-23T19:01:08.872450+0000","last_clean":"2023-06-23T19:01:08.872450+0000","last_became_active":"2023-06-23T19:01:04.371442+0000","last_became_peered":"2023-06-23T19:01:04.371442+0000","last_unstale":"2023-06-23T19:01:08.872450+0000","last_undegraded":"2023-06-23T19:01:08.872450+0000","last_fullsized":"2023-06-23T19:01:08.872450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:59.683785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873522+0000","last_change":"2023-06-23T19:01:08.403859+0000","last_active":"2023-06-23T19:01:08.873522+0000","last_peered":"2023-06-23T19:01:08.873522+0000","last_clean":"2023-06-23T19:01:08.873522+0000","last_became_active":"2023-06-23T19:01:08.402403+0000","last_became_peered":"2023-06-23T19:01:08.402403+0000","last_unstale":"2023-06-23T19:01:08.873522+0000","last_undegraded":"2023-06-23T19:01:08.873522+0000","last_fullsized":"2023-06-23T19:01:08.873522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:15.447230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282362+0000","last_change":"2023-06-23T19:00:58.032255+0000","last_active":"2023-06-23T19:01:09.282362+0000","last_peered":"2023-06-23T19:01:09.282362+0000","last_clean":"2023-06-23T19:01:09.282362+0000","last_became_active":"2023-06-23T19:00:58.031815+0000","last_became_peered":"2023-06-23T19:00:58.031815+0000","last_unstale":"2023-06-23T19:01:09.282362+0000","last_undegraded":"2023-06-23T19:01:09.282362+0000","last_fullsized":"2023-06-23T19:01:09.282362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:15.657801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281431+0000","last_change":"2023-06-23T19:01:03.878338+0000","last_active":"2023-06-23T19:01:09.281431+0000","last_peered":"2023-06-23T19:01:09.281431+0000","last_clean":"2023-06-23T19:01:09.281431+0000","last_became_active":"2023-06-23T19:01:03.873345+0000","last_became_peered":"2023-06-23T19:01:03.873345+0000","last_unstale":"2023-06-23T19:01:09.281431+0000","last_undegraded":"2023-06-23T19:01:09.281431+0000","last_fullsized":"2023-06-23T19:01:09.281431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:44:57.209204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872632+0000","last_change":"2023-06-23T19:01:04.385034+0000","last_active":"2023-06-23T19:01:08.872632+0000","last_peered":"2023-06-23T19:01:08.872632+0000","last_clean":"2023-06-23T19:01:08.872632+0000","last_became_active":"2023-06-23T19:01:04.384747+0000","last_became_peered":"2023-06-23T19:01:04.384747+0000","last_unstale":"2023-06-23T19:01:08.872632+0000","last_undegraded":"2023-06-23T19:01:08.872632+0000","last_fullsized":"2023-06-23T19:01:08.872632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:37:39.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871252+0000","last_change":"2023-06-23T19:01:08.404982+0000","last_active":"2023-06-23T19:01:08.871252+0000","last_peered":"2023-06-23T19:01:08.871252+0000","last_clean":"2023-06-23T19:01:08.871252+0000","last_became_active":"2023-06-23T19:01:08.404577+0000","last_became_peered":"2023-06-23T19:01:08.404577+0000","last_unstale":"2023-06-23T19:01:08.871252+0000","last_undegraded":"2023-06-23T19:01:08.871252+0000","last_fullsized":"2023-06-23T19:01:08.871252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:38:36.950113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870787+0000","last_change":"2023-06-23T19:00:58.810848+0000","last_active":"2023-06-23T19:01:08.870787+0000","last_peered":"2023-06-23T19:01:08.870787+0000","last_clean":"2023-06-23T19:01:08.870787+0000","last_became_active":"2023-06-23T19:00:58.810530+0000","last_became_peered":"2023-06-23T19:00:58.810530+0000","last_unstale":"2023-06-23T19:01:08.870787+0000","last_undegraded":"2023-06-23T19:01:08.870787+0000","last_fullsized":"2023-06-23T19:01:08.870787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:08:44.162030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871989+0000","last_change":"2023-06-23T19:01:03.878115+0000","last_active":"2023-06-23T19:01:08.871989+0000","last_peered":"2023-06-23T19:01:08.871989+0000","last_clean":"2023-06-23T19:01:08.871989+0000","last_became_active":"2023-06-23T19:01:03.877772+0000","last_became_peered":"2023-06-23T19:01:03.877772+0000","last_unstale":"2023-06-23T19:01:08.871989+0000","last_undegraded":"2023-06-23T19:01:08.871989+0000","last_fullsized":"2023-06-23T19:01:08.871989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:45:30.544760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872856+0000","last_change":"2023-06-23T19:01:04.371163+0000","last_active":"2023-06-23T19:01:08.872856+0000","last_peered":"2023-06-23T19:01:08.872856+0000","last_clean":"2023-06-23T19:01:08.872856+0000","last_became_active":"2023-06-23T19:01:04.370885+0000","last_became_peered":"2023-06-23T19:01:04.370885+0000","last_unstale":"2023-06-23T19:01:08.872856+0000","last_undegraded":"2023-06-23T19:01:08.872856+0000","last_fullsized":"2023-06-23T19:01:08.872856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:08.703615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281165+0000","last_change":"2023-06-23T19:01:08.403027+0000","last_active":"2023-06-23T19:01:09.281165+0000","last_peered":"2023-06-23T19:01:09.281165+0000","last_clean":"2023-06-23T19:01:09.281165+0000","last_became_active":"2023-06-23T19:01:08.402697+0000","last_became_peered":"2023-06-23T19:01:08.402697+0000","last_unstale":"2023-06-23T19:01:09.281165+0000","last_undegraded":"2023-06-23T19:01:09.281165+0000","last_fullsized":"2023-06-23T19:01:09.281165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:38.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282502+0000","last_change":"2023-06-23T19:00:58.032352+0000","last_active":"2023-06-23T19:01:09.282502+0000","last_peered":"2023-06-23T19:01:09.282502+0000","last_clean":"2023-06-23T19:01:09.282502+0000","last_became_active":"2023-06-23T19:00:58.031905+0000","last_became_peered":"2023-06-23T19:00:58.031905+0000","last_unstale":"2023-06-23T19:01:09.282502+0000","last_undegraded":"2023-06-23T19:01:09.282502+0000","last_fullsized":"2023-06-23T19:01:09.282502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:05.104177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281370+0000","last_change":"2023-06-23T19:00:50.002765+0000","last_active":"2023-06-23T19:01:09.281370+0000","last_peered":"2023-06-23T19:01:09.281370+0000","last_clean":"2023-06-23T19:01:09.281370+0000","last_became_active":"2023-06-23T19:00:50.002445+0000","last_became_peered":"2023-06-23T19:00:50.002445+0000","last_unstale":"2023-06-23T19:01:09.281370+0000","last_undegraded":"2023-06-23T19:01:09.281370+0000","last_fullsized":"2023-06-23T19:01:09.281370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_clean_scrub_stamp":"2023-06-23T19:00:48.989242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280695+0000","last_change":"2023-06-23T19:01:03.873914+0000","last_active":"2023-06-23T19:01:09.280695+0000","last_peered":"2023-06-23T19:01:09.280695+0000","last_clean":"2023-06-23T19:01:09.280695+0000","last_became_active":"2023-06-23T19:01:03.873592+0000","last_became_peered":"2023-06-23T19:01:03.873592+0000","last_unstale":"2023-06-23T19:01:09.280695+0000","last_undegraded":"2023-06-23T19:01:09.280695+0000","last_fullsized":"2023-06-23T19:01:09.280695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:15.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156830+0000","last_change":"2023-06-23T19:01:04.387883+0000","last_active":"2023-06-23T19:01:09.156830+0000","last_peered":"2023-06-23T19:01:09.156830+0000","last_clean":"2023-06-23T19:01:09.156830+0000","last_became_active":"2023-06-23T19:01:04.387600+0000","last_became_peered":"2023-06-23T19:01:04.387600+0000","last_unstale":"2023-06-23T19:01:09.156830+0000","last_undegraded":"2023-06-23T19:01:09.156830+0000","last_fullsized":"2023-06-23T19:01:09.156830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:16:44.300439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282713+0000","last_change":"2023-06-23T19:01:08.401404+0000","last_active":"2023-06-23T19:01:09.282713+0000","last_peered":"2023-06-23T19:01:09.282713+0000","last_clean":"2023-06-23T19:01:09.282713+0000","last_became_active":"2023-06-23T19:01:08.400568+0000","last_became_peered":"2023-06-23T19:01:08.400568+0000","last_unstale":"2023-06-23T19:01:09.282713+0000","last_undegraded":"2023-06-23T19:01:09.282713+0000","last_fullsized":"2023-06-23T19:01:09.282713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:33.995739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283199+0000","last_change":"2023-06-23T19:00:58.034045+0000","last_active":"2023-06-23T19:01:09.283199+0000","last_peered":"2023-06-23T19:01:09.283199+0000","last_clean":"2023-06-23T19:01:09.283199+0000","last_became_active":"2023-06-23T19:00:58.033654+0000","last_became_peered":"2023-06-23T19:00:58.033654+0000","last_unstale":"2023-06-23T19:01:09.283199+0000","last_undegraded":"2023-06-23T19:01:09.283199+0000","last_fullsized":"2023-06-23T19:01:09.283199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:01:40.788438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872071+0000","last_change":"2023-06-23T19:01:03.877003+0000","last_active":"2023-06-23T19:01:08.872071+0000","last_peered":"2023-06-23T19:01:08.872071+0000","last_clean":"2023-06-23T19:01:08.872071+0000","last_became_active":"2023-06-23T19:01:03.876599+0000","last_became_peered":"2023-06-23T19:01:03.876599+0000","last_unstale":"2023-06-23T19:01:08.872071+0000","last_undegraded":"2023-06-23T19:01:08.872071+0000","last_fullsized":"2023-06-23T19:01:08.872071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:50.138012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872292+0000","last_change":"2023-06-23T19:01:04.388623+0000","last_active":"2023-06-23T19:01:08.872292+0000","last_peered":"2023-06-23T19:01:08.872292+0000","last_clean":"2023-06-23T19:01:08.872292+0000","last_became_active":"2023-06-23T19:01:04.388354+0000","last_became_peered":"2023-06-23T19:01:04.388354+0000","last_unstale":"2023-06-23T19:01:08.872292+0000","last_undegraded":"2023-06-23T19:01:08.872292+0000","last_fullsized":"2023-06-23T19:01:08.872292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:52:26.947243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156779+0000","last_change":"2023-06-23T19:01:08.405177+0000","last_active":"2023-06-23T19:01:09.156779+0000","last_peered":"2023-06-23T19:01:09.156779+0000","last_clean":"2023-06-23T19:01:09.156779+0000","last_became_active":"2023-06-23T19:01:08.404747+0000","last_became_peered":"2023-06-23T19:01:08.404747+0000","last_unstale":"2023-06-23T19:01:09.156779+0000","last_undegraded":"2023-06-23T19:01:09.156779+0000","last_fullsized":"2023-06-23T19:01:09.156779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:17:06.369020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282026+0000","last_change":"2023-06-23T19:00:58.992645+0000","last_active":"2023-06-23T19:01:09.282026+0000","last_peered":"2023-06-23T19:01:09.282026+0000","last_clean":"2023-06-23T19:01:09.282026+0000","last_became_active":"2023-06-23T19:00:58.992291+0000","last_became_peered":"2023-06-23T19:00:58.992291+0000","last_unstale":"2023-06-23T19:01:09.282026+0000","last_undegraded":"2023-06-23T19:01:09.282026+0000","last_fullsized":"2023-06-23T19:01:09.282026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:16:30.068353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873413+0000","last_change":"2023-06-23T19:01:03.878082+0000","last_active":"2023-06-23T19:01:08.873413+0000","last_peered":"2023-06-23T19:01:08.873413+0000","last_clean":"2023-06-23T19:01:08.873413+0000","last_became_active":"2023-06-23T19:01:03.877747+0000","last_became_peered":"2023-06-23T19:01:03.877747+0000","last_unstale":"2023-06-23T19:01:08.873413+0000","last_undegraded":"2023-06-23T19:01:08.873413+0000","last_fullsized":"2023-06-23T19:01:08.873413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:21.482936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873397+0000","last_change":"2023-06-23T19:01:04.374320+0000","last_active":"2023-06-23T19:01:08.873397+0000","last_peered":"2023-06-23T19:01:08.873397+0000","last_clean":"2023-06-23T19:01:08.873397+0000","last_became_active":"2023-06-23T19:01:04.374031+0000","last_became_peered":"2023-06-23T19:01:04.374031+0000","last_unstale":"2023-06-23T19:01:08.873397+0000","last_undegraded":"2023-06-23T19:01:08.873397+0000","last_fullsized":"2023-06-23T19:01:08.873397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:34.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281624+0000","last_change":"2023-06-23T19:01:08.394556+0000","last_active":"2023-06-23T19:01:09.281624+0000","last_peered":"2023-06-23T19:01:09.281624+0000","last_clean":"2023-06-23T19:01:09.281624+0000","last_became_active":"2023-06-23T19:01:08.393875+0000","last_became_peered":"2023-06-23T19:01:08.393875+0000","last_unstale":"2023-06-23T19:01:09.281624+0000","last_undegraded":"2023-06-23T19:01:09.281624+0000","last_fullsized":"2023-06-23T19:01:09.281624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:07:00.398165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281299+0000","last_change":"2023-06-23T19:01:03.870177+0000","last_active":"2023-06-23T19:01:09.281299+0000","last_peered":"2023-06-23T19:01:09.281299+0000","last_clean":"2023-06-23T19:01:09.281299+0000","last_became_active":"2023-06-23T19:01:03.869846+0000","last_became_peered":"2023-06-23T19:01:03.869846+0000","last_unstale":"2023-06-23T19:01:09.281299+0000","last_undegraded":"2023-06-23T19:01:09.281299+0000","last_fullsized":"2023-06-23T19:01:09.281299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:16:04.856211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873658+0000","last_change":"2023-06-23T19:00:58.034828+0000","last_active":"2023-06-23T19:01:08.873658+0000","last_peered":"2023-06-23T19:01:08.873658+0000","last_clean":"2023-06-23T19:01:08.873658+0000","last_became_active":"2023-06-23T19:00:58.034502+0000","last_became_peered":"2023-06-23T19:00:58.034502+0000","last_unstale":"2023-06-23T19:01:08.873658+0000","last_undegraded":"2023-06-23T19:01:08.873658+0000","last_fullsized":"2023-06-23T19:01:08.873658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:41.813074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280470+0000","last_change":"2023-06-23T19:01:04.377485+0000","last_active":"2023-06-23T19:01:09.280470+0000","last_peered":"2023-06-23T19:01:09.280470+0000","last_clean":"2023-06-23T19:01:09.280470+0000","last_became_active":"2023-06-23T19:01:04.377242+0000","last_became_peered":"2023-06-23T19:01:04.377242+0000","last_unstale":"2023-06-23T19:01:09.280470+0000","last_undegraded":"2023-06-23T19:01:09.280470+0000","last_fullsized":"2023-06-23T19:01:09.280470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:49.389492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280412+0000","last_change":"2023-06-23T19:01:08.399309+0000","last_active":"2023-06-23T19:01:09.280412+0000","last_peered":"2023-06-23T19:01:09.280412+0000","last_clean":"2023-06-23T19:01:09.280412+0000","last_became_active":"2023-06-23T19:01:08.398913+0000","last_became_peered":"2023-06-23T19:01:08.398913+0000","last_unstale":"2023-06-23T19:01:09.280412+0000","last_undegraded":"2023-06-23T19:01:09.280412+0000","last_fullsized":"2023-06-23T19:01:09.280412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:05:26.164184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157050+0000","last_change":"2023-06-23T19:00:58.035530+0000","last_active":"2023-06-23T19:01:09.157050+0000","last_peered":"2023-06-23T19:01:09.157050+0000","last_clean":"2023-06-23T19:01:09.157050+0000","last_became_active":"2023-06-23T19:00:58.035130+0000","last_became_peered":"2023-06-23T19:00:58.035130+0000","last_unstale":"2023-06-23T19:01:09.157050+0000","last_undegraded":"2023-06-23T19:01:09.157050+0000","last_fullsized":"2023-06-23T19:01:09.157050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:11.697702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872441+0000","last_change":"2023-06-23T19:01:03.875213+0000","last_active":"2023-06-23T19:01:08.872441+0000","last_peered":"2023-06-23T19:01:08.872441+0000","last_clean":"2023-06-23T19:01:08.872441+0000","last_became_active":"2023-06-23T19:01:03.874930+0000","last_became_peered":"2023-06-23T19:01:03.874930+0000","last_unstale":"2023-06-23T19:01:08.872441+0000","last_undegraded":"2023-06-23T19:01:08.872441+0000","last_fullsized":"2023-06-23T19:01:08.872441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:08:23.340468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281216+0000","last_change":"2023-06-23T19:01:04.381558+0000","last_active":"2023-06-23T19:01:09.281216+0000","last_peered":"2023-06-23T19:01:09.281216+0000","last_clean":"2023-06-23T19:01:09.281216+0000","last_became_active":"2023-06-23T19:01:04.381261+0000","last_became_peered":"2023-06-23T19:01:04.381261+0000","last_unstale":"2023-06-23T19:01:09.281216+0000","last_undegraded":"2023-06-23T19:01:09.281216+0000","last_fullsized":"2023-06-23T19:01:09.281216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:19:13.412736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872856+0000","last_change":"2023-06-23T19:01:08.396210+0000","last_active":"2023-06-23T19:01:08.872856+0000","last_peered":"2023-06-23T19:01:08.872856+0000","last_clean":"2023-06-23T19:01:08.872856+0000","last_became_active":"2023-06-23T19:01:08.395784+0000","last_became_peered":"2023-06-23T19:01:08.395784+0000","last_unstale":"2023-06-23T19:01:08.872856+0000","last_undegraded":"2023-06-23T19:01:08.872856+0000","last_fullsized":"2023-06-23T19:01:08.872856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:37.937641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873475+0000","last_change":"2023-06-23T19:01:03.880745+0000","last_active":"2023-06-23T19:01:08.873475+0000","last_peered":"2023-06-23T19:01:08.873475+0000","last_clean":"2023-06-23T19:01:08.873475+0000","last_became_active":"2023-06-23T19:01:03.880470+0000","last_became_peered":"2023-06-23T19:01:03.880470+0000","last_unstale":"2023-06-23T19:01:08.873475+0000","last_undegraded":"2023-06-23T19:01:08.873475+0000","last_fullsized":"2023-06-23T19:01:08.873475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:47.638210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871233+0000","last_change":"2023-06-23T19:01:04.374095+0000","last_active":"2023-06-23T19:01:08.871233+0000","last_peered":"2023-06-23T19:01:08.871233+0000","last_clean":"2023-06-23T19:01:08.871233+0000","last_became_active":"2023-06-23T19:01:04.373775+0000","last_became_peered":"2023-06-23T19:01:04.373775+0000","last_unstale":"2023-06-23T19:01:08.871233+0000","last_undegraded":"2023-06-23T19:01:08.871233+0000","last_fullsized":"2023-06-23T19:01:08.871233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:17:02.854856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281073+0000","last_change":"2023-06-23T19:01:08.394708+0000","last_active":"2023-06-23T19:01:09.281073+0000","last_peered":"2023-06-23T19:01:09.281073+0000","last_clean":"2023-06-23T19:01:09.281073+0000","last_became_active":"2023-06-23T19:01:08.394307+0000","last_became_peered":"2023-06-23T19:01:08.394307+0000","last_unstale":"2023-06-23T19:01:09.281073+0000","last_undegraded":"2023-06-23T19:01:09.281073+0000","last_fullsized":"2023-06-23T19:01:09.281073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:37.937641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281731+0000","last_change":"2023-06-23T19:01:03.881055+0000","last_active":"2023-06-23T19:01:09.281731+0000","last_peered":"2023-06-23T19:01:09.281731+0000","last_clean":"2023-06-23T19:01:09.281731+0000","last_became_active":"2023-06-23T19:01:03.880783+0000","last_became_peered":"2023-06-23T19:01:03.880783+0000","last_unstale":"2023-06-23T19:01:09.281731+0000","last_undegraded":"2023-06-23T19:01:09.281731+0000","last_fullsized":"2023-06-23T19:01:09.281731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:33.419724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281290+0000","last_change":"2023-06-23T19:01:04.384460+0000","last_active":"2023-06-23T19:01:09.281290+0000","last_peered":"2023-06-23T19:01:09.281290+0000","last_clean":"2023-06-23T19:01:09.281290+0000","last_became_active":"2023-06-23T19:01:04.384176+0000","last_became_peered":"2023-06-23T19:01:04.384176+0000","last_unstale":"2023-06-23T19:01:09.281290+0000","last_undegraded":"2023-06-23T19:01:09.281290+0000","last_fullsized":"2023-06-23T19:01:09.281290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:22:29.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282471+0000","last_change":"2023-06-23T19:01:08.400916+0000","last_active":"2023-06-23T19:01:09.282471+0000","last_peered":"2023-06-23T19:01:09.282471+0000","last_clean":"2023-06-23T19:01:09.282471+0000","last_became_active":"2023-06-23T19:01:08.400414+0000","last_became_peered":"2023-06-23T19:01:08.400414+0000","last_unstale":"2023-06-23T19:01:09.282471+0000","last_undegraded":"2023-06-23T19:01:09.282471+0000","last_fullsized":"2023-06-23T19:01:09.282471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:52.156128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283145+0000","last_change":"2023-06-23T19:01:03.881189+0000","last_active":"2023-06-23T19:01:09.283145+0000","last_peered":"2023-06-23T19:01:09.283145+0000","last_clean":"2023-06-23T19:01:09.283145+0000","last_became_active":"2023-06-23T19:01:03.880951+0000","last_became_peered":"2023-06-23T19:01:03.880951+0000","last_unstale":"2023-06-23T19:01:09.283145+0000","last_undegraded":"2023-06-23T19:01:09.283145+0000","last_fullsized":"2023-06-23T19:01:09.283145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:15.133048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282217+0000","last_change":"2023-06-23T19:01:04.384653+0000","last_active":"2023-06-23T19:01:09.282217+0000","last_peered":"2023-06-23T19:01:09.282217+0000","last_clean":"2023-06-23T19:01:09.282217+0000","last_became_active":"2023-06-23T19:01:04.384329+0000","last_became_peered":"2023-06-23T19:01:04.384329+0000","last_unstale":"2023-06-23T19:01:09.282217+0000","last_undegraded":"2023-06-23T19:01:09.282217+0000","last_fullsized":"2023-06-23T19:01:09.282217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:34:32.935523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280710+0000","last_change":"2023-06-23T19:01:08.395019+0000","last_active":"2023-06-23T19:01:09.280710+0000","last_peered":"2023-06-23T19:01:09.280710+0000","last_clean":"2023-06-23T19:01:09.280710+0000","last_became_active":"2023-06-23T19:01:08.394627+0000","last_became_peered":"2023-06-23T19:01:08.394627+0000","last_unstale":"2023-06-23T19:01:09.280710+0000","last_undegraded":"2023-06-23T19:01:09.280710+0000","last_fullsized":"2023-06-23T19:01:09.280710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:47:00.590205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281012+0000","last_change":"2023-06-23T19:01:03.865046+0000","last_active":"2023-06-23T19:01:09.281012+0000","last_peered":"2023-06-23T19:01:09.281012+0000","last_clean":"2023-06-23T19:01:09.281012+0000","last_became_active":"2023-06-23T19:01:03.864670+0000","last_became_peered":"2023-06-23T19:01:03.864670+0000","last_unstale":"2023-06-23T19:01:09.281012+0000","last_undegraded":"2023-06-23T19:01:09.281012+0000","last_fullsized":"2023-06-23T19:01:09.281012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:12.906392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280997+0000","last_change":"2023-06-23T19:01:04.378240+0000","last_active":"2023-06-23T19:01:09.280997+0000","last_peered":"2023-06-23T19:01:09.280997+0000","last_clean":"2023-06-23T19:01:09.280997+0000","last_became_active":"2023-06-23T19:01:04.377992+0000","last_became_peered":"2023-06-23T19:01:04.377992+0000","last_unstale":"2023-06-23T19:01:09.280997+0000","last_undegraded":"2023-06-23T19:01:09.280997+0000","last_fullsized":"2023-06-23T19:01:09.280997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:32:02.858761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872457+0000","last_change":"2023-06-23T19:01:08.407782+0000","last_active":"2023-06-23T19:01:08.872457+0000","last_peered":"2023-06-23T19:01:08.872457+0000","last_clean":"2023-06-23T19:01:08.872457+0000","last_became_active":"2023-06-23T19:01:08.407314+0000","last_became_peered":"2023-06-23T19:01:08.407314+0000","last_unstale":"2023-06-23T19:01:08.872457+0000","last_undegraded":"2023-06-23T19:01:08.872457+0000","last_fullsized":"2023-06-23T19:01:08.872457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:08:27.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873611+0000","last_change":"2023-06-23T19:01:03.875481+0000","last_active":"2023-06-23T19:01:08.873611+0000","last_peered":"2023-06-23T19:01:08.873611+0000","last_clean":"2023-06-23T19:01:08.873611+0000","last_became_active":"2023-06-23T19:01:03.874826+0000","last_became_peered":"2023-06-23T19:01:03.874826+0000","last_unstale":"2023-06-23T19:01:08.873611+0000","last_undegraded":"2023-06-23T19:01:08.873611+0000","last_fullsized":"2023-06-23T19:01:08.873611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:58.742697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280899+0000","last_change":"2023-06-23T19:01:04.378819+0000","last_active":"2023-06-23T19:01:09.280899+0000","last_peered":"2023-06-23T19:01:09.280899+0000","last_clean":"2023-06-23T19:01:09.280899+0000","last_became_active":"2023-06-23T19:01:04.378183+0000","last_became_peered":"2023-06-23T19:01:04.378183+0000","last_unstale":"2023-06-23T19:01:09.280899+0000","last_undegraded":"2023-06-23T19:01:09.280899+0000","last_fullsized":"2023-06-23T19:01:09.280899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:00.026037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156609+0000","last_change":"2023-06-23T19:01:04.375991+0000","last_active":"2023-06-23T19:01:09.156609+0000","last_peered":"2023-06-23T19:01:09.156609+0000","last_clean":"2023-06-23T19:01:09.156609+0000","last_became_active":"2023-06-23T19:01:04.375767+0000","last_became_peered":"2023-06-23T19:01:04.375767+0000","last_unstale":"2023-06-23T19:01:09.156609+0000","last_undegraded":"2023-06-23T19:01:09.156609+0000","last_fullsized":"2023-06-23T19:01:09.156609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:03.089060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281270+0000","last_change":"2023-06-23T19:01:04.386075+0000","last_active":"2023-06-23T19:01:09.281270+0000","last_peered":"2023-06-23T19:01:09.281270+0000","last_clean":"2023-06-23T19:01:09.281270+0000","last_became_active":"2023-06-23T19:01:04.385788+0000","last_became_peered":"2023-06-23T19:01:04.385788+0000","last_unstale":"2023-06-23T19:01:09.281270+0000","last_undegraded":"2023-06-23T19:01:09.281270+0000","last_fullsized":"2023-06-23T19:01:09.281270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:38:17.246142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282773+0000","last_change":"2023-06-23T19:01:04.378811+0000","last_active":"2023-06-23T19:01:09.282773+0000","last_peered":"2023-06-23T19:01:09.282773+0000","last_clean":"2023-06-23T19:01:09.282773+0000","last_became_active":"2023-06-23T19:01:04.378217+0000","last_became_peered":"2023-06-23T19:01:04.378217+0000","last_unstale":"2023-06-23T19:01:09.282773+0000","last_undegraded":"2023-06-23T19:01:09.282773+0000","last_fullsized":"2023-06-23T19:01:09.282773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:21:41.388818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280565+0000","last_change":"2023-06-23T19:01:04.378198+0000","last_active":"2023-06-23T19:01:09.280565+0000","last_peered":"2023-06-23T19:01:09.280565+0000","last_clean":"2023-06-23T19:01:09.280565+0000","last_became_active":"2023-06-23T19:01:04.377778+0000","last_became_peered":"2023-06-23T19:01:04.377778+0000","last_unstale":"2023-06-23T19:01:09.280565+0000","last_undegraded":"2023-06-23T19:01:09.280565+0000","last_fullsized":"2023-06-23T19:01:09.280565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:10:45.255508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872832+0000","last_change":"2023-06-23T19:01:04.375219+0000","last_active":"2023-06-23T19:01:08.872832+0000","last_peered":"2023-06-23T19:01:08.872832+0000","last_clean":"2023-06-23T19:01:08.872832+0000","last_became_active":"2023-06-23T19:01:04.372075+0000","last_became_peered":"2023-06-23T19:01:04.372075+0000","last_unstale":"2023-06-23T19:01:08.872832+0000","last_undegraded":"2023-06-23T19:01:08.872832+0000","last_fullsized":"2023-06-23T19:01:08.872832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476746,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":716841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":126543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":327680,"data_stored":129741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":929792,"data_stored":720269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T19:01:32.409 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T19:01:32.630 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.626+0000 7fdb22dff700 1 Processor -- start 2023-06-23T19:01:32.631 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.627+0000 7fdb22dff700 1 -- start start 2023-06-23T19:01:32.634 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb22dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c0cd830 0x7fdb1c160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb22dff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdb1c160880 0x7fdb1c0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb22dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c1610a0 con 0x7fdb1c15c570 2023-06-23T19:01:32.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb22dff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c15d670 con 0x7fdb1c160880 2023-06-23T19:01:32.636 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb22dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c15da90 con 0x7fdb1c0cd830 2023-06-23T19:01:32.636 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb2139c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdb1c160880 0x7fdb1c0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.636 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb20b9b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fdb1c15c570 0x7fdb1c0cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52992/0 (socket says 172.21.15.136:52992) 2023-06-23T19:01:32.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb2139c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdb1c160880 0x7fdb1c0d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45976/0 (socket says 172.21.15.136:45976) 2023-06-23T19:01:32.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb20b9b700 1 -- 172.21.15.136:0/3844574244 learned_addr learned my addr 172.21.15.136:0/3844574244 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:32.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb1bfff700 1 --2- 172.21.15.136:0/3844574244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c0cd830 0x7fdb1c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb2139c700 1 -- 172.21.15.136:0/3844574244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c0cd830 msgr2=0x7fdb1c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:32.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb2139c700 1 --2- 172.21.15.136:0/3844574244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c0cd830 0x7fdb1c160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb2139c700 1 -- 172.21.15.136:0/3844574244 >> v1:172.21.15.136:6789/0 conn(0x7fdb1c15c570 legacy=0x7fdb1c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb2139c700 1 -- 172.21.15.136:0/3844574244 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c15ccd0 con 0x7fdb1c160880 2023-06-23T19:01:32.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.628+0000 7fdb1b7fe700 1 -- 172.21.15.136:0/3844574244 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200081814 0 0) 0x7fdb1c1610a0 con 0x7fdb1c15c570 2023-06-23T19:01:32.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.629+0000 7fdb2139c700 1 --2- 172.21.15.136:0/3844574244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c160880 0x7fdb1c0d0bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009d90 tx=0x7fdb1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c05d9dcd8343b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:32.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.629+0000 7fdb1b7fe700 1 -- 172.21.15.136:0/3844574244 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400e070 con 0x7fdb1c160880 2023-06-23T19:01:32.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.629+0000 7fdb1b7fe700 1 -- 172.21.15.136:0/3844574244 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400bbd0 con 0x7fdb1c160880 2023-06-23T19:01:32.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.629+0000 7fdb1b7fe700 1 -- 172.21.15.136:0/3844574244 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14012430 con 0x7fdb1c160880 2023-06-23T19:01:32.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.629+0000 7fdb22dff700 1 -- 172.21.15.136:0/3844574244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c160880 msgr2=0x7fdb1c0d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.629+0000 7fdb22dff700 1 --2- 172.21.15.136:0/3844574244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c160880 0x7fdb1c0d0bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009d90 tx=0x7fdb1400b330 comp rx=0 tx=0).stop 2023-06-23T19:01:32.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.630+0000 7fdb22dff700 1 -- 172.21.15.136:0/3844574244 shutdown_connections 2023-06-23T19:01:32.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.630+0000 7fdb22dff700 1 --2- 172.21.15.136:0/3844574244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c160880 0x7fdb1c0d0bb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.630+0000 7fdb22dff700 1 --2- 172.21.15.136:0/3844574244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c0cd830 0x7fdb1c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.630+0000 7fdb22dff700 1 -- 172.21.15.136:0/3844574244 >> 172.21.15.136:0/3844574244 conn(0x7fdb1c071620 msgr2=0x7fdb1c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:32.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.630+0000 7fdb22dff700 1 -- 172.21.15.136:0/3844574244 shutdown_connections 2023-06-23T19:01:32.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.630+0000 7fdb22dff700 1 -- 172.21.15.136:0/3844574244 wait complete. 2023-06-23T19:01:32.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.631+0000 7fdb22dff700 1 Processor -- start 2023-06-23T19:01:32.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.632+0000 7fdb22dff700 1 -- start start 2023-06-23T19:01:32.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.632+0000 7fdb22dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb1c0cd830 0x7fdb1c1f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.632+0000 7fdb22dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c15c570 0x7fdb1c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb22dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c160880 0x7fdb1c0c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb22dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c14c660 con 0x7fdb1c15c570 2023-06-23T19:01:32.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb22dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1f62a0 con 0x7fdb1c0cd830 2023-06-23T19:01:32.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb22dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0b5b70 con 0x7fdb1c160880 2023-06-23T19:01:32.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb1bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c15c570 0x7fdb1c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb1bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c15c570 0x7fdb1c0c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45990/0 (socket says 172.21.15.136:45990) 2023-06-23T19:01:32.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb1bfff700 1 -- 172.21.15.136:0/2160940771 learned_addr learned my addr 172.21.15.136:0/2160940771 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:32.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb20b9b700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb1c0cd830 0x7fdb1c1f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb2139c700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c160880 0x7fdb1c0c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb1bfff700 1 -- 172.21.15.136:0/2160940771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c160880 msgr2=0x7fdb1c0c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb1bfff700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c160880 0x7fdb1c0c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb1bfff700 1 -- 172.21.15.136:0/2160940771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb1c0cd830 msgr2=0x7fdb1c1f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb1bfff700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb1c0cd830 0x7fdb1c1f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb1bfff700 1 -- 172.21.15.136:0/2160940771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14009a70 con 0x7fdb1c15c570 2023-06-23T19:01:32.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb2139c700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c160880 0x7fdb1c0c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:32.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.633+0000 7fdb1bfff700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c15c570 0x7fdb1c0c90b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e870 tx=0x7fdb0800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:32.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.634+0000 7fdb197fa700 1 -- 172.21.15.136:0/2160940771 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800c5e0 con 0x7fdb1c15c570 2023-06-23T19:01:32.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.634+0000 7fdb197fa700 1 -- 172.21.15.136:0/2160940771 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0800c740 con 0x7fdb1c15c570 2023-06-23T19:01:32.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.634+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c1f5a00 con 0x7fdb1c15c570 2023-06-23T19:01:32.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.634+0000 7fdb197fa700 1 -- 172.21.15.136:0/2160940771 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800cad0 con 0x7fdb1c15c570 2023-06-23T19:01:32.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.634+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c1f5fc0 con 0x7fdb1c15c570 2023-06-23T19:01:32.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.635+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c073910 con 0x7fdb1c15c570 2023-06-23T19:01:32.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.636+0000 7fdb197fa700 1 -- 172.21.15.136:0/2160940771 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb0800cc30 con 0x7fdb1c15c570 2023-06-23T19:01:32.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.637+0000 7fdb197fa700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb0006ace0 0x7fdb0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:32.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.638+0000 7fdb197fa700 1 -- 172.21.15.136:0/2160940771 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdb080893d0 con 0x7fdb1c15c570 2023-06-23T19:01:32.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.638+0000 7fdb20b9b700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb0006ace0 0x7fdb0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:32.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.638+0000 7fdb20b9b700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb0006ace0 0x7fdb0006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdb10000f60 tx=0x7fdb10007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:32.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.641+0000 7fdb197fa700 1 -- 172.21.15.136:0/2160940771 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb08054180 con 0x7fdb1c15c570 2023-06-23T19:01:32.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.835+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 --> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb1c15d290 con 0x7fdb0006ace0 2023-06-23T19:01:32.849 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.845+0000 7fdb197fa700 1 -- 172.21.15.136:0/2160940771 <== mgr.4105 v2:172.21.15.136:6832/2653877961 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367337 (secure 0 0 0) 0x7fdb100012b0 con 0x7fdb0006ace0 2023-06-23T19:01:32.854 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:32.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb0006ace0 msgr2=0x7fdb0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb0006ace0 0x7fdb0006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdb10000f60 tx=0x7fdb10007c00 comp rx=0 tx=0).stop 2023-06-23T19:01:32.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c15c570 msgr2=0x7fdb1c0c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:32.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c15c570 0x7fdb1c0c90b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e870 tx=0x7fdb0800ec30 comp rx=0 tx=0).stop 2023-06-23T19:01:32.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 shutdown_connections 2023-06-23T19:01:32.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb0006ace0 0x7fdb0006d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb1c0cd830 0x7fdb1c1f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb1c160880 0x7fdb1c0c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 --2- 172.21.15.136:0/2160940771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb1c15c570 0x7fdb1c0c90b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:32.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 >> 172.21.15.136:0/2160940771 conn(0x7fdb1c071620 msgr2=0x7fdb1c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:32.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 shutdown_connections 2023-06-23T19:01:32.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:32.850+0000 7fdb22dff700 1 -- 172.21.15.136:0/2160940771 wait complete. 2023-06-23T19:01:32.859 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2023-06-23T19:01:32.873 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-06-23T19:01:30.937637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219240,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755480,"statfs":{"total":773094113280,"available":772869611520,"internally_reserved":0,"allocated":3710976,"data_stored":2197048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003526"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870887+0000","last_change":"2023-06-23T19:01:04.378688+0000","last_active":"2023-06-23T19:01:08.870887+0000","last_peered":"2023-06-23T19:01:08.870887+0000","last_clean":"2023-06-23T19:01:08.870887+0000","last_became_active":"2023-06-23T19:01:04.378277+0000","last_became_peered":"2023-06-23T19:01:04.378277+0000","last_unstale":"2023-06-23T19:01:08.870887+0000","last_undegraded":"2023-06-23T19:01:08.870887+0000","last_fullsized":"2023-06-23T19:01:08.870887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:32:11.850600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282720+0000","last_change":"2023-06-23T19:01:04.385368+0000","last_active":"2023-06-23T19:01:09.282720+0000","last_peered":"2023-06-23T19:01:09.282720+0000","last_clean":"2023-06-23T19:01:09.282720+0000","last_became_active":"2023-06-23T19:01:04.385091+0000","last_became_peered":"2023-06-23T19:01:04.385091+0000","last_unstale":"2023-06-23T19:01:09.282720+0000","last_undegraded":"2023-06-23T19:01:09.282720+0000","last_fullsized":"2023-06-23T19:01:09.282720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:02.533488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282796+0000","last_change":"2023-06-23T19:01:04.382104+0000","last_active":"2023-06-23T19:01:09.282796+0000","last_peered":"2023-06-23T19:01:09.282796+0000","last_clean":"2023-06-23T19:01:09.282796+0000","last_became_active":"2023-06-23T19:01:04.381827+0000","last_became_peered":"2023-06-23T19:01:04.381827+0000","last_unstale":"2023-06-23T19:01:09.282796+0000","last_undegraded":"2023-06-23T19:01:09.282796+0000","last_fullsized":"2023-06-23T19:01:09.282796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:28:01.174081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156752+0000","last_change":"2023-06-23T19:01:04.376037+0000","last_active":"2023-06-23T19:01:09.156752+0000","last_peered":"2023-06-23T19:01:09.156752+0000","last_clean":"2023-06-23T19:01:09.156752+0000","last_became_active":"2023-06-23T19:01:04.375479+0000","last_became_peered":"2023-06-23T19:01:04.375479+0000","last_unstale":"2023-06-23T19:01:09.156752+0000","last_undegraded":"2023-06-23T19:01:09.156752+0000","last_fullsized":"2023-06-23T19:01:09.156752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:42:12.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873331+0000","last_change":"2023-06-23T19:01:04.383574+0000","last_active":"2023-06-23T19:01:08.873331+0000","last_peered":"2023-06-23T19:01:08.873331+0000","last_clean":"2023-06-23T19:01:08.873331+0000","last_became_active":"2023-06-23T19:01:04.383178+0000","last_became_peered":"2023-06-23T19:01:04.383178+0000","last_unstale":"2023-06-23T19:01:08.873331+0000","last_undegraded":"2023-06-23T19:01:08.873331+0000","last_fullsized":"2023-06-23T19:01:08.873331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:08.703615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282561+0000","last_change":"2023-06-23T19:01:04.378592+0000","last_active":"2023-06-23T19:01:09.282561+0000","last_peered":"2023-06-23T19:01:09.282561+0000","last_clean":"2023-06-23T19:01:09.282561+0000","last_became_active":"2023-06-23T19:01:04.378270+0000","last_became_peered":"2023-06-23T19:01:04.378270+0000","last_unstale":"2023-06-23T19:01:09.282561+0000","last_undegraded":"2023-06-23T19:01:09.282561+0000","last_fullsized":"2023-06-23T19:01:09.282561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:03:42.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281650+0000","last_change":"2023-06-23T19:01:04.388383+0000","last_active":"2023-06-23T19:01:09.281650+0000","last_peered":"2023-06-23T19:01:09.281650+0000","last_clean":"2023-06-23T19:01:09.281650+0000","last_became_active":"2023-06-23T19:01:04.388104+0000","last_became_peered":"2023-06-23T19:01:04.388104+0000","last_unstale":"2023-06-23T19:01:09.281650+0000","last_undegraded":"2023-06-23T19:01:09.281650+0000","last_fullsized":"2023-06-23T19:01:09.281650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:59.746450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281560+0000","last_change":"2023-06-23T19:01:04.383152+0000","last_active":"2023-06-23T19:01:09.281560+0000","last_peered":"2023-06-23T19:01:09.281560+0000","last_clean":"2023-06-23T19:01:09.281560+0000","last_became_active":"2023-06-23T19:01:04.382712+0000","last_became_peered":"2023-06-23T19:01:04.382712+0000","last_unstale":"2023-06-23T19:01:09.281560+0000","last_undegraded":"2023-06-23T19:01:09.281560+0000","last_fullsized":"2023-06-23T19:01:09.281560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873324+0000","last_change":"2023-06-23T19:01:04.382700+0000","last_active":"2023-06-23T19:01:08.873324+0000","last_peered":"2023-06-23T19:01:08.873324+0000","last_clean":"2023-06-23T19:01:08.873324+0000","last_became_active":"2023-06-23T19:01:04.382201+0000","last_became_peered":"2023-06-23T19:01:04.382201+0000","last_unstale":"2023-06-23T19:01:08.873324+0000","last_undegraded":"2023-06-23T19:01:08.873324+0000","last_fullsized":"2023-06-23T19:01:08.873324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283207+0000","last_change":"2023-06-23T19:01:04.376595+0000","last_active":"2023-06-23T19:01:09.283207+0000","last_peered":"2023-06-23T19:01:09.283207+0000","last_clean":"2023-06-23T19:01:09.283207+0000","last_became_active":"2023-06-23T19:01:04.376392+0000","last_became_peered":"2023-06-23T19:01:04.376392+0000","last_unstale":"2023-06-23T19:01:09.283207+0000","last_undegraded":"2023-06-23T19:01:09.283207+0000","last_fullsized":"2023-06-23T19:01:09.283207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:30:56.096215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282762+0000","last_change":"2023-06-23T19:01:04.388979+0000","last_active":"2023-06-23T19:01:09.282762+0000","last_peered":"2023-06-23T19:01:09.282762+0000","last_clean":"2023-06-23T19:01:09.282762+0000","last_became_active":"2023-06-23T19:01:04.388676+0000","last_became_peered":"2023-06-23T19:01:04.388676+0000","last_unstale":"2023-06-23T19:01:09.282762+0000","last_undegraded":"2023-06-23T19:01:09.282762+0000","last_fullsized":"2023-06-23T19:01:09.282762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:29:33.177223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871107+0000","last_change":"2023-06-23T19:01:04.391858+0000","last_active":"2023-06-23T19:01:08.871107+0000","last_peered":"2023-06-23T19:01:08.871107+0000","last_clean":"2023-06-23T19:01:08.871107+0000","last_became_active":"2023-06-23T19:01:04.391669+0000","last_became_peered":"2023-06-23T19:01:04.391669+0000","last_unstale":"2023-06-23T19:01:08.871107+0000","last_undegraded":"2023-06-23T19:01:08.871107+0000","last_fullsized":"2023-06-23T19:01:08.871107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:03.089060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870980+0000","last_change":"2023-06-23T19:01:04.372094+0000","last_active":"2023-06-23T19:01:08.870980+0000","last_peered":"2023-06-23T19:01:08.870980+0000","last_clean":"2023-06-23T19:01:08.870980+0000","last_became_active":"2023-06-23T19:01:04.370416+0000","last_became_peered":"2023-06-23T19:01:04.370416+0000","last_unstale":"2023-06-23T19:01:08.870980+0000","last_undegraded":"2023-06-23T19:01:08.870980+0000","last_fullsized":"2023-06-23T19:01:08.870980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:50.510315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282222+0000","last_change":"2023-06-23T19:01:04.380048+0000","last_active":"2023-06-23T19:01:09.282222+0000","last_peered":"2023-06-23T19:01:09.282222+0000","last_clean":"2023-06-23T19:01:09.282222+0000","last_became_active":"2023-06-23T19:01:04.379845+0000","last_became_peered":"2023-06-23T19:01:04.379845+0000","last_unstale":"2023-06-23T19:01:09.282222+0000","last_undegraded":"2023-06-23T19:01:09.282222+0000","last_fullsized":"2023-06-23T19:01:09.282222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:34.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281323+0000","last_change":"2023-06-23T19:01:04.388881+0000","last_active":"2023-06-23T19:01:09.281323+0000","last_peered":"2023-06-23T19:01:09.281323+0000","last_clean":"2023-06-23T19:01:09.281323+0000","last_became_active":"2023-06-23T19:01:04.388417+0000","last_became_peered":"2023-06-23T19:01:04.388417+0000","last_unstale":"2023-06-23T19:01:09.281323+0000","last_undegraded":"2023-06-23T19:01:09.281323+0000","last_fullsized":"2023-06-23T19:01:09.281323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:22.486690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281157+0000","last_change":"2023-06-23T19:01:04.383317+0000","last_active":"2023-06-23T19:01:09.281157+0000","last_peered":"2023-06-23T19:01:09.281157+0000","last_clean":"2023-06-23T19:01:09.281157+0000","last_became_active":"2023-06-23T19:01:04.378678+0000","last_became_peered":"2023-06-23T19:01:04.378678+0000","last_unstale":"2023-06-23T19:01:09.281157+0000","last_undegraded":"2023-06-23T19:01:09.281157+0000","last_fullsized":"2023-06-23T19:01:09.281157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:01:47.617327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873389+0000","last_change":"2023-06-23T19:01:04.382482+0000","last_active":"2023-06-23T19:01:08.873389+0000","last_peered":"2023-06-23T19:01:08.873389+0000","last_clean":"2023-06-23T19:01:08.873389+0000","last_became_active":"2023-06-23T19:01:04.381876+0000","last_became_peered":"2023-06-23T19:01:04.381876+0000","last_unstale":"2023-06-23T19:01:08.873389+0000","last_undegraded":"2023-06-23T19:01:08.873389+0000","last_fullsized":"2023-06-23T19:01:08.873389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:34.423477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282971+0000","last_change":"2023-06-23T19:01:04.382129+0000","last_active":"2023-06-23T19:01:09.282971+0000","last_peered":"2023-06-23T19:01:09.282971+0000","last_clean":"2023-06-23T19:01:09.282971+0000","last_became_active":"2023-06-23T19:01:04.381462+0000","last_became_peered":"2023-06-23T19:01:04.381462+0000","last_unstale":"2023-06-23T19:01:09.282971+0000","last_undegraded":"2023-06-23T19:01:09.282971+0000","last_fullsized":"2023-06-23T19:01:09.282971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:51:17.974676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870818+0000","last_change":"2023-06-23T19:01:04.367952+0000","last_active":"2023-06-23T19:01:08.870818+0000","last_peered":"2023-06-23T19:01:08.870818+0000","last_clean":"2023-06-23T19:01:08.870818+0000","last_became_active":"2023-06-23T19:01:04.367677+0000","last_became_peered":"2023-06-23T19:01:04.367677+0000","last_unstale":"2023-06-23T19:01:08.870818+0000","last_undegraded":"2023-06-23T19:01:08.870818+0000","last_fullsized":"2023-06-23T19:01:08.870818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:28:28.127638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281961+0000","last_change":"2023-06-23T19:01:04.374187+0000","last_active":"2023-06-23T19:01:09.281961+0000","last_peered":"2023-06-23T19:01:09.281961+0000","last_clean":"2023-06-23T19:01:09.281961+0000","last_became_active":"2023-06-23T19:01:04.373921+0000","last_became_peered":"2023-06-23T19:01:04.373921+0000","last_unstale":"2023-06-23T19:01:09.281961+0000","last_undegraded":"2023-06-23T19:01:09.281961+0000","last_fullsized":"2023-06-23T19:01:09.281961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:14:17.383712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282957+0000","last_change":"2023-06-23T19:01:04.386537+0000","last_active":"2023-06-23T19:01:09.282957+0000","last_peered":"2023-06-23T19:01:09.282957+0000","last_clean":"2023-06-23T19:01:09.282957+0000","last_became_active":"2023-06-23T19:01:04.386192+0000","last_became_peered":"2023-06-23T19:01:04.386192+0000","last_unstale":"2023-06-23T19:01:09.282957+0000","last_undegraded":"2023-06-23T19:01:09.282957+0000","last_fullsized":"2023-06-23T19:01:09.282957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:02.220770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872398+0000","last_change":"2023-06-23T19:01:04.388749+0000","last_active":"2023-06-23T19:01:08.872398+0000","last_peered":"2023-06-23T19:01:08.872398+0000","last_clean":"2023-06-23T19:01:08.872398+0000","last_became_active":"2023-06-23T19:01:04.388450+0000","last_became_peered":"2023-06-23T19:01:04.388450+0000","last_unstale":"2023-06-23T19:01:08.872398+0000","last_undegraded":"2023-06-23T19:01:08.872398+0000","last_fullsized":"2023-06-23T19:01:08.872398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:59.683785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280402+0000","last_change":"2023-06-23T19:01:04.374228+0000","last_active":"2023-06-23T19:01:09.280402+0000","last_peered":"2023-06-23T19:01:09.280402+0000","last_clean":"2023-06-23T19:01:09.280402+0000","last_became_active":"2023-06-23T19:01:04.373934+0000","last_became_peered":"2023-06-23T19:01:04.373934+0000","last_unstale":"2023-06-23T19:01:09.280402+0000","last_undegraded":"2023-06-23T19:01:09.280402+0000","last_fullsized":"2023-06-23T19:01:09.280402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:09.120268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283074+0000","last_change":"2023-06-23T19:01:04.384671+0000","last_active":"2023-06-23T19:01:09.283074+0000","last_peered":"2023-06-23T19:01:09.283074+0000","last_clean":"2023-06-23T19:01:09.283074+0000","last_became_active":"2023-06-23T19:01:04.384373+0000","last_became_peered":"2023-06-23T19:01:04.384373+0000","last_unstale":"2023-06-23T19:01:09.283074+0000","last_undegraded":"2023-06-23T19:01:09.283074+0000","last_fullsized":"2023-06-23T19:01:09.283074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:13.294523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872724+0000","last_change":"2023-06-23T19:01:04.374136+0000","last_active":"2023-06-23T19:01:08.872724+0000","last_peered":"2023-06-23T19:01:08.872724+0000","last_clean":"2023-06-23T19:01:08.872724+0000","last_became_active":"2023-06-23T19:01:04.373867+0000","last_became_peered":"2023-06-23T19:01:04.373867+0000","last_unstale":"2023-06-23T19:01:08.872724+0000","last_undegraded":"2023-06-23T19:01:08.872724+0000","last_fullsized":"2023-06-23T19:01:08.872724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.507284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873820+0000","last_change":"2023-06-23T19:01:04.384724+0000","last_active":"2023-06-23T19:01:08.873820+0000","last_peered":"2023-06-23T19:01:08.873820+0000","last_clean":"2023-06-23T19:01:08.873820+0000","last_became_active":"2023-06-23T19:01:04.384514+0000","last_became_peered":"2023-06-23T19:01:04.384514+0000","last_unstale":"2023-06-23T19:01:08.873820+0000","last_undegraded":"2023-06-23T19:01:08.873820+0000","last_fullsized":"2023-06-23T19:01:08.873820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:59.746450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283574+0000","last_change":"2023-06-23T19:01:04.380891+0000","last_active":"2023-06-23T19:01:09.283574+0000","last_peered":"2023-06-23T19:01:09.283574+0000","last_clean":"2023-06-23T19:01:09.283574+0000","last_became_active":"2023-06-23T19:01:04.380336+0000","last_became_peered":"2023-06-23T19:01:04.380336+0000","last_unstale":"2023-06-23T19:01:09.283574+0000","last_undegraded":"2023-06-23T19:01:09.283574+0000","last_fullsized":"2023-06-23T19:01:09.283574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:00.026037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282369+0000","last_change":"2023-06-23T19:01:08.395986+0000","last_active":"2023-06-23T19:01:09.282369+0000","last_peered":"2023-06-23T19:01:09.282369+0000","last_clean":"2023-06-23T19:01:09.282369+0000","last_became_active":"2023-06-23T19:01:08.395550+0000","last_became_peered":"2023-06-23T19:01:08.395550+0000","last_unstale":"2023-06-23T19:01:09.282369+0000","last_undegraded":"2023-06-23T19:01:09.282369+0000","last_fullsized":"2023-06-23T19:01:09.282369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:55:35.582136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282386+0000","last_change":"2023-06-23T19:01:03.877831+0000","last_active":"2023-06-23T19:01:09.282386+0000","last_peered":"2023-06-23T19:01:09.282386+0000","last_clean":"2023-06-23T19:01:09.282386+0000","last_became_active":"2023-06-23T19:01:03.877541+0000","last_became_peered":"2023-06-23T19:01:03.877541+0000","last_unstale":"2023-06-23T19:01:09.282386+0000","last_undegraded":"2023-06-23T19:01:09.282386+0000","last_fullsized":"2023-06-23T19:01:09.282386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:02:36.669063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280914+0000","last_change":"2023-06-23T19:01:04.386920+0000","last_active":"2023-06-23T19:01:09.280914+0000","last_peered":"2023-06-23T19:01:09.280914+0000","last_clean":"2023-06-23T19:01:09.280914+0000","last_became_active":"2023-06-23T19:01:04.386357+0000","last_became_peered":"2023-06-23T19:01:04.386357+0000","last_unstale":"2023-06-23T19:01:09.280914+0000","last_undegraded":"2023-06-23T19:01:09.280914+0000","last_fullsized":"2023-06-23T19:01:09.280914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:47:30.538293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157090+0000","last_change":"2023-06-23T19:01:08.399323+0000","last_active":"2023-06-23T19:01:09.157090+0000","last_peered":"2023-06-23T19:01:09.157090+0000","last_clean":"2023-06-23T19:01:09.157090+0000","last_became_active":"2023-06-23T19:01:08.398808+0000","last_became_peered":"2023-06-23T19:01:08.398808+0000","last_unstale":"2023-06-23T19:01:09.157090+0000","last_undegraded":"2023-06-23T19:01:09.157090+0000","last_fullsized":"2023-06-23T19:01:09.157090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:35.871412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871893+0000","last_change":"2023-06-23T19:01:03.885277+0000","last_active":"2023-06-23T19:01:08.871893+0000","last_peered":"2023-06-23T19:01:08.871893+0000","last_clean":"2023-06-23T19:01:08.871893+0000","last_became_active":"2023-06-23T19:01:03.885059+0000","last_became_peered":"2023-06-23T19:01:03.885059+0000","last_unstale":"2023-06-23T19:01:08.871893+0000","last_undegraded":"2023-06-23T19:01:08.871893+0000","last_fullsized":"2023-06-23T19:01:08.871893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:50.138012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872568+0000","last_change":"2023-06-23T19:01:04.381825+0000","last_active":"2023-06-23T19:01:08.872568+0000","last_peered":"2023-06-23T19:01:08.872568+0000","last_clean":"2023-06-23T19:01:08.872568+0000","last_became_active":"2023-06-23T19:01:04.381313+0000","last_became_peered":"2023-06-23T19:01:04.381313+0000","last_unstale":"2023-06-23T19:01:08.872568+0000","last_undegraded":"2023-06-23T19:01:08.872568+0000","last_fullsized":"2023-06-23T19:01:08.872568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:15.464343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872863+0000","last_change":"2023-06-23T19:01:08.393931+0000","last_active":"2023-06-23T19:01:08.872863+0000","last_peered":"2023-06-23T19:01:08.872863+0000","last_clean":"2023-06-23T19:01:08.872863+0000","last_became_active":"2023-06-23T19:01:08.393556+0000","last_became_peered":"2023-06-23T19:01:08.393556+0000","last_unstale":"2023-06-23T19:01:08.872863+0000","last_undegraded":"2023-06-23T19:01:08.872863+0000","last_fullsized":"2023-06-23T19:01:08.872863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:27.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280805+0000","last_change":"2023-06-23T19:01:03.873568+0000","last_active":"2023-06-23T19:01:09.280805+0000","last_peered":"2023-06-23T19:01:09.280805+0000","last_clean":"2023-06-23T19:01:09.280805+0000","last_became_active":"2023-06-23T19:01:03.873256+0000","last_became_peered":"2023-06-23T19:01:03.873256+0000","last_unstale":"2023-06-23T19:01:09.280805+0000","last_undegraded":"2023-06-23T19:01:09.280805+0000","last_fullsized":"2023-06-23T19:01:09.280805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:22:44.177756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157154+0000","last_change":"2023-06-23T19:01:04.370281+0000","last_active":"2023-06-23T19:01:09.157154+0000","last_peered":"2023-06-23T19:01:09.157154+0000","last_clean":"2023-06-23T19:01:09.157154+0000","last_became_active":"2023-06-23T19:01:04.369996+0000","last_became_peered":"2023-06-23T19:01:04.369996+0000","last_unstale":"2023-06-23T19:01:09.157154+0000","last_undegraded":"2023-06-23T19:01:09.157154+0000","last_fullsized":"2023-06-23T19:01:09.157154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:05:09.392936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156729+0000","last_change":"2023-06-23T19:01:08.397782+0000","last_active":"2023-06-23T19:01:09.156729+0000","last_peered":"2023-06-23T19:01:09.156729+0000","last_clean":"2023-06-23T19:01:09.156729+0000","last_became_active":"2023-06-23T19:01:08.397312+0000","last_became_peered":"2023-06-23T19:01:08.397312+0000","last_unstale":"2023-06-23T19:01:09.156729+0000","last_undegraded":"2023-06-23T19:01:09.156729+0000","last_fullsized":"2023-06-23T19:01:09.156729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:38:36.950113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873470+0000","last_change":"2023-06-23T19:01:03.875654+0000","last_active":"2023-06-23T19:01:08.873470+0000","last_peered":"2023-06-23T19:01:08.873470+0000","last_clean":"2023-06-23T19:01:08.873470+0000","last_became_active":"2023-06-23T19:01:03.875197+0000","last_became_peered":"2023-06-23T19:01:03.875197+0000","last_unstale":"2023-06-23T19:01:08.873470+0000","last_undegraded":"2023-06-23T19:01:08.873470+0000","last_fullsized":"2023-06-23T19:01:08.873470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:21.482936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280620+0000","last_change":"2023-06-23T19:01:04.385872+0000","last_active":"2023-06-23T19:01:09.280620+0000","last_peered":"2023-06-23T19:01:09.280620+0000","last_clean":"2023-06-23T19:01:09.280620+0000","last_became_active":"2023-06-23T19:01:04.385605+0000","last_became_peered":"2023-06-23T19:01:04.385605+0000","last_unstale":"2023-06-23T19:01:09.280620+0000","last_undegraded":"2023-06-23T19:01:09.280620+0000","last_fullsized":"2023-06-23T19:01:09.280620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:30:07.714637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281074+0000","last_change":"2023-06-23T19:01:08.392127+0000","last_active":"2023-06-23T19:01:09.281074+0000","last_peered":"2023-06-23T19:01:09.281074+0000","last_clean":"2023-06-23T19:01:09.281074+0000","last_became_active":"2023-06-23T19:01:08.391726+0000","last_became_peered":"2023-06-23T19:01:08.391726+0000","last_unstale":"2023-06-23T19:01:09.281074+0000","last_undegraded":"2023-06-23T19:01:09.281074+0000","last_fullsized":"2023-06-23T19:01:09.281074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:03.540201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282960+0000","last_change":"2023-06-23T19:01:03.872890+0000","last_active":"2023-06-23T19:01:09.282960+0000","last_peered":"2023-06-23T19:01:09.282960+0000","last_clean":"2023-06-23T19:01:09.282960+0000","last_became_active":"2023-06-23T19:01:03.872477+0000","last_became_peered":"2023-06-23T19:01:03.872477+0000","last_unstale":"2023-06-23T19:01:09.282960+0000","last_undegraded":"2023-06-23T19:01:09.282960+0000","last_fullsized":"2023-06-23T19:01:09.282960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:16:35.893488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280412+0000","last_change":"2023-06-23T19:01:04.372079+0000","last_active":"2023-06-23T19:01:09.280412+0000","last_peered":"2023-06-23T19:01:09.280412+0000","last_clean":"2023-06-23T19:01:09.280412+0000","last_became_active":"2023-06-23T19:01:04.371764+0000","last_became_peered":"2023-06-23T19:01:04.371764+0000","last_unstale":"2023-06-23T19:01:09.280412+0000","last_undegraded":"2023-06-23T19:01:09.280412+0000","last_fullsized":"2023-06-23T19:01:09.280412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:39.705880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280820+0000","last_change":"2023-06-23T19:01:08.408231+0000","last_active":"2023-06-23T19:01:09.280820+0000","last_peered":"2023-06-23T19:01:09.280820+0000","last_clean":"2023-06-23T19:01:09.280820+0000","last_became_active":"2023-06-23T19:01:08.407872+0000","last_became_peered":"2023-06-23T19:01:08.407872+0000","last_unstale":"2023-06-23T19:01:09.280820+0000","last_undegraded":"2023-06-23T19:01:09.280820+0000","last_fullsized":"2023-06-23T19:01:09.280820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:41:47.186941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281857+0000","last_change":"2023-06-23T19:01:03.884943+0000","last_active":"2023-06-23T19:01:09.281857+0000","last_peered":"2023-06-23T19:01:09.281857+0000","last_clean":"2023-06-23T19:01:09.281857+0000","last_became_active":"2023-06-23T19:01:03.884670+0000","last_became_peered":"2023-06-23T19:01:03.884670+0000","last_unstale":"2023-06-23T19:01:09.281857+0000","last_undegraded":"2023-06-23T19:01:09.281857+0000","last_fullsized":"2023-06-23T19:01:09.281857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:01.529734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872631+0000","last_change":"2023-06-23T19:01:04.378162+0000","last_active":"2023-06-23T19:01:08.872631+0000","last_peered":"2023-06-23T19:01:08.872631+0000","last_clean":"2023-06-23T19:01:08.872631+0000","last_became_active":"2023-06-23T19:01:04.377889+0000","last_became_peered":"2023-06-23T19:01:04.377889+0000","last_unstale":"2023-06-23T19:01:08.872631+0000","last_undegraded":"2023-06-23T19:01:08.872631+0000","last_fullsized":"2023-06-23T19:01:08.872631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:15.464343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872077+0000","last_change":"2023-06-23T19:01:08.407720+0000","last_active":"2023-06-23T19:01:08.872077+0000","last_peered":"2023-06-23T19:01:08.872077+0000","last_clean":"2023-06-23T19:01:08.872077+0000","last_became_active":"2023-06-23T19:01:08.407375+0000","last_became_peered":"2023-06-23T19:01:08.407375+0000","last_unstale":"2023-06-23T19:01:08.872077+0000","last_undegraded":"2023-06-23T19:01:08.872077+0000","last_fullsized":"2023-06-23T19:01:08.872077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:52:30.461408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:22.099711+0000","last_change":"2023-06-23T19:01:03.874324+0000","last_active":"2023-06-23T19:01:22.099711+0000","last_peered":"2023-06-23T19:01:22.099711+0000","last_clean":"2023-06-23T19:01:22.099711+0000","last_became_active":"2023-06-23T19:01:03.873875+0000","last_became_peered":"2023-06-23T19:01:03.873875+0000","last_unstale":"2023-06-23T19:01:22.099711+0000","last_undegraded":"2023-06-23T19:01:22.099711+0000","last_fullsized":"2023-06-23T19:01:22.099711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:08:09.258254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281733+0000","last_change":"2023-06-23T19:01:04.386473+0000","last_active":"2023-06-23T19:01:09.281733+0000","last_peered":"2023-06-23T19:01:09.281733+0000","last_clean":"2023-06-23T19:01:09.281733+0000","last_became_active":"2023-06-23T19:01:04.386168+0000","last_became_peered":"2023-06-23T19:01:04.386168+0000","last_unstale":"2023-06-23T19:01:09.281733+0000","last_undegraded":"2023-06-23T19:01:09.281733+0000","last_fullsized":"2023-06-23T19:01:09.281733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:21.315691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283666+0000","last_change":"2023-06-23T19:01:08.403704+0000","last_active":"2023-06-23T19:01:09.283666+0000","last_peered":"2023-06-23T19:01:09.283666+0000","last_clean":"2023-06-23T19:01:09.283666+0000","last_became_active":"2023-06-23T19:01:08.401409+0000","last_became_peered":"2023-06-23T19:01:08.401409+0000","last_unstale":"2023-06-23T19:01:09.283666+0000","last_undegraded":"2023-06-23T19:01:09.283666+0000","last_fullsized":"2023-06-23T19:01:09.283666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:12.955870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281472+0000","last_change":"2023-06-23T19:01:03.879123+0000","last_active":"2023-06-23T19:01:09.281472+0000","last_peered":"2023-06-23T19:01:09.281472+0000","last_clean":"2023-06-23T19:01:09.281472+0000","last_became_active":"2023-06-23T19:01:03.878849+0000","last_became_peered":"2023-06-23T19:01:03.878849+0000","last_unstale":"2023-06-23T19:01:09.281472+0000","last_undegraded":"2023-06-23T19:01:09.281472+0000","last_fullsized":"2023-06-23T19:01:09.281472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:08.437952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280990+0000","last_change":"2023-06-23T19:01:04.386760+0000","last_active":"2023-06-23T19:01:09.280990+0000","last_peered":"2023-06-23T19:01:09.280990+0000","last_clean":"2023-06-23T19:01:09.280990+0000","last_became_active":"2023-06-23T19:01:04.386378+0000","last_became_peered":"2023-06-23T19:01:04.386378+0000","last_unstale":"2023-06-23T19:01:09.280990+0000","last_undegraded":"2023-06-23T19:01:09.280990+0000","last_fullsized":"2023-06-23T19:01:09.280990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:04:32.211071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280924+0000","last_change":"2023-06-23T19:01:08.398632+0000","last_active":"2023-06-23T19:01:09.280924+0000","last_peered":"2023-06-23T19:01:09.280924+0000","last_clean":"2023-06-23T19:01:09.280924+0000","last_became_active":"2023-06-23T19:01:08.397912+0000","last_became_peered":"2023-06-23T19:01:08.397912+0000","last_unstale":"2023-06-23T19:01:09.280924+0000","last_undegraded":"2023-06-23T19:01:09.280924+0000","last_fullsized":"2023-06-23T19:01:09.280924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:53:09.486798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872187+0000","last_change":"2023-06-23T19:01:03.868975+0000","last_active":"2023-06-23T19:01:08.872187+0000","last_peered":"2023-06-23T19:01:08.872187+0000","last_clean":"2023-06-23T19:01:08.872187+0000","last_became_active":"2023-06-23T19:01:03.868673+0000","last_became_peered":"2023-06-23T19:01:03.868673+0000","last_unstale":"2023-06-23T19:01:08.872187+0000","last_undegraded":"2023-06-23T19:01:08.872187+0000","last_fullsized":"2023-06-23T19:01:08.872187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:45:30.544760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283480+0000","last_change":"2023-06-23T19:01:04.380621+0000","last_active":"2023-06-23T19:01:09.283480+0000","last_peered":"2023-06-23T19:01:09.283480+0000","last_clean":"2023-06-23T19:01:09.283480+0000","last_became_active":"2023-06-23T19:01:04.379977+0000","last_became_peered":"2023-06-23T19:01:04.379977+0000","last_unstale":"2023-06-23T19:01:09.283480+0000","last_undegraded":"2023-06-23T19:01:09.283480+0000","last_fullsized":"2023-06-23T19:01:09.283480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:13.294523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281097+0000","last_change":"2023-06-23T19:01:08.399057+0000","last_active":"2023-06-23T19:01:09.281097+0000","last_peered":"2023-06-23T19:01:09.281097+0000","last_clean":"2023-06-23T19:01:09.281097+0000","last_became_active":"2023-06-23T19:01:08.398665+0000","last_became_peered":"2023-06-23T19:01:08.398665+0000","last_unstale":"2023-06-23T19:01:09.281097+0000","last_undegraded":"2023-06-23T19:01:09.281097+0000","last_fullsized":"2023-06-23T19:01:09.281097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:54:48.546637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281472+0000","last_change":"2023-06-23T19:01:03.876992+0000","last_active":"2023-06-23T19:01:09.281472+0000","last_peered":"2023-06-23T19:01:09.281472+0000","last_clean":"2023-06-23T19:01:09.281472+0000","last_became_active":"2023-06-23T19:01:03.876802+0000","last_became_peered":"2023-06-23T19:01:03.876802+0000","last_unstale":"2023-06-23T19:01:09.281472+0000","last_undegraded":"2023-06-23T19:01:09.281472+0000","last_fullsized":"2023-06-23T19:01:09.281472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:10.929312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872681+0000","last_change":"2023-06-23T19:01:04.382339+0000","last_active":"2023-06-23T19:01:08.872681+0000","last_peered":"2023-06-23T19:01:08.872681+0000","last_clean":"2023-06-23T19:01:08.872681+0000","last_became_active":"2023-06-23T19:01:04.382080+0000","last_became_peered":"2023-06-23T19:01:04.382080+0000","last_unstale":"2023-06-23T19:01:08.872681+0000","last_undegraded":"2023-06-23T19:01:08.872681+0000","last_fullsized":"2023-06-23T19:01:08.872681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:37:39.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282568+0000","last_change":"2023-06-23T19:01:08.405608+0000","last_active":"2023-06-23T19:01:09.282568+0000","last_peered":"2023-06-23T19:01:09.282568+0000","last_clean":"2023-06-23T19:01:09.282568+0000","last_became_active":"2023-06-23T19:01:08.405237+0000","last_became_peered":"2023-06-23T19:01:08.405237+0000","last_unstale":"2023-06-23T19:01:09.282568+0000","last_undegraded":"2023-06-23T19:01:09.282568+0000","last_fullsized":"2023-06-23T19:01:09.282568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:03.260614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156916+0000","last_change":"2023-06-23T19:01:03.869001+0000","last_active":"2023-06-23T19:01:09.156916+0000","last_peered":"2023-06-23T19:01:09.156916+0000","last_clean":"2023-06-23T19:01:09.156916+0000","last_became_active":"2023-06-23T19:01:03.868685+0000","last_became_peered":"2023-06-23T19:01:03.868685+0000","last_unstale":"2023-06-23T19:01:09.156916+0000","last_undegraded":"2023-06-23T19:01:09.156916+0000","last_fullsized":"2023-06-23T19:01:09.156916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:23:13.817453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281267+0000","last_change":"2023-06-23T19:01:04.374785+0000","last_active":"2023-06-23T19:01:09.281267+0000","last_peered":"2023-06-23T19:01:09.281267+0000","last_clean":"2023-06-23T19:01:09.281267+0000","last_became_active":"2023-06-23T19:01:04.374406+0000","last_became_peered":"2023-06-23T19:01:04.374406+0000","last_unstale":"2023-06-23T19:01:09.281267+0000","last_undegraded":"2023-06-23T19:01:09.281267+0000","last_fullsized":"2023-06-23T19:01:09.281267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:09:07.414494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282780+0000","last_change":"2023-06-23T19:01:08.393879+0000","last_active":"2023-06-23T19:01:09.282780+0000","last_peered":"2023-06-23T19:01:09.282780+0000","last_clean":"2023-06-23T19:01:09.282780+0000","last_became_active":"2023-06-23T19:01:08.393451+0000","last_became_peered":"2023-06-23T19:01:08.393451+0000","last_unstale":"2023-06-23T19:01:09.282780+0000","last_undegraded":"2023-06-23T19:01:09.282780+0000","last_fullsized":"2023-06-23T19:01:09.282780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:30:59.610379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282080+0000","last_change":"2023-06-23T19:01:03.880187+0000","last_active":"2023-06-23T19:01:09.282080+0000","last_peered":"2023-06-23T19:01:09.282080+0000","last_clean":"2023-06-23T19:01:09.282080+0000","last_became_active":"2023-06-23T19:01:03.879883+0000","last_became_peered":"2023-06-23T19:01:03.879883+0000","last_unstale":"2023-06-23T19:01:09.282080+0000","last_undegraded":"2023-06-23T19:01:09.282080+0000","last_fullsized":"2023-06-23T19:01:09.282080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:36:36.334076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281403+0000","last_change":"2023-06-23T19:01:04.374578+0000","last_active":"2023-06-23T19:01:09.281403+0000","last_peered":"2023-06-23T19:01:09.281403+0000","last_clean":"2023-06-23T19:01:09.281403+0000","last_became_active":"2023-06-23T19:01:04.374334+0000","last_became_peered":"2023-06-23T19:01:04.374334+0000","last_unstale":"2023-06-23T19:01:09.281403+0000","last_undegraded":"2023-06-23T19:01:09.281403+0000","last_fullsized":"2023-06-23T19:01:09.281403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.507284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870687+0000","last_change":"2023-06-23T19:01:08.401653+0000","last_active":"2023-06-23T19:01:08.870687+0000","last_peered":"2023-06-23T19:01:08.870687+0000","last_clean":"2023-06-23T19:01:08.870687+0000","last_became_active":"2023-06-23T19:01:08.401248+0000","last_became_peered":"2023-06-23T19:01:08.401248+0000","last_unstale":"2023-06-23T19:01:08.870687+0000","last_undegraded":"2023-06-23T19:01:08.870687+0000","last_fullsized":"2023-06-23T19:01:08.870687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:26.097068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281971+0000","last_change":"2023-06-23T19:01:03.877753+0000","last_active":"2023-06-23T19:01:09.281971+0000","last_peered":"2023-06-23T19:01:09.281971+0000","last_clean":"2023-06-23T19:01:09.281971+0000","last_became_active":"2023-06-23T19:01:03.877504+0000","last_became_peered":"2023-06-23T19:01:03.877504+0000","last_unstale":"2023-06-23T19:01:09.281971+0000","last_undegraded":"2023-06-23T19:01:09.281971+0000","last_fullsized":"2023-06-23T19:01:09.281971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:29.477822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281456+0000","last_change":"2023-06-23T19:01:04.388674+0000","last_active":"2023-06-23T19:01:09.281456+0000","last_peered":"2023-06-23T19:01:09.281456+0000","last_clean":"2023-06-23T19:01:09.281456+0000","last_became_active":"2023-06-23T19:01:04.386268+0000","last_became_peered":"2023-06-23T19:01:04.386268+0000","last_unstale":"2023-06-23T19:01:09.281456+0000","last_undegraded":"2023-06-23T19:01:09.281456+0000","last_fullsized":"2023-06-23T19:01:09.281456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:50:00.709971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870883+0000","last_change":"2023-06-23T19:01:08.403947+0000","last_active":"2023-06-23T19:01:08.870883+0000","last_peered":"2023-06-23T19:01:08.870883+0000","last_clean":"2023-06-23T19:01:08.870883+0000","last_became_active":"2023-06-23T19:01:08.403536+0000","last_became_peered":"2023-06-23T19:01:08.403536+0000","last_unstale":"2023-06-23T19:01:08.870883+0000","last_undegraded":"2023-06-23T19:01:08.870883+0000","last_fullsized":"2023-06-23T19:01:08.870883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:53:39.593981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282198+0000","last_change":"2023-06-23T19:01:03.874658+0000","last_active":"2023-06-23T19:01:09.282198+0000","last_peered":"2023-06-23T19:01:09.282198+0000","last_clean":"2023-06-23T19:01:09.282198+0000","last_became_active":"2023-06-23T19:01:03.874261+0000","last_became_peered":"2023-06-23T19:01:03.874261+0000","last_unstale":"2023-06-23T19:01:09.282198+0000","last_undegraded":"2023-06-23T19:01:09.282198+0000","last_fullsized":"2023-06-23T19:01:09.282198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:15.133048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156399+0000","last_change":"2023-06-23T19:01:04.375757+0000","last_active":"2023-06-23T19:01:09.156399+0000","last_peered":"2023-06-23T19:01:09.156399+0000","last_clean":"2023-06-23T19:01:09.156399+0000","last_became_active":"2023-06-23T19:01:04.375467+0000","last_became_peered":"2023-06-23T19:01:04.375467+0000","last_unstale":"2023-06-23T19:01:09.156399+0000","last_undegraded":"2023-06-23T19:01:09.156399+0000","last_fullsized":"2023-06-23T19:01:09.156399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:53:12.454851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870906+0000","last_change":"2023-06-23T19:01:08.400551+0000","last_active":"2023-06-23T19:01:08.870906+0000","last_peered":"2023-06-23T19:01:08.870906+0000","last_clean":"2023-06-23T19:01:08.870906+0000","last_became_active":"2023-06-23T19:01:08.400104+0000","last_became_peered":"2023-06-23T19:01:08.400104+0000","last_unstale":"2023-06-23T19:01:08.870906+0000","last_undegraded":"2023-06-23T19:01:08.870906+0000","last_fullsized":"2023-06-23T19:01:08.870906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:30:02.757178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281582+0000","last_change":"2023-06-23T19:01:03.879522+0000","last_active":"2023-06-23T19:01:09.281582+0000","last_peered":"2023-06-23T19:01:09.281582+0000","last_clean":"2023-06-23T19:01:09.281582+0000","last_became_active":"2023-06-23T19:01:03.879221+0000","last_became_peered":"2023-06-23T19:01:03.879221+0000","last_unstale":"2023-06-23T19:01:09.281582+0000","last_undegraded":"2023-06-23T19:01:09.281582+0000","last_fullsized":"2023-06-23T19:01:09.281582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:07.699862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873612+0000","last_change":"2023-06-23T19:01:04.387840+0000","last_active":"2023-06-23T19:01:08.873612+0000","last_peered":"2023-06-23T19:01:08.873612+0000","last_clean":"2023-06-23T19:01:08.873612+0000","last_became_active":"2023-06-23T19:01:04.387567+0000","last_became_peered":"2023-06-23T19:01:04.387567+0000","last_unstale":"2023-06-23T19:01:08.873612+0000","last_undegraded":"2023-06-23T19:01:08.873612+0000","last_fullsized":"2023-06-23T19:01:08.873612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:02.533488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871125+0000","last_change":"2023-06-23T19:01:08.403923+0000","last_active":"2023-06-23T19:01:08.871125+0000","last_peered":"2023-06-23T19:01:08.871125+0000","last_clean":"2023-06-23T19:01:08.871125+0000","last_became_active":"2023-06-23T19:01:08.403522+0000","last_became_peered":"2023-06-23T19:01:08.403522+0000","last_unstale":"2023-06-23T19:01:08.871125+0000","last_undegraded":"2023-06-23T19:01:08.871125+0000","last_fullsized":"2023-06-23T19:01:08.871125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:53:15.969015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280578+0000","last_change":"2023-06-23T19:01:03.873462+0000","last_active":"2023-06-23T19:01:09.280578+0000","last_peered":"2023-06-23T19:01:09.280578+0000","last_clean":"2023-06-23T19:01:09.280578+0000","last_became_active":"2023-06-23T19:01:03.873149+0000","last_became_peered":"2023-06-23T19:01:03.873149+0000","last_unstale":"2023-06-23T19:01:09.280578+0000","last_undegraded":"2023-06-23T19:01:09.280578+0000","last_fullsized":"2023-06-23T19:01:09.280578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:49:07.995821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281801+0000","last_change":"2023-06-23T19:01:04.374748+0000","last_active":"2023-06-23T19:01:09.281801+0000","last_peered":"2023-06-23T19:01:09.281801+0000","last_clean":"2023-06-23T19:01:09.281801+0000","last_became_active":"2023-06-23T19:01:04.374472+0000","last_became_peered":"2023-06-23T19:01:04.374472+0000","last_unstale":"2023-06-23T19:01:09.281801+0000","last_undegraded":"2023-06-23T19:01:09.281801+0000","last_fullsized":"2023-06-23T19:01:09.281801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:18:56.549266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872716+0000","last_change":"2023-06-23T19:01:08.401582+0000","last_active":"2023-06-23T19:01:08.872716+0000","last_peered":"2023-06-23T19:01:08.872716+0000","last_clean":"2023-06-23T19:01:08.872716+0000","last_became_active":"2023-06-23T19:01:08.401005+0000","last_became_peered":"2023-06-23T19:01:08.401005+0000","last_unstale":"2023-06-23T19:01:08.872716+0000","last_undegraded":"2023-06-23T19:01:08.872716+0000","last_fullsized":"2023-06-23T19:01:08.872716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:27.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156410+0000","last_change":"2023-06-23T19:01:03.875624+0000","last_active":"2023-06-23T19:01:09.156410+0000","last_peered":"2023-06-23T19:01:09.156410+0000","last_clean":"2023-06-23T19:01:09.156410+0000","last_became_active":"2023-06-23T19:01:03.875128+0000","last_became_peered":"2023-06-23T19:01:03.875128+0000","last_unstale":"2023-06-23T19:01:09.156410+0000","last_undegraded":"2023-06-23T19:01:09.156410+0000","last_fullsized":"2023-06-23T19:01:09.156410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:49.506561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282467+0000","last_change":"2023-06-23T19:01:04.378623+0000","last_active":"2023-06-23T19:01:09.282467+0000","last_peered":"2023-06-23T19:01:09.282467+0000","last_clean":"2023-06-23T19:01:09.282467+0000","last_became_active":"2023-06-23T19:01:04.378293+0000","last_became_peered":"2023-06-23T19:01:04.378293+0000","last_unstale":"2023-06-23T19:01:09.282467+0000","last_undegraded":"2023-06-23T19:01:09.282467+0000","last_fullsized":"2023-06-23T19:01:09.282467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:56:02.598277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282984+0000","last_change":"2023-06-23T19:01:08.401075+0000","last_active":"2023-06-23T19:01:09.282984+0000","last_peered":"2023-06-23T19:01:09.282984+0000","last_clean":"2023-06-23T19:01:09.282984+0000","last_became_active":"2023-06-23T19:01:08.400426+0000","last_became_peered":"2023-06-23T19:01:08.400426+0000","last_unstale":"2023-06-23T19:01:09.282984+0000","last_undegraded":"2023-06-23T19:01:09.282984+0000","last_fullsized":"2023-06-23T19:01:09.282984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:36:40.851994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281070+0000","last_change":"2023-06-23T19:01:03.874770+0000","last_active":"2023-06-23T19:01:09.281070+0000","last_peered":"2023-06-23T19:01:09.281070+0000","last_clean":"2023-06-23T19:01:09.281070+0000","last_became_active":"2023-06-23T19:01:03.874431+0000","last_became_peered":"2023-06-23T19:01:03.874431+0000","last_unstale":"2023-06-23T19:01:09.281070+0000","last_undegraded":"2023-06-23T19:01:09.281070+0000","last_fullsized":"2023-06-23T19:01:09.281070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:08.437952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283093+0000","last_change":"2023-06-23T19:01:04.386778+0000","last_active":"2023-06-23T19:01:09.283093+0000","last_peered":"2023-06-23T19:01:09.283093+0000","last_clean":"2023-06-23T19:01:09.283093+0000","last_became_active":"2023-06-23T19:01:04.386495+0000","last_became_peered":"2023-06-23T19:01:04.386495+0000","last_unstale":"2023-06-23T19:01:09.283093+0000","last_undegraded":"2023-06-23T19:01:09.283093+0000","last_fullsized":"2023-06-23T19:01:09.283093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:27:49.477353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282367+0000","last_change":"2023-06-23T19:01:08.404383+0000","last_active":"2023-06-23T19:01:09.282367+0000","last_peered":"2023-06-23T19:01:09.282367+0000","last_clean":"2023-06-23T19:01:09.282367+0000","last_became_active":"2023-06-23T19:01:08.404012+0000","last_became_peered":"2023-06-23T19:01:08.404012+0000","last_unstale":"2023-06-23T19:01:09.282367+0000","last_undegraded":"2023-06-23T19:01:09.282367+0000","last_fullsized":"2023-06-23T19:01:09.282367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:03:20.177798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280656+0000","last_change":"2023-06-23T19:01:03.878586+0000","last_active":"2023-06-23T19:01:09.280656+0000","last_peered":"2023-06-23T19:01:09.280656+0000","last_clean":"2023-06-23T19:01:09.280656+0000","last_became_active":"2023-06-23T19:01:03.878175+0000","last_became_peered":"2023-06-23T19:01:03.878175+0000","last_unstale":"2023-06-23T19:01:09.280656+0000","last_undegraded":"2023-06-23T19:01:09.280656+0000","last_fullsized":"2023-06-23T19:01:09.280656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:57:18.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873170+0000","last_change":"2023-06-23T19:01:04.379321+0000","last_active":"2023-06-23T19:01:08.873170+0000","last_peered":"2023-06-23T19:01:08.873170+0000","last_clean":"2023-06-23T19:01:08.873170+0000","last_became_active":"2023-06-23T19:01:04.379070+0000","last_became_peered":"2023-06-23T19:01:04.379070+0000","last_unstale":"2023-06-23T19:01:08.873170+0000","last_undegraded":"2023-06-23T19:01:08.873170+0000","last_fullsized":"2023-06-23T19:01:08.873170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:11.933066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873029+0000","last_change":"2023-06-23T19:01:08.408901+0000","last_active":"2023-06-23T19:01:08.873029+0000","last_peered":"2023-06-23T19:01:08.873029+0000","last_clean":"2023-06-23T19:01:08.873029+0000","last_became_active":"2023-06-23T19:01:08.407480+0000","last_became_peered":"2023-06-23T19:01:08.407480+0000","last_unstale":"2023-06-23T19:01:08.873029+0000","last_undegraded":"2023-06-23T19:01:08.873029+0000","last_fullsized":"2023-06-23T19:01:08.873029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:37.021448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872745+0000","last_change":"2023-06-23T19:00:58.992193+0000","last_active":"2023-06-23T19:01:08.872745+0000","last_peered":"2023-06-23T19:01:08.872745+0000","last_clean":"2023-06-23T19:01:08.872745+0000","last_became_active":"2023-06-23T19:00:58.991974+0000","last_became_peered":"2023-06-23T19:00:58.991974+0000","last_unstale":"2023-06-23T19:01:08.872745+0000","last_undegraded":"2023-06-23T19:01:08.872745+0000","last_fullsized":"2023-06-23T19:01:08.872745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:28.142431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283350+0000","last_change":"2023-06-23T19:01:03.879405+0000","last_active":"2023-06-23T19:01:09.283350+0000","last_peered":"2023-06-23T19:01:09.283350+0000","last_clean":"2023-06-23T19:01:09.283350+0000","last_became_active":"2023-06-23T19:01:03.879131+0000","last_became_peered":"2023-06-23T19:01:03.879131+0000","last_unstale":"2023-06-23T19:01:09.283350+0000","last_undegraded":"2023-06-23T19:01:09.283350+0000","last_fullsized":"2023-06-23T19:01:09.283350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:01.217016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872450+0000","last_change":"2023-06-23T19:01:04.371729+0000","last_active":"2023-06-23T19:01:08.872450+0000","last_peered":"2023-06-23T19:01:08.872450+0000","last_clean":"2023-06-23T19:01:08.872450+0000","last_became_active":"2023-06-23T19:01:04.371442+0000","last_became_peered":"2023-06-23T19:01:04.371442+0000","last_unstale":"2023-06-23T19:01:08.872450+0000","last_undegraded":"2023-06-23T19:01:08.872450+0000","last_fullsized":"2023-06-23T19:01:08.872450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:59.683785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873522+0000","last_change":"2023-06-23T19:01:08.403859+0000","last_active":"2023-06-23T19:01:08.873522+0000","last_peered":"2023-06-23T19:01:08.873522+0000","last_clean":"2023-06-23T19:01:08.873522+0000","last_became_active":"2023-06-23T19:01:08.402403+0000","last_became_peered":"2023-06-23T19:01:08.402403+0000","last_unstale":"2023-06-23T19:01:08.873522+0000","last_undegraded":"2023-06-23T19:01:08.873522+0000","last_fullsized":"2023-06-23T19:01:08.873522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:15.447230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282362+0000","last_change":"2023-06-23T19:00:58.032255+0000","last_active":"2023-06-23T19:01:09.282362+0000","last_peered":"2023-06-23T19:01:09.282362+0000","last_clean":"2023-06-23T19:01:09.282362+0000","last_became_active":"2023-06-23T19:00:58.031815+0000","last_became_peered":"2023-06-23T19:00:58.031815+0000","last_unstale":"2023-06-23T19:01:09.282362+0000","last_undegraded":"2023-06-23T19:01:09.282362+0000","last_fullsized":"2023-06-23T19:01:09.282362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:15.657801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281431+0000","last_change":"2023-06-23T19:01:03.878338+0000","last_active":"2023-06-23T19:01:09.281431+0000","last_peered":"2023-06-23T19:01:09.281431+0000","last_clean":"2023-06-23T19:01:09.281431+0000","last_became_active":"2023-06-23T19:01:03.873345+0000","last_became_peered":"2023-06-23T19:01:03.873345+0000","last_unstale":"2023-06-23T19:01:09.281431+0000","last_undegraded":"2023-06-23T19:01:09.281431+0000","last_fullsized":"2023-06-23T19:01:09.281431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:44:57.209204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872632+0000","last_change":"2023-06-23T19:01:04.385034+0000","last_active":"2023-06-23T19:01:08.872632+0000","last_peered":"2023-06-23T19:01:08.872632+0000","last_clean":"2023-06-23T19:01:08.872632+0000","last_became_active":"2023-06-23T19:01:04.384747+0000","last_became_peered":"2023-06-23T19:01:04.384747+0000","last_unstale":"2023-06-23T19:01:08.872632+0000","last_undegraded":"2023-06-23T19:01:08.872632+0000","last_fullsized":"2023-06-23T19:01:08.872632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:37:39.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871252+0000","last_change":"2023-06-23T19:01:08.404982+0000","last_active":"2023-06-23T19:01:08.871252+0000","last_peered":"2023-06-23T19:01:08.871252+0000","last_clean":"2023-06-23T19:01:08.871252+0000","last_became_active":"2023-06-23T19:01:08.404577+0000","last_became_peered":"2023-06-23T19:01:08.404577+0000","last_unstale":"2023-06-23T19:01:08.871252+0000","last_undegraded":"2023-06-23T19:01:08.871252+0000","last_fullsized":"2023-06-23T19:01:08.871252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:38:36.950113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870787+0000","last_change":"2023-06-23T19:00:58.810848+0000","last_active":"2023-06-23T19:01:08.870787+0000","last_peered":"2023-06-23T19:01:08.870787+0000","last_clean":"2023-06-23T19:01:08.870787+0000","last_became_active":"2023-06-23T19:00:58.810530+0000","last_became_peered":"2023-06-23T19:00:58.810530+0000","last_unstale":"2023-06-23T19:01:08.870787+0000","last_undegraded":"2023-06-23T19:01:08.870787+0000","last_fullsized":"2023-06-23T19:01:08.870787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:08:44.162030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871989+0000","last_change":"2023-06-23T19:01:03.878115+0000","last_active":"2023-06-23T19:01:08.871989+0000","last_peered":"2023-06-23T19:01:08.871989+0000","last_clean":"2023-06-23T19:01:08.871989+0000","last_became_active":"2023-06-23T19:01:03.877772+0000","last_became_peered":"2023-06-23T19:01:03.877772+0000","last_unstale":"2023-06-23T19:01:08.871989+0000","last_undegraded":"2023-06-23T19:01:08.871989+0000","last_fullsized":"2023-06-23T19:01:08.871989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:45:30.544760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872856+0000","last_change":"2023-06-23T19:01:04.371163+0000","last_active":"2023-06-23T19:01:08.872856+0000","last_peered":"2023-06-23T19:01:08.872856+0000","last_clean":"2023-06-23T19:01:08.872856+0000","last_became_active":"2023-06-23T19:01:04.370885+0000","last_became_peered":"2023-06-23T19:01:04.370885+0000","last_unstale":"2023-06-23T19:01:08.872856+0000","last_undegraded":"2023-06-23T19:01:08.872856+0000","last_fullsized":"2023-06-23T19:01:08.872856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:08.703615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281165+0000","last_change":"2023-06-23T19:01:08.403027+0000","last_active":"2023-06-23T19:01:09.281165+0000","last_peered":"2023-06-23T19:01:09.281165+0000","last_clean":"2023-06-23T19:01:09.281165+0000","last_became_active":"2023-06-23T19:01:08.402697+0000","last_became_peered":"2023-06-23T19:01:08.402697+0000","last_unstale":"2023-06-23T19:01:09.281165+0000","last_undegraded":"2023-06-23T19:01:09.281165+0000","last_fullsized":"2023-06-23T19:01:09.281165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:38.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282502+0000","last_change":"2023-06-23T19:00:58.032352+0000","last_active":"2023-06-23T19:01:09.282502+0000","last_peered":"2023-06-23T19:01:09.282502+0000","last_clean":"2023-06-23T19:01:09.282502+0000","last_became_active":"2023-06-23T19:00:58.031905+0000","last_became_peered":"2023-06-23T19:00:58.031905+0000","last_unstale":"2023-06-23T19:01:09.282502+0000","last_undegraded":"2023-06-23T19:01:09.282502+0000","last_fullsized":"2023-06-23T19:01:09.282502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:05.104177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281370+0000","last_change":"2023-06-23T19:00:50.002765+0000","last_active":"2023-06-23T19:01:09.281370+0000","last_peered":"2023-06-23T19:01:09.281370+0000","last_clean":"2023-06-23T19:01:09.281370+0000","last_became_active":"2023-06-23T19:00:50.002445+0000","last_became_peered":"2023-06-23T19:00:50.002445+0000","last_unstale":"2023-06-23T19:01:09.281370+0000","last_undegraded":"2023-06-23T19:01:09.281370+0000","last_fullsized":"2023-06-23T19:01:09.281370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_clean_scrub_stamp":"2023-06-23T19:00:48.989242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280695+0000","last_change":"2023-06-23T19:01:03.873914+0000","last_active":"2023-06-23T19:01:09.280695+0000","last_peered":"2023-06-23T19:01:09.280695+0000","last_clean":"2023-06-23T19:01:09.280695+0000","last_became_active":"2023-06-23T19:01:03.873592+0000","last_became_peered":"2023-06-23T19:01:03.873592+0000","last_unstale":"2023-06-23T19:01:09.280695+0000","last_undegraded":"2023-06-23T19:01:09.280695+0000","last_fullsized":"2023-06-23T19:01:09.280695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:15.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156830+0000","last_change":"2023-06-23T19:01:04.387883+0000","last_active":"2023-06-23T19:01:09.156830+0000","last_peered":"2023-06-23T19:01:09.156830+0000","last_clean":"2023-06-23T19:01:09.156830+0000","last_became_active":"2023-06-23T19:01:04.387600+0000","last_became_peered":"2023-06-23T19:01:04.387600+0000","last_unstale":"2023-06-23T19:01:09.156830+0000","last_undegraded":"2023-06-23T19:01:09.156830+0000","last_fullsized":"2023-06-23T19:01:09.156830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:16:44.300439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282713+0000","last_change":"2023-06-23T19:01:08.401404+0000","last_active":"2023-06-23T19:01:09.282713+0000","last_peered":"2023-06-23T19:01:09.282713+0000","last_clean":"2023-06-23T19:01:09.282713+0000","last_became_active":"2023-06-23T19:01:08.400568+0000","last_became_peered":"2023-06-23T19:01:08.400568+0000","last_unstale":"2023-06-23T19:01:09.282713+0000","last_undegraded":"2023-06-23T19:01:09.282713+0000","last_fullsized":"2023-06-23T19:01:09.282713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:33.995739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283199+0000","last_change":"2023-06-23T19:00:58.034045+0000","last_active":"2023-06-23T19:01:09.283199+0000","last_peered":"2023-06-23T19:01:09.283199+0000","last_clean":"2023-06-23T19:01:09.283199+0000","last_became_active":"2023-06-23T19:00:58.033654+0000","last_became_peered":"2023-06-23T19:00:58.033654+0000","last_unstale":"2023-06-23T19:01:09.283199+0000","last_undegraded":"2023-06-23T19:01:09.283199+0000","last_fullsized":"2023-06-23T19:01:09.283199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:01:40.788438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872071+0000","last_change":"2023-06-23T19:01:03.877003+0000","last_active":"2023-06-23T19:01:08.872071+0000","last_peered":"2023-06-23T19:01:08.872071+0000","last_clean":"2023-06-23T19:01:08.872071+0000","last_became_active":"2023-06-23T19:01:03.876599+0000","last_became_peered":"2023-06-23T19:01:03.876599+0000","last_unstale":"2023-06-23T19:01:08.872071+0000","last_undegraded":"2023-06-23T19:01:08.872071+0000","last_fullsized":"2023-06-23T19:01:08.872071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:50.138012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872292+0000","last_change":"2023-06-23T19:01:04.388623+0000","last_active":"2023-06-23T19:01:08.872292+0000","last_peered":"2023-06-23T19:01:08.872292+0000","last_clean":"2023-06-23T19:01:08.872292+0000","last_became_active":"2023-06-23T19:01:04.388354+0000","last_became_peered":"2023-06-23T19:01:04.388354+0000","last_unstale":"2023-06-23T19:01:08.872292+0000","last_undegraded":"2023-06-23T19:01:08.872292+0000","last_fullsized":"2023-06-23T19:01:08.872292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:52:26.947243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156779+0000","last_change":"2023-06-23T19:01:08.405177+0000","last_active":"2023-06-23T19:01:09.156779+0000","last_peered":"2023-06-23T19:01:09.156779+0000","last_clean":"2023-06-23T19:01:09.156779+0000","last_became_active":"2023-06-23T19:01:08.404747+0000","last_became_peered":"2023-06-23T19:01:08.404747+0000","last_unstale":"2023-06-23T19:01:09.156779+0000","last_undegraded":"2023-06-23T19:01:09.156779+0000","last_fullsized":"2023-06-23T19:01:09.156779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:17:06.369020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282026+0000","last_change":"2023-06-23T19:00:58.992645+0000","last_active":"2023-06-23T19:01:09.282026+0000","last_peered":"2023-06-23T19:01:09.282026+0000","last_clean":"2023-06-23T19:01:09.282026+0000","last_became_active":"2023-06-23T19:00:58.992291+0000","last_became_peered":"2023-06-23T19:00:58.992291+0000","last_unstale":"2023-06-23T19:01:09.282026+0000","last_undegraded":"2023-06-23T19:01:09.282026+0000","last_fullsized":"2023-06-23T19:01:09.282026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:16:30.068353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873413+0000","last_change":"2023-06-23T19:01:03.878082+0000","last_active":"2023-06-23T19:01:08.873413+0000","last_peered":"2023-06-23T19:01:08.873413+0000","last_clean":"2023-06-23T19:01:08.873413+0000","last_became_active":"2023-06-23T19:01:03.877747+0000","last_became_peered":"2023-06-23T19:01:03.877747+0000","last_unstale":"2023-06-23T19:01:08.873413+0000","last_undegraded":"2023-06-23T19:01:08.873413+0000","last_fullsized":"2023-06-23T19:01:08.873413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:21.482936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873397+0000","last_change":"2023-06-23T19:01:04.374320+0000","last_active":"2023-06-23T19:01:08.873397+0000","last_peered":"2023-06-23T19:01:08.873397+0000","last_clean":"2023-06-23T19:01:08.873397+0000","last_became_active":"2023-06-23T19:01:04.374031+0000","last_became_peered":"2023-06-23T19:01:04.374031+0000","last_unstale":"2023-06-23T19:01:08.873397+0000","last_undegraded":"2023-06-23T19:01:08.873397+0000","last_fullsized":"2023-06-23T19:01:08.873397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:34.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281624+0000","last_change":"2023-06-23T19:01:08.394556+0000","last_active":"2023-06-23T19:01:09.281624+0000","last_peered":"2023-06-23T19:01:09.281624+0000","last_clean":"2023-06-23T19:01:09.281624+0000","last_became_active":"2023-06-23T19:01:08.393875+0000","last_became_peered":"2023-06-23T19:01:08.393875+0000","last_unstale":"2023-06-23T19:01:09.281624+0000","last_undegraded":"2023-06-23T19:01:09.281624+0000","last_fullsized":"2023-06-23T19:01:09.281624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:07:00.398165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281299+0000","last_change":"2023-06-23T19:01:03.870177+0000","last_active":"2023-06-23T19:01:09.281299+0000","last_peered":"2023-06-23T19:01:09.281299+0000","last_clean":"2023-06-23T19:01:09.281299+0000","last_became_active":"2023-06-23T19:01:03.869846+0000","last_became_peered":"2023-06-23T19:01:03.869846+0000","last_unstale":"2023-06-23T19:01:09.281299+0000","last_undegraded":"2023-06-23T19:01:09.281299+0000","last_fullsized":"2023-06-23T19:01:09.281299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:16:04.856211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873658+0000","last_change":"2023-06-23T19:00:58.034828+0000","last_active":"2023-06-23T19:01:08.873658+0000","last_peered":"2023-06-23T19:01:08.873658+0000","last_clean":"2023-06-23T19:01:08.873658+0000","last_became_active":"2023-06-23T19:00:58.034502+0000","last_became_peered":"2023-06-23T19:00:58.034502+0000","last_unstale":"2023-06-23T19:01:08.873658+0000","last_undegraded":"2023-06-23T19:01:08.873658+0000","last_fullsized":"2023-06-23T19:01:08.873658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:41.813074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280470+0000","last_change":"2023-06-23T19:01:04.377485+0000","last_active":"2023-06-23T19:01:09.280470+0000","last_peered":"2023-06-23T19:01:09.280470+0000","last_clean":"2023-06-23T19:01:09.280470+0000","last_became_active":"2023-06-23T19:01:04.377242+0000","last_became_peered":"2023-06-23T19:01:04.377242+0000","last_unstale":"2023-06-23T19:01:09.280470+0000","last_undegraded":"2023-06-23T19:01:09.280470+0000","last_fullsized":"2023-06-23T19:01:09.280470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:49.389492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280412+0000","last_change":"2023-06-23T19:01:08.399309+0000","last_active":"2023-06-23T19:01:09.280412+0000","last_peered":"2023-06-23T19:01:09.280412+0000","last_clean":"2023-06-23T19:01:09.280412+0000","last_became_active":"2023-06-23T19:01:08.398913+0000","last_became_peered":"2023-06-23T19:01:08.398913+0000","last_unstale":"2023-06-23T19:01:09.280412+0000","last_undegraded":"2023-06-23T19:01:09.280412+0000","last_fullsized":"2023-06-23T19:01:09.280412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:05:26.164184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157050+0000","last_change":"2023-06-23T19:00:58.035530+0000","last_active":"2023-06-23T19:01:09.157050+0000","last_peered":"2023-06-23T19:01:09.157050+0000","last_clean":"2023-06-23T19:01:09.157050+0000","last_became_active":"2023-06-23T19:00:58.035130+0000","last_became_peered":"2023-06-23T19:00:58.035130+0000","last_unstale":"2023-06-23T19:01:09.157050+0000","last_undegraded":"2023-06-23T19:01:09.157050+0000","last_fullsized":"2023-06-23T19:01:09.157050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:11.697702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872441+0000","last_change":"2023-06-23T19:01:03.875213+0000","last_active":"2023-06-23T19:01:08.872441+0000","last_peered":"2023-06-23T19:01:08.872441+0000","last_clean":"2023-06-23T19:01:08.872441+0000","last_became_active":"2023-06-23T19:01:03.874930+0000","last_became_peered":"2023-06-23T19:01:03.874930+0000","last_unstale":"2023-06-23T19:01:08.872441+0000","last_undegraded":"2023-06-23T19:01:08.872441+0000","last_fullsized":"2023-06-23T19:01:08.872441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:08:23.340468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281216+0000","last_change":"2023-06-23T19:01:04.381558+0000","last_active":"2023-06-23T19:01:09.281216+0000","last_peered":"2023-06-23T19:01:09.281216+0000","last_clean":"2023-06-23T19:01:09.281216+0000","last_became_active":"2023-06-23T19:01:04.381261+0000","last_became_peered":"2023-06-23T19:01:04.381261+0000","last_unstale":"2023-06-23T19:01:09.281216+0000","last_undegraded":"2023-06-23T19:01:09.281216+0000","last_fullsized":"2023-06-23T19:01:09.281216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:19:13.412736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872856+0000","last_change":"2023-06-23T19:01:08.396210+0000","last_active":"2023-06-23T19:01:08.872856+0000","last_peered":"2023-06-23T19:01:08.872856+0000","last_clean":"2023-06-23T19:01:08.872856+0000","last_became_active":"2023-06-23T19:01:08.395784+0000","last_became_peered":"2023-06-23T19:01:08.395784+0000","last_unstale":"2023-06-23T19:01:08.872856+0000","last_undegraded":"2023-06-23T19:01:08.872856+0000","last_fullsized":"2023-06-23T19:01:08.872856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:37.937641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873475+0000","last_change":"2023-06-23T19:01:03.880745+0000","last_active":"2023-06-23T19:01:08.873475+0000","last_peered":"2023-06-23T19:01:08.873475+0000","last_clean":"2023-06-23T19:01:08.873475+0000","last_became_active":"2023-06-23T19:01:03.880470+0000","last_became_peered":"2023-06-23T19:01:03.880470+0000","last_unstale":"2023-06-23T19:01:08.873475+0000","last_undegraded":"2023-06-23T19:01:08.873475+0000","last_fullsized":"2023-06-23T19:01:08.873475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:47.638210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871233+0000","last_change":"2023-06-23T19:01:04.374095+0000","last_active":"2023-06-23T19:01:08.871233+0000","last_peered":"2023-06-23T19:01:08.871233+0000","last_clean":"2023-06-23T19:01:08.871233+0000","last_became_active":"2023-06-23T19:01:04.373775+0000","last_became_peered":"2023-06-23T19:01:04.373775+0000","last_unstale":"2023-06-23T19:01:08.871233+0000","last_undegraded":"2023-06-23T19:01:08.871233+0000","last_fullsized":"2023-06-23T19:01:08.871233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:17:02.854856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281073+0000","last_change":"2023-06-23T19:01:08.394708+0000","last_active":"2023-06-23T19:01:09.281073+0000","last_peered":"2023-06-23T19:01:09.281073+0000","last_clean":"2023-06-23T19:01:09.281073+0000","last_became_active":"2023-06-23T19:01:08.394307+0000","last_became_peered":"2023-06-23T19:01:08.394307+0000","last_unstale":"2023-06-23T19:01:09.281073+0000","last_undegraded":"2023-06-23T19:01:09.281073+0000","last_fullsized":"2023-06-23T19:01:09.281073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:37.937641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281731+0000","last_change":"2023-06-23T19:01:03.881055+0000","last_active":"2023-06-23T19:01:09.281731+0000","last_peered":"2023-06-23T19:01:09.281731+0000","last_clean":"2023-06-23T19:01:09.281731+0000","last_became_active":"2023-06-23T19:01:03.880783+0000","last_became_peered":"2023-06-23T19:01:03.880783+0000","last_unstale":"2023-06-23T19:01:09.281731+0000","last_undegraded":"2023-06-23T19:01:09.281731+0000","last_fullsized":"2023-06-23T19:01:09.281731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:33.419724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281290+0000","last_change":"2023-06-23T19:01:04.384460+0000","last_active":"2023-06-23T19:01:09.281290+0000","last_peered":"2023-06-23T19:01:09.281290+0000","last_clean":"2023-06-23T19:01:09.281290+0000","last_became_active":"2023-06-23T19:01:04.384176+0000","last_became_peered":"2023-06-23T19:01:04.384176+0000","last_unstale":"2023-06-23T19:01:09.281290+0000","last_undegraded":"2023-06-23T19:01:09.281290+0000","last_fullsized":"2023-06-23T19:01:09.281290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:22:29.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282471+0000","last_change":"2023-06-23T19:01:08.400916+0000","last_active":"2023-06-23T19:01:09.282471+0000","last_peered":"2023-06-23T19:01:09.282471+0000","last_clean":"2023-06-23T19:01:09.282471+0000","last_became_active":"2023-06-23T19:01:08.400414+0000","last_became_peered":"2023-06-23T19:01:08.400414+0000","last_unstale":"2023-06-23T19:01:09.282471+0000","last_undegraded":"2023-06-23T19:01:09.282471+0000","last_fullsized":"2023-06-23T19:01:09.282471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:52.156128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283145+0000","last_change":"2023-06-23T19:01:03.881189+0000","last_active":"2023-06-23T19:01:09.283145+0000","last_peered":"2023-06-23T19:01:09.283145+0000","last_clean":"2023-06-23T19:01:09.283145+0000","last_became_active":"2023-06-23T19:01:03.880951+0000","last_became_peered":"2023-06-23T19:01:03.880951+0000","last_unstale":"2023-06-23T19:01:09.283145+0000","last_undegraded":"2023-06-23T19:01:09.283145+0000","last_fullsized":"2023-06-23T19:01:09.283145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:15.133048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282217+0000","last_change":"2023-06-23T19:01:04.384653+0000","last_active":"2023-06-23T19:01:09.282217+0000","last_peered":"2023-06-23T19:01:09.282217+0000","last_clean":"2023-06-23T19:01:09.282217+0000","last_became_active":"2023-06-23T19:01:04.384329+0000","last_became_peered":"2023-06-23T19:01:04.384329+0000","last_unstale":"2023-06-23T19:01:09.282217+0000","last_undegraded":"2023-06-23T19:01:09.282217+0000","last_fullsized":"2023-06-23T19:01:09.282217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:34:32.935523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280710+0000","last_change":"2023-06-23T19:01:08.395019+0000","last_active":"2023-06-23T19:01:09.280710+0000","last_peered":"2023-06-23T19:01:09.280710+0000","last_clean":"2023-06-23T19:01:09.280710+0000","last_became_active":"2023-06-23T19:01:08.394627+0000","last_became_peered":"2023-06-23T19:01:08.394627+0000","last_unstale":"2023-06-23T19:01:09.280710+0000","last_undegraded":"2023-06-23T19:01:09.280710+0000","last_fullsized":"2023-06-23T19:01:09.280710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:47:00.590205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281012+0000","last_change":"2023-06-23T19:01:03.865046+0000","last_active":"2023-06-23T19:01:09.281012+0000","last_peered":"2023-06-23T19:01:09.281012+0000","last_clean":"2023-06-23T19:01:09.281012+0000","last_became_active":"2023-06-23T19:01:03.864670+0000","last_became_peered":"2023-06-23T19:01:03.864670+0000","last_unstale":"2023-06-23T19:01:09.281012+0000","last_undegraded":"2023-06-23T19:01:09.281012+0000","last_fullsized":"2023-06-23T19:01:09.281012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:12.906392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280997+0000","last_change":"2023-06-23T19:01:04.378240+0000","last_active":"2023-06-23T19:01:09.280997+0000","last_peered":"2023-06-23T19:01:09.280997+0000","last_clean":"2023-06-23T19:01:09.280997+0000","last_became_active":"2023-06-23T19:01:04.377992+0000","last_became_peered":"2023-06-23T19:01:04.377992+0000","last_unstale":"2023-06-23T19:01:09.280997+0000","last_undegraded":"2023-06-23T19:01:09.280997+0000","last_fullsized":"2023-06-23T19:01:09.280997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:32:02.858761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872457+0000","last_change":"2023-06-23T19:01:08.407782+0000","last_active":"2023-06-23T19:01:08.872457+0000","last_peered":"2023-06-23T19:01:08.872457+0000","last_clean":"2023-06-23T19:01:08.872457+0000","last_became_active":"2023-06-23T19:01:08.407314+0000","last_became_peered":"2023-06-23T19:01:08.407314+0000","last_unstale":"2023-06-23T19:01:08.872457+0000","last_undegraded":"2023-06-23T19:01:08.872457+0000","last_fullsized":"2023-06-23T19:01:08.872457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:08:27.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873611+0000","last_change":"2023-06-23T19:01:03.875481+0000","last_active":"2023-06-23T19:01:08.873611+0000","last_peered":"2023-06-23T19:01:08.873611+0000","last_clean":"2023-06-23T19:01:08.873611+0000","last_became_active":"2023-06-23T19:01:03.874826+0000","last_became_peered":"2023-06-23T19:01:03.874826+0000","last_unstale":"2023-06-23T19:01:08.873611+0000","last_undegraded":"2023-06-23T19:01:08.873611+0000","last_fullsized":"2023-06-23T19:01:08.873611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:58.742697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280899+0000","last_change":"2023-06-23T19:01:04.378819+0000","last_active":"2023-06-23T19:01:09.280899+0000","last_peered":"2023-06-23T19:01:09.280899+0000","last_clean":"2023-06-23T19:01:09.280899+0000","last_became_active":"2023-06-23T19:01:04.378183+0000","last_became_peered":"2023-06-23T19:01:04.378183+0000","last_unstale":"2023-06-23T19:01:09.280899+0000","last_undegraded":"2023-06-23T19:01:09.280899+0000","last_fullsized":"2023-06-23T19:01:09.280899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:00.026037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156609+0000","last_change":"2023-06-23T19:01:04.375991+0000","last_active":"2023-06-23T19:01:09.156609+0000","last_peered":"2023-06-23T19:01:09.156609+0000","last_clean":"2023-06-23T19:01:09.156609+0000","last_became_active":"2023-06-23T19:01:04.375767+0000","last_became_peered":"2023-06-23T19:01:04.375767+0000","last_unstale":"2023-06-23T19:01:09.156609+0000","last_undegraded":"2023-06-23T19:01:09.156609+0000","last_fullsized":"2023-06-23T19:01:09.156609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:03.089060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281270+0000","last_change":"2023-06-23T19:01:04.386075+0000","last_active":"2023-06-23T19:01:09.281270+0000","last_peered":"2023-06-23T19:01:09.281270+0000","last_clean":"2023-06-23T19:01:09.281270+0000","last_became_active":"2023-06-23T19:01:04.385788+0000","last_became_peered":"2023-06-23T19:01:04.385788+0000","last_unstale":"2023-06-23T19:01:09.281270+0000","last_undegraded":"2023-06-23T19:01:09.281270+0000","last_fullsized":"2023-06-23T19:01:09.281270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:38:17.246142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282773+0000","last_change":"2023-06-23T19:01:04.378811+0000","last_active":"2023-06-23T19:01:09.282773+0000","last_peered":"2023-06-23T19:01:09.282773+0000","last_clean":"2023-06-23T19:01:09.282773+0000","last_became_active":"2023-06-23T19:01:04.378217+0000","last_became_peered":"2023-06-23T19:01:04.378217+0000","last_unstale":"2023-06-23T19:01:09.282773+0000","last_undegraded":"2023-06-23T19:01:09.282773+0000","last_fullsized":"2023-06-23T19:01:09.282773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:21:41.388818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280565+0000","last_change":"2023-06-23T19:01:04.378198+0000","last_active":"2023-06-23T19:01:09.280565+0000","last_peered":"2023-06-23T19:01:09.280565+0000","last_clean":"2023-06-23T19:01:09.280565+0000","last_became_active":"2023-06-23T19:01:04.377778+0000","last_became_peered":"2023-06-23T19:01:04.377778+0000","last_unstale":"2023-06-23T19:01:09.280565+0000","last_undegraded":"2023-06-23T19:01:09.280565+0000","last_fullsized":"2023-06-23T19:01:09.280565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:10:45.255508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872832+0000","last_change":"2023-06-23T19:01:04.375219+0000","last_active":"2023-06-23T19:01:08.872832+0000","last_peered":"2023-06-23T19:01:08.872832+0000","last_clean":"2023-06-23T19:01:08.872832+0000","last_became_active":"2023-06-23T19:01:04.372075+0000","last_became_peered":"2023-06-23T19:01:04.372075+0000","last_unstale":"2023-06-23T19:01:08.872832+0000","last_undegraded":"2023-06-23T19:01:08.872832+0000","last_fullsized":"2023-06-23T19:01:08.872832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476746,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":716841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":126543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":327680,"data_stored":129741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":929792,"data_stored":720269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T19:01:32.883 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-23T19:01:32.884 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-23T19:01:32.884 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-23T19:01:32.884 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-23T19:01:32.885 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-23T19:01:33.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.104+0000 7fe4f77ff700 1 Processor -- start 2023-06-23T19:01:33.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.104+0000 7fe4f77ff700 1 -- start start 2023-06-23T19:01:33.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.105+0000 7fe4f77ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe4f015c570 0x7fe4f00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f77ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4f00cd660 0x7fe4f0160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f77ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f01610a0 con 0x7fe4f0160880 2023-06-23T19:01:33.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f77ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f015d670 con 0x7fe4f015c570 2023-06-23T19:01:33.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f77ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f00cdae0 con 0x7fe4f00cd660 2023-06-23T19:01:33.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f559b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe4f015c570 0x7fe4f00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f559b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe4f015c570 0x7fe4f00cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46000/0 (socket says 172.21.15.136:46000) 2023-06-23T19:01:33.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f559b700 1 -- 172.21.15.136:0/2986768772 learned_addr learned my addr 172.21.15.136:0/2986768772 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:33.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f4d9a700 1 --2- 172.21.15.136:0/2986768772 >> v2:172.21.15.178:3300/0 conn(0x7fe4f00cd660 0x7fe4f0160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.112 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f559b700 1 -- 172.21.15.136:0/2986768772 >> v2:172.21.15.178:3300/0 conn(0x7fe4f00cd660 msgr2=0x7fe4f0160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:33.112 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f559b700 1 --2- 172.21.15.136:0/2986768772 >> v2:172.21.15.178:3300/0 conn(0x7fe4f00cd660 0x7fe4f0160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.112 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f559b700 1 -- 172.21.15.136:0/2986768772 >> v1:172.21.15.136:6789/0 conn(0x7fe4f0160880 legacy=0x7fe4f006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.112 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4f559b700 1 -- 172.21.15.136:0/2986768772 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f015da90 con 0x7fe4f015c570 2023-06-23T19:01:33.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.106+0000 7fe4e7fff700 1 -- 172.21.15.136:0/2986768772 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738531631 0 0) 0x7fe4f01610a0 con 0x7fe4f0160880 2023-06-23T19:01:33.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4f559b700 1 --2- 172.21.15.136:0/2986768772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 0x7fe4f00cd120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe4f008bc50 tx=0x7fe4ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd7bc2685a78aac server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:33.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4e7fff700 1 -- 172.21.15.136:0/2986768772 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00b870 con 0x7fe4f015c570 2023-06-23T19:01:33.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4e7fff700 1 -- 172.21.15.136:0/2986768772 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec00b9d0 con 0x7fe4f015c570 2023-06-23T19:01:33.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4e7fff700 1 -- 172.21.15.136:0/2986768772 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00bd60 con 0x7fe4f015c570 2023-06-23T19:01:33.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4f77ff700 1 -- 172.21.15.136:0/2986768772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 msgr2=0x7fe4f00cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4f77ff700 1 --2- 172.21.15.136:0/2986768772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 0x7fe4f00cd120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe4f008bc50 tx=0x7fe4ec009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4f77ff700 1 -- 172.21.15.136:0/2986768772 shutdown_connections 2023-06-23T19:01:33.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4f77ff700 1 --2- 172.21.15.136:0/2986768772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 0x7fe4f00cd120 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4f77ff700 1 --2- 172.21.15.136:0/2986768772 >> v2:172.21.15.178:3300/0 conn(0x7fe4f00cd660 0x7fe4f0160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4f77ff700 1 -- 172.21.15.136:0/2986768772 >> 172.21.15.136:0/2986768772 conn(0x7fe4f0071620 msgr2=0x7fe4f00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:33.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4f77ff700 1 -- 172.21.15.136:0/2986768772 shutdown_connections 2023-06-23T19:01:33.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.107+0000 7fe4f77ff700 1 -- 172.21.15.136:0/2986768772 wait complete. 2023-06-23T19:01:33.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.109+0000 7fe4f77ff700 1 Processor -- start 2023-06-23T19:01:33.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.109+0000 7fe4f77ff700 1 -- start start 2023-06-23T19:01:33.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.110+0000 7fe4f77ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f00cd660 0x7fe4f00cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.110+0000 7fe4f77ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 0x7fe4f01e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.110+0000 7fe4f77ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f0160880 0x7fe4f01499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.110+0000 7fe4f77ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00b7c10 con 0x7fe4f015c570 2023-06-23T19:01:33.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.110+0000 7fe4f77ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00b6f90 con 0x7fe4f0160880 2023-06-23T19:01:33.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.110+0000 7fe4f77ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00b7270 con 0x7fe4f00cd660 2023-06-23T19:01:33.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.110+0000 7fe4f4d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 0x7fe4f01e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.110+0000 7fe4f4d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 0x7fe4f01e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46010/0 (socket says 172.21.15.136:46010) 2023-06-23T19:01:33.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f4d9a700 1 -- 172.21.15.136:0/4198424815 learned_addr learned my addr 172.21.15.136:0/4198424815 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:33.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f559b700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f00cd660 0x7fe4f00cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f5d9c700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f0160880 0x7fe4f01499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f4d9a700 1 -- 172.21.15.136:0/4198424815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f00cd660 msgr2=0x7fe4f00cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f4d9a700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f00cd660 0x7fe4f00cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f4d9a700 1 -- 172.21.15.136:0/4198424815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f0160880 msgr2=0x7fe4f01499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f4d9a700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f0160880 0x7fe4f01499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f4d9a700 1 -- 172.21.15.136:0/4198424815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec009550 con 0x7fe4f015c570 2023-06-23T19:01:33.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f4d9a700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 0x7fe4f01e5db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000e810 tx=0x7fe4e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:33.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4e5ffb700 1 -- 172.21.15.136:0/4198424815 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0013610 con 0x7fe4f015c570 2023-06-23T19:01:33.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4e5ffb700 1 -- 172.21.15.136:0/4198424815 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0013770 con 0x7fe4f015c570 2023-06-23T19:01:33.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4e5ffb700 1 -- 172.21.15.136:0/4198424815 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0013b20 con 0x7fe4f015c570 2023-06-23T19:01:33.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f00b7550 con 0x7fe4f015c570 2023-06-23T19:01:33.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.111+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f0159c80 con 0x7fe4f015c570 2023-06-23T19:01:33.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.112+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f0073910 con 0x7fe4f015c570 2023-06-23T19:01:33.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.113+0000 7fe4e5ffb700 1 -- 172.21.15.136:0/4198424815 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4e0013c80 con 0x7fe4f015c570 2023-06-23T19:01:33.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.114+0000 7fe4e5ffb700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4d406ace0 0x7fe4d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.114+0000 7fe4e5ffb700 1 -- 172.21.15.136:0/4198424815 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe4e00893f0 con 0x7fe4f015c570 2023-06-23T19:01:33.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.115+0000 7fe4f559b700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4d406ace0 0x7fe4d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.115+0000 7fe4f559b700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4d406ace0 0x7fe4d406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009c10 tx=0x7fe4ec008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:33.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.118+0000 7fe4e5ffb700 1 -- 172.21.15.136:0/4198424815 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4e0057bb0 con 0x7fe4f015c570 2023-06-23T19:01:33.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.368+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe4f015faf0 con 0x7fe4f015c570 2023-06-23T19:01:33.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.372+0000 7fe4e5ffb700 1 -- 172.21.15.136:0/4198424815 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170848 (secure 0 0 0) 0x7fe4e0057740 con 0x7fe4f015c570 2023-06-23T19:01:33.377 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:33.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4d406ace0 msgr2=0x7fe4d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4d406ace0 0x7fe4d406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009c10 tx=0x7fe4ec008030 comp rx=0 tx=0).stop 2023-06-23T19:01:33.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 msgr2=0x7fe4f01e5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 0x7fe4f01e5db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000e810 tx=0x7fe4e000eb20 comp rx=0 tx=0).stop 2023-06-23T19:01:33.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 shutdown_connections 2023-06-23T19:01:33.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4d406ace0 0x7fe4d406d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f0160880 0x7fe4f01499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f00cd660 0x7fe4f00cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 --2- 172.21.15.136:0/4198424815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4f015c570 0x7fe4f01e5db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 >> 172.21.15.136:0/4198424815 conn(0x7fe4f0071620 msgr2=0x7fe4f00cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:33.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 shutdown_connections 2023-06-23T19:01:33.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.375+0000 7fe4f77ff700 1 -- 172.21.15.136:0/4198424815 wait complete. 2023-06-23T19:01:33.397 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2653877961},{"type":"v1","addr":"172.21.15.136:6833","nonce":2653877961}]},"active_addr":"172.21.15.136:6833/2653877961","active_change":"2023-06-23T19:00:42.914409+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":3828613077}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":906017315}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":1670325685}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":3321171929}]}]} 2023-06-23T19:01:33.401 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-23T19:01:33.401 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-23T19:01:33.402 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:33.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.589+0000 7f1bb9f9d700 1 Processor -- start 2023-06-23T19:01:33.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.589+0000 7f1bb9f9d700 1 -- start start 2023-06-23T19:01:33.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.591+0000 7f1bb9f9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1bb40b1dc0 0x7f1bb40d0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.591+0000 7f1bb9f9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 0x7f1bb40cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.591+0000 7f1bb9f9d700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb40cd470 con 0x7f1bb40cf880 2023-06-23T19:01:33.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.591+0000 7f1bb9f9d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb40cfd00 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.591+0000 7f1bb9f9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40d10a0 con 0x7f1bb406cb20 2023-06-23T19:01:33.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.591+0000 7f1bb979c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f1bb40cf880 0x7f1bb406b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53002/0 (socket says 172.21.15.136:53002) 2023-06-23T19:01:33.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.591+0000 7f1bb979c700 1 -- 172.21.15.136:0/2059855784 learned_addr learned my addr 172.21.15.136:0/2059855784 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:33.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb3fff700 1 --2- 172.21.15.136:0/2059855784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 0x7f1bb40cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb8f9b700 1 --2- 172.21.15.136:0/2059855784 >> v2:172.21.15.178:3300/0 conn(0x7f1bb40b1dc0 0x7f1bb40d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb37fe700 1 -- 172.21.15.136:0/2059855784 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379785559 0 0) 0x7f1bb40cd470 con 0x7f1bb40cf880 2023-06-23T19:01:33.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb37fe700 1 -- 172.21.15.136:0/2059855784 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba40035b0 con 0x7f1bb40cf880 2023-06-23T19:01:33.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb37fe700 1 -- 172.21.15.136:0/2059855784 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1246554796 0 0) 0x7f1ba40035b0 con 0x7f1bb40cf880 2023-06-23T19:01:33.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb8f9b700 1 -- 172.21.15.136:0/2059855784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 msgr2=0x7f1bb40cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:33.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb8f9b700 1 --2- 172.21.15.136:0/2059855784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 0x7f1bb40cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb8f9b700 1 -- 172.21.15.136:0/2059855784 >> v1:172.21.15.136:6789/0 conn(0x7f1bb40cf880 legacy=0x7f1bb406b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb8f9b700 1 -- 172.21.15.136:0/2059855784 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40b2190 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb3fff700 1 --2- 172.21.15.136:0/2059855784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 0x7f1bb40cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:33.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.592+0000 7f1bb8f9b700 1 --2- 172.21.15.136:0/2059855784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb40b1dc0 0x7f1bb40d0500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009de0 tx=0x7f1ba800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e86886362ae82e23 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:33.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb37fe700 1 -- 172.21.15.136:0/2059855784 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba800e070 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb37fe700 1 -- 172.21.15.136:0/2059855784 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba8003a20 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb37fe700 1 -- 172.21.15.136:0/2059855784 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac001670 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2059855784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb40b1dc0 msgr2=0x7f1bb40d0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb9f9d700 1 --2- 172.21.15.136:0/2059855784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb40b1dc0 0x7f1bb40d0500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009de0 tx=0x7f1ba800b330 comp rx=0 tx=0).stop 2023-06-23T19:01:33.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2059855784 shutdown_connections 2023-06-23T19:01:33.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb9f9d700 1 --2- 172.21.15.136:0/2059855784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb40b1dc0 0x7f1bb40d0500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb9f9d700 1 --2- 172.21.15.136:0/2059855784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 0x7f1bb40cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2059855784 >> 172.21.15.136:0/2059855784 conn(0x7f1bb409bbf0 msgr2=0x7f1bb40d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:33.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2059855784 shutdown_connections 2023-06-23T19:01:33.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.593+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2059855784 wait complete. 2023-06-23T19:01:33.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.595+0000 7f1bb9f9d700 1 Processor -- start 2023-06-23T19:01:33.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.595+0000 7f1bb9f9d700 1 -- start start 2023-06-23T19:01:33.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb9f9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 0x7f1bb40b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb9f9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb40b1dc0 0x7f1bb415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb9f9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb40cf880 0x7f1bb415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb9f9d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40b74c0 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb9f9d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40b6420 con 0x7f1bb40cf880 2023-06-23T19:01:33.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb9f9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40b6700 con 0x7f1bb406cb20 2023-06-23T19:01:33.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb40b1dc0 0x7f1bb415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb40b1dc0 0x7f1bb415aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46016/0 (socket says 172.21.15.136:46016) 2023-06-23T19:01:33.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb3fff700 1 -- 172.21.15.136:0/2314572498 learned_addr learned my addr 172.21.15.136:0/2314572498 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:33.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb8f9b700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 0x7f1bb40b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.596+0000 7f1bb979c700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb40cf880 0x7f1bb415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb3fff700 1 -- 172.21.15.136:0/2314572498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 msgr2=0x7f1bb40b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb3fff700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 0x7f1bb40b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb3fff700 1 -- 172.21.15.136:0/2314572498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb40cf880 msgr2=0x7f1bb415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb3fff700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb40cf880 0x7f1bb415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb3fff700 1 -- 172.21.15.136:0/2314572498 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba00094a0 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb3fff700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb40b1dc0 0x7f1bb415aa20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000ebe0 tx=0x7f1ba000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:33.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb17fa700 1 -- 172.21.15.136:0/2314572498 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000c850 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb17fa700 1 -- 172.21.15.136:0/2314572498 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba000c9b0 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb17fa700 1 -- 172.21.15.136:0/2314572498 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000cd40 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba8009a70 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.597+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb40b6cc0 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.598+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb404ea20 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.599+0000 7f1bb17fa700 1 -- 172.21.15.136:0/2314572498 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ba0013470 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.600+0000 7f1bb17fa700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1b9806ace0 0x7f1b9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:33.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.600+0000 7f1bb17fa700 1 -- 172.21.15.136:0/2314572498 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1ba0089830 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.601+0000 7f1bb8f9b700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1b9806ace0 0x7f1b9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:33.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.601+0000 7f1bb8f9b700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1b9806ace0 0x7f1b9806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800b370 tx=0x7f1ba8011000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:33.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.604+0000 7f1bb17fa700 1 -- 172.21.15.136:0/2314572498 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1ba00545e0 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.799+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bb40d3490 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.800+0000 7f1bb17fa700 1 -- 172.21.15.136:0/2314572498 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f1ba000cea0 con 0x7f1bb40b1dc0 2023-06-23T19:01:33.804 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:33.805 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:33.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1b9806ace0 msgr2=0x7f1b9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1b9806ace0 0x7f1b9806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800b370 tx=0x7f1ba8011000 comp rx=0 tx=0).stop 2023-06-23T19:01:33.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb40b1dc0 msgr2=0x7f1bb415aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:33.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb40b1dc0 0x7f1bb415aa20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000ebe0 tx=0x7f1ba000eef0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 shutdown_connections 2023-06-23T19:01:33.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1b9806ace0 0x7f1b9806d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb40cf880 0x7f1bb415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bb406cb20 0x7f1bb40b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 --2- 172.21.15.136:0/2314572498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb40b1dc0 0x7f1bb415aa20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:33.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 >> 172.21.15.136:0/2314572498 conn(0x7f1bb409bbf0 msgr2=0x7f1bb40cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:33.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 shutdown_connections 2023-06-23T19:01:33.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:33.803+0000 7f1bb9f9d700 1 -- 172.21.15.136:0/2314572498 wait complete. 2023-06-23T19:01:33.825 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-23T19:01:33.826 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:34.019 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.015+0000 7ff0539ff700 1 Processor -- start 2023-06-23T19:01:34.019 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.015+0000 7ff0539ff700 1 -- start start 2023-06-23T19:01:34.021 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff0539ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff04c15c570 0x7ff04c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.021 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff0539ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff04c160a50 0x7ff04c0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.021 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff0539ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c160e70 con 0x7ff04c0cd660 2023-06-23T19:01:34.021 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff0539ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c15d670 con 0x7ff04c15c570 2023-06-23T19:01:34.022 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff0539ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c0cdae0 con 0x7ff04c160a50 2023-06-23T19:01:34.022 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff05179b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff04c15c570 0x7ff04c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.022 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff05179b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff04c15c570 0x7ff04c0cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46024/0 (socket says 172.21.15.136:46024) 2023-06-23T19:01:34.022 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff05179b700 1 -- 172.21.15.136:0/2675155819 learned_addr learned my addr 172.21.15.136:0/2675155819 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.022 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff051f9c700 1 --2- 172.21.15.136:0/2675155819 >> v2:172.21.15.178:3300/0 conn(0x7ff04c160a50 0x7ff04c0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff05179b700 1 -- 172.21.15.136:0/2675155819 >> v2:172.21.15.178:3300/0 conn(0x7ff04c160a50 msgr2=0x7ff04c0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:34.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff05179b700 1 --2- 172.21.15.136:0/2675155819 >> v2:172.21.15.178:3300/0 conn(0x7ff04c160a50 0x7ff04c0d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff05179b700 1 -- 172.21.15.136:0/2675155819 >> v1:172.21.15.178:6789/0 conn(0x7ff04c0cd660 legacy=0x7ff04c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.017+0000 7ff05179b700 1 -- 172.21.15.136:0/2675155819 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c1610a0 con 0x7ff04c15c570 2023-06-23T19:01:34.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff05179b700 1 --2- 172.21.15.136:0/2675155819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c15c570 0x7ff04c0cd120 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0b5070 tx=0x7ff048009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a77f692a9daecb5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff043fff700 1 -- 172.21.15.136:0/2675155819 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048011830 con 0x7ff04c15c570 2023-06-23T19:01:34.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff043fff700 1 -- 172.21.15.136:0/2675155819 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff048011990 con 0x7ff04c15c570 2023-06-23T19:01:34.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff043fff700 1 -- 172.21.15.136:0/2675155819 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048011d20 con 0x7ff04c15c570 2023-06-23T19:01:34.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff0539ff700 1 -- 172.21.15.136:0/2675155819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c15c570 msgr2=0x7ff04c0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff0539ff700 1 --2- 172.21.15.136:0/2675155819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c15c570 0x7ff04c0cd120 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0b5070 tx=0x7ff048009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff0539ff700 1 -- 172.21.15.136:0/2675155819 shutdown_connections 2023-06-23T19:01:34.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff0539ff700 1 --2- 172.21.15.136:0/2675155819 >> v2:172.21.15.178:3300/0 conn(0x7ff04c160a50 0x7ff04c0d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff0539ff700 1 --2- 172.21.15.136:0/2675155819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c15c570 0x7ff04c0cd120 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.018+0000 7ff0539ff700 1 -- 172.21.15.136:0/2675155819 >> 172.21.15.136:0/2675155819 conn(0x7ff04c071620 msgr2=0x7ff04c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.019+0000 7ff0539ff700 1 -- 172.21.15.136:0/2675155819 shutdown_connections 2023-06-23T19:01:34.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.019+0000 7ff0539ff700 1 -- 172.21.15.136:0/2675155819 wait complete. 2023-06-23T19:01:34.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.021+0000 7ff0539ff700 1 Processor -- start 2023-06-23T19:01:34.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.021+0000 7ff0539ff700 1 -- start start 2023-06-23T19:01:34.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.022+0000 7ff0539ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff04c0cd660 0x7ff04c0b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.022+0000 7ff0539ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff04c15c570 0x7ff04c0b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.022+0000 7ff0539ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c160a50 0x7ff04c0b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.022+0000 7ff0539ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0c9ba0 con 0x7ff04c160a50 2023-06-23T19:01:34.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.022+0000 7ff0539ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0ca370 con 0x7ff04c15c570 2023-06-23T19:01:34.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.022+0000 7ff0539ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0cb7a0 con 0x7ff04c0cd660 2023-06-23T19:01:34.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff051f9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c160a50 0x7ff04c0b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff051f9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c160a50 0x7ff04c0b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46026/0 (socket says 172.21.15.136:46026) 2023-06-23T19:01:34.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff051f9c700 1 -- 172.21.15.136:0/2693522000 learned_addr learned my addr 172.21.15.136:0/2693522000 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff05179b700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff04c0cd660 0x7ff04c0b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff050f9a700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff04c15c570 0x7ff04c0b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff051f9c700 1 -- 172.21.15.136:0/2693522000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff04c0cd660 msgr2=0x7ff04c0b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff051f9c700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff04c0cd660 0x7ff04c0b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff051f9c700 1 -- 172.21.15.136:0/2693522000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff04c15c570 msgr2=0x7ff04c0b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff051f9c700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff04c15c570 0x7ff04c0b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff051f9c700 1 -- 172.21.15.136:0/2693522000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048009550 con 0x7ff04c160a50 2023-06-23T19:01:34.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff051f9c700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c160a50 0x7ff04c0b7480 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff04400efc0 tx=0x7ff04400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff041ffb700 1 -- 172.21.15.136:0/2693522000 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04400cad0 con 0x7ff04c160a50 2023-06-23T19:01:34.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff041ffb700 1 -- 172.21.15.136:0/2693522000 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04400f040 con 0x7ff04c160a50 2023-06-23T19:01:34.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.023+0000 7ff041ffb700 1 -- 172.21.15.136:0/2693522000 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04400ce70 con 0x7ff04c160a50 2023-06-23T19:01:34.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.024+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c0c9db0 con 0x7ff04c160a50 2023-06-23T19:01:34.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.024+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c0cba40 con 0x7ff04c160a50 2023-06-23T19:01:34.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.025+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c15da70 con 0x7ff04c160a50 2023-06-23T19:01:34.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.026+0000 7ff041ffb700 1 -- 172.21.15.136:0/2693522000 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff044014480 con 0x7ff04c160a50 2023-06-23T19:01:34.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.026+0000 7ff041ffb700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff03006ace0 0x7ff03006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.027+0000 7ff041ffb700 1 -- 172.21.15.136:0/2693522000 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff04408a240 con 0x7ff04c160a50 2023-06-23T19:01:34.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.027+0000 7ff05179b700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff03006ace0 0x7ff03006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.027+0000 7ff05179b700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff03006ace0 0x7ff03006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff048009c10 tx=0x7ff048008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.031+0000 7ff041ffb700 1 -- 172.21.15.136:0/2693522000 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff04c15da70 con 0x7ff04c160a50 2023-06-23T19:01:34.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.230+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff04c15da70 con 0x7ff04c160a50 2023-06-23T19:01:34.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.232+0000 7ff041ffb700 1 -- 172.21.15.136:0/2693522000 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7ff04c15da70 con 0x7ff04c160a50 2023-06-23T19:01:34.236 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:34.236 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:34.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff03006ace0 msgr2=0x7ff03006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff03006ace0 0x7ff03006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff048009c10 tx=0x7ff048008030 comp rx=0 tx=0).stop 2023-06-23T19:01:34.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c160a50 msgr2=0x7ff04c0b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c160a50 0x7ff04c0b7480 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff04400efc0 tx=0x7ff04400c0c0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 shutdown_connections 2023-06-23T19:01:34.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff03006ace0 0x7ff03006d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04c160a50 0x7ff04c0b7480 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff04c0cd660 0x7ff04c0b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 --2- 172.21.15.136:0/2693522000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff04c15c570 0x7ff04c0b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 >> 172.21.15.136:0/2693522000 conn(0x7ff04c071620 msgr2=0x7ff04c15dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 shutdown_connections 2023-06-23T19:01:34.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.234+0000 7ff0539ff700 1 -- 172.21.15.136:0/2693522000 wait complete. 2023-06-23T19:01:34.257 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-23T19:01:34.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-23T19:01:34.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-23T19:01:34.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-23T19:01:34.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-23T19:01:34.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-23T19:01:34.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-23T19:01:34.261 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-23T19:01:34.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.595+0000 7effd3dff700 1 Processor -- start 2023-06-23T19:01:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.595+0000 7effd3dff700 1 -- start start 2023-06-23T19:01:34.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.598+0000 7effd3dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc0c1800 0x7effcc0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.598+0000 7effd3dff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7effcc164200 0x7effcc164680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.598+0000 7effd3dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effcc06c290 con 0x7effcc160590 2023-06-23T19:01:34.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.598+0000 7effd3dff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effcc164bc0 con 0x7effcc164200 2023-06-23T19:01:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.598+0000 7effd3dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0ce330 con 0x7effcc0c1800 2023-06-23T19:01:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.599+0000 7effd139a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc0c1800 0x7effcc0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.599+0000 7effd139a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc0c1800 0x7effcc0cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54780/0 (socket says 172.21.15.136:54780) 2023-06-23T19:01:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.599+0000 7effd139a700 1 -- 172.21.15.136:0/1136167208 learned_addr learned my addr 172.21.15.136:0/1136167208 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.599+0000 7effd139a700 1 -- 172.21.15.136:0/1136167208 >> v2:172.21.15.178:3300/0 conn(0x7effcc164200 msgr2=0x7effcc164680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:01:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.600+0000 7effd139a700 1 --2- 172.21.15.136:0/1136167208 >> v2:172.21.15.178:3300/0 conn(0x7effcc164200 0x7effcc164680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.600+0000 7effd139a700 1 -- 172.21.15.136:0/1136167208 >> v1:172.21.15.136:6789/0 conn(0x7effcc160590 legacy=0x7effcc06c720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:01:34.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.600+0000 7effd139a700 1 -- 172.21.15.136:0/1136167208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc0c1f70 con 0x7effcc0c1800 2023-06-23T19:01:34.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.600+0000 7effd139a700 1 --2- 172.21.15.136:0/1136167208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc0c1800 0x7effcc0cddf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effbc0098f0 tx=0x7effbc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839dfe3ce4c6c589 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.600+0000 7effd0b99700 1 -- 172.21.15.136:0/1136167208 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc004230 con 0x7effcc0c1800 2023-06-23T19:01:34.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.601+0000 7effd0b99700 1 -- 172.21.15.136:0/1136167208 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc004390 con 0x7effcc0c1800 2023-06-23T19:01:34.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.601+0000 7effd0b99700 1 -- 172.21.15.136:0/1136167208 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc0036a0 con 0x7effcc0c1800 2023-06-23T19:01:34.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.605+0000 7effd3dff700 1 -- 172.21.15.136:0/1136167208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc0c1800 msgr2=0x7effcc0cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.605+0000 7effd3dff700 1 --2- 172.21.15.136:0/1136167208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc0c1800 0x7effcc0cddf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effbc0098f0 tx=0x7effbc009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:34.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.606+0000 7effd3dff700 1 -- 172.21.15.136:0/1136167208 shutdown_connections 2023-06-23T19:01:34.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.606+0000 7effd3dff700 1 --2- 172.21.15.136:0/1136167208 >> v2:172.21.15.178:3300/0 conn(0x7effcc164200 0x7effcc164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.606+0000 7effd3dff700 1 --2- 172.21.15.136:0/1136167208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc0c1800 0x7effcc0cddf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.606+0000 7effd3dff700 1 -- 172.21.15.136:0/1136167208 >> 172.21.15.136:0/1136167208 conn(0x7effcc0b0ef0 msgr2=0x7effcc0ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.606+0000 7effd3dff700 1 -- 172.21.15.136:0/1136167208 shutdown_connections 2023-06-23T19:01:34.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.606+0000 7effd3dff700 1 -- 172.21.15.136:0/1136167208 wait complete. 2023-06-23T19:01:34.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.609+0000 7effd3dff700 1 Processor -- start 2023-06-23T19:01:34.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.609+0000 7effd3dff700 1 -- start start 2023-06-23T19:01:34.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.610+0000 7effd3dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effcc0c1800 0x7effcc1ec770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.610+0000 7effd3dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc160590 0x7effcc163320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.610+0000 7effd3dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effcc164200 0x7effcc15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.610+0000 7effd3dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc163860 con 0x7effcc0c1800 2023-06-23T19:01:34.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.610+0000 7effd3dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc1eb6d0 con 0x7effcc164200 2023-06-23T19:01:34.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.610+0000 7effd3dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc1eb9b0 con 0x7effcc160590 2023-06-23T19:01:34.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.611+0000 7effd139a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc160590 0x7effcc163320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.611+0000 7effd139a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc160590 0x7effcc163320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54790/0 (socket says 172.21.15.136:54790) 2023-06-23T19:01:34.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.611+0000 7effd139a700 1 -- 172.21.15.136:0/3430002995 learned_addr learned my addr 172.21.15.136:0/3430002995 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.611+0000 7effd239c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effcc164200 0x7effcc15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.611+0000 7effd139a700 1 -- 172.21.15.136:0/3430002995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effcc164200 msgr2=0x7effcc15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.611+0000 7effd139a700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effcc164200 0x7effcc15ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.611+0000 7effd139a700 1 -- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effcc0c1800 msgr2=0x7effcc1ec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.611+0000 7effd139a700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effcc0c1800 0x7effcc1ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.611+0000 7effd139a700 1 -- 172.21.15.136:0/3430002995 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc009550 con 0x7effcc160590 2023-06-23T19:01:34.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.612+0000 7effd139a700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc160590 0x7effcc163320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effbc000c00 tx=0x7effbc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.612+0000 7f3fde1ff700 1 Processor -- start 2023-06-23T19:01:34.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.612+0000 7effc27fc700 1 -- 172.21.15.136:0/3430002995 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00b660 con 0x7effcc160590 2023-06-23T19:01:34.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.613+0000 7effc27fc700 1 -- 172.21.15.136:0/3430002995 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc00b7c0 con 0x7effcc160590 2023-06-23T19:01:34.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.613+0000 7effc27fc700 1 -- 172.21.15.136:0/3430002995 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00bb50 con 0x7effcc160590 2023-06-23T19:01:34.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.613+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc1ebc90 con 0x7effcc160590 2023-06-23T19:01:34.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.613+0000 7f3fde1ff700 1 -- start start 2023-06-23T19:01:34.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.613+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc1ec250 con 0x7effcc160590 2023-06-23T19:01:34.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.614+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effcc0cc400 con 0x7effcc160590 2023-06-23T19:01:34.621 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.614+0000 7fd399fff700 1 Processor -- start 2023-06-23T19:01:34.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.616+0000 7f3fde1ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3fd80b0d40 0x7f3fd8159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.616+0000 7f3fde1ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3fd80cb4e0 0x7f3fd80cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.616+0000 7f3fde1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd815f0a0 con 0x7f3fd80cc260 2023-06-23T19:01:34.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.616+0000 7f3fde1ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd81586a0 con 0x7f3fd80cb4e0 2023-06-23T19:01:34.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.616+0000 7f3fde1ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd80cbea0 con 0x7f3fd80b0d40 2023-06-23T19:01:34.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.616+0000 7efec4dff700 1 Processor -- start 2023-06-23T19:01:34.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.616+0000 7efec4dff700 1 -- start start 2023-06-23T19:01:34.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.617+0000 7f3fd7fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3fd80cc260 0x7f3fd80cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:39806/0 (socket says 172.21.15.136:39806) 2023-06-23T19:01:34.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.617+0000 7f3fd7fff700 1 -- 172.21.15.136:0/3104513268 learned_addr learned my addr 172.21.15.136:0/3104513268 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:34.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.617+0000 7f3fd77fe700 1 --2- 172.21.15.136:0/3104513268 >> v2:172.21.15.178:3300/0 conn(0x7f3fd80b0d40 0x7f3fd8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7f3fd67fc700 1 -- 172.21.15.136:0/3104513268 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216872797 0 0) 0x7f3fd815f0a0 con 0x7f3fd80cc260 2023-06-23T19:01:34.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7f3fd67fc700 1 -- 172.21.15.136:0/3104513268 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc00035b0 con 0x7f3fd80cc260 2023-06-23T19:01:34.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7f3fd77fe700 1 -- 172.21.15.136:0/3104513268 >> v2:172.21.15.136:3300/0 conn(0x7f3fd80cb4e0 msgr2=0x7f3fd80cb960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:01:34.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7f3fd77fe700 1 --2- 172.21.15.136:0/3104513268 >> v2:172.21.15.136:3300/0 conn(0x7f3fd80cb4e0 0x7f3fd80cb960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7f3fd77fe700 1 -- 172.21.15.136:0/3104513268 >> v1:172.21.15.178:6789/0 conn(0x7f3fd80cc260 legacy=0x7f3fd80cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7f3fd77fe700 1 -- 172.21.15.136:0/3104513268 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd815bfd0 con 0x7f3fd80b0d40 2023-06-23T19:01:34.628 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7f3fd77fe700 1 --2- 172.21.15.136:0/3104513268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd80b0d40 0x7f3fd8159000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80b4820 tx=0x7f3fd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3657748bf5ec0f82 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.628 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7f3fd67fc700 1 -- 172.21.15.136:0/3104513268 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000e070 con 0x7f3fd80b0d40 2023-06-23T19:01:34.628 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7f3fd67fc700 1 -- 172.21.15.136:0/3104513268 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000bae0 con 0x7f3fd80b0d40 2023-06-23T19:01:34.629 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7f3fd67fc700 1 -- 172.21.15.136:0/3104513268 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000be90 con 0x7f3fd80b0d40 2023-06-23T19:01:34.629 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7f3fde1ff700 1 -- 172.21.15.136:0/3104513268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd80b0d40 msgr2=0x7f3fd8159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.629 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7f3fde1ff700 1 --2- 172.21.15.136:0/3104513268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd80b0d40 0x7f3fd8159000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80b4820 tx=0x7f3fd000b330 comp rx=0 tx=0).stop 2023-06-23T19:01:34.629 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7f3fde1ff700 1 -- 172.21.15.136:0/3104513268 shutdown_connections 2023-06-23T19:01:34.630 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7f3fde1ff700 1 --2- 172.21.15.136:0/3104513268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd80b0d40 0x7f3fd8159000 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.630 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7f3fde1ff700 1 --2- 172.21.15.136:0/3104513268 >> v2:172.21.15.136:3300/0 conn(0x7f3fd80cb4e0 0x7f3fd80cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.630 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7f3fde1ff700 1 -- 172.21.15.136:0/3104513268 >> 172.21.15.136:0/3104513268 conn(0x7f3fd80b0260 msgr2=0x7f3fd80b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.630 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7fd399fff700 1 -- start start 2023-06-23T19:01:34.631 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7efec4dff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efec006a160 0x7efec016c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.631 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7efec4dff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efec006a530 0x7efec016cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.631 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7efec4dff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec00cc260 con 0x7efec00893f0 2023-06-23T19:01:34.631 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7efec4dff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec0169370 con 0x7efec006a530 2023-06-23T19:01:34.631 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7efec4dff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec00cdf80 con 0x7efec006a160 2023-06-23T19:01:34.631 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7efebed9d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7efec00893f0 0x7efec006ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:39818/0 (socket says 172.21.15.136:39818) 2023-06-23T19:01:34.632 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7efebed9d700 1 -- 172.21.15.136:0/3061974560 learned_addr learned my addr 172.21.15.136:0/3061974560 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:34.632 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7efebe59c700 1 --2- 172.21.15.136:0/3061974560 >> v2:172.21.15.178:3300/0 conn(0x7efec006a160 0x7efec016c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.632 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7efeb7fff700 1 --2- 172.21.15.136:0/3061974560 >> v2:172.21.15.136:3300/0 conn(0x7efec006a530 0x7efec016cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.633 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.621+0000 7f97405ff700 1 Processor -- start 2023-06-23T19:01:34.633 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.617+0000 7effc27fc700 1 -- 172.21.15.136:0/3430002995 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7effbc00bcb0 con 0x7effcc160590 2023-06-23T19:01:34.633 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.618+0000 7effc27fc700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7effb006adb0 0x7effb006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.633 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7effc27fc700 1 -- 172.21.15.136:0/3430002995 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7effbc08ac10 con 0x7effcc160590 2023-06-23T19:01:34.633 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7effc27fc700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6807/3924036391,v1:172.21.15.136:6809/3924036391] conn(0x7effb0074a80 0x7effb0076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.634 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7effc27fc700 1 -- 172.21.15.136:0/3430002995 --> [v2:172.21.15.136:6807/3924036391,v1:172.21.15.136:6809/3924036391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effb0077580 con 0x7effb0074a80 2023-06-23T19:01:34.634 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.619+0000 7effc27fc700 1 -- 172.21.15.136:0/3430002995 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7effbc08afc0 con 0x7effcc160590 2023-06-23T19:01:34.634 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7effd1b9b700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7effb006adb0 0x7effb006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.634 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7fd399fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd39415c570 0x7fd3940cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.634 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7fd399fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3940cd660 0x7fd394160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7fd399fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3940cdab0 con 0x7fd394160880 2023-06-23T19:01:34.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7fd399fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39415d670 con 0x7fd39415c570 2023-06-23T19:01:34.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.620+0000 7fd399fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3941610a0 con 0x7fd3940cd660 2023-06-23T19:01:34.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.621+0000 7fd393fff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd394160880 0x7fd39406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53008/0 (socket says 172.21.15.136:53008) 2023-06-23T19:01:34.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.621+0000 7fd393fff700 1 -- 172.21.15.136:0/2571891527 learned_addr learned my addr 172.21.15.136:0/2571891527 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:34.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.621+0000 7fd3937fe700 1 --2- 172.21.15.136:0/2571891527 >> v2:172.21.15.136:3300/0 conn(0x7fd39415c570 0x7fd3940cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.622+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722650248 0 0) 0x7fd38c001490 con 0x7fd394160880 2023-06-23T19:01:34.636 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.622+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd37c0035b0 con 0x7fd394160880 2023-06-23T19:01:34.636 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.621+0000 7f97405ff700 1 -- start start 2023-06-23T19:01:34.636 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.622+0000 7efebe59c700 1 -- 172.21.15.136:0/3061974560 >> v2:172.21.15.136:3300/0 conn(0x7efec006a530 msgr2=0x7efec016cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:34.636 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.622+0000 7efebe59c700 1 --2- 172.21.15.136:0/3061974560 >> v2:172.21.15.136:3300/0 conn(0x7efec006a530 0x7efec016cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.622+0000 7efebe59c700 1 -- 172.21.15.136:0/3061974560 >> v1:172.21.15.178:6789/0 conn(0x7efec00893f0 legacy=0x7efec006ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.622+0000 7efebe59c700 1 -- 172.21.15.136:0/3061974560 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec00ade80 con 0x7efec006a160 2023-06-23T19:01:34.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.622+0000 7efebe59c700 1 --2- 172.21.15.136:0/3061974560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec006a160 0x7efec016c9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efec00704e0 tx=0x7efea8009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a93fce0192df0bbb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.621+0000 7f3fde1ff700 1 -- 172.21.15.136:0/3104513268 shutdown_connections 2023-06-23T19:01:34.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.622+0000 7f3fde1ff700 1 -- 172.21.15.136:0/3104513268 wait complete. 2023-06-23T19:01:34.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4184170778 0 0) 0x7fd37c0035b0 con 0x7fd394160880 2023-06-23T19:01:34.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3940cd660 msgr2=0x7fd394160340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:01:34.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 --2- 172.21.15.136:0/2571891527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3940cd660 0x7fd394160340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 >> v2:172.21.15.136:3300/0 conn(0x7fd39415c570 msgr2=0x7fd3940cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:34.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 --2- 172.21.15.136:0/2571891527 >> v2:172.21.15.136:3300/0 conn(0x7fd39415c570 0x7fd3940cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39415da90 con 0x7fd394160880 2023-06-23T19:01:34.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fd38c001b80 con 0x7fd394160880 2023-06-23T19:01:34.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 >> v1:172.21.15.136:6789/0 conn(0x7fd394160880 legacy=0x7fd39406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 --2- 172.21.15.136:0/2571891527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c003a00 0x7fd37c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 --2- 172.21.15.136:0/2571891527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c004850 0x7fd37c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 --2- 172.21.15.136:0/2571891527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37c005200 0x7fd37c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7f97405ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97380b0d40 0x7f9738159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39415d670 con 0x7fd37c005200 2023-06-23T19:01:34.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3941610a0 con 0x7fd37c004850 2023-06-23T19:01:34.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c00c130 con 0x7fd37c003a00 2023-06-23T19:01:34.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7f97405ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973815bd30 con 0x7f97380cb4e0 2023-06-23T19:01:34.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7f97405ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973815bfd0 con 0x7f97380cc970 2023-06-23T19:01:34.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.623+0000 7f97405ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97381586a0 con 0x7f97380b0d40 2023-06-23T19:01:34.642 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7effd1b9b700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7effb006adb0 0x7effb006d260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7effc8009770 tx=0x7effc8006cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.642 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7effd239c700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6807/3924036391,v1:172.21.15.136:6809/3924036391] conn(0x7effb0074a80 0x7effb0076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.642 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7fd393fff700 1 --2- 172.21.15.136:0/2571891527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37c005200 0x7fd37c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7f973eb9c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f97380cc970 0x7f97381630c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:39828/0 (socket says 172.21.15.136:39828) 2023-06-23T19:01:34.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7f973eb9c700 1 -- 172.21.15.136:0/1861279262 learned_addr learned my addr 172.21.15.136:0/1861279262 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:34.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7f3fde1ff700 1 Processor -- start 2023-06-23T19:01:34.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7f973e39b700 1 --2- 172.21.15.136:0/1861279262 >> v2:172.21.15.136:3300/0 conn(0x7f97380b0d40 0x7f9738159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7effd239c700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6807/3924036391,v1:172.21.15.136:6809/3924036391] conn(0x7effb0074a80 0x7effb0076eb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7fd393fff700 1 -- 172.21.15.136:0/2571891527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c003a00 msgr2=0x7fd37c003e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T19:01:34.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7fd393fff700 1 --2- 172.21.15.136:0/2571891527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c003a00 0x7fd37c003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7fd393fff700 1 -- 172.21.15.136:0/2571891527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c004850 msgr2=0x7fd37c004cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T19:01:34.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7fd393fff700 1 --2- 172.21.15.136:0/2571891527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c004850 0x7fd37c004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7fd393fff700 1 -- 172.21.15.136:0/2571891527 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0035b0 con 0x7fd37c005200 2023-06-23T19:01:34.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7fd393fff700 1 --2- 172.21.15.136:0/2571891527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37c005200 0x7fd37c00ba10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00a780 tx=0x7fd37c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e13dee9dd05202 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7f973d399700 1 -- 172.21.15.136:0/1861279262 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378978443 0 0) 0x7f973815bfd0 con 0x7f97380cc970 2023-06-23T19:01:34.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7f973d399700 1 -- 172.21.15.136:0/1861279262 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97240035b0 con 0x7f97380cc970 2023-06-23T19:01:34.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7efebdd9b700 1 -- 172.21.15.136:0/3061974560 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8004230 con 0x7efec006a160 2023-06-23T19:01:34.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7efebdd9b700 1 -- 172.21.15.136:0/3061974560 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea8004390 con 0x7efec006a160 2023-06-23T19:01:34.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.624+0000 7efebdd9b700 1 -- 172.21.15.136:0/3061974560 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea80036a0 con 0x7efec006a160 2023-06-23T19:01:34.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7efec4dff700 1 -- 172.21.15.136:0/3061974560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec006a160 msgr2=0x7efec016c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7efec4dff700 1 --2- 172.21.15.136:0/3061974560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec006a160 0x7efec016c9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efec00704e0 tx=0x7efea8009b20 comp rx=0 tx=0).stop 2023-06-23T19:01:34.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7f3fde1ff700 1 -- start start 2023-06-23T19:01:34.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7efec4dff700 1 -- 172.21.15.136:0/3061974560 shutdown_connections 2023-06-23T19:01:34.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7efec4dff700 1 --2- 172.21.15.136:0/3061974560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec006a160 0x7efec016c9d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7efec4dff700 1 --2- 172.21.15.136:0/3061974560 >> v2:172.21.15.136:3300/0 conn(0x7efec006a530 0x7efec016cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7efec4dff700 1 -- 172.21.15.136:0/3061974560 >> 172.21.15.136:0/3061974560 conn(0x7efec00b0260 msgr2=0x7efec00b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7f973e39b700 1 -- 172.21.15.136:0/1861279262 >> v1:172.21.15.178:6789/0 conn(0x7f97380cc970 legacy=0x7f97381630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7f973e39b700 1 -- 172.21.15.136:0/1861279262 >> v1:172.21.15.136:6789/0 conn(0x7f97380cb4e0 legacy=0x7f97380cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7f973e39b700 1 -- 172.21.15.136:0/1861279262 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973815c2b0 con 0x7f97380b0d40 2023-06-23T19:01:34.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.625+0000 7efec4dff700 1 -- 172.21.15.136:0/3061974560 shutdown_connections 2023-06-23T19:01:34.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0072d0 con 0x7fd37c005200 2023-06-23T19:01:34.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c007430 con 0x7fd37c005200 2023-06-23T19:01:34.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7fd3927fc700 1 -- 172.21.15.136:0/2571891527 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0077e0 con 0x7fd37c005200 2023-06-23T19:01:34.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7f973e39b700 1 --2- 172.21.15.136:0/1861279262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97380b0d40 0x7f9738159270 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f973400bae0 tx=0x7f973400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5b5ff5d4880138 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7effc27fc700 1 -- 172.21.15.136:0/3430002995 <== osd.1 v2:172.21.15.136:6807/3924036391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7effb0077580 con 0x7effb0074a80 2023-06-23T19:01:34.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7f973d399700 1 -- 172.21.15.136:0/1861279262 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973400dc70 con 0x7f97380b0d40 2023-06-23T19:01:34.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7f3fde1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd80b0d40 0x7f3fd80c1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7f3fde1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80cb4e0 0x7f3fd8140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7f973d399700 1 -- 172.21.15.136:0/1861279262 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973400ddd0 con 0x7f97380b0d40 2023-06-23T19:01:34.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7f973d399700 1 -- 172.21.15.136:0/1861279262 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734010690 con 0x7f97380b0d40 2023-06-23T19:01:34.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7f3fde1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd80cc260 0x7f3fd8141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7f3fde1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8148fd0 con 0x7f3fd80cc260 2023-06-23T19:01:34.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7f3fde1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd813f720 con 0x7f3fd80b0d40 2023-06-23T19:01:34.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7f3fde1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd81415b0 con 0x7f3fd80cb4e0 2023-06-23T19:01:34.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7fd399fff700 1 -- 172.21.15.136:0/2571891527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37c005200 msgr2=0x7fd37c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7fd399fff700 1 --2- 172.21.15.136:0/2571891527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37c005200 0x7fd37c00ba10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00a780 tx=0x7fd37c005880 comp rx=0 tx=0).stop 2023-06-23T19:01:34.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7fd393fff700 1 -- 172.21.15.136:0/2571891527 reap_dead start 2023-06-23T19:01:34.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7fd399fff700 1 -- 172.21.15.136:0/2571891527 shutdown_connections 2023-06-23T19:01:34.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7fd399fff700 1 -- 172.21.15.136:0/2571891527 >> 172.21.15.136:0/2571891527 conn(0x7fd394071620 msgr2=0x7fd3940719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7f3fd77fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd80b0d40 0x7f3fd80c1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7f3fd77fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd80b0d40 0x7f3fd80c1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:36074/0 (socket says 172.21.15.136:36074) 2023-06-23T19:01:34.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7f3fd77fe700 1 -- 172.21.15.136:0/181905321 learned_addr learned my addr 172.21.15.136:0/181905321 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7f3fd7fff700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd80cc260 0x7f3fd8141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f97405ff700 1 -- 172.21.15.136:0/1861279262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97380b0d40 msgr2=0x7f9738159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f97405ff700 1 --2- 172.21.15.136:0/1861279262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97380b0d40 0x7f9738159270 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f973400bae0 tx=0x7f973400bdf0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f97405ff700 1 -- 172.21.15.136:0/1861279262 shutdown_connections 2023-06-23T19:01:34.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f97405ff700 1 --2- 172.21.15.136:0/1861279262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97380b0d40 0x7f9738159270 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f97405ff700 1 -- 172.21.15.136:0/1861279262 >> 172.21.15.136:0/1861279262 conn(0x7f97380b0260 msgr2=0x7f97380b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7f23c79ff700 1 Processor -- start 2023-06-23T19:01:34.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.627+0000 7f23c79ff700 1 -- start start 2023-06-23T19:01:34.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f3fd6ffd700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80cb4e0 0x7f3fd8140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f3fd7fff700 1 -- 172.21.15.136:0/181905321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80cb4e0 msgr2=0x7f3fd8140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f3fd7fff700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80cb4e0 0x7f3fd8140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f3fd7fff700 1 -- 172.21.15.136:0/181905321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd80b0d40 msgr2=0x7f3fd80c1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f3fd7fff700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd80b0d40 0x7f3fd80c1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f3fd7fff700 1 -- 172.21.15.136:0/181905321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009a70 con 0x7f3fd80cc260 2023-06-23T19:01:34.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f3fd6ffd700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80cb4e0 0x7f3fd8140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:34.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.628+0000 7f3fd7fff700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd80cc260 0x7f3fd8141070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc000c00 tx=0x7f3fcc00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.626+0000 7efec4dff700 1 -- 172.21.15.136:0/3061974560 wait complete. 2023-06-23T19:01:34.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.629+0000 7efec4dff700 1 Processor -- start 2023-06-23T19:01:34.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f3fbffff700 1 -- 172.21.15.136:0/181905321 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00cea0 con 0x7f3fd80cc260 2023-06-23T19:01:34.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f3fbffff700 1 -- 172.21.15.136:0/181905321 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc004c80 con 0x7f3fd80cc260 2023-06-23T19:01:34.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f3fbffff700 1 -- 172.21.15.136:0/181905321 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc0070d0 con 0x7f3fd80cc260 2023-06-23T19:01:34.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.631+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd80ca540 con 0x7f3fd80cc260 2023-06-23T19:01:34.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.631+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd80ae420 con 0x7f3fd80cc260 2023-06-23T19:01:34.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.629+0000 7f97405ff700 1 -- 172.21.15.136:0/1861279262 shutdown_connections 2023-06-23T19:01:34.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.629+0000 7f97405ff700 1 -- 172.21.15.136:0/1861279262 wait complete. 2023-06-23T19:01:34.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7f97405ff700 1 Processor -- start 2023-06-23T19:01:34.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7f97405ff700 1 -- start start 2023-06-23T19:01:34.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7f97405ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97380b0d40 0x7f97380c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7f97405ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97380cb4e0 0x7f9738153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f97405ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97380cc970 0x7f97381e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f97405ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380c9ef0 con 0x7f97380cc970 2023-06-23T19:01:34.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f97405ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97381542e0 con 0x7f97380b0d40 2023-06-23T19:01:34.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f97405ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380c9270 con 0x7f97380cb4e0 2023-06-23T19:01:34.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f973db9a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97380cb4e0 0x7f9738153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f973e39b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97380b0d40 0x7f97380c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f973db9a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97380cb4e0 0x7f9738153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54852/0 (socket says 172.21.15.136:54852) 2023-06-23T19:01:34.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f973db9a700 1 -- 172.21.15.136:0/1937868726 learned_addr learned my addr 172.21.15.136:0/1937868726 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f973eb9c700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97380cc970 0x7f97381e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f23c79ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f23c01605d0 0x7f23c006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f23c79ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f23c00c18c0 0x7f23c01641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f23c79ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 0x7f23c00cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f23c79ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c00cbd10 con 0x7f23c01605d0 2023-06-23T19:01:34.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f23c79ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c006d280 con 0x7f23c00c18c0 2023-06-23T19:01:34.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f23c79ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00cdd50 con 0x7f23c00cb350 2023-06-23T19:01:34.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7f23c579b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f23c01605d0 0x7f23c006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.631+0000 7f23c579b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f23c01605d0 0x7f23c006a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46086/0 (socket says 172.21.15.136:46086) 2023-06-23T19:01:34.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.631+0000 7f23c579b700 1 -- 172.21.15.136:0/3342084068 learned_addr learned my addr 172.21.15.136:0/3342084068 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.631+0000 7f23c5f9c700 1 --2- 172.21.15.136:0/3342084068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 0x7f23c00cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.631+0000 7f23c4f9a700 1 --2- 172.21.15.136:0/3342084068 >> v2:172.21.15.178:3300/0 conn(0x7f23c00c18c0 0x7f23c01641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7f23c579b700 1 -- 172.21.15.136:0/3342084068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 msgr2=0x7f23c00cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:34.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7f23c579b700 1 --2- 172.21.15.136:0/3342084068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 0x7f23c00cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7f23c579b700 1 -- 172.21.15.136:0/3342084068 >> v2:172.21.15.178:3300/0 conn(0x7f23c00c18c0 msgr2=0x7f23c01641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:34.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7f23c579b700 1 --2- 172.21.15.136:0/3342084068 >> v2:172.21.15.178:3300/0 conn(0x7f23c00c18c0 0x7f23c01641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7f23c579b700 1 -- 172.21.15.136:0/3342084068 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c00cc640 con 0x7f23c01605d0 2023-06-23T19:01:34.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7f23c579b700 1 --2- 172.21.15.136:0/3342084068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23c01605d0 0x7f23c006a900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23c00c16f0 tx=0x7f23b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0a456c9c809ffd server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7f23b7fff700 1 -- 172.21.15.136:0/3342084068 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800e070 con 0x7f23c01605d0 2023-06-23T19:01:34.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7f23b7fff700 1 -- 172.21.15.136:0/3342084068 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b800b910 con 0x7f23c01605d0 2023-06-23T19:01:34.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7f23b7fff700 1 -- 172.21.15.136:0/3342084068 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800bcc0 con 0x7f23c01605d0 2023-06-23T19:01:34.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f23c79ff700 1 -- 172.21.15.136:0/3342084068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23c01605d0 msgr2=0x7f23c006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f23c79ff700 1 --2- 172.21.15.136:0/3342084068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23c01605d0 0x7f23c006a900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23c00c16f0 tx=0x7f23b800b330 comp rx=0 tx=0).stop 2023-06-23T19:01:34.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f23c79ff700 1 -- 172.21.15.136:0/3342084068 shutdown_connections 2023-06-23T19:01:34.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f23c79ff700 1 --2- 172.21.15.136:0/3342084068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 0x7f23c00cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f23c79ff700 1 --2- 172.21.15.136:0/3342084068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23c01605d0 0x7f23c006a900 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f23c79ff700 1 --2- 172.21.15.136:0/3342084068 >> v2:172.21.15.178:3300/0 conn(0x7f23c00c18c0 0x7f23c01641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7f23c79ff700 1 -- 172.21.15.136:0/3342084068 >> 172.21.15.136:0/3342084068 conn(0x7f23c00b0260 msgr2=0x7f23c00b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.629+0000 7efec4dff700 1 -- start start 2023-06-23T19:01:34.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7efec4dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec006a160 0x7efec006d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7efec4dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec006a530 0x7efec0166580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7efec4dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec00893f0 0x7efec0164520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7efec4dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec01642f0 con 0x7efec006a160 2023-06-23T19:01:34.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7efec4dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec0163d30 con 0x7efec00893f0 2023-06-23T19:01:34.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.630+0000 7efec4dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec0164010 con 0x7efec006a530 2023-06-23T19:01:34.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7efebed9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec00893f0 0x7efec0164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7efebe59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec006a160 0x7efec006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7efebe59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec006a160 0x7efec006d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46102/0 (socket says 172.21.15.136:46102) 2023-06-23T19:01:34.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.632+0000 7efebe59c700 1 -- 172.21.15.136:0/919473405 learned_addr learned my addr 172.21.15.136:0/919473405 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7efebed9d700 1 -- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec006a530 msgr2=0x7efec0166580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-23T19:01:34.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7efebed9d700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec006a530 0x7efec0166580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7efebed9d700 1 -- 172.21.15.136:0/919473405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec006a160 msgr2=0x7efec006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7efebed9d700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec006a160 0x7efec006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.633+0000 7efebed9d700 1 -- 172.21.15.136:0/919473405 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea80094a0 con 0x7efec00893f0 2023-06-23T19:01:34.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.634+0000 7efebed9d700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec00893f0 0x7efec0164520 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efeb800bac0 tx=0x7efeb800bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7f3fbffff700 1 -- 172.21.15.136:0/181905321 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3fcc007230 con 0x7f3fd80cc260 2023-06-23T19:01:34.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7f23c79ff700 1 -- 172.21.15.136:0/3342084068 shutdown_connections 2023-06-23T19:01:34.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7f23c79ff700 1 -- 172.21.15.136:0/3342084068 wait complete. 2023-06-23T19:01:34.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7fd399fff700 1 -- 172.21.15.136:0/2571891527 shutdown_connections 2023-06-23T19:01:34.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7f973eb9c700 1 -- 172.21.15.136:0/1937868726 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97380cb4e0 msgr2=0x7f9738153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7f973eb9c700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97380cb4e0 0x7f9738153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7f973eb9c700 1 -- 172.21.15.136:0/1937868726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97380b0d40 msgr2=0x7f97380c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7f973eb9c700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97380b0d40 0x7f97380c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7f973eb9c700 1 -- 172.21.15.136:0/1937868726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973400b740 con 0x7f97380cc970 2023-06-23T19:01:34.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7f973eb9c700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97380cc970 0x7f97381e2d00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f973000caa0 tx=0x7f973000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7f972effd700 1 -- 172.21.15.136:0/1937868726 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973000a9e0 con 0x7f97380cc970 2023-06-23T19:01:34.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7f972effd700 1 -- 172.21.15.136:0/1937868726 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973000ab40 con 0x7f97380cc970 2023-06-23T19:01:34.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97380c9550 con 0x7f97380cc970 2023-06-23T19:01:34.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97380c9b10 con 0x7f97380cc970 2023-06-23T19:01:34.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7f972effd700 1 -- 172.21.15.136:0/1937868726 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730012400 con 0x7f97380cc970 2023-06-23T19:01:34.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.637+0000 7f23c79ff700 1 Processor -- start 2023-06-23T19:01:34.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7f3fbffff700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc006b1b0 0x7f3fc006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7f3fbffff700 1 -- 172.21.15.136:0/181905321 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3fcc089280 con 0x7f3fd80cc260 2023-06-23T19:01:34.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.637+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f971c000ff0 con 0x7f97380cc970 2023-06-23T19:01:34.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.635+0000 7fd399fff700 1 -- 172.21.15.136:0/2571891527 wait complete. 2023-06-23T19:01:34.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.638+0000 7fd399fff700 1 Processor -- start 2023-06-23T19:01:34.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7efeb6ffd700 1 -- 172.21.15.136:0/919473405 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb800ccf0 con 0x7efec00893f0 2023-06-23T19:01:34.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7efeb6ffd700 1 -- 172.21.15.136:0/919473405 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb800ce50 con 0x7efec00893f0 2023-06-23T19:01:34.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.636+0000 7efeb6ffd700 1 -- 172.21.15.136:0/919473405 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80156b0 con 0x7efec00893f0 2023-06-23T19:01:34.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.637+0000 7f3fd77fe700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc006b1b0 0x7f3fc006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.637+0000 7f23c79ff700 1 -- start start 2023-06-23T19:01:34.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.638+0000 7f3fd77fe700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc006b1b0 0x7f3fc006d660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0000f80 tx=0x7f3fd0011000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.639+0000 7f23c79ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 0x7f23c0157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.639+0000 7f23c79ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23c01605d0 0x7f23c01616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.639+0000 7f23c79ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0157800 0x7f23c00c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.639+0000 7f23c79ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c01584a0 con 0x7f23c01605d0 2023-06-23T19:01:34.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.639+0000 7f23c79ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c01eb150 con 0x7f23c0157800 2023-06-23T19:01:34.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.639+0000 7f23c79ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c01eb430 con 0x7f23c00cb350 2023-06-23T19:01:34.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f23c579b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 0x7f23c0157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f23c579b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 0x7f23c0157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54856/0 (socket says 172.21.15.136:54856) 2023-06-23T19:01:34.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f23c579b700 1 -- 172.21.15.136:0/3730633017 learned_addr learned my addr 172.21.15.136:0/3730633017 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f23c5f9c700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0157800 0x7f23c00c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.638+0000 7fd399fff700 1 -- start start 2023-06-23T19:01:34.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7fd399fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c005200 0x7fd394155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7fd399fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3940c9740 0x7fd3940ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7fd399fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3940cba10 0x7fd3940cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7fd399fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940cc3f0 con 0x7fd3940c9740 2023-06-23T19:01:34.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7fd399fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394155660 con 0x7fd37c005200 2023-06-23T19:01:34.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7fd399fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3941f6820 con 0x7fd3940cba10 2023-06-23T19:01:34.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f3fde1ff700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6822/1091078003,v1:172.21.15.136:6824/1091078003] conn(0x7f3fb80015e0 0x7f3fb8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 --> [v2:172.21.15.136:6822/1091078003,v1:172.21.15.136:6824/1091078003] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fb8006bc0 con 0x7f3fb80015e0 2023-06-23T19:01:34.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7fd393fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3940cba10 0x7fd3940cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7fd393fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3940cba10 0x7fd3940cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54866/0 (socket says 172.21.15.136:54866) 2023-06-23T19:01:34.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7fd393fff700 1 -- 172.21.15.136:0/3527660726 learned_addr learned my addr 172.21.15.136:0/3527660726 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f23c579b700 1 -- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0157800 msgr2=0x7f23c00c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f23c579b700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0157800 0x7f23c00c21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f23c579b700 1 -- 172.21.15.136:0/3730633017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23c01605d0 msgr2=0x7f23c01616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f23c579b700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23c01605d0 0x7f23c01616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.640+0000 7f23c579b700 1 -- 172.21.15.136:0/3730633017 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8009b30 con 0x7f23c00cb350 2023-06-23T19:01:34.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7fd3937fe700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c005200 0x7fd394155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7f972effd700 1 -- 172.21.15.136:0/1937868726 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f973001b3b0 con 0x7f97380cc970 2023-06-23T19:01:34.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7f3fd6ffd700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6822/1091078003,v1:172.21.15.136:6824/1091078003] conn(0x7f3fb80015e0 0x7f3fb8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7f23c579b700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 0x7f23c0157c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23c00cc0b0 tx=0x7f23b8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7fd393fff700 1 -- 172.21.15.136:0/3527660726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c005200 msgr2=0x7fd394155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7fd393fff700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c005200 0x7fd394155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7fd393fff700 1 -- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3940c9740 msgr2=0x7fd3940ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7fd393fff700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3940c9740 0x7fd3940ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.641+0000 7fd393fff700 1 -- 172.21.15.136:0/3527660726 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940caee0 con 0x7fd3940cba10 2023-06-23T19:01:34.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.642+0000 7f23b5ffb700 1 -- 172.21.15.136:0/3730633017 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800ce80 con 0x7f23c00cb350 2023-06-23T19:01:34.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.642+0000 7f23b5ffb700 1 -- 172.21.15.136:0/3730633017 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b8004250 con 0x7f23c00cb350 2023-06-23T19:01:34.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.642+0000 7f23b5ffb700 1 -- 172.21.15.136:0/3730633017 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8004600 con 0x7f23c00cb350 2023-06-23T19:01:34.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.642+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c01eb710 con 0x7f23c00cb350 2023-06-23T19:01:34.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.642+0000 7fd393fff700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3940cba10 0x7fd3940cbeb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd37c005800 tx=0x7fd38c001e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.642+0000 7f3fd6ffd700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6822/1091078003,v1:172.21.15.136:6824/1091078003] conn(0x7f3fb80015e0 0x7f3fb8003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7f972effd700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f972406b160 0x7f972406d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7f972effd700 1 -- 172.21.15.136:0/1937868726 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f97300898b0 con 0x7f97380cc970 2023-06-23T19:01:34.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.642+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c0161da0 con 0x7f23c00cb350 2023-06-23T19:01:34.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7f3fbffff700 1 -- 172.21.15.136:0/181905321 <== osd.0 v2:172.21.15.136:6822/1091078003 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3fb8006bc0 con 0x7f3fb80015e0 2023-06-23T19:01:34.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7f972effd700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6800/4143692413,v1:172.21.15.136:6801/4143692413] conn(0x7f9724074e30 0x7f9724077260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7f972effd700 1 -- 172.21.15.136:0/1937868726 --> [v2:172.21.15.136:6800/4143692413,v1:172.21.15.136:6801/4143692413] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9724077930 con 0x7f9724074e30 2023-06-23T19:01:34.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7f972effd700 1 -- 172.21.15.136:0/1937868726 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9730089c20 con 0x7f97380cc970 2023-06-23T19:01:34.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.644+0000 7f973e39b700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f972406b160 0x7f972406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.644+0000 7f973db9a700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6800/4143692413,v1:172.21.15.136:6801/4143692413] conn(0x7f9724074e30 0x7f9724077260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec00c35f0 con 0x7efec00893f0 2023-06-23T19:01:34.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec0088fc0 con 0x7efec00893f0 2023-06-23T19:01:34.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.644+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efec00ce410 con 0x7efec00893f0 2023-06-23T19:01:34.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7fd383fff700 1 -- 172.21.15.136:0/3527660726 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c026070 con 0x7fd3940cba10 2023-06-23T19:01:34.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7fd383fff700 1 -- 172.21.15.136:0/3527660726 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c001490 con 0x7fd3940cba10 2023-06-23T19:01:34.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.643+0000 7fd383fff700 1 -- 172.21.15.136:0/3527660726 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c020610 con 0x7fd3940cba10 2023-06-23T19:01:34.695 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.645+0000 7f973db9a700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6800/4143692413,v1:172.21.15.136:6801/4143692413] conn(0x7f9724074e30 0x7f9724077260 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.695 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.644+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3940c76f0 con 0x7fd3940cba10 2023-06-23T19:01:34.695 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.644+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3940c7cb0 con 0x7fd3940cba10 2023-06-23T19:01:34.695 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.645+0000 7f973e39b700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f972406b160 0x7f972406d610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f973400be30 tx=0x7f9734008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.696 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.645+0000 7f92a51ff700 1 Processor -- start 2023-06-23T19:01:34.696 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.646+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd39415cfb0 con 0x7fd3940cba10 2023-06-23T19:01:34.696 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.645+0000 7f23b5ffb700 1 -- 172.21.15.136:0/3730633017 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23b8004760 con 0x7f23c00cb350 2023-06-23T19:01:34.697 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.646+0000 7f972effd700 1 -- 172.21.15.136:0/1937868726 <== osd.3 v2:172.21.15.136:6800/4143692413 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9724077930 con 0x7f9724074e30 2023-06-23T19:01:34.697 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.647+0000 7f23b5ffb700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f23a406adb0 0x7f23a406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.697 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.647+0000 7f23b5ffb700 1 -- 172.21.15.136:0/3730633017 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23b808a7e0 con 0x7f23c00cb350 2023-06-23T19:01:34.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.646+0000 7f92a51ff700 1 -- start start 2023-06-23T19:01:34.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.648+0000 7f23c4f9a700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f23a406adb0 0x7f23a406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.648+0000 7efeb6ffd700 1 -- 172.21.15.136:0/919473405 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efeb8012070 con 0x7efec00893f0 2023-06-23T19:01:34.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.649+0000 7f23c4f9a700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f23a406adb0 0x7f23a406d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23c015f150 tx=0x7f23b0009640 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.648+0000 7f92a51ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 0x7f92a0159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.648+0000 7f92a51ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92a00cb4e0 0x7f92a00cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.648+0000 7f92a51ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a015bd30 con 0x7f92a00cc260 2023-06-23T19:01:34.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.648+0000 7f92a51ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a01586a0 con 0x7f92a00cb4e0 2023-06-23T19:01:34.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.648+0000 7f92a51ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00cbe90 con 0x7f92a00b0d40 2023-06-23T19:01:34.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.649+0000 7f929f59e700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f92a00cc260 0x7f92a00cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:39836/0 (socket says 172.21.15.136:39836) 2023-06-23T19:01:34.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.649+0000 7f929f59e700 1 -- 172.21.15.136:0/3332048787 learned_addr learned my addr 172.21.15.136:0/3332048787 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:34.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.649+0000 7efeb6ffd700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efea006adb0 0x7efea006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7efeb6ffd700 1 -- 172.21.15.136:0/919473405 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efeb8089c50 con 0x7efec00893f0 2023-06-23T19:01:34.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7efeb6ffd700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:6824/2052306776,v1:172.21.15.178:6825/2052306776] conn(0x7efea0074a80 0x7efea0076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7efeb6ffd700 1 -- 172.21.15.136:0/919473405 --> [v2:172.21.15.178:6824/2052306776,v1:172.21.15.178:6825/2052306776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efea0077580 con 0x7efea0074a80 2023-06-23T19:01:34.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7efeb6ffd700 1 -- 172.21.15.136:0/919473405 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7efeb808a000 con 0x7efec00893f0 2023-06-23T19:01:34.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7efebe59c700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efea006adb0 0x7efea006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7efeb7fff700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:6824/2052306776,v1:172.21.15.178:6825/2052306776] conn(0x7efea0074a80 0x7efea0076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.649+0000 7f929ed9d700 1 --2- 172.21.15.136:0/3332048787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 0x7f92a0159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7f929659c700 1 --2- 172.21.15.136:0/3332048787 >> v2:172.21.15.136:3300/0 conn(0x7f92a00cb4e0 0x7f92a00cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7f929659c700 1 -- 172.21.15.136:0/3332048787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 msgr2=0x7f92a0159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:34.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7f929659c700 1 --2- 172.21.15.136:0/3332048787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 0x7f92a0159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7f929659c700 1 -- 172.21.15.136:0/3332048787 >> v1:172.21.15.178:6789/0 conn(0x7f92a00cc260 legacy=0x7f92a00cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.650+0000 7f929659c700 1 -- 172.21.15.136:0/3332048787 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a015bfd0 con 0x7f92a00cb4e0 2023-06-23T19:01:34.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.651+0000 7fd383fff700 1 -- 172.21.15.136:0/3527660726 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd38c020770 con 0x7fd3940cba10 2023-06-23T19:01:34.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.651+0000 7efeb7fff700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:6824/2052306776,v1:172.21.15.178:6825/2052306776] conn(0x7efea0074a80 0x7efea0076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.704 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.651+0000 7f929659c700 1 --2- 172.21.15.136:0/3332048787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92a00cb4e0 0x7f92a00cb950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92900098d0 tx=0x7f9290009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b04e5bad0fa7d04 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.704 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.652+0000 7efebe59c700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efea006adb0 0x7efea006d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efea8004720 tx=0x7efea801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.652+0000 7f929e59c700 1 -- 172.21.15.136:0/3332048787 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290014e90 con 0x7f92a00cb4e0 2023-06-23T19:01:34.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.652+0000 7f929e59c700 1 -- 172.21.15.136:0/3332048787 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9290004030 con 0x7f92a00cb4e0 2023-06-23T19:01:34.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.652+0000 7f929e59c700 1 -- 172.21.15.136:0/3332048787 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900043e0 con 0x7f92a00cb4e0 2023-06-23T19:01:34.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.652+0000 7f23c79ff700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:6800/597055350,v1:172.21.15.178:6801/597055350] conn(0x7f23c00c18c0 0x7f23c00b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.652+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 --> [v2:172.21.15.178:6800/597055350,v1:172.21.15.178:6801/597055350] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23c00ce2d0 con 0x7f23c00c18c0 2023-06-23T19:01:34.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.652+0000 7fd383fff700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd37806ad80 0x7fd37806d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.652+0000 7fd383fff700 1 -- 172.21.15.136:0/3527660726 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd38c08bbe0 con 0x7fd3940cba10 2023-06-23T19:01:34.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.652+0000 7f23c5f9c700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:6800/597055350,v1:172.21.15.178:6801/597055350] conn(0x7f23c00c18c0 0x7f23c00b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7fd383fff700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6810/1156429713,v1:172.21.15.136:6812/1156429713] conn(0x7fd378074a50 0x7fd378076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7fd383fff700 1 -- 172.21.15.136:0/3527660726 --> [v2:172.21.15.136:6810/1156429713,v1:172.21.15.136:6812/1156429713] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd378077550 con 0x7fd378074a50 2023-06-23T19:01:34.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7fd383fff700 1 -- 172.21.15.136:0/3527660726 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd38c08bf90 con 0x7fd3940cba10 2023-06-23T19:01:34.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7f92a51ff700 1 -- 172.21.15.136:0/3332048787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92a00cb4e0 msgr2=0x7f92a00cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7f92a51ff700 1 --2- 172.21.15.136:0/3332048787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92a00cb4e0 0x7f92a00cb950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92900098d0 tx=0x7f9290009be0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7f92a51ff700 1 -- 172.21.15.136:0/3332048787 shutdown_connections 2023-06-23T19:01:34.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7f92a51ff700 1 --2- 172.21.15.136:0/3332048787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 0x7f92a0159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7f92a51ff700 1 --2- 172.21.15.136:0/3332048787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92a00cb4e0 0x7f92a00cb950 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92900098d0 tx=0x7f9290009be0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7f92a51ff700 1 -- 172.21.15.136:0/3332048787 >> 172.21.15.136:0/3332048787 conn(0x7f92a00b0260 msgr2=0x7f92a00b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.654+0000 7fd3937fe700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd37806ad80 0x7fd37806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.709 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.654+0000 7fd392ffd700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6810/1156429713,v1:172.21.15.136:6812/1156429713] conn(0x7fd378074a50 0x7fd378076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.709 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.654+0000 7fd3937fe700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd37806ad80 0x7fd37806d230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd38400d8d0 tx=0x7fd384008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.709 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.655+0000 7fd392ffd700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6810/1156429713,v1:172.21.15.136:6812/1156429713] conn(0x7fd378074a50 0x7fd378076e80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.709 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.653+0000 7efeb6ffd700 1 -- 172.21.15.136:0/919473405 <== osd.5 v2:172.21.15.178:6824/2052306776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efea0077580 con 0x7efea0074a80 2023-06-23T19:01:34.709 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.655+0000 7f92a51ff700 1 -- 172.21.15.136:0/3332048787 shutdown_connections 2023-06-23T19:01:34.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.656+0000 7f23c5f9c700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:6800/597055350,v1:172.21.15.178:6801/597055350] conn(0x7f23c00c18c0 0x7f23c00b3730 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.657+0000 7f23b5ffb700 1 -- 172.21.15.136:0/3730633017 <== osd.4 v2:172.21.15.178:6800/597055350 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f23bc0098b0 con 0x7f23c00c18c0 2023-06-23T19:01:34.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.655+0000 7f92a51ff700 1 -- 172.21.15.136:0/3332048787 wait complete. 2023-06-23T19:01:34.711 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.658+0000 7fd383fff700 1 -- 172.21.15.136:0/3527660726 <== osd.2 v2:172.21.15.136:6810/1156429713 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd378077550 con 0x7fd378074a50 2023-06-23T19:01:34.711 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.658+0000 7f92a51ff700 1 Processor -- start 2023-06-23T19:01:34.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.659+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 --> [v2:172.21.15.136:6807/3924036391,v1:172.21.15.136:6809/3924036391] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7effcc06ce30 con 0x7effb0074a80 2023-06-23T19:01:34.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.660+0000 7effc27fc700 1 -- 172.21.15.136:0/3430002995 <== osd.1 v2:172.21.15.136:6807/3924036391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7effc4009c20 con 0x7effb0074a80 2023-06-23T19:01:34.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.661+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6807/3924036391,v1:172.21.15.136:6809/3924036391] conn(0x7effb0074a80 msgr2=0x7effb0076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.661+0000 7effd3dff700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6807/3924036391,v1:172.21.15.136:6809/3924036391] conn(0x7effb0074a80 0x7effb0076eb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.659+0000 7f92a51ff700 1 -- start start 2023-06-23T19:01:34.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.660+0000 7f92a51ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 0x7f92a00c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.660+0000 7f92a51ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92a00cc260 0x7f92a00c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.660+0000 7f92a51ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92a01f1cf0 0x7f92a00af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.660+0000 7f92a51ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c3f00 con 0x7f92a00cc260 2023-06-23T19:01:34.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.660+0000 7f92a51ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c7cc0 con 0x7f92a01f1cf0 2023-06-23T19:01:34.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.660+0000 7f92a51ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c8690 con 0x7f92a00b0d40 2023-06-23T19:01:34.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.662+0000 7f929ed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 0x7f92a00c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.662+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7effb006adb0 msgr2=0x7effb006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.662+0000 7effd3dff700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7effb006adb0 0x7effb006d260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7effc8009770 tx=0x7effc8006cd0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.662+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc160590 msgr2=0x7effcc163320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.662+0000 7effd3dff700 1 --2- 172.21.15.136:0/3430002995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effcc160590 0x7effcc163320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effbc000c00 tx=0x7effbc004750 comp rx=0 tx=0).stop 2023-06-23T19:01:34.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7effd239c700 1 -- 172.21.15.136:0/3430002995 reap_dead start 2023-06-23T19:01:34.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.662+0000 7f929f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92a01f1cf0 0x7f92a00af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7f929ed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 0x7f92a00c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54876/0 (socket says 172.21.15.136:54876) 2023-06-23T19:01:34.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7f929ed9d700 1 -- 172.21.15.136:0/1534702252 learned_addr learned my addr 172.21.15.136:0/1534702252 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 shutdown_connections 2023-06-23T19:01:34.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 >> 172.21.15.136:0/3430002995 conn(0x7effcc0b0ef0 msgr2=0x7effcc15f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7f929ed9d700 1 -- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92a01f1cf0 msgr2=0x7f92a00af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7f929ed9d700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92a01f1cf0 0x7f92a00af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7f929ed9d700 1 -- 172.21.15.136:0/1534702252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92a00cc260 msgr2=0x7f92a00c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7f929ed9d700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92a00cc260 0x7f92a00c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.663+0000 7f929ed9d700 1 -- 172.21.15.136:0/1534702252 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900094a0 con 0x7f92a00b0d40 2023-06-23T19:01:34.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.664+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 shutdown_connections 2023-06-23T19:01:34.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.664+0000 7f929ed9d700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 0x7f92a00c8150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f928800e9e0 tx=0x7f928800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.664+0000 7f9297fff700 1 -- 172.21.15.136:0/1534702252 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288009710 con 0x7f92a00b0d40 2023-06-23T19:01:34.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.664+0000 7f9297fff700 1 -- 172.21.15.136:0/1534702252 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928800c850 con 0x7f92a00b0d40 2023-06-23T19:01:34.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.664+0000 7f9297fff700 1 -- 172.21.15.136:0/1534702252 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928800cbc0 con 0x7f92a00b0d40 2023-06-23T19:01:34.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.664+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a00c70b0 con 0x7f92a00b0d40 2023-06-23T19:01:34.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.664+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a00c7670 con 0x7f92a00b0d40 2023-06-23T19:01:34.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.665+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92a015c590 con 0x7f92a00b0d40 2023-06-23T19:01:34.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.667+0000 7effd3dff700 1 -- 172.21.15.136:0/3430002995 wait complete. 2023-06-23T19:01:34.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.672+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 --> [v2:172.21.15.136:6822/1091078003,v1:172.21.15.136:6824/1091078003] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3fb8005ca0 con 0x7f3fb80015e0 2023-06-23T19:01:34.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.671+0000 7f9297fff700 1 -- 172.21.15.136:0/1534702252 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f928800cd20 con 0x7f92a00b0d40 2023-06-23T19:01:34.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.673+0000 7f3fbffff700 1 -- 172.21.15.136:0/181905321 <== osd.0 v2:172.21.15.136:6822/1091078003 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3fb8005ca0 con 0x7f3fb80015e0 2023-06-23T19:01:34.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.667+0000 7fac291ff700 1 Processor -- start 2023-06-23T19:01:34.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.668+0000 7fac291ff700 1 -- start start 2023-06-23T19:01:34.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.670+0000 7fac291ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac24069ef0 0x7fac240adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.670+0000 7fac291ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240ce410 con 0x7fac2406ccb0 2023-06-23T19:01:34.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.670+0000 7fac291ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240cc400 con 0x7fac24089940 2023-06-23T19:01:34.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.670+0000 7fac291ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac24169370 con 0x7fac24069ef0 2023-06-23T19:01:34.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.671+0000 7fac2359e700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fac2406ccb0 0x7fac2406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53038/0 (socket says 172.21.15.136:53038) 2023-06-23T19:01:34.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.671+0000 7fac2359e700 1 -- 172.21.15.136:0/1385477620 learned_addr learned my addr 172.21.15.136:0/1385477620 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:34.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.671+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747497616 0 0) 0x7fac240ce410 con 0x7fac2406ccb0 2023-06-23T19:01:34.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.672+0000 7fac22d9d700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac24069ef0 0x7fac240adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.673+0000 7f9297fff700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f928006adb0 0x7f928006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.673+0000 7f9297fff700 1 -- 172.21.15.136:0/1534702252 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9288089bf0 con 0x7f92a00b0d40 2023-06-23T19:01:34.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.673+0000 7f9297fff700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:6816/400133386,v1:172.21.15.178:6817/400133386] conn(0x7f9280074a80 0x7f9280076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.673+0000 7f9297fff700 1 -- 172.21.15.136:0/1534702252 --> [v2:172.21.15.178:6816/400133386,v1:172.21.15.178:6817/400133386] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9280077580 con 0x7f9280074a80 2023-06-23T19:01:34.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.673+0000 7f9297fff700 1 -- 172.21.15.136:0/1534702252 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9288089fa0 con 0x7f92a00b0d40 2023-06-23T19:01:34.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac100035b0 con 0x7fac2406ccb0 2023-06-23T19:01:34.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746971899 0 0) 0x7fac240cc400 con 0x7fac24089940 2023-06-23T19:01:34.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac240ce410 con 0x7fac24089940 2023-06-23T19:01:34.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6822/1091078003,v1:172.21.15.136:6824/1091078003] conn(0x7f3fb80015e0 msgr2=0x7f3fb8003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7f3fde1ff700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6822/1091078003,v1:172.21.15.136:6824/1091078003] conn(0x7f3fb80015e0 0x7f3fb8003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7f929f59e700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:6816/400133386,v1:172.21.15.178:6817/400133386] conn(0x7f9280074a80 0x7f9280076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc006b1b0 msgr2=0x7f3fc006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7f3fde1ff700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc006b1b0 0x7f3fc006d660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0000f80 tx=0x7f3fd0011000 comp rx=0 tx=0).stop 2023-06-23T19:01:34.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd80cc260 msgr2=0x7f3fd8141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7f3fde1ff700 1 --2- 172.21.15.136:0/181905321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd80cc260 0x7f3fd8141070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc000c00 tx=0x7f3fcc00c730 comp rx=0 tx=0).stop 2023-06-23T19:01:34.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7f3fd7fff700 1 -- 172.21.15.136:0/181905321 reap_dead start 2023-06-23T19:01:34.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346682273 0 0) 0x7fac240ce410 con 0x7fac24089940 2023-06-23T19:01:34.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac24069ef0 msgr2=0x7fac240adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:34.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.674+0000 7fac2259c700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac24069ef0 0x7fac240adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 >> v1:172.21.15.136:6789/0 conn(0x7fac2406ccb0 legacy=0x7fac2406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240cc6e0 con 0x7fac24089940 2023-06-23T19:01:34.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fac0c001670 con 0x7fac24089940 2023-06-23T19:01:34.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 >> v1:172.21.15.178:6789/0 conn(0x7fac24089940 legacy=0x7fac2406a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10004bf0 0x7fac10004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac100037f0 0x7fac10003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac24069ef0 0x7fac100041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24169370 con 0x7fac10004bf0 2023-06-23T19:01:34.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1000baf0 con 0x7fac100037f0 2023-06-23T19:01:34.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1000bcb0 con 0x7fac24069ef0 2023-06-23T19:01:34.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 shutdown_connections 2023-06-23T19:01:34.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 >> 172.21.15.136:0/181905321 conn(0x7f3fd80b0260 msgr2=0x7f3fd8159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.675+0000 7fac22d9d700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10004bf0 0x7fac10004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.676+0000 7fac1bfff700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac100037f0 0x7fac10003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.676+0000 7fac22d9d700 1 -- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac24069ef0 msgr2=0x7fac100041a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T19:01:34.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.676+0000 7fac22d9d700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac24069ef0 0x7fac100041a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.676+0000 7fac22d9d700 1 -- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac100037f0 msgr2=0x7fac10003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:34.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.676+0000 7fac22d9d700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac100037f0 0x7fac10003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.676+0000 7fac22d9d700 1 -- 172.21.15.136:0/1385477620 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240cc6e0 con 0x7fac10004bf0 2023-06-23T19:01:34.735 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.676+0000 7f929f59e700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:6816/400133386,v1:172.21.15.178:6817/400133386] conn(0x7f9280074a80 0x7f9280076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.735 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.676+0000 7fac22d9d700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10004bf0 0x7fac10004fe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac1400a100 tx=0x7fac10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda1119d5c961371 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.677+0000 7f929659c700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f928006adb0 0x7f928006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.677+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14012450 con 0x7fac10004bf0 2023-06-23T19:01:34.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.677+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac140125b0 con 0x7fac10004bf0 2023-06-23T19:01:34.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.677+0000 7fac2259c700 1 -- 172.21.15.136:0/1385477620 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14012960 con 0x7fac10004bf0 2023-06-23T19:01:34.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.678+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 shutdown_connections 2023-06-23T19:01:34.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.678+0000 7f9297fff700 1 -- 172.21.15.136:0/1534702252 <== osd.7 v2:172.21.15.178:6816/400133386 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9280077580 con 0x7f9280074a80 2023-06-23T19:01:34.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.678+0000 7f929659c700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f928006adb0 0x7f928006d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92a00cdca0 tx=0x7f9290016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.678+0000 7fac291ff700 1 -- 172.21.15.136:0/1385477620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10004bf0 msgr2=0x7fac10004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.678+0000 7fac291ff700 1 --2- 172.21.15.136:0/1385477620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10004bf0 0x7fac10004fe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac1400a100 tx=0x7fac10005880 comp rx=0 tx=0).stop 2023-06-23T19:01:34.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.678+0000 7fac2359e700 1 -- 172.21.15.136:0/1385477620 reap_dead start 2023-06-23T19:01:34.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.678+0000 7f3fde1ff700 1 -- 172.21.15.136:0/181905321 wait complete. 2023-06-23T19:01:34.739 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.679+0000 7fac291ff700 1 -- 172.21.15.136:0/1385477620 shutdown_connections 2023-06-23T19:01:34.739 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.679+0000 7fac291ff700 1 -- 172.21.15.136:0/1385477620 >> 172.21.15.136:0/1385477620 conn(0x7fac240b0260 msgr2=0x7fac240b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.739 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.679+0000 7fac291ff700 1 -- 172.21.15.136:0/1385477620 shutdown_connections 2023-06-23T19:01:34.739 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.679+0000 7fac291ff700 1 -- 172.21.15.136:0/1385477620 wait complete. 2023-06-23T19:01:34.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.679+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 --> [v2:172.21.15.136:6800/4143692413,v1:172.21.15.136:6801/4143692413] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f971c002d70 con 0x7f9724074e30 2023-06-23T19:01:34.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.680+0000 7f972effd700 1 -- 172.21.15.136:0/1937868726 <== osd.3 v2:172.21.15.136:6800/4143692413 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f971c002d70 con 0x7f9724074e30 2023-06-23T19:01:34.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.681+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6800/4143692413,v1:172.21.15.136:6801/4143692413] conn(0x7f9724074e30 msgr2=0x7f9724077260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.741 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.681+0000 7f97405ff700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6800/4143692413,v1:172.21.15.136:6801/4143692413] conn(0x7f9724074e30 0x7f9724077260 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.741 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.681+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f972406b160 msgr2=0x7f972406d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.741 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.681+0000 7f97405ff700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f972406b160 0x7f972406d610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f973400be30 tx=0x7f9734008040 comp rx=0 tx=0).stop 2023-06-23T19:01:34.741 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.681+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97380cc970 msgr2=0x7f97381e2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.741 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.681+0000 7f97405ff700 1 --2- 172.21.15.136:0/1937868726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97380cc970 0x7f97381e2d00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f973000caa0 tx=0x7f973000cdb0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.741 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.682+0000 7fac291ff700 1 Processor -- start 2023-06-23T19:01:34.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.682+0000 7fac291ff700 1 -- start start 2023-06-23T19:01:34.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.684+0000 7f973eb9c700 1 -- 172.21.15.136:0/1937868726 reap_dead start 2023-06-23T19:01:34.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.684+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 --> [v2:172.21.15.178:6824/2052306776,v1:172.21.15.178:6825/2052306776] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efec00cc4b0 con 0x7efea0074a80 2023-06-23T19:01:34.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.685+0000 7efeb6ffd700 1 -- 172.21.15.136:0/919473405 <== osd.5 v2:172.21.15.178:6824/2052306776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efeb0009a80 con 0x7efea0074a80 2023-06-23T19:01:34.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.685+0000 7fac291ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac10004bf0 0x7fac24169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.685+0000 7fac291ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c4560 0x7fac240c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.685+0000 7fac291ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2416b7b0 0x7fac2416bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.685+0000 7fac291ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2416c170 con 0x7fac240c4560 2023-06-23T19:01:34.743 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.685+0000 7fac291ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2416a340 con 0x7fac10004bf0 2023-06-23T19:01:34.744 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.685+0000 7fac291ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2420ab80 con 0x7fac2416b7b0 2023-06-23T19:01:34.745 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.686+0000 7fac2359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2416b7b0 0x7fac2416bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.745 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.686+0000 7fac2359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2416b7b0 0x7fac2416bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:54910/0 (socket says 172.21.15.136:54910) 2023-06-23T19:01:34.745 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.686+0000 7fac2359e700 1 -- 172.21.15.136:0/1928557547 learned_addr learned my addr 172.21.15.136:0/1928557547 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:34.746 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.686+0000 7fac1bfff700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c4560 0x7fac240c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.746 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.686+0000 7fac22d9d700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac10004bf0 0x7fac24169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.747 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:6824/2052306776,v1:172.21.15.178:6825/2052306776] conn(0x7efea0074a80 msgr2=0x7efea0076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.747 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7efec4dff700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:6824/2052306776,v1:172.21.15.178:6825/2052306776] conn(0x7efea0074a80 0x7efea0076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.748 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7fac2359e700 1 -- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac10004bf0 msgr2=0x7fac24169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.748 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7fac2359e700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac10004bf0 0x7fac24169e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.748 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7fac2359e700 1 -- 172.21.15.136:0/1928557547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c4560 msgr2=0x7fac240c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.749 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7fac2359e700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c4560 0x7fac240c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.749 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7fac2359e700 1 -- 172.21.15.136:0/1928557547 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2420ae60 con 0x7fac2416b7b0 2023-06-23T19:01:34.749 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7fac1bfff700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c4560 0x7fac240c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:34.750 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efea006adb0 msgr2=0x7efea006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.750 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7efec4dff700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efea006adb0 0x7efea006d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efea8004720 tx=0x7efea801c040 comp rx=0 tx=0).stop 2023-06-23T19:01:34.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec00893f0 msgr2=0x7efec0164520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7efec4dff700 1 --2- 172.21.15.136:0/919473405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec00893f0 0x7efec0164520 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efeb800bac0 tx=0x7efeb800bdd0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7efebed9d700 1 -- 172.21.15.136:0/919473405 reap_dead start 2023-06-23T19:01:34.752 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.687+0000 7fac2359e700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2416b7b0 0x7fac2416bc30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fac240cd500 tx=0x7fac1c00cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.752 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 shutdown_connections 2023-06-23T19:01:34.753 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 >> 172.21.15.136:0/1937868726 conn(0x7f97380b0260 msgr2=0x7f97380ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.753 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 --> [v2:172.21.15.178:6800/597055350,v1:172.21.15.178:6801/597055350] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f23c00cdff0 con 0x7f23c00c18c0 2023-06-23T19:01:34.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 shutdown_connections 2023-06-23T19:01:34.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7f97405ff700 1 -- 172.21.15.136:0/1937868726 wait complete. 2023-06-23T19:01:34.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 shutdown_connections 2023-06-23T19:01:34.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 >> 172.21.15.136:0/919473405 conn(0x7efec00b0260 msgr2=0x7efec00af990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 shutdown_connections 2023-06-23T19:01:34.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7efec4dff700 1 -- 172.21.15.136:0/919473405 wait complete. 2023-06-23T19:01:34.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.689+0000 7f23b5ffb700 1 -- 172.21.15.136:0/3730633017 <== osd.4 v2:172.21.15.178:6800/597055350 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f23bc009c80 con 0x7f23c00c18c0 2023-06-23T19:01:34.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7fac1b7fe700 1 -- 172.21.15.136:0/1928557547 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00a6f0 con 0x7fac2416b7b0 2023-06-23T19:01:34.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7fac1b7fe700 1 -- 172.21.15.136:0/1928557547 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c00a850 con 0x7fac2416b7b0 2023-06-23T19:01:34.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7fac1b7fe700 1 -- 172.21.15.136:0/1928557547 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00abc0 con 0x7fac2416b7b0 2023-06-23T19:01:34.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2420b140 con 0x7fac2416b7b0 2023-06-23T19:01:34.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.688+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2420b700 con 0x7fac2416b7b0 2023-06-23T19:01:34.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.690+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:6800/597055350,v1:172.21.15.178:6801/597055350] conn(0x7f23c00c18c0 msgr2=0x7f23c00b3730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.690+0000 7f23c79ff700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:6800/597055350,v1:172.21.15.178:6801/597055350] conn(0x7f23c00c18c0 0x7f23c00b3730 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.690+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f23a406adb0 msgr2=0x7f23a406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.690+0000 7f23c79ff700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f23a406adb0 0x7f23a406d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23c015f150 tx=0x7f23b0009640 comp rx=0 tx=0).stop 2023-06-23T19:01:34.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.690+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 msgr2=0x7f23c0157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.690+0000 7f23c79ff700 1 --2- 172.21.15.136:0/3730633017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c00cb350 0x7f23c0157c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23c00cc0b0 tx=0x7f23b8004ad0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.690+0000 7f23c5f9c700 1 -- 172.21.15.136:0/3730633017 reap_dead start 2023-06-23T19:01:34.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.691+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 shutdown_connections 2023-06-23T19:01:34.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.691+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 >> 172.21.15.136:0/3730633017 conn(0x7f23c00b0260 msgr2=0x7f23c00af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.693+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 --> [v2:172.21.15.136:6810/1156429713,v1:172.21.15.136:6812/1156429713] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd39415ccd0 con 0x7fd378074a50 2023-06-23T19:01:34.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.694+0000 7fd383fff700 1 -- 172.21.15.136:0/3527660726 <== osd.2 v2:172.21.15.136:6810/1156429713 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3880092a0 con 0x7fd378074a50 2023-06-23T19:01:34.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.694+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6810/1156429713,v1:172.21.15.136:6812/1156429713] conn(0x7fd378074a50 msgr2=0x7fd378076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.694+0000 7fd399fff700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6810/1156429713,v1:172.21.15.136:6812/1156429713] conn(0x7fd378074a50 0x7fd378076e80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.696+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 shutdown_connections 2023-06-23T19:01:34.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.696+0000 7f23c79ff700 1 -- 172.21.15.136:0/3730633017 wait complete. 2023-06-23T19:01:34.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.695+0000 7fac1b7fe700 1 -- 172.21.15.136:0/1928557547 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac1c00ad20 con 0x7fac2416b7b0 2023-06-23T19:01:34.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.696+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac240cdd50 con 0x7fac2416b7b0 2023-06-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.697+0000 7fac1b7fe700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fac0406ada0 0x7fac0406d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.697+0000 7fac1b7fe700 1 -- 172.21.15.136:0/1928557547 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fac1c0892b0 con 0x7fac2416b7b0 2023-06-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.697+0000 7fac1b7fe700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:6808/458584113,v1:172.21.15.178:6809/458584113] conn(0x7fac040749f0 0x7fac04076e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.697+0000 7fac1b7fe700 1 -- 172.21.15.136:0/1928557547 --> [v2:172.21.15.178:6808/458584113,v1:172.21.15.178:6809/458584113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac040774f0 con 0x7fac040749f0 2023-06-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.698+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd37806ad80 msgr2=0x7fd37806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.698+0000 7fd399fff700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd37806ad80 0x7fd37806d230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd38400d8d0 tx=0x7fd384008040 comp rx=0 tx=0).stop 2023-06-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.698+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3940cba10 msgr2=0x7fd3940cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.698+0000 7fd399fff700 1 --2- 172.21.15.136:0/3527660726 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3940cba10 0x7fd3940cbeb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd37c005800 tx=0x7fd38c001e40 comp rx=0 tx=0).stop 2023-06-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.698+0000 7fac22d9d700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fac0406ada0 0x7fac0406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.700+0000 7fd393fff700 1 -- 172.21.15.136:0/3527660726 reap_dead start 2023-06-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.699+0000 7fac1bfff700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:6808/458584113,v1:172.21.15.178:6809/458584113] conn(0x7fac040749f0 0x7fac04076e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.700+0000 7fac22d9d700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fac0406ada0 0x7fac0406d250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac14000c00 tx=0x7fac1401f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.700+0000 7fac1b7fe700 1 -- 172.21.15.136:0/1928557547 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac1c0540e0 con 0x7fac2416b7b0 2023-06-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.700+0000 7fac1bfff700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:6808/458584113,v1:172.21.15.178:6809/458584113] conn(0x7fac040749f0 0x7fac04076e20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.702+0000 7fac1b7fe700 1 -- 172.21.15.136:0/1928557547 <== osd.6 v2:172.21.15.178:6808/458584113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fac040774f0 con 0x7fac040749f0 2023-06-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi136.stdout:64424509452 2023-06-23T19:01:34.766 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.703+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 shutdown_connections 2023-06-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.703+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 >> 172.21.15.136:0/3527660726 conn(0x7fd394071620 msgr2=0x7fd39415b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.703+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 shutdown_connections 2023-06-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.703+0000 7fd399fff700 1 -- 172.21.15.136:0/3527660726 wait complete. 2023-06-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.710+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 --> [v2:172.21.15.178:6816/400133386,v1:172.21.15.178:6817/400133386] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f92a015c2b0 con 0x7f9280074a80 2023-06-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi136.stdout:68719476748 2023-06-23T19:01:34.768 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.712+0000 7f9297fff700 1 -- 172.21.15.136:0/1534702252 <== osd.7 v2:172.21.15.178:6816/400133386 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9298001ec0 con 0x7f9280074a80 2023-06-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.713+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:6816/400133386,v1:172.21.15.178:6817/400133386] conn(0x7f9280074a80 msgr2=0x7f9280076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.713+0000 7f92a51ff700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:6816/400133386,v1:172.21.15.178:6817/400133386] conn(0x7f9280074a80 0x7f9280076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.713+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f928006adb0 msgr2=0x7f928006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.713+0000 7f92a51ff700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f928006adb0 0x7f928006d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92a00cdca0 tx=0x7f9290016000 comp rx=0 tx=0).stop 2023-06-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.713+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 msgr2=0x7f92a00c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.713+0000 7f92a51ff700 1 --2- 172.21.15.136:0/1534702252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00b0d40 0x7f92a00c8150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f928800e9e0 tx=0x7f928800ecf0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.713+0000 7f929f59e700 1 -- 172.21.15.136:0/1534702252 reap_dead start 2023-06-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.713+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 shutdown_connections 2023-06-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.713+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 >> 172.21.15.136:0/1534702252 conn(0x7f92a00b0260 msgr2=0x7f92a0159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.714+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 shutdown_connections 2023-06-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.714+0000 7f92a51ff700 1 -- 172.21.15.136:0/1534702252 wait complete. 2023-06-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi136.stdout:64424509451 2023-06-23T19:01:34.773 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi136.stdout:64424509451 2023-06-23T19:01:34.775 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi136.stdout:60129542155 2023-06-23T19:01:34.777 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.732+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 --> [v2:172.21.15.178:6808/458584113,v1:172.21.15.178:6809/458584113] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac240ce0a0 con 0x7fac040749f0 2023-06-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac1b7fe700 1 -- 172.21.15.136:0/1928557547 <== osd.6 v2:172.21.15.178:6808/458584113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fac0c007d40 con 0x7fac040749f0 2023-06-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:6808/458584113,v1:172.21.15.178:6809/458584113] conn(0x7fac040749f0 msgr2=0x7fac04076e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac291ff700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:6808/458584113,v1:172.21.15.178:6809/458584113] conn(0x7fac040749f0 0x7fac04076e20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fac0406ada0 msgr2=0x7fac0406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac291ff700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fac0406ada0 0x7fac0406d250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac14000c00 tx=0x7fac1401f040 comp rx=0 tx=0).stop 2023-06-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2416b7b0 msgr2=0x7fac2416bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac291ff700 1 --2- 172.21.15.136:0/1928557547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2416b7b0 0x7fac2416bc30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fac240cd500 tx=0x7fac1c00cd50 comp rx=0 tx=0).stop 2023-06-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac2359e700 1 -- 172.21.15.136:0/1928557547 reap_dead start 2023-06-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 shutdown_connections 2023-06-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.734+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 >> 172.21.15.136:0/1928557547 conn(0x7fac240b0260 msgr2=0x7fac241687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.735+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 shutdown_connections 2023-06-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:34.735+0000 7fac291ff700 1 -- 172.21.15.136:0/1928557547 wait complete. 2023-06-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi136.stdout:64424509451 2023-06-23T19:01:34.783 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-23T19:01:34.784 INFO:teuthology.orchestra.run.smithi136.stdout:64424509451 2023-06-23T19:01:34.785 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-23T19:01:34.785 INFO:teuthology.orchestra.run.smithi136.stdout:55834574859 2023-06-23T19:01:34.786 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-23T19:01:35.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.158+0000 7fc492bff700 1 Processor -- start 2023-06-23T19:01:35.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.159+0000 7fc492bff700 1 -- start start 2023-06-23T19:01:35.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.160+0000 7f21c7fff700 1 Processor -- start 2023-06-23T19:01:35.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.161+0000 7fc492bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c15c570 0x7fc48c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.161+0000 7fc492bff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc48c160a50 0x7fc48c0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.161+0000 7fc492bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c1610a0 con 0x7fc48c0cd660 2023-06-23T19:01:35.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.161+0000 7fc492bff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c15d670 con 0x7fc48c160a50 2023-06-23T19:01:35.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.161+0000 7fc492bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c160eb0 con 0x7fc48c15c570 2023-06-23T19:01:35.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.161+0000 7f21c7fff700 1 -- start start 2023-06-23T19:01:35.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.162+0000 7fc48bfff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc48c0cd660 0x7fc48c160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42098/0 (socket says 172.21.15.136:42098) 2023-06-23T19:01:35.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.162+0000 7fc48bfff700 1 -- 172.21.15.136:0/3732630763 learned_addr learned my addr 172.21.15.136:0/3732630763 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:35.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.162+0000 7fc49099b700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c15c570 0x7fc48c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.162+0000 7fc49119c700 1 --2- 172.21.15.136:0/3732630763 >> v2:172.21.15.178:3300/0 conn(0x7fc48c160a50 0x7fc48c0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.162+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789700441 0 0) 0x7fc48c1610a0 con 0x7fc48c0cd660 2023-06-23T19:01:35.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.163+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc47c0035b0 con 0x7fc48c0cd660 2023-06-23T19:01:35.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.163+0000 7f21c7fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8158490 0x7f21c806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.163+0000 7f21c7fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f21c80c8b20 0x7f21c8071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.163+0000 7f21c7fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c8158860 con 0x7f21c80c8f90 2023-06-23T19:01:35.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.163+0000 7f21c7fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c806baf0 con 0x7f21c80c8b20 2023-06-23T19:01:35.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.163+0000 7f21c7fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c806bd40 con 0x7f21c8158490 2023-06-23T19:01:35.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.163+0000 7f21c77fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f21c80c8f90 0x7f21c80ac530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42102/0 (socket says 172.21.15.136:42102) 2023-06-23T19:01:35.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.163+0000 7f21c77fe700 1 -- 172.21.15.136:0/3100421583 learned_addr learned my addr 172.21.15.136:0/3100421583 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:35.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7f21c67fc700 1 --2- 172.21.15.136:0/3100421583 >> v2:172.21.15.178:3300/0 conn(0x7f21c80c8b20 0x7f21c8071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7f21c6ffd700 1 --2- 172.21.15.136:0/3100421583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8158490 0x7f21c806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2327251690 0 0) 0x7fc47c0035b0 con 0x7fc48c0cd660 2023-06-23T19:01:35.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c15c570 msgr2=0x7fc48c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7fc48b7fe700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c15c570 0x7fc48c0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 >> v2:172.21.15.178:3300/0 conn(0x7fc48c160a50 msgr2=0x7fc48c0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7fc48b7fe700 1 --2- 172.21.15.136:0/3732630763 >> v2:172.21.15.178:3300/0 conn(0x7fc48c160a50 0x7fc48c0d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c15da90 con 0x7fc48c0cd660 2023-06-23T19:01:35.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fc480001670 con 0x7fc48c0cd660 2023-06-23T19:01:35.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 >> v1:172.21.15.136:6789/0 conn(0x7fc48c0cd660 legacy=0x7fc48c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.164+0000 7fc48b7fe700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc47c003a30 0x7fc47c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7fc48b7fe700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc47c004850 0x7fc47c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7fc48b7fe700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc47c005200 0x7fc47c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c15d670 con 0x7fc47c005200 2023-06-23T19:01:35.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c00bf50 con 0x7fc47c003a30 2023-06-23T19:01:35.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c00c0c0 con 0x7fc47c004850 2023-06-23T19:01:35.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7f21c5ffb700 1 -- 172.21.15.136:0/3100421583 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540297177 0 0) 0x7f21c8158860 con 0x7f21c80c8f90 2023-06-23T19:01:35.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7f21c67fc700 1 -- 172.21.15.136:0/3100421583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8158490 msgr2=0x7f21c806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7f21c67fc700 1 --2- 172.21.15.136:0/3100421583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8158490 0x7f21c806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7f21c67fc700 1 -- 172.21.15.136:0/3100421583 >> v1:172.21.15.136:6789/0 conn(0x7f21c80c8f90 legacy=0x7f21c80ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7f21c67fc700 1 -- 172.21.15.136:0/3100421583 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c806c020 con 0x7f21c80c8b20 2023-06-23T19:01:35.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7fc48bfff700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc47c004850 0x7fc47c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7f21c67fc700 1 --2- 172.21.15.136:0/3100421583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c80c8b20 0x7f21c8071530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009840 tx=0x7f21bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7326e4172ff77202 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.165+0000 7efd9a3ff700 1 Processor -- start 2023-06-23T19:01:35.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.166+0000 7f21c5ffb700 1 -- 172.21.15.136:0/3100421583 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00f940 con 0x7f21c80c8b20 2023-06-23T19:01:35.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.166+0000 7f21c5ffb700 1 -- 172.21.15.136:0/3100421583 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc00faa0 con 0x7f21c80c8b20 2023-06-23T19:01:35.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.166+0000 7f21c5ffb700 1 -- 172.21.15.136:0/3100421583 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00fe30 con 0x7f21c80c8b20 2023-06-23T19:01:35.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.167+0000 7f21c7fff700 1 -- 172.21.15.136:0/3100421583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c80c8b20 msgr2=0x7f21c8071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.167+0000 7f21c7fff700 1 --2- 172.21.15.136:0/3100421583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c80c8b20 0x7f21c8071530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009840 tx=0x7f21bc009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:35.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.167+0000 7fc48bfff700 1 -- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc47c003a30 msgr2=0x7fc47c003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:01:35.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.167+0000 7fc48bfff700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc47c003a30 0x7fc47c003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.167+0000 7fc48bfff700 1 -- 172.21.15.136:0/3732630763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc47c005200 msgr2=0x7fc47c00ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:01:35.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.167+0000 7fc48bfff700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc47c005200 0x7fc47c00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.167+0000 7fc48bfff700 1 -- 172.21.15.136:0/3732630763 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c15da90 con 0x7fc47c004850 2023-06-23T19:01:35.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.166+0000 7efd9a3ff700 1 -- start start 2023-06-23T19:01:35.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7fc48bfff700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc47c004850 0x7fc47c004cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c370 tx=0x7fc47c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47799da4e4d4509c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7efd9a3ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efd94164910 0x7efd940cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7efd9a3ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9406c290 con 0x7efd94160590 2023-06-23T19:01:35.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7efd9a3ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd940ce330 con 0x7efd940c1800 2023-06-23T19:01:35.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7efd9a3ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd940c1f70 con 0x7efd94164910 2023-06-23T19:01:35.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7f21c7fff700 1 -- 172.21.15.136:0/3100421583 shutdown_connections 2023-06-23T19:01:35.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7f21c7fff700 1 --2- 172.21.15.136:0/3100421583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8158490 0x7f21c806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7f21c7fff700 1 --2- 172.21.15.136:0/3100421583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c80c8b20 0x7f21c8071530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7f21c7fff700 1 -- 172.21.15.136:0/3100421583 >> 172.21.15.136:0/3100421583 conn(0x7f21c80ce560 msgr2=0x7f21c80ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7f21c7fff700 1 -- 172.21.15.136:0/3100421583 shutdown_connections 2023-06-23T19:01:35.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000ce50 con 0x7fc47c004850 2023-06-23T19:01:35.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc480005960 con 0x7fc47c004850 2023-06-23T19:01:35.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7fc48b7fe700 1 -- 172.21.15.136:0/3732630763 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480005d10 con 0x7fc47c004850 2023-06-23T19:01:35.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7f21c7fff700 1 -- 172.21.15.136:0/3100421583 wait complete. 2023-06-23T19:01:35.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.168+0000 7efd9899c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efd94164910 0x7efd940cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.169+0000 7efd9899c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efd94164910 0x7efd940cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:34514/0 (socket says 172.21.15.136:34514) 2023-06-23T19:01:35.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.169+0000 7efd9899c700 1 -- 172.21.15.136:0/1822184893 learned_addr learned my addr 172.21.15.136:0/1822184893 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.169+0000 7efd9899c700 1 -- 172.21.15.136:0/1822184893 >> v1:172.21.15.178:6789/0 conn(0x7efd940c1800 legacy=0x7efd94164200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:01:35.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.169+0000 7efd9899c700 1 -- 172.21.15.136:0/1822184893 >> v1:172.21.15.136:6789/0 conn(0x7efd94160590 legacy=0x7efd9406c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.169+0000 7efd9899c700 1 -- 172.21.15.136:0/1822184893 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9406ce30 con 0x7efd94164910 2023-06-23T19:01:35.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.170+0000 7fc492bff700 1 -- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc47c004850 msgr2=0x7fc47c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.170+0000 7fc492bff700 1 --2- 172.21.15.136:0/3732630763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc47c004850 0x7fc47c004cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c370 tx=0x7fc47c005880 comp rx=0 tx=0).stop 2023-06-23T19:01:35.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.170+0000 7efd9899c700 1 --2- 172.21.15.136:0/1822184893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94164910 0x7efd940cddf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0098f0 tx=0x7efd8c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e55137dfd9154276 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.170+0000 7fc49119c700 1 -- 172.21.15.136:0/3732630763 reap_dead start 2023-06-23T19:01:35.183 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.170+0000 7ff35f9ff700 1 Processor -- start 2023-06-23T19:01:35.184 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.171+0000 7fc492bff700 1 -- 172.21.15.136:0/3732630763 shutdown_connections 2023-06-23T19:01:35.184 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.171+0000 7fc492bff700 1 -- 172.21.15.136:0/3732630763 >> 172.21.15.136:0/3732630763 conn(0x7fc48c071620 msgr2=0x7fc48c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.184 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.171+0000 7fc492bff700 1 -- 172.21.15.136:0/3732630763 shutdown_connections 2023-06-23T19:01:35.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.171+0000 7f21c7fff700 1 Processor -- start 2023-06-23T19:01:35.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.171+0000 7fc492bff700 1 -- 172.21.15.136:0/3732630763 wait complete. 2023-06-23T19:01:35.186 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.171+0000 7ff35f9ff700 1 -- start start 2023-06-23T19:01:35.187 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.171+0000 7f21c7fff700 1 -- start start 2023-06-23T19:01:35.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7ff35f9ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff358160590 0x7ff3580cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7ff35f9ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff3580c1800 0x7ff35806c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7ff35f9ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35806c290 con 0x7ff35806cc60 2023-06-23T19:01:35.189 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7ff35f9ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3580ce330 con 0x7ff3580c1800 2023-06-23T19:01:35.189 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7ff35f9ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3580c1f70 con 0x7ff358160590 2023-06-23T19:01:35.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7f21c7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80c8b20 0x7f21c81f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7f21c7fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c80c8f90 0x7f21c81592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7f21c7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c8158490 0x7f21c80af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7f21c7fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8159ce0 con 0x7f21c80c8b20 2023-06-23T19:01:35.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7f21c7fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8159800 con 0x7f21c8158490 2023-06-23T19:01:35.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7f21c7fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80ad990 con 0x7f21c80c8f90 2023-06-23T19:01:35.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7f21c6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80c8b20 0x7f21c81f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7f21c6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80c8b20 0x7f21c81f8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46296/0 (socket says 172.21.15.136:46296) 2023-06-23T19:01:35.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7f21c6ffd700 1 -- 172.21.15.136:0/1400029010 learned_addr learned my addr 172.21.15.136:0/1400029010 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7fc492bff700 1 Processor -- start 2023-06-23T19:01:35.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.173+0000 7ff35d79b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff358160590 0x7ff3580cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7ff35d79b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff358160590 0x7ff3580cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:34524/0 (socket says 172.21.15.136:34524) 2023-06-23T19:01:35.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7ff35d79b700 1 -- 172.21.15.136:0/1211670720 learned_addr learned my addr 172.21.15.136:0/1211670720 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7ff35cf9a700 1 --2- 172.21.15.136:0/1211670720 >> v2:172.21.15.136:3300/0 conn(0x7ff3580c1800 0x7ff35806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7fc492bff700 1 -- start start 2023-06-23T19:01:35.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7efd92ffd700 1 -- 172.21.15.136:0/1822184893 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c004230 con 0x7efd94164910 2023-06-23T19:01:35.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7efd92ffd700 1 -- 172.21.15.136:0/1822184893 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c004390 con 0x7efd94164910 2023-06-23T19:01:35.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7efd92ffd700 1 -- 172.21.15.136:0/1822184893 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0036a0 con 0x7efd94164910 2023-06-23T19:01:35.194 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7ff35d79b700 1 -- 172.21.15.136:0/1211670720 >> v2:172.21.15.136:3300/0 conn(0x7ff3580c1800 msgr2=0x7ff35806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.194 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7ff34ffff700 1 -- 172.21.15.136:0/1211670720 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048252695 0 0) 0x7ff35806c290 con 0x7ff35806cc60 2023-06-23T19:01:35.194 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7ff35d79b700 1 --2- 172.21.15.136:0/1211670720 >> v2:172.21.15.136:3300/0 conn(0x7ff3580c1800 0x7ff35806c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.194 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7ff35d79b700 1 -- 172.21.15.136:0/1211670720 >> v1:172.21.15.178:6789/0 conn(0x7ff35806cc60 legacy=0x7ff358164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.194 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7ff35d79b700 1 -- 172.21.15.136:0/1211670720 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3580cc400 con 0x7ff358160590 2023-06-23T19:01:35.195 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7f21c6ffd700 1 -- 172.21.15.136:0/1400029010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c80c8f90 msgr2=0x7f21c81592c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-23T19:01:35.195 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7f21c6ffd700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c80c8f90 0x7f21c81592c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.195 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7f21c6ffd700 1 -- 172.21.15.136:0/1400029010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c8158490 msgr2=0x7f21c80af940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T19:01:35.195 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7f21c6ffd700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c8158490 0x7f21c80af940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.195 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.174+0000 7f21c6ffd700 1 -- 172.21.15.136:0/1400029010 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0094a0 con 0x7f21c80c8b20 2023-06-23T19:01:35.196 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7f4b567ff700 1 Processor -- start 2023-06-23T19:01:35.196 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7ff35d79b700 1 --2- 172.21.15.136:0/1211670720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 0x7ff3580cddf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff358071b10 tx=0x7ff348009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe5778ce481e6e38 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.196 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7f21c6ffd700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80c8b20 0x7f21c81f8f30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d800 tx=0x7f21b800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7ff34ffff700 1 -- 172.21.15.136:0/1211670720 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348011830 con 0x7ff358160590 2023-06-23T19:01:35.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7ff34ffff700 1 -- 172.21.15.136:0/1211670720 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff348011990 con 0x7ff358160590 2023-06-23T19:01:35.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7ff34ffff700 1 -- 172.21.15.136:0/1211670720 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348011d20 con 0x7ff358160590 2023-06-23T19:01:35.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7f4b567ff700 1 -- start start 2023-06-23T19:01:35.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7f21af7fe700 1 -- 172.21.15.136:0/1400029010 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80125f0 con 0x7f21c80c8b20 2023-06-23T19:01:35.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7f21af7fe700 1 -- 172.21.15.136:0/1400029010 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8012750 con 0x7f21c80c8b20 2023-06-23T19:01:35.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7f21af7fe700 1 -- 172.21.15.136:0/1400029010 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8012b00 con 0x7f21c80c8b20 2023-06-23T19:01:35.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7fc492bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc47c004850 0x7fc48c0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7fc492bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c0b6b10 0x7fc48c14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7fc492bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc48c0c9d30 0x7fc48c144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7fc492bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0b2b60 con 0x7fc48c0c9d30 2023-06-23T19:01:35.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7fc492bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0b2830 con 0x7fc47c004850 2023-06-23T19:01:35.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7fc492bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0d2550 con 0x7fc48c0b6b10 2023-06-23T19:01:35.200 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7efd9a3ff700 1 -- 172.21.15.136:0/1822184893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94164910 msgr2=0x7efd940cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.200 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.175+0000 7efd9a3ff700 1 --2- 172.21.15.136:0/1822184893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94164910 0x7efd940cddf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0098f0 tx=0x7efd8c009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:35.200 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7efd9a3ff700 1 -- 172.21.15.136:0/1822184893 shutdown_connections 2023-06-23T19:01:35.200 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7efd9a3ff700 1 --2- 172.21.15.136:0/1822184893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94164910 0x7efd940cddf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.200 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7efd9a3ff700 1 -- 172.21.15.136:0/1822184893 >> 172.21.15.136:0/1822184893 conn(0x7efd940b0ef0 msgr2=0x7efd940ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.201 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7efd9a3ff700 1 -- 172.21.15.136:0/1822184893 shutdown_connections 2023-06-23T19:01:35.201 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7f550f1ff700 1 Processor -- start 2023-06-23T19:01:35.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7ff35f9ff700 1 -- 172.21.15.136:0/1211670720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 msgr2=0x7ff3580cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7ff35f9ff700 1 --2- 172.21.15.136:0/1211670720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 0x7ff3580cddf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff358071b10 tx=0x7ff348009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7ff35f9ff700 1 -- 172.21.15.136:0/1211670720 shutdown_connections 2023-06-23T19:01:35.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7ff35f9ff700 1 --2- 172.21.15.136:0/1211670720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 0x7ff3580cddf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7ff35f9ff700 1 --2- 172.21.15.136:0/1211670720 >> v2:172.21.15.136:3300/0 conn(0x7ff3580c1800 0x7ff35806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7ff35f9ff700 1 -- 172.21.15.136:0/1211670720 >> 172.21.15.136:0/1211670720 conn(0x7ff3580b0ef0 msgr2=0x7ff3580ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.203 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7ff35f9ff700 1 -- 172.21.15.136:0/1211670720 shutdown_connections 2023-06-23T19:01:35.203 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7ff35f9ff700 1 -- 172.21.15.136:0/1211670720 wait complete. 2023-06-23T19:01:35.203 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7f4b567ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4b5015c570 0x7f4b500cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.203 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7f4b567ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4b500cd660 0x7f4b50160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.203 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7f4b567ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b5006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7f4b567ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5015d670 con 0x7f4b5015c570 2023-06-23T19:01:35.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7f4b567ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b500cdae0 con 0x7f4b500cd660 2023-06-23T19:01:35.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7f4b567ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b501610a0 con 0x7f4b50160880 2023-06-23T19:01:35.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.178+0000 7f4b54d9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b5006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.178+0000 7f4b54d9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b5006b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:41770/0 (socket says 172.21.15.136:41770) 2023-06-23T19:01:35.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.178+0000 7f4b54d9c700 1 -- 172.21.15.136:0/1397299551 learned_addr learned my addr 172.21.15.136:0/1397299551 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.178+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c80adc70 con 0x7f21c80c8b20 2023-06-23T19:01:35.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.178+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c80ae230 con 0x7f21c80c8b20 2023-06-23T19:01:35.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7fc48bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c0b6b10 0x7fc48c14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7fc48bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c0b6b10 0x7fc48c14d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:41754/0 (socket says 172.21.15.136:41754) 2023-06-23T19:01:35.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7fc48bfff700 1 -- 172.21.15.136:0/621237859 learned_addr learned my addr 172.21.15.136:0/621237859 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7fc49099b700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc47c004850 0x7fc48c0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7fc48bfff700 1 -- 172.21.15.136:0/621237859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc47c004850 msgr2=0x7fc48c0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7fc48bfff700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc47c004850 0x7fc48c0b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7fc48bfff700 1 -- 172.21.15.136:0/621237859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc48c0c9d30 msgr2=0x7fc48c144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7fc48bfff700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc48c0c9d30 0x7fc48c144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.177+0000 7fc48bfff700 1 -- 172.21.15.136:0/621237859 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0b70d0 con 0x7fc48c0b6b10 2023-06-23T19:01:35.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.176+0000 7efd9a3ff700 1 -- 172.21.15.136:0/1822184893 wait complete. 2023-06-23T19:01:35.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.179+0000 7efd9a3ff700 1 Processor -- start 2023-06-23T19:01:35.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.179+0000 7f4b54d9c700 1 -- 172.21.15.136:0/1397299551 >> v2:172.21.15.178:3300/0 conn(0x7f4b500cd660 msgr2=0x7f4b50160340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:01:35.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.179+0000 7f4b54d9c700 1 --2- 172.21.15.136:0/1397299551 >> v2:172.21.15.178:3300/0 conn(0x7f4b500cd660 0x7f4b50160340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.179+0000 7f4b54d9c700 1 -- 172.21.15.136:0/1397299551 >> v2:172.21.15.136:3300/0 conn(0x7f4b5015c570 msgr2=0x7f4b500cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.179+0000 7f4b54d9c700 1 --2- 172.21.15.136:0/1397299551 >> v2:172.21.15.136:3300/0 conn(0x7f4b5015c570 0x7f4b500cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.179+0000 7f4b54d9c700 1 -- 172.21.15.136:0/1397299551 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5015da90 con 0x7f4b50160880 2023-06-23T19:01:35.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.179+0000 7f4b54d9c700 1 --2- 172.21.15.136:0/1397299551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b5006b200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b5008bc50 tx=0x7f4b4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9663ce030b477bac server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.179+0000 7f4b4effd700 1 -- 172.21.15.136:0/1397299551 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800e070 con 0x7f4b50160880 2023-06-23T19:01:35.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.180+0000 7f4b4effd700 1 -- 172.21.15.136:0/1397299551 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4800b9c0 con 0x7f4b50160880 2023-06-23T19:01:35.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.180+0000 7f4b4effd700 1 -- 172.21.15.136:0/1397299551 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800bd70 con 0x7f4b50160880 2023-06-23T19:01:35.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.180+0000 7ff35f9ff700 1 Processor -- start 2023-06-23T19:01:35.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.180+0000 7ff35f9ff700 1 -- start start 2023-06-23T19:01:35.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.179+0000 7f550f1ff700 1 -- start start 2023-06-23T19:01:35.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7f550f1ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5508160590 0x7f55080cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7f550f1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55080c1800 0x7f550806c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7f550f1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550806c290 con 0x7f550806cc60 2023-06-23T19:01:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7f550f1ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55080ce330 con 0x7f5508160590 2023-06-23T19:01:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7f550f1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080c1f70 con 0x7f55080c1800 2023-06-23T19:01:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7f4b567ff700 1 -- 172.21.15.136:0/1397299551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 msgr2=0x7f4b5006b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7f4b567ff700 1 --2- 172.21.15.136:0/1397299551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b5006b200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b5008bc50 tx=0x7f4b4800b330 comp rx=0 tx=0).stop 2023-06-23T19:01:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7ff35f9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35806cc60 0x7ff3581f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7ff35f9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3580c1800 0x7ff3580cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7ff35f9ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 0x7ff3580c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7ff35f9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580c68c0 con 0x7ff3580c1800 2023-06-23T19:01:35.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7ff35f9ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3581f7010 con 0x7ff358160590 2023-06-23T19:01:35.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7ff35f9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580cb7a0 con 0x7ff35806cc60 2023-06-23T19:01:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7fc48bfff700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c0b6b10 0x7fc48c14d7c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00c250 tx=0x7fc480001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.180+0000 7efd9a3ff700 1 -- start start 2023-06-23T19:01:35.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7efd9a3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd940c1800 0x7efd940cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7efd9a3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd94160590 0x7efd941f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7efd9a3ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94164910 0x7efd940c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7efd9a3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd941f9d30 con 0x7efd94160590 2023-06-23T19:01:35.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7efd9a3ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd941f6550 con 0x7efd94164910 2023-06-23T19:01:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.181+0000 7efd9a3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd940c85e0 con 0x7efd940c1800 2023-06-23T19:01:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7efd93fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd940c1800 0x7efd940cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7efd93fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd940c1800 0x7efd940cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:41798/0 (socket says 172.21.15.136:41798) 2023-06-23T19:01:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7efd93fff700 1 -- 172.21.15.136:0/1804116732 learned_addr learned my addr 172.21.15.136:0/1804116732 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7efd9899c700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94164910 0x7efd940c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7f550d79c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f550806cc60 0x7f5508164200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:35378/0 (socket says 172.21.15.136:35378) 2023-06-23T19:01:35.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7f550d79c700 1 -- 172.21.15.136:0/893947481 learned_addr learned my addr 172.21.15.136:0/893947481 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:35.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7f5507fff700 1 --2- 172.21.15.136:0/893947481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55080c1800 0x7f550806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7ff35df9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 0x7ff3580c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7ff35df9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 0x7ff3580c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:34568/0 (socket says 172.21.15.136:34568) 2023-06-23T19:01:35.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7ff35df9c700 1 -- 172.21.15.136:0/2055182019 learned_addr learned my addr 172.21.15.136:0/2055182019 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.182+0000 7ff35d79b700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35806cc60 0x7ff3581f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7efd93fff700 1 -- 172.21.15.136:0/1804116732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94164910 msgr2=0x7efd940c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7efd93fff700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94164910 0x7efd940c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7efd93fff700 1 -- 172.21.15.136:0/1804116732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd94160590 msgr2=0x7efd941f97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7efd93fff700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd94160590 0x7efd941f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7efd93fff700 1 -- 172.21.15.136:0/1804116732 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c009550 con 0x7efd940c1800 2023-06-23T19:01:35.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7ff35cf9a700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3580c1800 0x7ff3580cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7ff35df9c700 1 -- 172.21.15.136:0/2055182019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35806cc60 msgr2=0x7ff3581f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7ff35df9c700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35806cc60 0x7ff3581f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7ff35df9c700 1 -- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3580c1800 msgr2=0x7ff3580cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7ff35df9c700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3580c1800 0x7ff3580cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7ff35df9c700 1 -- 172.21.15.136:0/2055182019 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009550 con 0x7ff358160590 2023-06-23T19:01:35.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7ff35cf9a700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3580c1800 0x7ff3580cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:35.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7efd93fff700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd940c1800 0x7efd940cb6c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd84001ed0 tx=0x7efd840021e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c804ea20 con 0x7f21c80c8b20 2023-06-23T19:01:35.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7ff35df9c700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 0x7ff3580c7440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c780 tx=0x7ff35400ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7fc4897fa700 1 -- 172.21.15.136:0/621237859 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480001c10 con 0x7fc48c0b6b10 2023-06-23T19:01:35.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7fc4897fa700 1 -- 172.21.15.136:0/621237859 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc480005e80 con 0x7fc48c0b6b10 2023-06-23T19:01:35.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7fc4897fa700 1 -- 172.21.15.136:0/621237859 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480004ca0 con 0x7fc48c0b6b10 2023-06-23T19:01:35.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c0b73b0 con 0x7fc48c0b6b10 2023-06-23T19:01:35.224 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c14dd00 con 0x7fc48c0b6b10 2023-06-23T19:01:35.224 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7ff34dffb700 1 -- 172.21.15.136:0/2055182019 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354003e30 con 0x7ff358160590 2023-06-23T19:01:35.224 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7ff34dffb700 1 -- 172.21.15.136:0/2055182019 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354005070 con 0x7ff358160590 2023-06-23T19:01:35.224 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7ff34dffb700 1 -- 172.21.15.136:0/2055182019 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354005400 con 0x7ff358160590 2023-06-23T19:01:35.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3580cb080 con 0x7ff358160590 2023-06-23T19:01:35.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3580c5f90 con 0x7ff358160590 2023-06-23T19:01:35.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.183+0000 7f550cf9b700 1 --2- 172.21.15.136:0/893947481 >> v2:172.21.15.178:3300/0 conn(0x7f5508160590 0x7f55080cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7f55077fe700 1 -- 172.21.15.136:0/893947481 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105618355 0 0) 0x7f550806c290 con 0x7f550806cc60 2023-06-23T19:01:35.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7f55077fe700 1 -- 172.21.15.136:0/893947481 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f00035b0 con 0x7f550806cc60 2023-06-23T19:01:35.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7f5507fff700 1 -- 172.21.15.136:0/893947481 >> v2:172.21.15.178:3300/0 conn(0x7f5508160590 msgr2=0x7f55080cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7f5507fff700 1 --2- 172.21.15.136:0/893947481 >> v2:172.21.15.178:3300/0 conn(0x7f5508160590 0x7f55080cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7f5507fff700 1 -- 172.21.15.136:0/893947481 >> v1:172.21.15.178:6789/0 conn(0x7f550806cc60 legacy=0x7f5508164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.184+0000 7f5507fff700 1 -- 172.21.15.136:0/893947481 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080cc400 con 0x7f55080c1800 2023-06-23T19:01:35.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7f5507fff700 1 --2- 172.21.15.136:0/893947481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55080c1800 0x7f550806c720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009840 tx=0x7f54f8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2814c15038675d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7efd90ff9700 1 -- 172.21.15.136:0/1804116732 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84003c00 con 0x7efd940c1800 2023-06-23T19:01:35.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7efd90ff9700 1 -- 172.21.15.136:0/1804116732 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd84003d60 con 0x7efd940c1800 2023-06-23T19:01:35.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7efd90ff9700 1 -- 172.21.15.136:0/1804116732 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400abf0 con 0x7efd940c1800 2023-06-23T19:01:35.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7f21af7fe700 1 -- 172.21.15.136:0/1400029010 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21b8012c60 con 0x7f21c80c8b20 2023-06-23T19:01:35.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.187+0000 7f21af7fe700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f21b406adb0 0x7f21b406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.187+0000 7f21af7fe700 1 -- 172.21.15.136:0/1400029010 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f21b8089b80 con 0x7f21c80c8b20 2023-06-23T19:01:35.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7efd9a3ff700 1 -- 172.21.15.136:0/1804116732 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd941f6200 con 0x7efd940c1800 2023-06-23T19:01:35.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7efd9a3ff700 1 -- 172.21.15.136:0/1804116732 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd941fa240 con 0x7efd940c1800 2023-06-23T19:01:35.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.187+0000 7efd8a7fc700 1 -- 172.21.15.136:0/1804116732 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd780052f0 con 0x7efd940c1800 2023-06-23T19:01:35.233 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7f4b567ff700 1 -- 172.21.15.136:0/1397299551 shutdown_connections 2023-06-23T19:01:35.233 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7f4b567ff700 1 --2- 172.21.15.136:0/1397299551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b5006b200 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.233 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7f4b567ff700 1 --2- 172.21.15.136:0/1397299551 >> v2:172.21.15.136:3300/0 conn(0x7f4b5015c570 0x7f4b500cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.185+0000 7f4b567ff700 1 --2- 172.21.15.136:0/1397299551 >> v2:172.21.15.178:3300/0 conn(0x7f4b500cd660 0x7f4b50160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.186+0000 7f4b567ff700 1 -- 172.21.15.136:0/1397299551 >> 172.21.15.136:0/1397299551 conn(0x7f4b50071620 msgr2=0x7f4b500719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.186+0000 7f4b567ff700 1 -- 172.21.15.136:0/1397299551 shutdown_connections 2023-06-23T19:01:35.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.186+0000 7f4b567ff700 1 -- 172.21.15.136:0/1397299551 wait complete. 2023-06-23T19:01:35.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.186+0000 7f55077fe700 1 -- 172.21.15.136:0/893947481 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011830 con 0x7f55080c1800 2023-06-23T19:01:35.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.186+0000 7f55077fe700 1 -- 172.21.15.136:0/893947481 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f8011990 con 0x7f55080c1800 2023-06-23T19:01:35.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.186+0000 7f55077fe700 1 -- 172.21.15.136:0/893947481 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011d20 con 0x7f55080c1800 2023-06-23T19:01:35.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.187+0000 7f550f1ff700 1 -- 172.21.15.136:0/893947481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55080c1800 msgr2=0x7f550806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.187+0000 7f550f1ff700 1 --2- 172.21.15.136:0/893947481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55080c1800 0x7f550806c720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009840 tx=0x7f54f8009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:35.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.188+0000 7f550f1ff700 1 -- 172.21.15.136:0/893947481 shutdown_connections 2023-06-23T19:01:35.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.188+0000 7f550f1ff700 1 --2- 172.21.15.136:0/893947481 >> v2:172.21.15.178:3300/0 conn(0x7f5508160590 0x7f55080cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.188+0000 7f550f1ff700 1 --2- 172.21.15.136:0/893947481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55080c1800 0x7f550806c720 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.188+0000 7f550f1ff700 1 -- 172.21.15.136:0/893947481 >> 172.21.15.136:0/893947481 conn(0x7f55080b0ef0 msgr2=0x7f55080ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.186+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff358073910 con 0x7ff358160590 2023-06-23T19:01:35.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.190+0000 7f21c67fc700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f21b406adb0 0x7f21b406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7f21c67fc700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f21b406adb0 0x7f21b406d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b45f0 tx=0x7f21bc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.189+0000 7fc4897fa700 1 -- 172.21.15.136:0/621237859 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc480019070 con 0x7fc48c0b6b10 2023-06-23T19:01:35.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.190+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46c0052f0 con 0x7fc48c0b6b10 2023-06-23T19:01:35.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7fc4897fa700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc47006adb0 0x7fc47006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7fc4897fa700 1 -- 172.21.15.136:0/621237859 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc48008aec0 con 0x7fc48c0b6b10 2023-06-23T19:01:35.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.188+0000 7f550f1ff700 1 -- 172.21.15.136:0/893947481 shutdown_connections 2023-06-23T19:01:35.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.188+0000 7f550f1ff700 1 -- 172.21.15.136:0/893947481 wait complete. 2023-06-23T19:01:35.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.191+0000 7f550f1ff700 1 Processor -- start 2023-06-23T19:01:35.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.188+0000 7ff34dffb700 1 -- 172.21.15.136:0/2055182019 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff354005560 con 0x7ff358160590 2023-06-23T19:01:35.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.190+0000 7ff34dffb700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff33c06adb0 0x7ff33c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.190+0000 7ff34dffb700 1 -- 172.21.15.136:0/2055182019 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff354088e40 con 0x7ff358160590 2023-06-23T19:01:35.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.191+0000 7ff35d79b700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff33c06adb0 0x7ff33c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7ff35d79b700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff33c06adb0 0x7ff33c06d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff348009c10 tx=0x7ff34801d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.190+0000 7efd90ff9700 1 -- 172.21.15.136:0/1804116732 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd8400ad50 con 0x7efd940c1800 2023-06-23T19:01:35.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7efd90ff9700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efd7406adb0 0x7efd7406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7efd90ff9700 1 -- 172.21.15.136:0/1804116732 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd84089ba0 con 0x7efd940c1800 2023-06-23T19:01:35.242 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.189+0000 7f4b567ff700 1 Processor -- start 2023-06-23T19:01:35.242 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.189+0000 7f4b567ff700 1 -- start start 2023-06-23T19:01:35.242 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.190+0000 7f4b567ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b500cd660 0x7f4b500cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.242 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.190+0000 7f4b567ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5015c570 0x7f4b5015b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.243 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.191+0000 7f4b567ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b500b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.243 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.191+0000 7f4b567ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b500b61c0 con 0x7f4b5015c570 2023-06-23T19:01:35.243 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.191+0000 7f4b567ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b500cca50 con 0x7f4b500cd660 2023-06-23T19:01:35.243 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.191+0000 7f4b567ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b500b59b0 con 0x7f4b50160880 2023-06-23T19:01:35.243 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.191+0000 7f550f1ff700 1 -- start start 2023-06-23T19:01:35.244 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7fc49099b700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc47006adb0 0x7fc47006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.244 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7f550f1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f550806cc60 0x7f55081509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.244 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7f550f1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55080c1800 0x7f5508145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7f550f1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5508160590 0x7f550814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7f550f1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5508150f20 con 0x7f5508160590 2023-06-23T19:01:35.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7f550f1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550814cf10 con 0x7f55080c1800 2023-06-23T19:01:35.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.192+0000 7f550f1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5508145db0 con 0x7f550806cc60 2023-06-23T19:01:35.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7f4b4ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b500cd660 0x7f4b500cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7f4b54d9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b500b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7fc49099b700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc47006adb0 0x7fc47006d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc48c04fa50 tx=0x7fc478009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7efd937fe700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efd7406adb0 0x7efd7406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7f550cf9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f550806cc60 0x7f55081509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7f5507fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55080c1800 0x7f5508145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7f4b4ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b500cd660 0x7f4b500cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:34572/0 (socket says 172.21.15.136:34572) 2023-06-23T19:01:35.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7f4b4ffff700 1 -- 172.21.15.136:0/364029182 learned_addr learned my addr 172.21.15.136:0/364029182 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7f550cf9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f550806cc60 0x7f55081509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:41834/0 (socket says 172.21.15.136:41834) 2023-06-23T19:01:35.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.193+0000 7f550cf9b700 1 -- 172.21.15.136:0/1922497590 learned_addr learned my addr 172.21.15.136:0/1922497590 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7efd937fe700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efd7406adb0 0x7efd7406d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd940c5710 tx=0x7efd7c007ae0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f4b4ffff700 1 -- 172.21.15.136:0/364029182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 msgr2=0x7f4b500b7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f4b4ffff700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b500b7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f4b4ffff700 1 -- 172.21.15.136:0/364029182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5015c570 msgr2=0x7f4b5015b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f4b4ffff700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5015c570 0x7f4b5015b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f4b4ffff700 1 -- 172.21.15.136:0/364029182 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48009b30 con 0x7f4b500cd660 2023-06-23T19:01:35.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f4b54d9c700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b500b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:35.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f5507fff700 1 -- 172.21.15.136:0/1922497590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f550806cc60 msgr2=0x7f55081509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f5507fff700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f550806cc60 0x7f55081509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f5507fff700 1 -- 172.21.15.136:0/1922497590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5508160590 msgr2=0x7f550814ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f5507fff700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5508160590 0x7f550814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f5507fff700 1 -- 172.21.15.136:0/1922497590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f80094a0 con 0x7f55080c1800 2023-06-23T19:01:35.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f4b4ffff700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b500cd660 0x7f4b500cb5c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000b560 tx=0x7f4b4000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.194+0000 7f5507fff700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55080c1800 0x7f5508145870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5508071bc0 tx=0x7f54f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.195+0000 7ff34dffb700 1 -- 172.21.15.136:0/2055182019 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff354053be0 con 0x7ff358160590 2023-06-23T19:01:35.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.195+0000 7f4b4cff9700 1 -- 172.21.15.136:0/364029182 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40011830 con 0x7f4b500cd660 2023-06-23T19:01:35.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.195+0000 7f4b4cff9700 1 -- 172.21.15.136:0/364029182 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b400119b0 con 0x7f4b500cd660 2023-06-23T19:01:35.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.195+0000 7f4b4cff9700 1 -- 172.21.15.136:0/364029182 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40011d60 con 0x7f4b500cd660 2023-06-23T19:01:35.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.195+0000 7efd90ff9700 1 -- 172.21.15.136:0/1804116732 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efd840549d0 con 0x7efd940c1800 2023-06-23T19:01:35.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.195+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5015ee90 con 0x7f4b500cd660 2023-06-23T19:01:35.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.195+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b500b5c00 con 0x7f4b500cd660 2023-06-23T19:01:35.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.195+0000 7f55057fa700 1 -- 172.21.15.136:0/1922497590 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8004300 con 0x7f55080c1800 2023-06-23T19:01:35.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.196+0000 7f55057fa700 1 -- 172.21.15.136:0/1922497590 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f801f070 con 0x7f55080c1800 2023-06-23T19:01:35.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.196+0000 7f55057fa700 1 -- 172.21.15.136:0/1922497590 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80036a0 con 0x7f55080c1800 2023-06-23T19:01:35.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.196+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5508151150 con 0x7f55080c1800 2023-06-23T19:01:35.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.196+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550814cba0 con 0x7f55080c1800 2023-06-23T19:01:35.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.196+0000 7f4f707ff700 1 Processor -- start 2023-06-23T19:01:35.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.196+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b50073910 con 0x7f4b500cd660 2023-06-23T19:01:35.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.197+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e80052f0 con 0x7f55080c1800 2023-06-23T19:01:35.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.197+0000 7f4f707ff700 1 -- start start 2023-06-23T19:01:35.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.199+0000 7f4f707ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4f6815c570 0x7f4f680cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.199+0000 7f4f707ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4f680cd660 0x7f4f68160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.199+0000 7f4f707ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f681610a0 con 0x7f4f68160880 2023-06-23T19:01:35.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.199+0000 7f4f707ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6815d670 con 0x7f4f6815c570 2023-06-23T19:01:35.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.199+0000 7f4f707ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f680cdae0 con 0x7f4f680cd660 2023-06-23T19:01:35.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.199+0000 7f4f6e59b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4f6815c570 0x7f4f680cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.200+0000 7f4f6e59b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4f6815c570 0x7f4f680cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46382/0 (socket says 172.21.15.136:46382) 2023-06-23T19:01:35.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.200+0000 7f4f6e59b700 1 -- 172.21.15.136:0/380520850 learned_addr learned my addr 172.21.15.136:0/380520850 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.200+0000 7f4f6dd9a700 1 --2- 172.21.15.136:0/380520850 >> v2:172.21.15.178:3300/0 conn(0x7f4f680cd660 0x7f4f68160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.200+0000 7f21af7fe700 1 -- 172.21.15.136:0/1400029010 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f21b80549b0 con 0x7f21c80c8b20 2023-06-23T19:01:35.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.200+0000 7f4f6e59b700 1 -- 172.21.15.136:0/380520850 >> v2:172.21.15.178:3300/0 conn(0x7f4f680cd660 msgr2=0x7f4f68160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.200+0000 7f4f6e59b700 1 --2- 172.21.15.136:0/380520850 >> v2:172.21.15.178:3300/0 conn(0x7f4f680cd660 0x7f4f68160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.200+0000 7f4f6e59b700 1 -- 172.21.15.136:0/380520850 >> v1:172.21.15.136:6789/0 conn(0x7f4f68160880 legacy=0x7f4f6806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.200+0000 7f4f6e59b700 1 -- 172.21.15.136:0/380520850 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6815da90 con 0x7f4f6815c570 2023-06-23T19:01:35.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.201+0000 7fc4897fa700 1 -- 172.21.15.136:0/621237859 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc480055e10 con 0x7fc48c0b6b10 2023-06-23T19:01:35.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.199+0000 7f4b4cff9700 1 -- 172.21.15.136:0/364029182 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b4001a400 con 0x7f4b500cd660 2023-06-23T19:01:35.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.201+0000 7f4b4cff9700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b3406ad80 0x7f4b3406d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.201+0000 7f4b4cff9700 1 -- 172.21.15.136:0/364029182 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b40089a10 con 0x7f4b500cd660 2023-06-23T19:01:35.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.202+0000 7f4f6e59b700 1 --2- 172.21.15.136:0/380520850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f6815c570 0x7f4f680cd120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f6808bc50 tx=0x7f4f64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18ca6d60c0b234b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.202+0000 7f4b4f7fe700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b3406ad80 0x7f4b3406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.202+0000 7f55057fa700 1 -- 172.21.15.136:0/1922497590 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54f8021030 con 0x7f55080c1800 2023-06-23T19:01:35.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.204+0000 7fe4a7fff700 1 Processor -- start 2023-06-23T19:01:35.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.204+0000 7fe4a7fff700 1 -- start start 2023-06-23T19:01:35.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.204+0000 7f4f6d599700 1 -- 172.21.15.136:0/380520850 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64004230 con 0x7f4f6815c570 2023-06-23T19:01:35.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.205+0000 7f4f6d599700 1 -- 172.21.15.136:0/380520850 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f64004390 con 0x7f4f6815c570 2023-06-23T19:01:35.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.205+0000 7f4f6d599700 1 -- 172.21.15.136:0/380520850 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f640036a0 con 0x7f4f6815c570 2023-06-23T19:01:35.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7f4f707ff700 1 -- 172.21.15.136:0/380520850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f6815c570 msgr2=0x7f4f680cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7f4f707ff700 1 --2- 172.21.15.136:0/380520850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f6815c570 0x7f4f680cd120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f6808bc50 tx=0x7f4f64009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.204+0000 7f55057fa700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54f406adb0 0x7f54f406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.204+0000 7f55057fa700 1 -- 172.21.15.136:0/1922497590 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54f808abc0 con 0x7f55080c1800 2023-06-23T19:01:35.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.205+0000 7f550cf9b700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54f406adb0 0x7f54f406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7f550cf9b700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54f406adb0 0x7f54f406d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f55080b0100 tx=0x7f54fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7fe4a7fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4a0160590 0x7fe4a00cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 0x7fe4a0164680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7fe4a7fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a006c290 con 0x7fe4a00c1800 2023-06-23T19:01:35.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7fe4a7fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a0164bc0 con 0x7fe4a0160590 2023-06-23T19:01:35.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7fe4a7fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00ce330 con 0x7fe4a0164200 2023-06-23T19:01:35.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7fe4a5d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4a0160590 0x7fe4a00cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7fe4a5d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4a0160590 0x7fe4a00cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:34582/0 (socket says 172.21.15.136:34582) 2023-06-23T19:01:35.263 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7fe4a5d9b700 1 -- 172.21.15.136:0/1223270433 learned_addr learned my addr 172.21.15.136:0/1223270433 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7f4f707ff700 1 -- 172.21.15.136:0/380520850 shutdown_connections 2023-06-23T19:01:35.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7f4f707ff700 1 --2- 172.21.15.136:0/380520850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f6815c570 0x7f4f680cd120 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7f4f707ff700 1 --2- 172.21.15.136:0/380520850 >> v2:172.21.15.178:3300/0 conn(0x7f4f680cd660 0x7f4f68160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.206+0000 7f4f707ff700 1 -- 172.21.15.136:0/380520850 >> 172.21.15.136:0/380520850 conn(0x7f4f68071620 msgr2=0x7f4f680719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.207+0000 7fe4a659c700 1 --2- 172.21.15.136:0/1223270433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 0x7fe4a0164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.207+0000 7f55057fa700 1 -- 172.21.15.136:0/1922497590 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54f80559f0 con 0x7f55080c1800 2023-06-23T19:01:35.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.207+0000 7fe4a5d9b700 1 -- 172.21.15.136:0/1223270433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 msgr2=0x7fe4a0164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.207+0000 7fe4a5d9b700 1 --2- 172.21.15.136:0/1223270433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 0x7fe4a0164680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.207+0000 7fe4a5d9b700 1 -- 172.21.15.136:0/1223270433 >> v1:172.21.15.136:6789/0 conn(0x7fe4a00c1800 legacy=0x7fe4a006c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.207+0000 7fe4a5d9b700 1 -- 172.21.15.136:0/1223270433 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00c1f70 con 0x7fe4a0160590 2023-06-23T19:01:35.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.208+0000 7f4f707ff700 1 -- 172.21.15.136:0/380520850 shutdown_connections 2023-06-23T19:01:35.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.208+0000 7fe4a5d9b700 1 --2- 172.21.15.136:0/1223270433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 0x7fe4a00cddf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0098f0 tx=0x7fe49c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=116dd6c73ea87fb3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.208+0000 7fe4a4d99700 1 -- 172.21.15.136:0/1223270433 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c011830 con 0x7fe4a0160590 2023-06-23T19:01:35.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.208+0000 7fe4a4d99700 1 -- 172.21.15.136:0/1223270433 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c011990 con 0x7fe4a0160590 2023-06-23T19:01:35.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.208+0000 7fe4a4d99700 1 -- 172.21.15.136:0/1223270433 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c011d20 con 0x7fe4a0160590 2023-06-23T19:01:35.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.209+0000 7fe4a7fff700 1 -- 172.21.15.136:0/1223270433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 msgr2=0x7fe4a00cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.209+0000 7fe4a7fff700 1 --2- 172.21.15.136:0/1223270433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 0x7fe4a00cddf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0098f0 tx=0x7fe49c009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:35.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.209+0000 7fe4a7fff700 1 -- 172.21.15.136:0/1223270433 shutdown_connections 2023-06-23T19:01:35.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.209+0000 7fe4a7fff700 1 --2- 172.21.15.136:0/1223270433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 0x7fe4a00cddf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.209+0000 7fe4a7fff700 1 --2- 172.21.15.136:0/1223270433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 0x7fe4a0164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.209+0000 7fe4a7fff700 1 -- 172.21.15.136:0/1223270433 >> 172.21.15.136:0/1223270433 conn(0x7fe4a00b0ef0 msgr2=0x7fe4a00ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.208+0000 7f4f707ff700 1 -- 172.21.15.136:0/380520850 wait complete. 2023-06-23T19:01:35.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.210+0000 7fe4a7fff700 1 -- 172.21.15.136:0/1223270433 shutdown_connections 2023-06-23T19:01:35.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.208+0000 7f4b4f7fe700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b3406ad80 0x7f4b3406d230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b500d3660 tx=0x7f4b44007ae0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.210+0000 7fe4a7fff700 1 -- 172.21.15.136:0/1223270433 wait complete. 2023-06-23T19:01:35.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.211+0000 7f4f707ff700 1 Processor -- start 2023-06-23T19:01:35.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.213+0000 7fe4a7fff700 1 Processor -- start 2023-06-23T19:01:35.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.211+0000 7f4f707ff700 1 -- start start 2023-06-23T19:01:35.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.213+0000 7f4f707ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f680cd660 0x7f4f680b8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.213+0000 7f4f707ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6815c570 0x7f4f680c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.213+0000 7f4f707ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f68160880 0x7f4f681e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.213+0000 7f4f707ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f68151aa0 con 0x7f4f68160880 2023-06-23T19:01:35.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.213+0000 7f4f707ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f680b46b0 con 0x7f4f6815c570 2023-06-23T19:01:35.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.213+0000 7f4f707ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f680b3610 con 0x7f4f680cd660 2023-06-23T19:01:35.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.213+0000 7f4f6dd9a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6815c570 0x7f4f680c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.214+0000 7f4f6dd9a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6815c570 0x7f4f680c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:34598/0 (socket says 172.21.15.136:34598) 2023-06-23T19:01:35.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.214+0000 7f4f6dd9a700 1 -- 172.21.15.136:0/2575610165 learned_addr learned my addr 172.21.15.136:0/2575610165 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.213+0000 7fe4a7fff700 1 -- start start 2023-06-23T19:01:35.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.214+0000 7f4f6e59b700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f680cd660 0x7f4f680b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.214+0000 7f4f6dd9a700 1 -- 172.21.15.136:0/2575610165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f680cd660 msgr2=0x7f4f680b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.214+0000 7f4f6dd9a700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f680cd660 0x7f4f680b8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.214+0000 7f4f6dd9a700 1 -- 172.21.15.136:0/2575610165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f68160880 msgr2=0x7f4f681e64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.214+0000 7f4f6dd9a700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f68160880 0x7f4f681e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.214+0000 7f4f6dd9a700 1 -- 172.21.15.136:0/2575610165 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f64009550 con 0x7f4f6815c570 2023-06-23T19:01:35.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a00c1800 0x7fe4a01631c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 0x7fe4a00c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 0x7fe4a015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a7fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00c3370 con 0x7fe4a00c1800 2023-06-23T19:01:35.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a7fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a01622b0 con 0x7fe4a0160590 2023-06-23T19:01:35.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a7fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a0161a10 con 0x7fe4a0164200 2023-06-23T19:01:35.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7f4f6dd9a700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6815c570 0x7f4f680c9050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800e9e0 tx=0x7f4f5800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a5d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a00c1800 0x7fe4a01631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a5d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a00c1800 0x7fe4a01631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46398/0 (socket says 172.21.15.136:46398) 2023-06-23T19:01:35.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a5d9b700 1 -- 172.21.15.136:0/2940733079 learned_addr learned my addr 172.21.15.136:0/2940733079 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7fe4a559a700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 0x7fe4a00c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7fe4a659c700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 0x7fe4a015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7f4f5effd700 1 -- 172.21.15.136:0/2575610165 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58009710 con 0x7f4f6815c570 2023-06-23T19:01:35.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7f4f5effd700 1 -- 172.21.15.136:0/2575610165 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5800c850 con 0x7f4f6815c570 2023-06-23T19:01:35.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7f4f5effd700 1 -- 172.21.15.136:0/2575610165 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800cbc0 con 0x7f4f6815c570 2023-06-23T19:01:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7fe4a5d9b700 1 -- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 msgr2=0x7fe4a015f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7fe4a5d9b700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 0x7fe4a015f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7fe4a5d9b700 1 -- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 msgr2=0x7fe4a00c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7fe4a5d9b700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 0x7fe4a00c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7fe4a5d9b700 1 -- 172.21.15.136:0/2940733079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009550 con 0x7fe4a00c1800 2023-06-23T19:01:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7fe4a659c700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 0x7fe4a015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.216+0000 7fe4a559a700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 0x7fe4a00c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.217+0000 7fe4a5d9b700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a00c1800 0x7fe4a01631c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009c40 tx=0x7fe49c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.217+0000 7fe4967fc700 1 -- 172.21.15.136:0/2940733079 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c004510 con 0x7fe4a00c1800 2023-06-23T19:01:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.217+0000 7fe4967fc700 1 -- 172.21.15.136:0/2940733079 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c01f070 con 0x7fe4a00c1800 2023-06-23T19:01:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.217+0000 7fe4967fc700 1 -- 172.21.15.136:0/2940733079 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0038c0 con 0x7fe4a00c1800 2023-06-23T19:01:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.218+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a0161cf0 con 0x7fe4a00c1800 2023-06-23T19:01:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.218+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a015fa00 con 0x7fe4a00c1800 2023-06-23T19:01:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.217+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f680b38f0 con 0x7f4f6815c570 2023-06-23T19:01:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.217+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f680b3eb0 con 0x7f4f6815c570 2023-06-23T19:01:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.215+0000 7f4b4cff9700 1 -- 172.21.15.136:0/364029182 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b400547b0 con 0x7f4b500cd660 2023-06-23T19:01:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.221+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a0073910 con 0x7fe4a00c1800 2023-06-23T19:01:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.221+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f68073910 con 0x7f4f6815c570 2023-06-23T19:01:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.224+0000 7f4f5effd700 1 -- 172.21.15.136:0/2575610165 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f5800cd20 con 0x7f4f6815c570 2023-06-23T19:01:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.226+0000 7f4f5effd700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f4c06adb0 0x7f4f4c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.226+0000 7f4f5effd700 1 -- 172.21.15.136:0/2575610165 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4f58089cc0 con 0x7f4f6815c570 2023-06-23T19:01:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.227+0000 7f4f5effd700 1 -- 172.21.15.136:0/2575610165 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f58054a60 con 0x7f4f6815c570 2023-06-23T19:01:35.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.230+0000 7f4f6e59b700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f4c06adb0 0x7f4f4c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.222+0000 7fe4967fc700 1 -- 172.21.15.136:0/2940733079 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe49c003a20 con 0x7fe4a00c1800 2023-06-23T19:01:35.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.224+0000 7fe4967fc700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe48406adb0 0x7fe48406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.224+0000 7fe4967fc700 1 -- 172.21.15.136:0/2940733079 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe49c021070 con 0x7fe4a00c1800 2023-06-23T19:01:35.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.230+0000 7fe4a559a700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe48406adb0 0x7fe48406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.232+0000 7f4f6e59b700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f4c06adb0 0x7f4f4c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009c10 tx=0x7f4f64010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.233+0000 7fe4a559a700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe48406adb0 0x7fe48406d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00c0f80 tx=0x7fe490009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.234+0000 7fe4967fc700 1 -- 172.21.15.136:0/2940733079 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe49c055bc0 con 0x7fe4a00c1800 2023-06-23T19:01:35.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.644+0000 7efd8a7fc700 1 -- 172.21.15.136:0/1804116732 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd78005870 con 0x7efd940c1800 2023-06-23T19:01:35.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.645+0000 7efd90ff9700 1 -- 172.21.15.136:0/1804116732 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd84057ff0 con 0x7efd940c1800 2023-06-23T19:01:35.651 INFO:teuthology.orchestra.run.smithi136.stdout:64424509451 2023-06-23T19:01:35.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.648+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff3580ceee0 con 0x7ff358160590 2023-06-23T19:01:35.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.648+0000 7ff34dffb700 1 -- 172.21.15.136:0/2055182019 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff354057200 con 0x7ff358160590 2023-06-23T19:01:35.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.649+0000 7efd8a7fc700 1 -- 172.21.15.136:0/1804116732 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efd7406adb0 msgr2=0x7efd7406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.649+0000 7efd8a7fc700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efd7406adb0 0x7efd7406d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd940c5710 tx=0x7efd7c007ae0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.649+0000 7efd8a7fc700 1 -- 172.21.15.136:0/1804116732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd940c1800 msgr2=0x7efd940cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.649+0000 7efd8a7fc700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd940c1800 0x7efd940cb6c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd84001ed0 tx=0x7efd840021e0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.650+0000 7efd8a7fc700 1 -- 172.21.15.136:0/1804116732 shutdown_connections 2023-06-23T19:01:35.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.650+0000 7efd8a7fc700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efd7406adb0 0x7efd7406d260 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.650+0000 7efd8a7fc700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94164910 0x7efd940c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.650+0000 7efd8a7fc700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd940c1800 0x7efd940cb6c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.650+0000 7efd8a7fc700 1 --2- 172.21.15.136:0/1804116732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd94160590 0x7efd941f97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.650+0000 7efd8a7fc700 1 -- 172.21.15.136:0/1804116732 >> 172.21.15.136:0/1804116732 conn(0x7efd940b0ef0 msgr2=0x7efd9406e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.650+0000 7efd8a7fc700 1 -- 172.21.15.136:0/1804116732 shutdown_connections 2023-06-23T19:01:35.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.650+0000 7efd8a7fc700 1 -- 172.21.15.136:0/1804116732 wait complete. 2023-06-23T19:01:35.657 INFO:teuthology.orchestra.run.smithi136.stdout:64424509451 2023-06-23T19:01:35.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.652+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f21c80cdba0 con 0x7f21c80c8b20 2023-06-23T19:01:35.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc46c005160 con 0x7fc48c0b6b10 2023-06-23T19:01:35.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7f21af7fe700 1 -- 172.21.15.136:0/1400029010 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21b8057fd0 con 0x7f21c80c8b20 2023-06-23T19:01:35.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff33c06adb0 msgr2=0x7ff33c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff33c06adb0 0x7ff33c06d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff348009c10 tx=0x7ff34801d040 comp rx=0 tx=0).stop 2023-06-23T19:01:35.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 msgr2=0x7ff3580c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 0x7ff3580c7440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c780 tx=0x7ff35400ca90 comp rx=0 tx=0).stop 2023-06-23T19:01:35.660 INFO:teuthology.orchestra.run.smithi136.stdout:68719476748 2023-06-23T19:01:35.660 INFO:teuthology.orchestra.run.smithi136.stdout:64424509452 2023-06-23T19:01:35.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7fc4897fa700 1 -- 172.21.15.136:0/621237859 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc480017090 con 0x7fc48c0b6b10 2023-06-23T19:01:35.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 shutdown_connections 2023-06-23T19:01:35.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff33c06adb0 0x7ff33c06d260 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff358160590 0x7ff3580c7440 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35806cc60 0x7ff3581f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 --2- 172.21.15.136:0/2055182019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3580c1800 0x7ff3580cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.653+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 >> 172.21.15.136:0/2055182019 conn(0x7ff3580b0ef0 msgr2=0x7ff3580b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.654+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 shutdown_connections 2023-06-23T19:01:35.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.654+0000 7ff35f9ff700 1 -- 172.21.15.136:0/2055182019 wait complete. 2023-06-23T19:01:35.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.657+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f21b406adb0 msgr2=0x7f21b406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.657+0000 7f21c7fff700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f21b406adb0 0x7f21b406d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b45f0 tx=0x7f21bc008030 comp rx=0 tx=0).stop 2023-06-23T19:01:35.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.657+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80c8b20 msgr2=0x7f21c81f8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.657+0000 7f21c7fff700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80c8b20 0x7f21c81f8f30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d800 tx=0x7f21b800dbc0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 shutdown_connections 2023-06-23T19:01:35.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7f21c7fff700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f21b406adb0 0x7f21b406d260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7f21c7fff700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c8158490 0x7f21c80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7f21c7fff700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80c8b20 0x7f21c81f8f30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7f21c7fff700 1 --2- 172.21.15.136:0/1400029010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c80c8f90 0x7f21c81592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 >> 172.21.15.136:0/1400029010 conn(0x7f21c80ce560 msgr2=0x7f21c8071530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 shutdown_connections 2023-06-23T19:01:35.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc47006adb0 msgr2=0x7fc47006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7fc492bff700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc47006adb0 0x7fc47006d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc48c04fa50 tx=0x7fc478009210 comp rx=0 tx=0).stop 2023-06-23T19:01:35.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c0b6b10 msgr2=0x7fc48c14d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7fc492bff700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c0b6b10 0x7fc48c14d7c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00c250 tx=0x7fc480001930 comp rx=0 tx=0).stop 2023-06-23T19:01:35.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.659+0000 7f21c7fff700 1 -- 172.21.15.136:0/1400029010 wait complete. 2023-06-23T19:01:35.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.658+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f54e8005870 con 0x7f55080c1800 2023-06-23T19:01:35.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.660+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 shutdown_connections 2023-06-23T19:01:35.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.660+0000 7fc492bff700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc47006adb0 0x7fc47006d260 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.660+0000 7fc492bff700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc47c004850 0x7fc48c0b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.660+0000 7fc492bff700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc48c0c9d30 0x7fc48c144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.660+0000 7fc492bff700 1 --2- 172.21.15.136:0/621237859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48c0b6b10 0x7fc48c14d7c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.660+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 >> 172.21.15.136:0/621237859 conn(0x7fc48c071620 msgr2=0x7fc48c152440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.660+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 shutdown_connections 2023-06-23T19:01:35.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.660+0000 7fc492bff700 1 -- 172.21.15.136:0/621237859 wait complete. 2023-06-23T19:01:35.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.661+0000 7f55057fa700 1 -- 172.21.15.136:0/1922497590 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54f8059010 con 0x7f55080c1800 2023-06-23T19:01:35.667 INFO:teuthology.orchestra.run.smithi136.stdout:64424509451 2023-06-23T19:01:35.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54f406adb0 msgr2=0x7f54f406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54f406adb0 0x7f54f406d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f55080b0100 tx=0x7f54fc008040 comp rx=0 tx=0).stop 2023-06-23T19:01:35.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55080c1800 msgr2=0x7f5508145870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55080c1800 0x7f5508145870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5508071bc0 tx=0x7f54f8004750 comp rx=0 tx=0).stop 2023-06-23T19:01:35.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 shutdown_connections 2023-06-23T19:01:35.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54f406adb0 0x7f54f406d260 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5508160590 0x7f550814ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f550806cc60 0x7f55081509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 --2- 172.21.15.136:0/1922497590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55080c1800 0x7f5508145870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.668+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 >> 172.21.15.136:0/1922497590 conn(0x7f55080b0ef0 msgr2=0x7f55080b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.672+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 shutdown_connections 2023-06-23T19:01:35.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.672+0000 7f550f1ff700 1 -- 172.21.15.136:0/1922497590 wait complete. 2023-06-23T19:01:35.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.673+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4b500d3690 con 0x7f4b500cd660 2023-06-23T19:01:35.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.675+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f680b5360 con 0x7f4f6815c570 2023-06-23T19:01:35.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.675+0000 7f4b4cff9700 1 -- 172.21.15.136:0/364029182 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b40057dd0 con 0x7f4b500cd660 2023-06-23T19:01:35.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.676+0000 7f4f5effd700 1 -- 172.21.15.136:0/2575610165 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f58058080 con 0x7f4f6815c570 2023-06-23T19:01:35.683 INFO:teuthology.orchestra.run.smithi136.stdout:64424509451 2023-06-23T19:01:35.683 INFO:teuthology.orchestra.run.smithi136.stdout:60129542155 2023-06-23T19:01:35.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.676+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe4a00ceee0 con 0x7fe4a00c1800 2023-06-23T19:01:35.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.7 2023-06-23T19:01:35.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.681+0000 7fe4967fc700 1 -- 172.21.15.136:0/2940733079 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe49c0591e0 con 0x7fe4a00c1800 2023-06-23T19:01:35.686 INFO:teuthology.orchestra.run.smithi136.stdout:55834574859 2023-06-23T19:01:35.686 DEBUG:teuthology.parallel:result is None 2023-06-23T19:01:35.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2023-06-23T19:01:35.688 DEBUG:teuthology.parallel:result is None 2023-06-23T19:01:35.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f4c06adb0 msgr2=0x7f4f4c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f4c06adb0 0x7f4f4c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009c10 tx=0x7f4f64010000 comp rx=0 tx=0).stop 2023-06-23T19:01:35.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6815c570 msgr2=0x7f4f680c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6815c570 0x7f4f680c9050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800e9e0 tx=0x7f4f5800ecf0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 shutdown_connections 2023-06-23T19:01:35.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f4c06adb0 0x7f4f4c06d260 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f68160880 0x7f4f681e64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f680cd660 0x7f4f680b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 --2- 172.21.15.136:0/2575610165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6815c570 0x7f4f680c9050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.683+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 >> 172.21.15.136:0/2575610165 conn(0x7f4f68071620 msgr2=0x7f4f6815dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.684+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 shutdown_connections 2023-06-23T19:01:35.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.684+0000 7f4f707ff700 1 -- 172.21.15.136:0/2575610165 wait complete. 2023-06-23T19:01:35.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b3406ad80 msgr2=0x7f4b3406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b3406ad80 0x7f4b3406d230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b500d3660 tx=0x7f4b44007ae0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b500cd660 msgr2=0x7f4b500cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b500cd660 0x7f4b500cb5c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000b560 tx=0x7f4b4000b870 comp rx=0 tx=0).stop 2023-06-23T19:01:35.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 shutdown_connections 2023-06-23T19:01:35.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4b3406ad80 0x7f4b3406d230 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b500cd660 0x7f4b500cb5c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b50160880 0x7f4b500b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 --2- 172.21.15.136:0/364029182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5015c570 0x7f4b5015b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.685+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 >> 172.21.15.136:0/364029182 conn(0x7f4b50071620 msgr2=0x7f4b500d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 shutdown_connections 2023-06-23T19:01:35.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7f4b567ff700 1 -- 172.21.15.136:0/364029182 wait complete. 2023-06-23T19:01:35.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe48406adb0 msgr2=0x7fe48406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe48406adb0 0x7fe48406d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00c0f80 tx=0x7fe490009040 comp rx=0 tx=0).stop 2023-06-23T19:01:35.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a00c1800 msgr2=0x7fe4a01631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.693 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a00c1800 0x7fe4a01631c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009c40 tx=0x7fe49c004750 comp rx=0 tx=0).stop 2023-06-23T19:01:35.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 shutdown_connections 2023-06-23T19:01:35.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe48406adb0 0x7fe48406d260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a0164200 0x7fe4a015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a00c1800 0x7fe4a01631c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 --2- 172.21.15.136:0/2940733079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a0160590 0x7fe4a00c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 >> 172.21.15.136:0/2940733079 conn(0x7fe4a00b0ef0 msgr2=0x7fe4a00b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 shutdown_connections 2023-06-23T19:01:35.694 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.686+0000 7fe4a7fff700 1 -- 172.21.15.136:0/2940733079 wait complete. 2023-06-23T19:01:35.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476748 for osd.0 2023-06-23T19:01:35.699 DEBUG:teuthology.parallel:result is None 2023-06-23T19:01:35.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.4 2023-06-23T19:01:35.707 DEBUG:teuthology.parallel:result is None 2023-06-23T19:01:35.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.1 2023-06-23T19:01:35.711 DEBUG:teuthology.parallel:result is None 2023-06-23T19:01:35.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.5 2023-06-23T19:01:35.715 DEBUG:teuthology.parallel:result is None 2023-06-23T19:01:35.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.2 2023-06-23T19:01:35.716 DEBUG:teuthology.parallel:result is None 2023-06-23T19:01:35.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-06-23T19:01:35.718 DEBUG:teuthology.parallel:result is None 2023-06-23T19:01:35.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-23T19:01:35.719 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T19:01:35.954 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.951+0000 7f36c49ff700 1 Processor -- start 2023-06-23T19:01:35.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.951+0000 7f36c49ff700 1 -- start start 2023-06-23T19:01:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.952+0000 7f36c49ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c015c570 0x7f36c00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.952+0000 7f36c49ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f36c00cd660 0x7f36c0160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.952+0000 7f36c49ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c01610a0 con 0x7f36c0160880 2023-06-23T19:01:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.952+0000 7f36c49ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c015d670 con 0x7f36c00cd660 2023-06-23T19:01:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.952+0000 7f36c49ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00cdad0 con 0x7f36c015c570 2023-06-23T19:01:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.952+0000 7f36bdd9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f36c00cd660 0x7f36c0160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.952+0000 7f36bed9d700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f36c0160880 0x7f36c006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42150/0 (socket says 172.21.15.136:42150) 2023-06-23T19:01:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.952+0000 7f36bed9d700 1 -- 172.21.15.136:0/4003356540 learned_addr learned my addr 172.21.15.136:0/4003356540 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36be59c700 1 --2- 172.21.15.136:0/4003356540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c015c570 0x7f36c00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bd59a700 1 -- 172.21.15.136:0/4003356540 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484627040 0 0) 0x7f36c01610a0 con 0x7f36c0160880 2023-06-23T19:01:35.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bd59a700 1 -- 172.21.15.136:0/4003356540 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a80035b0 con 0x7f36c0160880 2023-06-23T19:01:35.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bdd9b700 1 -- 172.21.15.136:0/4003356540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c015c570 msgr2=0x7f36c00cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:35.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bdd9b700 1 --2- 172.21.15.136:0/4003356540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c015c570 0x7f36c00cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bdd9b700 1 -- 172.21.15.136:0/4003356540 >> v1:172.21.15.136:6789/0 conn(0x7f36c0160880 legacy=0x7f36c006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bdd9b700 1 -- 172.21.15.136:0/4003356540 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c015da90 con 0x7f36c00cd660 2023-06-23T19:01:35.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bdd9b700 1 --2- 172.21.15.136:0/4003356540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c00cd660 0x7f36c0160340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009870 tx=0x7f36b4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36646df01d4a5277 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bd59a700 1 -- 172.21.15.136:0/4003356540 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4011830 con 0x7f36c00cd660 2023-06-23T19:01:35.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bd59a700 1 -- 172.21.15.136:0/4003356540 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b4011990 con 0x7f36c00cd660 2023-06-23T19:01:35.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.953+0000 7f36bd59a700 1 -- 172.21.15.136:0/4003356540 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4011d20 con 0x7f36c00cd660 2023-06-23T19:01:35.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.954+0000 7f36c49ff700 1 -- 172.21.15.136:0/4003356540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c00cd660 msgr2=0x7f36c0160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.954+0000 7f36c49ff700 1 --2- 172.21.15.136:0/4003356540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c00cd660 0x7f36c0160340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009870 tx=0x7f36b4009b80 comp rx=0 tx=0).stop 2023-06-23T19:01:35.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.954+0000 7f36c49ff700 1 -- 172.21.15.136:0/4003356540 shutdown_connections 2023-06-23T19:01:35.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.954+0000 7f36c49ff700 1 --2- 172.21.15.136:0/4003356540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c015c570 0x7f36c00cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.954+0000 7f36c49ff700 1 --2- 172.21.15.136:0/4003356540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c00cd660 0x7f36c0160340 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.954+0000 7f36c49ff700 1 -- 172.21.15.136:0/4003356540 >> 172.21.15.136:0/4003356540 conn(0x7f36c0071620 msgr2=0x7f36c00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:35.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.954+0000 7f36c49ff700 1 -- 172.21.15.136:0/4003356540 shutdown_connections 2023-06-23T19:01:35.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.954+0000 7f36c49ff700 1 -- 172.21.15.136:0/4003356540 wait complete. 2023-06-23T19:01:35.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.956+0000 7f36c49ff700 1 Processor -- start 2023-06-23T19:01:35.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.956+0000 7f36c49ff700 1 -- start start 2023-06-23T19:01:35.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36c49ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c00cd660 0x7f36c014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36c49ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36c015c570 0x7f36c00b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36c49ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c0160880 0x7f36c014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36c49ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00c83f0 con 0x7f36c0160880 2023-06-23T19:01:35.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36c49ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00cb5d0 con 0x7f36c015c570 2023-06-23T19:01:35.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36c49ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00b5ef0 con 0x7f36c00cd660 2023-06-23T19:01:35.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36bed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c0160880 0x7f36c014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36bed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c0160880 0x7f36c014f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46406/0 (socket says 172.21.15.136:46406) 2023-06-23T19:01:35.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36be59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c00cd660 0x7f36c014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36bed9d700 1 -- 172.21.15.136:0/4249990766 learned_addr learned my addr 172.21.15.136:0/4249990766 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:35.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.957+0000 7f36bdd9b700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36c015c570 0x7f36c00b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36bed9d700 1 -- 172.21.15.136:0/4249990766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c00cd660 msgr2=0x7f36c014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36bed9d700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c00cd660 0x7f36c014fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36bed9d700 1 -- 172.21.15.136:0/4249990766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36c015c570 msgr2=0x7f36c00b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:35.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36bed9d700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36c015c570 0x7f36c00b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:35.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36bed9d700 1 -- 172.21.15.136:0/4249990766 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b40094a0 con 0x7f36c0160880 2023-06-23T19:01:35.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36bed9d700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c0160880 0x7f36c014f7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f36b800cb70 tx=0x7f36b800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36aeffd700 1 -- 172.21.15.136:0/4249990766 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b800aa60 con 0x7f36c0160880 2023-06-23T19:01:35.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36aeffd700 1 -- 172.21.15.136:0/4249990766 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b800abc0 con 0x7f36c0160880 2023-06-23T19:01:35.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c014fce0 con 0x7f36c0160880 2023-06-23T19:01:35.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36aeffd700 1 -- 172.21.15.136:0/4249990766 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8012400 con 0x7f36c0160880 2023-06-23T19:01:35.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.958+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c00c7d30 con 0x7f36c0160880 2023-06-23T19:01:35.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.959+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c015c940 con 0x7f36c0160880 2023-06-23T19:01:35.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.960+0000 7f36aeffd700 1 -- 172.21.15.136:0/4249990766 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f36b801b3b0 con 0x7f36c0160880 2023-06-23T19:01:35.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.962+0000 7f36aeffd700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f36a006ace0 0x7f36a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:35.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.962+0000 7f36aeffd700 1 -- 172.21.15.136:0/4249990766 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36b80894d0 con 0x7f36c0160880 2023-06-23T19:01:35.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.962+0000 7f36be59c700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f36a006ace0 0x7f36a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:35.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.962+0000 7f36be59c700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f36a006ace0 0x7f36a006d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36c00c7730 tx=0x7f36b0009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:35.966+0000 7f36aeffd700 1 -- 172.21.15.136:0/4249990766 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f36b8054280 con 0x7f36c0160880 2023-06-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.161+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 --> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36c015cfb0 con 0x7f36a006ace0 2023-06-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.171+0000 7f36aeffd700 1 -- 172.21.15.136:0/4249990766 <== mgr.4105 v2:172.21.15.136:6832/2653877961 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367286 (secure 0 0 0) 0x7f36b0011910 con 0x7f36a006ace0 2023-06-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.175+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f36a006ace0 msgr2=0x7f36a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.175+0000 7f36c49ff700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f36a006ace0 0x7f36a006d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36c00c7730 tx=0x7f36b0009210 comp rx=0 tx=0).stop 2023-06-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.175+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c0160880 msgr2=0x7f36c014f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.175+0000 7f36c49ff700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c0160880 0x7f36c014f7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f36b800cb70 tx=0x7f36b800ce80 comp rx=0 tx=0).stop 2023-06-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.176+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 shutdown_connections 2023-06-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.176+0000 7f36c49ff700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f36a006ace0 0x7f36a006d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.176+0000 7f36c49ff700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36c0160880 0x7f36c014f7a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.176+0000 7f36c49ff700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36c00cd660 0x7f36c014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.176+0000 7f36c49ff700 1 --2- 172.21.15.136:0/4249990766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36c015c570 0x7f36c00b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.176+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 >> 172.21.15.136:0/4249990766 conn(0x7f36c0071620 msgr2=0x7f36c015a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.176+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 shutdown_connections 2023-06-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.176+0000 7f36c49ff700 1 -- 172.21.15.136:0/4249990766 wait complete. 2023-06-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2023-06-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2023-06-23T19:01:34.940221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219240,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755480,"statfs":{"total":773094113280,"available":772869611520,"internally_reserved":0,"allocated":3710976,"data_stored":2197048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005059"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870887+0000","last_change":"2023-06-23T19:01:04.378688+0000","last_active":"2023-06-23T19:01:08.870887+0000","last_peered":"2023-06-23T19:01:08.870887+0000","last_clean":"2023-06-23T19:01:08.870887+0000","last_became_active":"2023-06-23T19:01:04.378277+0000","last_became_peered":"2023-06-23T19:01:04.378277+0000","last_unstale":"2023-06-23T19:01:08.870887+0000","last_undegraded":"2023-06-23T19:01:08.870887+0000","last_fullsized":"2023-06-23T19:01:08.870887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:32:11.850600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282720+0000","last_change":"2023-06-23T19:01:04.385368+0000","last_active":"2023-06-23T19:01:09.282720+0000","last_peered":"2023-06-23T19:01:09.282720+0000","last_clean":"2023-06-23T19:01:09.282720+0000","last_became_active":"2023-06-23T19:01:04.385091+0000","last_became_peered":"2023-06-23T19:01:04.385091+0000","last_unstale":"2023-06-23T19:01:09.282720+0000","last_undegraded":"2023-06-23T19:01:09.282720+0000","last_fullsized":"2023-06-23T19:01:09.282720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:02.533488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282796+0000","last_change":"2023-06-23T19:01:04.382104+0000","last_active":"2023-06-23T19:01:09.282796+0000","last_peered":"2023-06-23T19:01:09.282796+0000","last_clean":"2023-06-23T19:01:09.282796+0000","last_became_active":"2023-06-23T19:01:04.381827+0000","last_became_peered":"2023-06-23T19:01:04.381827+0000","last_unstale":"2023-06-23T19:01:09.282796+0000","last_undegraded":"2023-06-23T19:01:09.282796+0000","last_fullsized":"2023-06-23T19:01:09.282796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:28:01.174081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156752+0000","last_change":"2023-06-23T19:01:04.376037+0000","last_active":"2023-06-23T19:01:09.156752+0000","last_peered":"2023-06-23T19:01:09.156752+0000","last_clean":"2023-06-23T19:01:09.156752+0000","last_became_active":"2023-06-23T19:01:04.375479+0000","last_became_peered":"2023-06-23T19:01:04.375479+0000","last_unstale":"2023-06-23T19:01:09.156752+0000","last_undegraded":"2023-06-23T19:01:09.156752+0000","last_fullsized":"2023-06-23T19:01:09.156752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:42:12.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873331+0000","last_change":"2023-06-23T19:01:04.383574+0000","last_active":"2023-06-23T19:01:08.873331+0000","last_peered":"2023-06-23T19:01:08.873331+0000","last_clean":"2023-06-23T19:01:08.873331+0000","last_became_active":"2023-06-23T19:01:04.383178+0000","last_became_peered":"2023-06-23T19:01:04.383178+0000","last_unstale":"2023-06-23T19:01:08.873331+0000","last_undegraded":"2023-06-23T19:01:08.873331+0000","last_fullsized":"2023-06-23T19:01:08.873331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:08.703615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282561+0000","last_change":"2023-06-23T19:01:04.378592+0000","last_active":"2023-06-23T19:01:09.282561+0000","last_peered":"2023-06-23T19:01:09.282561+0000","last_clean":"2023-06-23T19:01:09.282561+0000","last_became_active":"2023-06-23T19:01:04.378270+0000","last_became_peered":"2023-06-23T19:01:04.378270+0000","last_unstale":"2023-06-23T19:01:09.282561+0000","last_undegraded":"2023-06-23T19:01:09.282561+0000","last_fullsized":"2023-06-23T19:01:09.282561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:03:42.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281650+0000","last_change":"2023-06-23T19:01:04.388383+0000","last_active":"2023-06-23T19:01:09.281650+0000","last_peered":"2023-06-23T19:01:09.281650+0000","last_clean":"2023-06-23T19:01:09.281650+0000","last_became_active":"2023-06-23T19:01:04.388104+0000","last_became_peered":"2023-06-23T19:01:04.388104+0000","last_unstale":"2023-06-23T19:01:09.281650+0000","last_undegraded":"2023-06-23T19:01:09.281650+0000","last_fullsized":"2023-06-23T19:01:09.281650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:59.746450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281560+0000","last_change":"2023-06-23T19:01:04.383152+0000","last_active":"2023-06-23T19:01:09.281560+0000","last_peered":"2023-06-23T19:01:09.281560+0000","last_clean":"2023-06-23T19:01:09.281560+0000","last_became_active":"2023-06-23T19:01:04.382712+0000","last_became_peered":"2023-06-23T19:01:04.382712+0000","last_unstale":"2023-06-23T19:01:09.281560+0000","last_undegraded":"2023-06-23T19:01:09.281560+0000","last_fullsized":"2023-06-23T19:01:09.281560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873324+0000","last_change":"2023-06-23T19:01:04.382700+0000","last_active":"2023-06-23T19:01:08.873324+0000","last_peered":"2023-06-23T19:01:08.873324+0000","last_clean":"2023-06-23T19:01:08.873324+0000","last_became_active":"2023-06-23T19:01:04.382201+0000","last_became_peered":"2023-06-23T19:01:04.382201+0000","last_unstale":"2023-06-23T19:01:08.873324+0000","last_undegraded":"2023-06-23T19:01:08.873324+0000","last_fullsized":"2023-06-23T19:01:08.873324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283207+0000","last_change":"2023-06-23T19:01:04.376595+0000","last_active":"2023-06-23T19:01:09.283207+0000","last_peered":"2023-06-23T19:01:09.283207+0000","last_clean":"2023-06-23T19:01:09.283207+0000","last_became_active":"2023-06-23T19:01:04.376392+0000","last_became_peered":"2023-06-23T19:01:04.376392+0000","last_unstale":"2023-06-23T19:01:09.283207+0000","last_undegraded":"2023-06-23T19:01:09.283207+0000","last_fullsized":"2023-06-23T19:01:09.283207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:30:56.096215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282762+0000","last_change":"2023-06-23T19:01:04.388979+0000","last_active":"2023-06-23T19:01:09.282762+0000","last_peered":"2023-06-23T19:01:09.282762+0000","last_clean":"2023-06-23T19:01:09.282762+0000","last_became_active":"2023-06-23T19:01:04.388676+0000","last_became_peered":"2023-06-23T19:01:04.388676+0000","last_unstale":"2023-06-23T19:01:09.282762+0000","last_undegraded":"2023-06-23T19:01:09.282762+0000","last_fullsized":"2023-06-23T19:01:09.282762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:29:33.177223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871107+0000","last_change":"2023-06-23T19:01:04.391858+0000","last_active":"2023-06-23T19:01:08.871107+0000","last_peered":"2023-06-23T19:01:08.871107+0000","last_clean":"2023-06-23T19:01:08.871107+0000","last_became_active":"2023-06-23T19:01:04.391669+0000","last_became_peered":"2023-06-23T19:01:04.391669+0000","last_unstale":"2023-06-23T19:01:08.871107+0000","last_undegraded":"2023-06-23T19:01:08.871107+0000","last_fullsized":"2023-06-23T19:01:08.871107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:03.089060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870980+0000","last_change":"2023-06-23T19:01:04.372094+0000","last_active":"2023-06-23T19:01:08.870980+0000","last_peered":"2023-06-23T19:01:08.870980+0000","last_clean":"2023-06-23T19:01:08.870980+0000","last_became_active":"2023-06-23T19:01:04.370416+0000","last_became_peered":"2023-06-23T19:01:04.370416+0000","last_unstale":"2023-06-23T19:01:08.870980+0000","last_undegraded":"2023-06-23T19:01:08.870980+0000","last_fullsized":"2023-06-23T19:01:08.870980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:50.510315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282222+0000","last_change":"2023-06-23T19:01:04.380048+0000","last_active":"2023-06-23T19:01:09.282222+0000","last_peered":"2023-06-23T19:01:09.282222+0000","last_clean":"2023-06-23T19:01:09.282222+0000","last_became_active":"2023-06-23T19:01:04.379845+0000","last_became_peered":"2023-06-23T19:01:04.379845+0000","last_unstale":"2023-06-23T19:01:09.282222+0000","last_undegraded":"2023-06-23T19:01:09.282222+0000","last_fullsized":"2023-06-23T19:01:09.282222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:34.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281323+0000","last_change":"2023-06-23T19:01:04.388881+0000","last_active":"2023-06-23T19:01:09.281323+0000","last_peered":"2023-06-23T19:01:09.281323+0000","last_clean":"2023-06-23T19:01:09.281323+0000","last_became_active":"2023-06-23T19:01:04.388417+0000","last_became_peered":"2023-06-23T19:01:04.388417+0000","last_unstale":"2023-06-23T19:01:09.281323+0000","last_undegraded":"2023-06-23T19:01:09.281323+0000","last_fullsized":"2023-06-23T19:01:09.281323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:22.486690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281157+0000","last_change":"2023-06-23T19:01:04.383317+0000","last_active":"2023-06-23T19:01:09.281157+0000","last_peered":"2023-06-23T19:01:09.281157+0000","last_clean":"2023-06-23T19:01:09.281157+0000","last_became_active":"2023-06-23T19:01:04.378678+0000","last_became_peered":"2023-06-23T19:01:04.378678+0000","last_unstale":"2023-06-23T19:01:09.281157+0000","last_undegraded":"2023-06-23T19:01:09.281157+0000","last_fullsized":"2023-06-23T19:01:09.281157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:01:47.617327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873389+0000","last_change":"2023-06-23T19:01:04.382482+0000","last_active":"2023-06-23T19:01:08.873389+0000","last_peered":"2023-06-23T19:01:08.873389+0000","last_clean":"2023-06-23T19:01:08.873389+0000","last_became_active":"2023-06-23T19:01:04.381876+0000","last_became_peered":"2023-06-23T19:01:04.381876+0000","last_unstale":"2023-06-23T19:01:08.873389+0000","last_undegraded":"2023-06-23T19:01:08.873389+0000","last_fullsized":"2023-06-23T19:01:08.873389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:34.423477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282971+0000","last_change":"2023-06-23T19:01:04.382129+0000","last_active":"2023-06-23T19:01:09.282971+0000","last_peered":"2023-06-23T19:01:09.282971+0000","last_clean":"2023-06-23T19:01:09.282971+0000","last_became_active":"2023-06-23T19:01:04.381462+0000","last_became_peered":"2023-06-23T19:01:04.381462+0000","last_unstale":"2023-06-23T19:01:09.282971+0000","last_undegraded":"2023-06-23T19:01:09.282971+0000","last_fullsized":"2023-06-23T19:01:09.282971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:51:17.974676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870818+0000","last_change":"2023-06-23T19:01:04.367952+0000","last_active":"2023-06-23T19:01:08.870818+0000","last_peered":"2023-06-23T19:01:08.870818+0000","last_clean":"2023-06-23T19:01:08.870818+0000","last_became_active":"2023-06-23T19:01:04.367677+0000","last_became_peered":"2023-06-23T19:01:04.367677+0000","last_unstale":"2023-06-23T19:01:08.870818+0000","last_undegraded":"2023-06-23T19:01:08.870818+0000","last_fullsized":"2023-06-23T19:01:08.870818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:28:28.127638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281961+0000","last_change":"2023-06-23T19:01:04.374187+0000","last_active":"2023-06-23T19:01:09.281961+0000","last_peered":"2023-06-23T19:01:09.281961+0000","last_clean":"2023-06-23T19:01:09.281961+0000","last_became_active":"2023-06-23T19:01:04.373921+0000","last_became_peered":"2023-06-23T19:01:04.373921+0000","last_unstale":"2023-06-23T19:01:09.281961+0000","last_undegraded":"2023-06-23T19:01:09.281961+0000","last_fullsized":"2023-06-23T19:01:09.281961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:14:17.383712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282957+0000","last_change":"2023-06-23T19:01:04.386537+0000","last_active":"2023-06-23T19:01:09.282957+0000","last_peered":"2023-06-23T19:01:09.282957+0000","last_clean":"2023-06-23T19:01:09.282957+0000","last_became_active":"2023-06-23T19:01:04.386192+0000","last_became_peered":"2023-06-23T19:01:04.386192+0000","last_unstale":"2023-06-23T19:01:09.282957+0000","last_undegraded":"2023-06-23T19:01:09.282957+0000","last_fullsized":"2023-06-23T19:01:09.282957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:02.220770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872398+0000","last_change":"2023-06-23T19:01:04.388749+0000","last_active":"2023-06-23T19:01:08.872398+0000","last_peered":"2023-06-23T19:01:08.872398+0000","last_clean":"2023-06-23T19:01:08.872398+0000","last_became_active":"2023-06-23T19:01:04.388450+0000","last_became_peered":"2023-06-23T19:01:04.388450+0000","last_unstale":"2023-06-23T19:01:08.872398+0000","last_undegraded":"2023-06-23T19:01:08.872398+0000","last_fullsized":"2023-06-23T19:01:08.872398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:59.683785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280402+0000","last_change":"2023-06-23T19:01:04.374228+0000","last_active":"2023-06-23T19:01:09.280402+0000","last_peered":"2023-06-23T19:01:09.280402+0000","last_clean":"2023-06-23T19:01:09.280402+0000","last_became_active":"2023-06-23T19:01:04.373934+0000","last_became_peered":"2023-06-23T19:01:04.373934+0000","last_unstale":"2023-06-23T19:01:09.280402+0000","last_undegraded":"2023-06-23T19:01:09.280402+0000","last_fullsized":"2023-06-23T19:01:09.280402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:09.120268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283074+0000","last_change":"2023-06-23T19:01:04.384671+0000","last_active":"2023-06-23T19:01:09.283074+0000","last_peered":"2023-06-23T19:01:09.283074+0000","last_clean":"2023-06-23T19:01:09.283074+0000","last_became_active":"2023-06-23T19:01:04.384373+0000","last_became_peered":"2023-06-23T19:01:04.384373+0000","last_unstale":"2023-06-23T19:01:09.283074+0000","last_undegraded":"2023-06-23T19:01:09.283074+0000","last_fullsized":"2023-06-23T19:01:09.283074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:13.294523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872724+0000","last_change":"2023-06-23T19:01:04.374136+0000","last_active":"2023-06-23T19:01:08.872724+0000","last_peered":"2023-06-23T19:01:08.872724+0000","last_clean":"2023-06-23T19:01:08.872724+0000","last_became_active":"2023-06-23T19:01:04.373867+0000","last_became_peered":"2023-06-23T19:01:04.373867+0000","last_unstale":"2023-06-23T19:01:08.872724+0000","last_undegraded":"2023-06-23T19:01:08.872724+0000","last_fullsized":"2023-06-23T19:01:08.872724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.507284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873820+0000","last_change":"2023-06-23T19:01:04.384724+0000","last_active":"2023-06-23T19:01:08.873820+0000","last_peered":"2023-06-23T19:01:08.873820+0000","last_clean":"2023-06-23T19:01:08.873820+0000","last_became_active":"2023-06-23T19:01:04.384514+0000","last_became_peered":"2023-06-23T19:01:04.384514+0000","last_unstale":"2023-06-23T19:01:08.873820+0000","last_undegraded":"2023-06-23T19:01:08.873820+0000","last_fullsized":"2023-06-23T19:01:08.873820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:59.746450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283574+0000","last_change":"2023-06-23T19:01:04.380891+0000","last_active":"2023-06-23T19:01:09.283574+0000","last_peered":"2023-06-23T19:01:09.283574+0000","last_clean":"2023-06-23T19:01:09.283574+0000","last_became_active":"2023-06-23T19:01:04.380336+0000","last_became_peered":"2023-06-23T19:01:04.380336+0000","last_unstale":"2023-06-23T19:01:09.283574+0000","last_undegraded":"2023-06-23T19:01:09.283574+0000","last_fullsized":"2023-06-23T19:01:09.283574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:00.026037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282369+0000","last_change":"2023-06-23T19:01:08.395986+0000","last_active":"2023-06-23T19:01:09.282369+0000","last_peered":"2023-06-23T19:01:09.282369+0000","last_clean":"2023-06-23T19:01:09.282369+0000","last_became_active":"2023-06-23T19:01:08.395550+0000","last_became_peered":"2023-06-23T19:01:08.395550+0000","last_unstale":"2023-06-23T19:01:09.282369+0000","last_undegraded":"2023-06-23T19:01:09.282369+0000","last_fullsized":"2023-06-23T19:01:09.282369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:55:35.582136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282386+0000","last_change":"2023-06-23T19:01:03.877831+0000","last_active":"2023-06-23T19:01:09.282386+0000","last_peered":"2023-06-23T19:01:09.282386+0000","last_clean":"2023-06-23T19:01:09.282386+0000","last_became_active":"2023-06-23T19:01:03.877541+0000","last_became_peered":"2023-06-23T19:01:03.877541+0000","last_unstale":"2023-06-23T19:01:09.282386+0000","last_undegraded":"2023-06-23T19:01:09.282386+0000","last_fullsized":"2023-06-23T19:01:09.282386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:02:36.669063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280914+0000","last_change":"2023-06-23T19:01:04.386920+0000","last_active":"2023-06-23T19:01:09.280914+0000","last_peered":"2023-06-23T19:01:09.280914+0000","last_clean":"2023-06-23T19:01:09.280914+0000","last_became_active":"2023-06-23T19:01:04.386357+0000","last_became_peered":"2023-06-23T19:01:04.386357+0000","last_unstale":"2023-06-23T19:01:09.280914+0000","last_undegraded":"2023-06-23T19:01:09.280914+0000","last_fullsized":"2023-06-23T19:01:09.280914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:47:30.538293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157090+0000","last_change":"2023-06-23T19:01:08.399323+0000","last_active":"2023-06-23T19:01:09.157090+0000","last_peered":"2023-06-23T19:01:09.157090+0000","last_clean":"2023-06-23T19:01:09.157090+0000","last_became_active":"2023-06-23T19:01:08.398808+0000","last_became_peered":"2023-06-23T19:01:08.398808+0000","last_unstale":"2023-06-23T19:01:09.157090+0000","last_undegraded":"2023-06-23T19:01:09.157090+0000","last_fullsized":"2023-06-23T19:01:09.157090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:35.871412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871893+0000","last_change":"2023-06-23T19:01:03.885277+0000","last_active":"2023-06-23T19:01:08.871893+0000","last_peered":"2023-06-23T19:01:08.871893+0000","last_clean":"2023-06-23T19:01:08.871893+0000","last_became_active":"2023-06-23T19:01:03.885059+0000","last_became_peered":"2023-06-23T19:01:03.885059+0000","last_unstale":"2023-06-23T19:01:08.871893+0000","last_undegraded":"2023-06-23T19:01:08.871893+0000","last_fullsized":"2023-06-23T19:01:08.871893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:50.138012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872568+0000","last_change":"2023-06-23T19:01:04.381825+0000","last_active":"2023-06-23T19:01:08.872568+0000","last_peered":"2023-06-23T19:01:08.872568+0000","last_clean":"2023-06-23T19:01:08.872568+0000","last_became_active":"2023-06-23T19:01:04.381313+0000","last_became_peered":"2023-06-23T19:01:04.381313+0000","last_unstale":"2023-06-23T19:01:08.872568+0000","last_undegraded":"2023-06-23T19:01:08.872568+0000","last_fullsized":"2023-06-23T19:01:08.872568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:15.464343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872863+0000","last_change":"2023-06-23T19:01:08.393931+0000","last_active":"2023-06-23T19:01:08.872863+0000","last_peered":"2023-06-23T19:01:08.872863+0000","last_clean":"2023-06-23T19:01:08.872863+0000","last_became_active":"2023-06-23T19:01:08.393556+0000","last_became_peered":"2023-06-23T19:01:08.393556+0000","last_unstale":"2023-06-23T19:01:08.872863+0000","last_undegraded":"2023-06-23T19:01:08.872863+0000","last_fullsized":"2023-06-23T19:01:08.872863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:27.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280805+0000","last_change":"2023-06-23T19:01:03.873568+0000","last_active":"2023-06-23T19:01:09.280805+0000","last_peered":"2023-06-23T19:01:09.280805+0000","last_clean":"2023-06-23T19:01:09.280805+0000","last_became_active":"2023-06-23T19:01:03.873256+0000","last_became_peered":"2023-06-23T19:01:03.873256+0000","last_unstale":"2023-06-23T19:01:09.280805+0000","last_undegraded":"2023-06-23T19:01:09.280805+0000","last_fullsized":"2023-06-23T19:01:09.280805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:22:44.177756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157154+0000","last_change":"2023-06-23T19:01:04.370281+0000","last_active":"2023-06-23T19:01:09.157154+0000","last_peered":"2023-06-23T19:01:09.157154+0000","last_clean":"2023-06-23T19:01:09.157154+0000","last_became_active":"2023-06-23T19:01:04.369996+0000","last_became_peered":"2023-06-23T19:01:04.369996+0000","last_unstale":"2023-06-23T19:01:09.157154+0000","last_undegraded":"2023-06-23T19:01:09.157154+0000","last_fullsized":"2023-06-23T19:01:09.157154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:05:09.392936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156729+0000","last_change":"2023-06-23T19:01:08.397782+0000","last_active":"2023-06-23T19:01:09.156729+0000","last_peered":"2023-06-23T19:01:09.156729+0000","last_clean":"2023-06-23T19:01:09.156729+0000","last_became_active":"2023-06-23T19:01:08.397312+0000","last_became_peered":"2023-06-23T19:01:08.397312+0000","last_unstale":"2023-06-23T19:01:09.156729+0000","last_undegraded":"2023-06-23T19:01:09.156729+0000","last_fullsized":"2023-06-23T19:01:09.156729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:38:36.950113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873470+0000","last_change":"2023-06-23T19:01:03.875654+0000","last_active":"2023-06-23T19:01:08.873470+0000","last_peered":"2023-06-23T19:01:08.873470+0000","last_clean":"2023-06-23T19:01:08.873470+0000","last_became_active":"2023-06-23T19:01:03.875197+0000","last_became_peered":"2023-06-23T19:01:03.875197+0000","last_unstale":"2023-06-23T19:01:08.873470+0000","last_undegraded":"2023-06-23T19:01:08.873470+0000","last_fullsized":"2023-06-23T19:01:08.873470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:21.482936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280620+0000","last_change":"2023-06-23T19:01:04.385872+0000","last_active":"2023-06-23T19:01:09.280620+0000","last_peered":"2023-06-23T19:01:09.280620+0000","last_clean":"2023-06-23T19:01:09.280620+0000","last_became_active":"2023-06-23T19:01:04.385605+0000","last_became_peered":"2023-06-23T19:01:04.385605+0000","last_unstale":"2023-06-23T19:01:09.280620+0000","last_undegraded":"2023-06-23T19:01:09.280620+0000","last_fullsized":"2023-06-23T19:01:09.280620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:30:07.714637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281074+0000","last_change":"2023-06-23T19:01:08.392127+0000","last_active":"2023-06-23T19:01:09.281074+0000","last_peered":"2023-06-23T19:01:09.281074+0000","last_clean":"2023-06-23T19:01:09.281074+0000","last_became_active":"2023-06-23T19:01:08.391726+0000","last_became_peered":"2023-06-23T19:01:08.391726+0000","last_unstale":"2023-06-23T19:01:09.281074+0000","last_undegraded":"2023-06-23T19:01:09.281074+0000","last_fullsized":"2023-06-23T19:01:09.281074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:03.540201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282960+0000","last_change":"2023-06-23T19:01:03.872890+0000","last_active":"2023-06-23T19:01:09.282960+0000","last_peered":"2023-06-23T19:01:09.282960+0000","last_clean":"2023-06-23T19:01:09.282960+0000","last_became_active":"2023-06-23T19:01:03.872477+0000","last_became_peered":"2023-06-23T19:01:03.872477+0000","last_unstale":"2023-06-23T19:01:09.282960+0000","last_undegraded":"2023-06-23T19:01:09.282960+0000","last_fullsized":"2023-06-23T19:01:09.282960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:16:35.893488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280412+0000","last_change":"2023-06-23T19:01:04.372079+0000","last_active":"2023-06-23T19:01:09.280412+0000","last_peered":"2023-06-23T19:01:09.280412+0000","last_clean":"2023-06-23T19:01:09.280412+0000","last_became_active":"2023-06-23T19:01:04.371764+0000","last_became_peered":"2023-06-23T19:01:04.371764+0000","last_unstale":"2023-06-23T19:01:09.280412+0000","last_undegraded":"2023-06-23T19:01:09.280412+0000","last_fullsized":"2023-06-23T19:01:09.280412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:39.705880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280820+0000","last_change":"2023-06-23T19:01:08.408231+0000","last_active":"2023-06-23T19:01:09.280820+0000","last_peered":"2023-06-23T19:01:09.280820+0000","last_clean":"2023-06-23T19:01:09.280820+0000","last_became_active":"2023-06-23T19:01:08.407872+0000","last_became_peered":"2023-06-23T19:01:08.407872+0000","last_unstale":"2023-06-23T19:01:09.280820+0000","last_undegraded":"2023-06-23T19:01:09.280820+0000","last_fullsized":"2023-06-23T19:01:09.280820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:41:47.186941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281857+0000","last_change":"2023-06-23T19:01:03.884943+0000","last_active":"2023-06-23T19:01:09.281857+0000","last_peered":"2023-06-23T19:01:09.281857+0000","last_clean":"2023-06-23T19:01:09.281857+0000","last_became_active":"2023-06-23T19:01:03.884670+0000","last_became_peered":"2023-06-23T19:01:03.884670+0000","last_unstale":"2023-06-23T19:01:09.281857+0000","last_undegraded":"2023-06-23T19:01:09.281857+0000","last_fullsized":"2023-06-23T19:01:09.281857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:01.529734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872631+0000","last_change":"2023-06-23T19:01:04.378162+0000","last_active":"2023-06-23T19:01:08.872631+0000","last_peered":"2023-06-23T19:01:08.872631+0000","last_clean":"2023-06-23T19:01:08.872631+0000","last_became_active":"2023-06-23T19:01:04.377889+0000","last_became_peered":"2023-06-23T19:01:04.377889+0000","last_unstale":"2023-06-23T19:01:08.872631+0000","last_undegraded":"2023-06-23T19:01:08.872631+0000","last_fullsized":"2023-06-23T19:01:08.872631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:15.464343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872077+0000","last_change":"2023-06-23T19:01:08.407720+0000","last_active":"2023-06-23T19:01:08.872077+0000","last_peered":"2023-06-23T19:01:08.872077+0000","last_clean":"2023-06-23T19:01:08.872077+0000","last_became_active":"2023-06-23T19:01:08.407375+0000","last_became_peered":"2023-06-23T19:01:08.407375+0000","last_unstale":"2023-06-23T19:01:08.872077+0000","last_undegraded":"2023-06-23T19:01:08.872077+0000","last_fullsized":"2023-06-23T19:01:08.872077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:52:30.461408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:22.099711+0000","last_change":"2023-06-23T19:01:03.874324+0000","last_active":"2023-06-23T19:01:22.099711+0000","last_peered":"2023-06-23T19:01:22.099711+0000","last_clean":"2023-06-23T19:01:22.099711+0000","last_became_active":"2023-06-23T19:01:03.873875+0000","last_became_peered":"2023-06-23T19:01:03.873875+0000","last_unstale":"2023-06-23T19:01:22.099711+0000","last_undegraded":"2023-06-23T19:01:22.099711+0000","last_fullsized":"2023-06-23T19:01:22.099711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:08:09.258254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281733+0000","last_change":"2023-06-23T19:01:04.386473+0000","last_active":"2023-06-23T19:01:09.281733+0000","last_peered":"2023-06-23T19:01:09.281733+0000","last_clean":"2023-06-23T19:01:09.281733+0000","last_became_active":"2023-06-23T19:01:04.386168+0000","last_became_peered":"2023-06-23T19:01:04.386168+0000","last_unstale":"2023-06-23T19:01:09.281733+0000","last_undegraded":"2023-06-23T19:01:09.281733+0000","last_fullsized":"2023-06-23T19:01:09.281733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:21.315691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283666+0000","last_change":"2023-06-23T19:01:08.403704+0000","last_active":"2023-06-23T19:01:09.283666+0000","last_peered":"2023-06-23T19:01:09.283666+0000","last_clean":"2023-06-23T19:01:09.283666+0000","last_became_active":"2023-06-23T19:01:08.401409+0000","last_became_peered":"2023-06-23T19:01:08.401409+0000","last_unstale":"2023-06-23T19:01:09.283666+0000","last_undegraded":"2023-06-23T19:01:09.283666+0000","last_fullsized":"2023-06-23T19:01:09.283666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:12.955870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281472+0000","last_change":"2023-06-23T19:01:03.879123+0000","last_active":"2023-06-23T19:01:09.281472+0000","last_peered":"2023-06-23T19:01:09.281472+0000","last_clean":"2023-06-23T19:01:09.281472+0000","last_became_active":"2023-06-23T19:01:03.878849+0000","last_became_peered":"2023-06-23T19:01:03.878849+0000","last_unstale":"2023-06-23T19:01:09.281472+0000","last_undegraded":"2023-06-23T19:01:09.281472+0000","last_fullsized":"2023-06-23T19:01:09.281472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:08.437952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280990+0000","last_change":"2023-06-23T19:01:04.386760+0000","last_active":"2023-06-23T19:01:09.280990+0000","last_peered":"2023-06-23T19:01:09.280990+0000","last_clean":"2023-06-23T19:01:09.280990+0000","last_became_active":"2023-06-23T19:01:04.386378+0000","last_became_peered":"2023-06-23T19:01:04.386378+0000","last_unstale":"2023-06-23T19:01:09.280990+0000","last_undegraded":"2023-06-23T19:01:09.280990+0000","last_fullsized":"2023-06-23T19:01:09.280990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:04:32.211071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280924+0000","last_change":"2023-06-23T19:01:08.398632+0000","last_active":"2023-06-23T19:01:09.280924+0000","last_peered":"2023-06-23T19:01:09.280924+0000","last_clean":"2023-06-23T19:01:09.280924+0000","last_became_active":"2023-06-23T19:01:08.397912+0000","last_became_peered":"2023-06-23T19:01:08.397912+0000","last_unstale":"2023-06-23T19:01:09.280924+0000","last_undegraded":"2023-06-23T19:01:09.280924+0000","last_fullsized":"2023-06-23T19:01:09.280924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:53:09.486798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872187+0000","last_change":"2023-06-23T19:01:03.868975+0000","last_active":"2023-06-23T19:01:08.872187+0000","last_peered":"2023-06-23T19:01:08.872187+0000","last_clean":"2023-06-23T19:01:08.872187+0000","last_became_active":"2023-06-23T19:01:03.868673+0000","last_became_peered":"2023-06-23T19:01:03.868673+0000","last_unstale":"2023-06-23T19:01:08.872187+0000","last_undegraded":"2023-06-23T19:01:08.872187+0000","last_fullsized":"2023-06-23T19:01:08.872187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:45:30.544760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283480+0000","last_change":"2023-06-23T19:01:04.380621+0000","last_active":"2023-06-23T19:01:09.283480+0000","last_peered":"2023-06-23T19:01:09.283480+0000","last_clean":"2023-06-23T19:01:09.283480+0000","last_became_active":"2023-06-23T19:01:04.379977+0000","last_became_peered":"2023-06-23T19:01:04.379977+0000","last_unstale":"2023-06-23T19:01:09.283480+0000","last_undegraded":"2023-06-23T19:01:09.283480+0000","last_fullsized":"2023-06-23T19:01:09.283480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:13.294523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281097+0000","last_change":"2023-06-23T19:01:08.399057+0000","last_active":"2023-06-23T19:01:09.281097+0000","last_peered":"2023-06-23T19:01:09.281097+0000","last_clean":"2023-06-23T19:01:09.281097+0000","last_became_active":"2023-06-23T19:01:08.398665+0000","last_became_peered":"2023-06-23T19:01:08.398665+0000","last_unstale":"2023-06-23T19:01:09.281097+0000","last_undegraded":"2023-06-23T19:01:09.281097+0000","last_fullsized":"2023-06-23T19:01:09.281097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:54:48.546637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281472+0000","last_change":"2023-06-23T19:01:03.876992+0000","last_active":"2023-06-23T19:01:09.281472+0000","last_peered":"2023-06-23T19:01:09.281472+0000","last_clean":"2023-06-23T19:01:09.281472+0000","last_became_active":"2023-06-23T19:01:03.876802+0000","last_became_peered":"2023-06-23T19:01:03.876802+0000","last_unstale":"2023-06-23T19:01:09.281472+0000","last_undegraded":"2023-06-23T19:01:09.281472+0000","last_fullsized":"2023-06-23T19:01:09.281472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:10.929312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872681+0000","last_change":"2023-06-23T19:01:04.382339+0000","last_active":"2023-06-23T19:01:08.872681+0000","last_peered":"2023-06-23T19:01:08.872681+0000","last_clean":"2023-06-23T19:01:08.872681+0000","last_became_active":"2023-06-23T19:01:04.382080+0000","last_became_peered":"2023-06-23T19:01:04.382080+0000","last_unstale":"2023-06-23T19:01:08.872681+0000","last_undegraded":"2023-06-23T19:01:08.872681+0000","last_fullsized":"2023-06-23T19:01:08.872681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:37:39.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282568+0000","last_change":"2023-06-23T19:01:08.405608+0000","last_active":"2023-06-23T19:01:09.282568+0000","last_peered":"2023-06-23T19:01:09.282568+0000","last_clean":"2023-06-23T19:01:09.282568+0000","last_became_active":"2023-06-23T19:01:08.405237+0000","last_became_peered":"2023-06-23T19:01:08.405237+0000","last_unstale":"2023-06-23T19:01:09.282568+0000","last_undegraded":"2023-06-23T19:01:09.282568+0000","last_fullsized":"2023-06-23T19:01:09.282568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:03.260614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156916+0000","last_change":"2023-06-23T19:01:03.869001+0000","last_active":"2023-06-23T19:01:09.156916+0000","last_peered":"2023-06-23T19:01:09.156916+0000","last_clean":"2023-06-23T19:01:09.156916+0000","last_became_active":"2023-06-23T19:01:03.868685+0000","last_became_peered":"2023-06-23T19:01:03.868685+0000","last_unstale":"2023-06-23T19:01:09.156916+0000","last_undegraded":"2023-06-23T19:01:09.156916+0000","last_fullsized":"2023-06-23T19:01:09.156916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:23:13.817453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281267+0000","last_change":"2023-06-23T19:01:04.374785+0000","last_active":"2023-06-23T19:01:09.281267+0000","last_peered":"2023-06-23T19:01:09.281267+0000","last_clean":"2023-06-23T19:01:09.281267+0000","last_became_active":"2023-06-23T19:01:04.374406+0000","last_became_peered":"2023-06-23T19:01:04.374406+0000","last_unstale":"2023-06-23T19:01:09.281267+0000","last_undegraded":"2023-06-23T19:01:09.281267+0000","last_fullsized":"2023-06-23T19:01:09.281267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:09:07.414494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282780+0000","last_change":"2023-06-23T19:01:08.393879+0000","last_active":"2023-06-23T19:01:09.282780+0000","last_peered":"2023-06-23T19:01:09.282780+0000","last_clean":"2023-06-23T19:01:09.282780+0000","last_became_active":"2023-06-23T19:01:08.393451+0000","last_became_peered":"2023-06-23T19:01:08.393451+0000","last_unstale":"2023-06-23T19:01:09.282780+0000","last_undegraded":"2023-06-23T19:01:09.282780+0000","last_fullsized":"2023-06-23T19:01:09.282780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:30:59.610379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282080+0000","last_change":"2023-06-23T19:01:03.880187+0000","last_active":"2023-06-23T19:01:09.282080+0000","last_peered":"2023-06-23T19:01:09.282080+0000","last_clean":"2023-06-23T19:01:09.282080+0000","last_became_active":"2023-06-23T19:01:03.879883+0000","last_became_peered":"2023-06-23T19:01:03.879883+0000","last_unstale":"2023-06-23T19:01:09.282080+0000","last_undegraded":"2023-06-23T19:01:09.282080+0000","last_fullsized":"2023-06-23T19:01:09.282080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:36:36.334076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281403+0000","last_change":"2023-06-23T19:01:04.374578+0000","last_active":"2023-06-23T19:01:09.281403+0000","last_peered":"2023-06-23T19:01:09.281403+0000","last_clean":"2023-06-23T19:01:09.281403+0000","last_became_active":"2023-06-23T19:01:04.374334+0000","last_became_peered":"2023-06-23T19:01:04.374334+0000","last_unstale":"2023-06-23T19:01:09.281403+0000","last_undegraded":"2023-06-23T19:01:09.281403+0000","last_fullsized":"2023-06-23T19:01:09.281403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.507284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870687+0000","last_change":"2023-06-23T19:01:08.401653+0000","last_active":"2023-06-23T19:01:08.870687+0000","last_peered":"2023-06-23T19:01:08.870687+0000","last_clean":"2023-06-23T19:01:08.870687+0000","last_became_active":"2023-06-23T19:01:08.401248+0000","last_became_peered":"2023-06-23T19:01:08.401248+0000","last_unstale":"2023-06-23T19:01:08.870687+0000","last_undegraded":"2023-06-23T19:01:08.870687+0000","last_fullsized":"2023-06-23T19:01:08.870687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:26.097068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281971+0000","last_change":"2023-06-23T19:01:03.877753+0000","last_active":"2023-06-23T19:01:09.281971+0000","last_peered":"2023-06-23T19:01:09.281971+0000","last_clean":"2023-06-23T19:01:09.281971+0000","last_became_active":"2023-06-23T19:01:03.877504+0000","last_became_peered":"2023-06-23T19:01:03.877504+0000","last_unstale":"2023-06-23T19:01:09.281971+0000","last_undegraded":"2023-06-23T19:01:09.281971+0000","last_fullsized":"2023-06-23T19:01:09.281971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:29.477822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281456+0000","last_change":"2023-06-23T19:01:04.388674+0000","last_active":"2023-06-23T19:01:09.281456+0000","last_peered":"2023-06-23T19:01:09.281456+0000","last_clean":"2023-06-23T19:01:09.281456+0000","last_became_active":"2023-06-23T19:01:04.386268+0000","last_became_peered":"2023-06-23T19:01:04.386268+0000","last_unstale":"2023-06-23T19:01:09.281456+0000","last_undegraded":"2023-06-23T19:01:09.281456+0000","last_fullsized":"2023-06-23T19:01:09.281456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:50:00.709971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870883+0000","last_change":"2023-06-23T19:01:08.403947+0000","last_active":"2023-06-23T19:01:08.870883+0000","last_peered":"2023-06-23T19:01:08.870883+0000","last_clean":"2023-06-23T19:01:08.870883+0000","last_became_active":"2023-06-23T19:01:08.403536+0000","last_became_peered":"2023-06-23T19:01:08.403536+0000","last_unstale":"2023-06-23T19:01:08.870883+0000","last_undegraded":"2023-06-23T19:01:08.870883+0000","last_fullsized":"2023-06-23T19:01:08.870883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:53:39.593981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282198+0000","last_change":"2023-06-23T19:01:03.874658+0000","last_active":"2023-06-23T19:01:09.282198+0000","last_peered":"2023-06-23T19:01:09.282198+0000","last_clean":"2023-06-23T19:01:09.282198+0000","last_became_active":"2023-06-23T19:01:03.874261+0000","last_became_peered":"2023-06-23T19:01:03.874261+0000","last_unstale":"2023-06-23T19:01:09.282198+0000","last_undegraded":"2023-06-23T19:01:09.282198+0000","last_fullsized":"2023-06-23T19:01:09.282198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:15.133048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156399+0000","last_change":"2023-06-23T19:01:04.375757+0000","last_active":"2023-06-23T19:01:09.156399+0000","last_peered":"2023-06-23T19:01:09.156399+0000","last_clean":"2023-06-23T19:01:09.156399+0000","last_became_active":"2023-06-23T19:01:04.375467+0000","last_became_peered":"2023-06-23T19:01:04.375467+0000","last_unstale":"2023-06-23T19:01:09.156399+0000","last_undegraded":"2023-06-23T19:01:09.156399+0000","last_fullsized":"2023-06-23T19:01:09.156399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:53:12.454851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870906+0000","last_change":"2023-06-23T19:01:08.400551+0000","last_active":"2023-06-23T19:01:08.870906+0000","last_peered":"2023-06-23T19:01:08.870906+0000","last_clean":"2023-06-23T19:01:08.870906+0000","last_became_active":"2023-06-23T19:01:08.400104+0000","last_became_peered":"2023-06-23T19:01:08.400104+0000","last_unstale":"2023-06-23T19:01:08.870906+0000","last_undegraded":"2023-06-23T19:01:08.870906+0000","last_fullsized":"2023-06-23T19:01:08.870906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:30:02.757178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281582+0000","last_change":"2023-06-23T19:01:03.879522+0000","last_active":"2023-06-23T19:01:09.281582+0000","last_peered":"2023-06-23T19:01:09.281582+0000","last_clean":"2023-06-23T19:01:09.281582+0000","last_became_active":"2023-06-23T19:01:03.879221+0000","last_became_peered":"2023-06-23T19:01:03.879221+0000","last_unstale":"2023-06-23T19:01:09.281582+0000","last_undegraded":"2023-06-23T19:01:09.281582+0000","last_fullsized":"2023-06-23T19:01:09.281582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:07.699862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873612+0000","last_change":"2023-06-23T19:01:04.387840+0000","last_active":"2023-06-23T19:01:08.873612+0000","last_peered":"2023-06-23T19:01:08.873612+0000","last_clean":"2023-06-23T19:01:08.873612+0000","last_became_active":"2023-06-23T19:01:04.387567+0000","last_became_peered":"2023-06-23T19:01:04.387567+0000","last_unstale":"2023-06-23T19:01:08.873612+0000","last_undegraded":"2023-06-23T19:01:08.873612+0000","last_fullsized":"2023-06-23T19:01:08.873612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:02.533488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871125+0000","last_change":"2023-06-23T19:01:08.403923+0000","last_active":"2023-06-23T19:01:08.871125+0000","last_peered":"2023-06-23T19:01:08.871125+0000","last_clean":"2023-06-23T19:01:08.871125+0000","last_became_active":"2023-06-23T19:01:08.403522+0000","last_became_peered":"2023-06-23T19:01:08.403522+0000","last_unstale":"2023-06-23T19:01:08.871125+0000","last_undegraded":"2023-06-23T19:01:08.871125+0000","last_fullsized":"2023-06-23T19:01:08.871125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:53:15.969015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280578+0000","last_change":"2023-06-23T19:01:03.873462+0000","last_active":"2023-06-23T19:01:09.280578+0000","last_peered":"2023-06-23T19:01:09.280578+0000","last_clean":"2023-06-23T19:01:09.280578+0000","last_became_active":"2023-06-23T19:01:03.873149+0000","last_became_peered":"2023-06-23T19:01:03.873149+0000","last_unstale":"2023-06-23T19:01:09.280578+0000","last_undegraded":"2023-06-23T19:01:09.280578+0000","last_fullsized":"2023-06-23T19:01:09.280578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:49:07.995821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281801+0000","last_change":"2023-06-23T19:01:04.374748+0000","last_active":"2023-06-23T19:01:09.281801+0000","last_peered":"2023-06-23T19:01:09.281801+0000","last_clean":"2023-06-23T19:01:09.281801+0000","last_became_active":"2023-06-23T19:01:04.374472+0000","last_became_peered":"2023-06-23T19:01:04.374472+0000","last_unstale":"2023-06-23T19:01:09.281801+0000","last_undegraded":"2023-06-23T19:01:09.281801+0000","last_fullsized":"2023-06-23T19:01:09.281801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:18:56.549266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872716+0000","last_change":"2023-06-23T19:01:08.401582+0000","last_active":"2023-06-23T19:01:08.872716+0000","last_peered":"2023-06-23T19:01:08.872716+0000","last_clean":"2023-06-23T19:01:08.872716+0000","last_became_active":"2023-06-23T19:01:08.401005+0000","last_became_peered":"2023-06-23T19:01:08.401005+0000","last_unstale":"2023-06-23T19:01:08.872716+0000","last_undegraded":"2023-06-23T19:01:08.872716+0000","last_fullsized":"2023-06-23T19:01:08.872716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:27.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156410+0000","last_change":"2023-06-23T19:01:03.875624+0000","last_active":"2023-06-23T19:01:09.156410+0000","last_peered":"2023-06-23T19:01:09.156410+0000","last_clean":"2023-06-23T19:01:09.156410+0000","last_became_active":"2023-06-23T19:01:03.875128+0000","last_became_peered":"2023-06-23T19:01:03.875128+0000","last_unstale":"2023-06-23T19:01:09.156410+0000","last_undegraded":"2023-06-23T19:01:09.156410+0000","last_fullsized":"2023-06-23T19:01:09.156410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:49.506561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282467+0000","last_change":"2023-06-23T19:01:04.378623+0000","last_active":"2023-06-23T19:01:09.282467+0000","last_peered":"2023-06-23T19:01:09.282467+0000","last_clean":"2023-06-23T19:01:09.282467+0000","last_became_active":"2023-06-23T19:01:04.378293+0000","last_became_peered":"2023-06-23T19:01:04.378293+0000","last_unstale":"2023-06-23T19:01:09.282467+0000","last_undegraded":"2023-06-23T19:01:09.282467+0000","last_fullsized":"2023-06-23T19:01:09.282467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:56:02.598277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282984+0000","last_change":"2023-06-23T19:01:08.401075+0000","last_active":"2023-06-23T19:01:09.282984+0000","last_peered":"2023-06-23T19:01:09.282984+0000","last_clean":"2023-06-23T19:01:09.282984+0000","last_became_active":"2023-06-23T19:01:08.400426+0000","last_became_peered":"2023-06-23T19:01:08.400426+0000","last_unstale":"2023-06-23T19:01:09.282984+0000","last_undegraded":"2023-06-23T19:01:09.282984+0000","last_fullsized":"2023-06-23T19:01:09.282984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:36:40.851994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281070+0000","last_change":"2023-06-23T19:01:03.874770+0000","last_active":"2023-06-23T19:01:09.281070+0000","last_peered":"2023-06-23T19:01:09.281070+0000","last_clean":"2023-06-23T19:01:09.281070+0000","last_became_active":"2023-06-23T19:01:03.874431+0000","last_became_peered":"2023-06-23T19:01:03.874431+0000","last_unstale":"2023-06-23T19:01:09.281070+0000","last_undegraded":"2023-06-23T19:01:09.281070+0000","last_fullsized":"2023-06-23T19:01:09.281070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:08.437952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283093+0000","last_change":"2023-06-23T19:01:04.386778+0000","last_active":"2023-06-23T19:01:09.283093+0000","last_peered":"2023-06-23T19:01:09.283093+0000","last_clean":"2023-06-23T19:01:09.283093+0000","last_became_active":"2023-06-23T19:01:04.386495+0000","last_became_peered":"2023-06-23T19:01:04.386495+0000","last_unstale":"2023-06-23T19:01:09.283093+0000","last_undegraded":"2023-06-23T19:01:09.283093+0000","last_fullsized":"2023-06-23T19:01:09.283093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:27:49.477353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282367+0000","last_change":"2023-06-23T19:01:08.404383+0000","last_active":"2023-06-23T19:01:09.282367+0000","last_peered":"2023-06-23T19:01:09.282367+0000","last_clean":"2023-06-23T19:01:09.282367+0000","last_became_active":"2023-06-23T19:01:08.404012+0000","last_became_peered":"2023-06-23T19:01:08.404012+0000","last_unstale":"2023-06-23T19:01:09.282367+0000","last_undegraded":"2023-06-23T19:01:09.282367+0000","last_fullsized":"2023-06-23T19:01:09.282367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:03:20.177798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280656+0000","last_change":"2023-06-23T19:01:03.878586+0000","last_active":"2023-06-23T19:01:09.280656+0000","last_peered":"2023-06-23T19:01:09.280656+0000","last_clean":"2023-06-23T19:01:09.280656+0000","last_became_active":"2023-06-23T19:01:03.878175+0000","last_became_peered":"2023-06-23T19:01:03.878175+0000","last_unstale":"2023-06-23T19:01:09.280656+0000","last_undegraded":"2023-06-23T19:01:09.280656+0000","last_fullsized":"2023-06-23T19:01:09.280656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:57:18.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873170+0000","last_change":"2023-06-23T19:01:04.379321+0000","last_active":"2023-06-23T19:01:08.873170+0000","last_peered":"2023-06-23T19:01:08.873170+0000","last_clean":"2023-06-23T19:01:08.873170+0000","last_became_active":"2023-06-23T19:01:04.379070+0000","last_became_peered":"2023-06-23T19:01:04.379070+0000","last_unstale":"2023-06-23T19:01:08.873170+0000","last_undegraded":"2023-06-23T19:01:08.873170+0000","last_fullsized":"2023-06-23T19:01:08.873170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:11.933066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873029+0000","last_change":"2023-06-23T19:01:08.408901+0000","last_active":"2023-06-23T19:01:08.873029+0000","last_peered":"2023-06-23T19:01:08.873029+0000","last_clean":"2023-06-23T19:01:08.873029+0000","last_became_active":"2023-06-23T19:01:08.407480+0000","last_became_peered":"2023-06-23T19:01:08.407480+0000","last_unstale":"2023-06-23T19:01:08.873029+0000","last_undegraded":"2023-06-23T19:01:08.873029+0000","last_fullsized":"2023-06-23T19:01:08.873029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:37.021448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872745+0000","last_change":"2023-06-23T19:00:58.992193+0000","last_active":"2023-06-23T19:01:08.872745+0000","last_peered":"2023-06-23T19:01:08.872745+0000","last_clean":"2023-06-23T19:01:08.872745+0000","last_became_active":"2023-06-23T19:00:58.991974+0000","last_became_peered":"2023-06-23T19:00:58.991974+0000","last_unstale":"2023-06-23T19:01:08.872745+0000","last_undegraded":"2023-06-23T19:01:08.872745+0000","last_fullsized":"2023-06-23T19:01:08.872745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:28.142431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283350+0000","last_change":"2023-06-23T19:01:03.879405+0000","last_active":"2023-06-23T19:01:09.283350+0000","last_peered":"2023-06-23T19:01:09.283350+0000","last_clean":"2023-06-23T19:01:09.283350+0000","last_became_active":"2023-06-23T19:01:03.879131+0000","last_became_peered":"2023-06-23T19:01:03.879131+0000","last_unstale":"2023-06-23T19:01:09.283350+0000","last_undegraded":"2023-06-23T19:01:09.283350+0000","last_fullsized":"2023-06-23T19:01:09.283350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:01.217016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872450+0000","last_change":"2023-06-23T19:01:04.371729+0000","last_active":"2023-06-23T19:01:08.872450+0000","last_peered":"2023-06-23T19:01:08.872450+0000","last_clean":"2023-06-23T19:01:08.872450+0000","last_became_active":"2023-06-23T19:01:04.371442+0000","last_became_peered":"2023-06-23T19:01:04.371442+0000","last_unstale":"2023-06-23T19:01:08.872450+0000","last_undegraded":"2023-06-23T19:01:08.872450+0000","last_fullsized":"2023-06-23T19:01:08.872450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:59.683785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873522+0000","last_change":"2023-06-23T19:01:08.403859+0000","last_active":"2023-06-23T19:01:08.873522+0000","last_peered":"2023-06-23T19:01:08.873522+0000","last_clean":"2023-06-23T19:01:08.873522+0000","last_became_active":"2023-06-23T19:01:08.402403+0000","last_became_peered":"2023-06-23T19:01:08.402403+0000","last_unstale":"2023-06-23T19:01:08.873522+0000","last_undegraded":"2023-06-23T19:01:08.873522+0000","last_fullsized":"2023-06-23T19:01:08.873522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:15.447230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282362+0000","last_change":"2023-06-23T19:00:58.032255+0000","last_active":"2023-06-23T19:01:09.282362+0000","last_peered":"2023-06-23T19:01:09.282362+0000","last_clean":"2023-06-23T19:01:09.282362+0000","last_became_active":"2023-06-23T19:00:58.031815+0000","last_became_peered":"2023-06-23T19:00:58.031815+0000","last_unstale":"2023-06-23T19:01:09.282362+0000","last_undegraded":"2023-06-23T19:01:09.282362+0000","last_fullsized":"2023-06-23T19:01:09.282362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:15.657801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281431+0000","last_change":"2023-06-23T19:01:03.878338+0000","last_active":"2023-06-23T19:01:09.281431+0000","last_peered":"2023-06-23T19:01:09.281431+0000","last_clean":"2023-06-23T19:01:09.281431+0000","last_became_active":"2023-06-23T19:01:03.873345+0000","last_became_peered":"2023-06-23T19:01:03.873345+0000","last_unstale":"2023-06-23T19:01:09.281431+0000","last_undegraded":"2023-06-23T19:01:09.281431+0000","last_fullsized":"2023-06-23T19:01:09.281431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:44:57.209204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872632+0000","last_change":"2023-06-23T19:01:04.385034+0000","last_active":"2023-06-23T19:01:08.872632+0000","last_peered":"2023-06-23T19:01:08.872632+0000","last_clean":"2023-06-23T19:01:08.872632+0000","last_became_active":"2023-06-23T19:01:04.384747+0000","last_became_peered":"2023-06-23T19:01:04.384747+0000","last_unstale":"2023-06-23T19:01:08.872632+0000","last_undegraded":"2023-06-23T19:01:08.872632+0000","last_fullsized":"2023-06-23T19:01:08.872632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:37:39.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871252+0000","last_change":"2023-06-23T19:01:08.404982+0000","last_active":"2023-06-23T19:01:08.871252+0000","last_peered":"2023-06-23T19:01:08.871252+0000","last_clean":"2023-06-23T19:01:08.871252+0000","last_became_active":"2023-06-23T19:01:08.404577+0000","last_became_peered":"2023-06-23T19:01:08.404577+0000","last_unstale":"2023-06-23T19:01:08.871252+0000","last_undegraded":"2023-06-23T19:01:08.871252+0000","last_fullsized":"2023-06-23T19:01:08.871252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:38:36.950113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870787+0000","last_change":"2023-06-23T19:00:58.810848+0000","last_active":"2023-06-23T19:01:08.870787+0000","last_peered":"2023-06-23T19:01:08.870787+0000","last_clean":"2023-06-23T19:01:08.870787+0000","last_became_active":"2023-06-23T19:00:58.810530+0000","last_became_peered":"2023-06-23T19:00:58.810530+0000","last_unstale":"2023-06-23T19:01:08.870787+0000","last_undegraded":"2023-06-23T19:01:08.870787+0000","last_fullsized":"2023-06-23T19:01:08.870787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:08:44.162030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871989+0000","last_change":"2023-06-23T19:01:03.878115+0000","last_active":"2023-06-23T19:01:08.871989+0000","last_peered":"2023-06-23T19:01:08.871989+0000","last_clean":"2023-06-23T19:01:08.871989+0000","last_became_active":"2023-06-23T19:01:03.877772+0000","last_became_peered":"2023-06-23T19:01:03.877772+0000","last_unstale":"2023-06-23T19:01:08.871989+0000","last_undegraded":"2023-06-23T19:01:08.871989+0000","last_fullsized":"2023-06-23T19:01:08.871989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:45:30.544760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872856+0000","last_change":"2023-06-23T19:01:04.371163+0000","last_active":"2023-06-23T19:01:08.872856+0000","last_peered":"2023-06-23T19:01:08.872856+0000","last_clean":"2023-06-23T19:01:08.872856+0000","last_became_active":"2023-06-23T19:01:04.370885+0000","last_became_peered":"2023-06-23T19:01:04.370885+0000","last_unstale":"2023-06-23T19:01:08.872856+0000","last_undegraded":"2023-06-23T19:01:08.872856+0000","last_fullsized":"2023-06-23T19:01:08.872856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:08.703615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281165+0000","last_change":"2023-06-23T19:01:08.403027+0000","last_active":"2023-06-23T19:01:09.281165+0000","last_peered":"2023-06-23T19:01:09.281165+0000","last_clean":"2023-06-23T19:01:09.281165+0000","last_became_active":"2023-06-23T19:01:08.402697+0000","last_became_peered":"2023-06-23T19:01:08.402697+0000","last_unstale":"2023-06-23T19:01:09.281165+0000","last_undegraded":"2023-06-23T19:01:09.281165+0000","last_fullsized":"2023-06-23T19:01:09.281165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:38.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282502+0000","last_change":"2023-06-23T19:00:58.032352+0000","last_active":"2023-06-23T19:01:09.282502+0000","last_peered":"2023-06-23T19:01:09.282502+0000","last_clean":"2023-06-23T19:01:09.282502+0000","last_became_active":"2023-06-23T19:00:58.031905+0000","last_became_peered":"2023-06-23T19:00:58.031905+0000","last_unstale":"2023-06-23T19:01:09.282502+0000","last_undegraded":"2023-06-23T19:01:09.282502+0000","last_fullsized":"2023-06-23T19:01:09.282502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:05.104177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281370+0000","last_change":"2023-06-23T19:00:50.002765+0000","last_active":"2023-06-23T19:01:09.281370+0000","last_peered":"2023-06-23T19:01:09.281370+0000","last_clean":"2023-06-23T19:01:09.281370+0000","last_became_active":"2023-06-23T19:00:50.002445+0000","last_became_peered":"2023-06-23T19:00:50.002445+0000","last_unstale":"2023-06-23T19:01:09.281370+0000","last_undegraded":"2023-06-23T19:01:09.281370+0000","last_fullsized":"2023-06-23T19:01:09.281370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_clean_scrub_stamp":"2023-06-23T19:00:48.989242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280695+0000","last_change":"2023-06-23T19:01:03.873914+0000","last_active":"2023-06-23T19:01:09.280695+0000","last_peered":"2023-06-23T19:01:09.280695+0000","last_clean":"2023-06-23T19:01:09.280695+0000","last_became_active":"2023-06-23T19:01:03.873592+0000","last_became_peered":"2023-06-23T19:01:03.873592+0000","last_unstale":"2023-06-23T19:01:09.280695+0000","last_undegraded":"2023-06-23T19:01:09.280695+0000","last_fullsized":"2023-06-23T19:01:09.280695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:15.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156830+0000","last_change":"2023-06-23T19:01:04.387883+0000","last_active":"2023-06-23T19:01:09.156830+0000","last_peered":"2023-06-23T19:01:09.156830+0000","last_clean":"2023-06-23T19:01:09.156830+0000","last_became_active":"2023-06-23T19:01:04.387600+0000","last_became_peered":"2023-06-23T19:01:04.387600+0000","last_unstale":"2023-06-23T19:01:09.156830+0000","last_undegraded":"2023-06-23T19:01:09.156830+0000","last_fullsized":"2023-06-23T19:01:09.156830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:16:44.300439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282713+0000","last_change":"2023-06-23T19:01:08.401404+0000","last_active":"2023-06-23T19:01:09.282713+0000","last_peered":"2023-06-23T19:01:09.282713+0000","last_clean":"2023-06-23T19:01:09.282713+0000","last_became_active":"2023-06-23T19:01:08.400568+0000","last_became_peered":"2023-06-23T19:01:08.400568+0000","last_unstale":"2023-06-23T19:01:09.282713+0000","last_undegraded":"2023-06-23T19:01:09.282713+0000","last_fullsized":"2023-06-23T19:01:09.282713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:33.995739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283199+0000","last_change":"2023-06-23T19:00:58.034045+0000","last_active":"2023-06-23T19:01:09.283199+0000","last_peered":"2023-06-23T19:01:09.283199+0000","last_clean":"2023-06-23T19:01:09.283199+0000","last_became_active":"2023-06-23T19:00:58.033654+0000","last_became_peered":"2023-06-23T19:00:58.033654+0000","last_unstale":"2023-06-23T19:01:09.283199+0000","last_undegraded":"2023-06-23T19:01:09.283199+0000","last_fullsized":"2023-06-23T19:01:09.283199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:01:40.788438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872071+0000","last_change":"2023-06-23T19:01:03.877003+0000","last_active":"2023-06-23T19:01:08.872071+0000","last_peered":"2023-06-23T19:01:08.872071+0000","last_clean":"2023-06-23T19:01:08.872071+0000","last_became_active":"2023-06-23T19:01:03.876599+0000","last_became_peered":"2023-06-23T19:01:03.876599+0000","last_unstale":"2023-06-23T19:01:08.872071+0000","last_undegraded":"2023-06-23T19:01:08.872071+0000","last_fullsized":"2023-06-23T19:01:08.872071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:50.138012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872292+0000","last_change":"2023-06-23T19:01:04.388623+0000","last_active":"2023-06-23T19:01:08.872292+0000","last_peered":"2023-06-23T19:01:08.872292+0000","last_clean":"2023-06-23T19:01:08.872292+0000","last_became_active":"2023-06-23T19:01:04.388354+0000","last_became_peered":"2023-06-23T19:01:04.388354+0000","last_unstale":"2023-06-23T19:01:08.872292+0000","last_undegraded":"2023-06-23T19:01:08.872292+0000","last_fullsized":"2023-06-23T19:01:08.872292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:52:26.947243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156779+0000","last_change":"2023-06-23T19:01:08.405177+0000","last_active":"2023-06-23T19:01:09.156779+0000","last_peered":"2023-06-23T19:01:09.156779+0000","last_clean":"2023-06-23T19:01:09.156779+0000","last_became_active":"2023-06-23T19:01:08.404747+0000","last_became_peered":"2023-06-23T19:01:08.404747+0000","last_unstale":"2023-06-23T19:01:09.156779+0000","last_undegraded":"2023-06-23T19:01:09.156779+0000","last_fullsized":"2023-06-23T19:01:09.156779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:17:06.369020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282026+0000","last_change":"2023-06-23T19:00:58.992645+0000","last_active":"2023-06-23T19:01:09.282026+0000","last_peered":"2023-06-23T19:01:09.282026+0000","last_clean":"2023-06-23T19:01:09.282026+0000","last_became_active":"2023-06-23T19:00:58.992291+0000","last_became_peered":"2023-06-23T19:00:58.992291+0000","last_unstale":"2023-06-23T19:01:09.282026+0000","last_undegraded":"2023-06-23T19:01:09.282026+0000","last_fullsized":"2023-06-23T19:01:09.282026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:16:30.068353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873413+0000","last_change":"2023-06-23T19:01:03.878082+0000","last_active":"2023-06-23T19:01:08.873413+0000","last_peered":"2023-06-23T19:01:08.873413+0000","last_clean":"2023-06-23T19:01:08.873413+0000","last_became_active":"2023-06-23T19:01:03.877747+0000","last_became_peered":"2023-06-23T19:01:03.877747+0000","last_unstale":"2023-06-23T19:01:08.873413+0000","last_undegraded":"2023-06-23T19:01:08.873413+0000","last_fullsized":"2023-06-23T19:01:08.873413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:21.482936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873397+0000","last_change":"2023-06-23T19:01:04.374320+0000","last_active":"2023-06-23T19:01:08.873397+0000","last_peered":"2023-06-23T19:01:08.873397+0000","last_clean":"2023-06-23T19:01:08.873397+0000","last_became_active":"2023-06-23T19:01:04.374031+0000","last_became_peered":"2023-06-23T19:01:04.374031+0000","last_unstale":"2023-06-23T19:01:08.873397+0000","last_undegraded":"2023-06-23T19:01:08.873397+0000","last_fullsized":"2023-06-23T19:01:08.873397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:34.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281624+0000","last_change":"2023-06-23T19:01:08.394556+0000","last_active":"2023-06-23T19:01:09.281624+0000","last_peered":"2023-06-23T19:01:09.281624+0000","last_clean":"2023-06-23T19:01:09.281624+0000","last_became_active":"2023-06-23T19:01:08.393875+0000","last_became_peered":"2023-06-23T19:01:08.393875+0000","last_unstale":"2023-06-23T19:01:09.281624+0000","last_undegraded":"2023-06-23T19:01:09.281624+0000","last_fullsized":"2023-06-23T19:01:09.281624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:07:00.398165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281299+0000","last_change":"2023-06-23T19:01:03.870177+0000","last_active":"2023-06-23T19:01:09.281299+0000","last_peered":"2023-06-23T19:01:09.281299+0000","last_clean":"2023-06-23T19:01:09.281299+0000","last_became_active":"2023-06-23T19:01:03.869846+0000","last_became_peered":"2023-06-23T19:01:03.869846+0000","last_unstale":"2023-06-23T19:01:09.281299+0000","last_undegraded":"2023-06-23T19:01:09.281299+0000","last_fullsized":"2023-06-23T19:01:09.281299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:16:04.856211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873658+0000","last_change":"2023-06-23T19:00:58.034828+0000","last_active":"2023-06-23T19:01:08.873658+0000","last_peered":"2023-06-23T19:01:08.873658+0000","last_clean":"2023-06-23T19:01:08.873658+0000","last_became_active":"2023-06-23T19:00:58.034502+0000","last_became_peered":"2023-06-23T19:00:58.034502+0000","last_unstale":"2023-06-23T19:01:08.873658+0000","last_undegraded":"2023-06-23T19:01:08.873658+0000","last_fullsized":"2023-06-23T19:01:08.873658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:41.813074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280470+0000","last_change":"2023-06-23T19:01:04.377485+0000","last_active":"2023-06-23T19:01:09.280470+0000","last_peered":"2023-06-23T19:01:09.280470+0000","last_clean":"2023-06-23T19:01:09.280470+0000","last_became_active":"2023-06-23T19:01:04.377242+0000","last_became_peered":"2023-06-23T19:01:04.377242+0000","last_unstale":"2023-06-23T19:01:09.280470+0000","last_undegraded":"2023-06-23T19:01:09.280470+0000","last_fullsized":"2023-06-23T19:01:09.280470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:49.389492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280412+0000","last_change":"2023-06-23T19:01:08.399309+0000","last_active":"2023-06-23T19:01:09.280412+0000","last_peered":"2023-06-23T19:01:09.280412+0000","last_clean":"2023-06-23T19:01:09.280412+0000","last_became_active":"2023-06-23T19:01:08.398913+0000","last_became_peered":"2023-06-23T19:01:08.398913+0000","last_unstale":"2023-06-23T19:01:09.280412+0000","last_undegraded":"2023-06-23T19:01:09.280412+0000","last_fullsized":"2023-06-23T19:01:09.280412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:05:26.164184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157050+0000","last_change":"2023-06-23T19:00:58.035530+0000","last_active":"2023-06-23T19:01:09.157050+0000","last_peered":"2023-06-23T19:01:09.157050+0000","last_clean":"2023-06-23T19:01:09.157050+0000","last_became_active":"2023-06-23T19:00:58.035130+0000","last_became_peered":"2023-06-23T19:00:58.035130+0000","last_unstale":"2023-06-23T19:01:09.157050+0000","last_undegraded":"2023-06-23T19:01:09.157050+0000","last_fullsized":"2023-06-23T19:01:09.157050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:11.697702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872441+0000","last_change":"2023-06-23T19:01:03.875213+0000","last_active":"2023-06-23T19:01:08.872441+0000","last_peered":"2023-06-23T19:01:08.872441+0000","last_clean":"2023-06-23T19:01:08.872441+0000","last_became_active":"2023-06-23T19:01:03.874930+0000","last_became_peered":"2023-06-23T19:01:03.874930+0000","last_unstale":"2023-06-23T19:01:08.872441+0000","last_undegraded":"2023-06-23T19:01:08.872441+0000","last_fullsized":"2023-06-23T19:01:08.872441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:08:23.340468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281216+0000","last_change":"2023-06-23T19:01:04.381558+0000","last_active":"2023-06-23T19:01:09.281216+0000","last_peered":"2023-06-23T19:01:09.281216+0000","last_clean":"2023-06-23T19:01:09.281216+0000","last_became_active":"2023-06-23T19:01:04.381261+0000","last_became_peered":"2023-06-23T19:01:04.381261+0000","last_unstale":"2023-06-23T19:01:09.281216+0000","last_undegraded":"2023-06-23T19:01:09.281216+0000","last_fullsized":"2023-06-23T19:01:09.281216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:19:13.412736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872856+0000","last_change":"2023-06-23T19:01:08.396210+0000","last_active":"2023-06-23T19:01:08.872856+0000","last_peered":"2023-06-23T19:01:08.872856+0000","last_clean":"2023-06-23T19:01:08.872856+0000","last_became_active":"2023-06-23T19:01:08.395784+0000","last_became_peered":"2023-06-23T19:01:08.395784+0000","last_unstale":"2023-06-23T19:01:08.872856+0000","last_undegraded":"2023-06-23T19:01:08.872856+0000","last_fullsized":"2023-06-23T19:01:08.872856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:37.937641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873475+0000","last_change":"2023-06-23T19:01:03.880745+0000","last_active":"2023-06-23T19:01:08.873475+0000","last_peered":"2023-06-23T19:01:08.873475+0000","last_clean":"2023-06-23T19:01:08.873475+0000","last_became_active":"2023-06-23T19:01:03.880470+0000","last_became_peered":"2023-06-23T19:01:03.880470+0000","last_unstale":"2023-06-23T19:01:08.873475+0000","last_undegraded":"2023-06-23T19:01:08.873475+0000","last_fullsized":"2023-06-23T19:01:08.873475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:47.638210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871233+0000","last_change":"2023-06-23T19:01:04.374095+0000","last_active":"2023-06-23T19:01:08.871233+0000","last_peered":"2023-06-23T19:01:08.871233+0000","last_clean":"2023-06-23T19:01:08.871233+0000","last_became_active":"2023-06-23T19:01:04.373775+0000","last_became_peered":"2023-06-23T19:01:04.373775+0000","last_unstale":"2023-06-23T19:01:08.871233+0000","last_undegraded":"2023-06-23T19:01:08.871233+0000","last_fullsized":"2023-06-23T19:01:08.871233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:17:02.854856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281073+0000","last_change":"2023-06-23T19:01:08.394708+0000","last_active":"2023-06-23T19:01:09.281073+0000","last_peered":"2023-06-23T19:01:09.281073+0000","last_clean":"2023-06-23T19:01:09.281073+0000","last_became_active":"2023-06-23T19:01:08.394307+0000","last_became_peered":"2023-06-23T19:01:08.394307+0000","last_unstale":"2023-06-23T19:01:09.281073+0000","last_undegraded":"2023-06-23T19:01:09.281073+0000","last_fullsized":"2023-06-23T19:01:09.281073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:37.937641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281731+0000","last_change":"2023-06-23T19:01:03.881055+0000","last_active":"2023-06-23T19:01:09.281731+0000","last_peered":"2023-06-23T19:01:09.281731+0000","last_clean":"2023-06-23T19:01:09.281731+0000","last_became_active":"2023-06-23T19:01:03.880783+0000","last_became_peered":"2023-06-23T19:01:03.880783+0000","last_unstale":"2023-06-23T19:01:09.281731+0000","last_undegraded":"2023-06-23T19:01:09.281731+0000","last_fullsized":"2023-06-23T19:01:09.281731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:33.419724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281290+0000","last_change":"2023-06-23T19:01:04.384460+0000","last_active":"2023-06-23T19:01:09.281290+0000","last_peered":"2023-06-23T19:01:09.281290+0000","last_clean":"2023-06-23T19:01:09.281290+0000","last_became_active":"2023-06-23T19:01:04.384176+0000","last_became_peered":"2023-06-23T19:01:04.384176+0000","last_unstale":"2023-06-23T19:01:09.281290+0000","last_undegraded":"2023-06-23T19:01:09.281290+0000","last_fullsized":"2023-06-23T19:01:09.281290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:22:29.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282471+0000","last_change":"2023-06-23T19:01:08.400916+0000","last_active":"2023-06-23T19:01:09.282471+0000","last_peered":"2023-06-23T19:01:09.282471+0000","last_clean":"2023-06-23T19:01:09.282471+0000","last_became_active":"2023-06-23T19:01:08.400414+0000","last_became_peered":"2023-06-23T19:01:08.400414+0000","last_unstale":"2023-06-23T19:01:09.282471+0000","last_undegraded":"2023-06-23T19:01:09.282471+0000","last_fullsized":"2023-06-23T19:01:09.282471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:52.156128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283145+0000","last_change":"2023-06-23T19:01:03.881189+0000","last_active":"2023-06-23T19:01:09.283145+0000","last_peered":"2023-06-23T19:01:09.283145+0000","last_clean":"2023-06-23T19:01:09.283145+0000","last_became_active":"2023-06-23T19:01:03.880951+0000","last_became_peered":"2023-06-23T19:01:03.880951+0000","last_unstale":"2023-06-23T19:01:09.283145+0000","last_undegraded":"2023-06-23T19:01:09.283145+0000","last_fullsized":"2023-06-23T19:01:09.283145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:15.133048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282217+0000","last_change":"2023-06-23T19:01:04.384653+0000","last_active":"2023-06-23T19:01:09.282217+0000","last_peered":"2023-06-23T19:01:09.282217+0000","last_clean":"2023-06-23T19:01:09.282217+0000","last_became_active":"2023-06-23T19:01:04.384329+0000","last_became_peered":"2023-06-23T19:01:04.384329+0000","last_unstale":"2023-06-23T19:01:09.282217+0000","last_undegraded":"2023-06-23T19:01:09.282217+0000","last_fullsized":"2023-06-23T19:01:09.282217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:34:32.935523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280710+0000","last_change":"2023-06-23T19:01:08.395019+0000","last_active":"2023-06-23T19:01:09.280710+0000","last_peered":"2023-06-23T19:01:09.280710+0000","last_clean":"2023-06-23T19:01:09.280710+0000","last_became_active":"2023-06-23T19:01:08.394627+0000","last_became_peered":"2023-06-23T19:01:08.394627+0000","last_unstale":"2023-06-23T19:01:09.280710+0000","last_undegraded":"2023-06-23T19:01:09.280710+0000","last_fullsized":"2023-06-23T19:01:09.280710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:47:00.590205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281012+0000","last_change":"2023-06-23T19:01:03.865046+0000","last_active":"2023-06-23T19:01:09.281012+0000","last_peered":"2023-06-23T19:01:09.281012+0000","last_clean":"2023-06-23T19:01:09.281012+0000","last_became_active":"2023-06-23T19:01:03.864670+0000","last_became_peered":"2023-06-23T19:01:03.864670+0000","last_unstale":"2023-06-23T19:01:09.281012+0000","last_undegraded":"2023-06-23T19:01:09.281012+0000","last_fullsized":"2023-06-23T19:01:09.281012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:12.906392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280997+0000","last_change":"2023-06-23T19:01:04.378240+0000","last_active":"2023-06-23T19:01:09.280997+0000","last_peered":"2023-06-23T19:01:09.280997+0000","last_clean":"2023-06-23T19:01:09.280997+0000","last_became_active":"2023-06-23T19:01:04.377992+0000","last_became_peered":"2023-06-23T19:01:04.377992+0000","last_unstale":"2023-06-23T19:01:09.280997+0000","last_undegraded":"2023-06-23T19:01:09.280997+0000","last_fullsized":"2023-06-23T19:01:09.280997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:32:02.858761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872457+0000","last_change":"2023-06-23T19:01:08.407782+0000","last_active":"2023-06-23T19:01:08.872457+0000","last_peered":"2023-06-23T19:01:08.872457+0000","last_clean":"2023-06-23T19:01:08.872457+0000","last_became_active":"2023-06-23T19:01:08.407314+0000","last_became_peered":"2023-06-23T19:01:08.407314+0000","last_unstale":"2023-06-23T19:01:08.872457+0000","last_undegraded":"2023-06-23T19:01:08.872457+0000","last_fullsized":"2023-06-23T19:01:08.872457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:08:27.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873611+0000","last_change":"2023-06-23T19:01:03.875481+0000","last_active":"2023-06-23T19:01:08.873611+0000","last_peered":"2023-06-23T19:01:08.873611+0000","last_clean":"2023-06-23T19:01:08.873611+0000","last_became_active":"2023-06-23T19:01:03.874826+0000","last_became_peered":"2023-06-23T19:01:03.874826+0000","last_unstale":"2023-06-23T19:01:08.873611+0000","last_undegraded":"2023-06-23T19:01:08.873611+0000","last_fullsized":"2023-06-23T19:01:08.873611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:58.742697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280899+0000","last_change":"2023-06-23T19:01:04.378819+0000","last_active":"2023-06-23T19:01:09.280899+0000","last_peered":"2023-06-23T19:01:09.280899+0000","last_clean":"2023-06-23T19:01:09.280899+0000","last_became_active":"2023-06-23T19:01:04.378183+0000","last_became_peered":"2023-06-23T19:01:04.378183+0000","last_unstale":"2023-06-23T19:01:09.280899+0000","last_undegraded":"2023-06-23T19:01:09.280899+0000","last_fullsized":"2023-06-23T19:01:09.280899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:00.026037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156609+0000","last_change":"2023-06-23T19:01:04.375991+0000","last_active":"2023-06-23T19:01:09.156609+0000","last_peered":"2023-06-23T19:01:09.156609+0000","last_clean":"2023-06-23T19:01:09.156609+0000","last_became_active":"2023-06-23T19:01:04.375767+0000","last_became_peered":"2023-06-23T19:01:04.375767+0000","last_unstale":"2023-06-23T19:01:09.156609+0000","last_undegraded":"2023-06-23T19:01:09.156609+0000","last_fullsized":"2023-06-23T19:01:09.156609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:03.089060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281270+0000","last_change":"2023-06-23T19:01:04.386075+0000","last_active":"2023-06-23T19:01:09.281270+0000","last_peered":"2023-06-23T19:01:09.281270+0000","last_clean":"2023-06-23T19:01:09.281270+0000","last_became_active":"2023-06-23T19:01:04.385788+0000","last_became_peered":"2023-06-23T19:01:04.385788+0000","last_unstale":"2023-06-23T19:01:09.281270+0000","last_undegraded":"2023-06-23T19:01:09.281270+0000","last_fullsized":"2023-06-23T19:01:09.281270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:38:17.246142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282773+0000","last_change":"2023-06-23T19:01:04.378811+0000","last_active":"2023-06-23T19:01:09.282773+0000","last_peered":"2023-06-23T19:01:09.282773+0000","last_clean":"2023-06-23T19:01:09.282773+0000","last_became_active":"2023-06-23T19:01:04.378217+0000","last_became_peered":"2023-06-23T19:01:04.378217+0000","last_unstale":"2023-06-23T19:01:09.282773+0000","last_undegraded":"2023-06-23T19:01:09.282773+0000","last_fullsized":"2023-06-23T19:01:09.282773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:21:41.388818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280565+0000","last_change":"2023-06-23T19:01:04.378198+0000","last_active":"2023-06-23T19:01:09.280565+0000","last_peered":"2023-06-23T19:01:09.280565+0000","last_clean":"2023-06-23T19:01:09.280565+0000","last_became_active":"2023-06-23T19:01:04.377778+0000","last_became_peered":"2023-06-23T19:01:04.377778+0000","last_unstale":"2023-06-23T19:01:09.280565+0000","last_undegraded":"2023-06-23T19:01:09.280565+0000","last_fullsized":"2023-06-23T19:01:09.280565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:10:45.255508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872832+0000","last_change":"2023-06-23T19:01:04.375219+0000","last_active":"2023-06-23T19:01:08.872832+0000","last_peered":"2023-06-23T19:01:08.872832+0000","last_clean":"2023-06-23T19:01:08.872832+0000","last_became_active":"2023-06-23T19:01:04.372075+0000","last_became_peered":"2023-06-23T19:01:04.372075+0000","last_unstale":"2023-06-23T19:01:08.872832+0000","last_undegraded":"2023-06-23T19:01:08.872832+0000","last_fullsized":"2023-06-23T19:01:08.872832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476748,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":716841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":126543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.165}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0939999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9770000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":327680,"data_stored":129741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":929792,"data_stored":720269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.992}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7849999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T19:01:36.210 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T19:01:36.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.431+0000 7f8c95fff700 1 Processor -- start 2023-06-23T19:01:36.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.432+0000 7f8c95fff700 1 -- start start 2023-06-23T19:01:36.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c95fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c9015c3e0 0x7f8c900d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c95fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900d2040 0x7f8c900cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c95fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c900d0870 con 0x7f8c900cf4e0 2023-06-23T19:01:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c95fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c900cd150 con 0x7f8c9015c3e0 2023-06-23T19:01:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c95fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900cfec0 con 0x7f8c900d2040 2023-06-23T19:01:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c87fff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f8c900cf4e0 0x7f8c9015fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42166/0 (socket says 172.21.15.136:42166) 2023-06-23T19:01:36.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c87fff700 1 -- 172.21.15.136:0/3214315488 learned_addr learned my addr 172.21.15.136:0/3214315488 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:36.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c8f7fe700 1 --2- 172.21.15.136:0/3214315488 >> v2:172.21.15.178:3300/0 conn(0x7f8c9015c3e0 0x7f8c900d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c8ffff700 1 --2- 172.21.15.136:0/3214315488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900d2040 0x7f8c900cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.433+0000 7f8c8effd700 1 -- 172.21.15.136:0/3214315488 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806575528 0 0) 0x7f8c900d0870 con 0x7f8c900cf4e0 2023-06-23T19:01:36.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8effd700 1 -- 172.21.15.136:0/3214315488 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c7c0035b0 con 0x7f8c900cf4e0 2023-06-23T19:01:36.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8f7fe700 1 -- 172.21.15.136:0/3214315488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900d2040 msgr2=0x7f8c900cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:36.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8f7fe700 1 --2- 172.21.15.136:0/3214315488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900d2040 0x7f8c900cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8f7fe700 1 -- 172.21.15.136:0/3214315488 >> v1:172.21.15.136:6789/0 conn(0x7f8c900cf4e0 legacy=0x7f8c9015fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8f7fe700 1 -- 172.21.15.136:0/3214315488 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c900cd920 con 0x7f8c9015c3e0 2023-06-23T19:01:36.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8ffff700 1 --2- 172.21.15.136:0/3214315488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900d2040 0x7f8c900cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:36.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8f7fe700 1 --2- 172.21.15.136:0/3214315488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c9015c3e0 0x7f8c900d3310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009840 tx=0x7f8c80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cc4299f9201fbf2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:36.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8effd700 1 -- 172.21.15.136:0/3214315488 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80011830 con 0x7f8c9015c3e0 2023-06-23T19:01:36.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8effd700 1 -- 172.21.15.136:0/3214315488 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c80011990 con 0x7f8c9015c3e0 2023-06-23T19:01:36.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.434+0000 7f8c8effd700 1 -- 172.21.15.136:0/3214315488 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80011d20 con 0x7f8c9015c3e0 2023-06-23T19:01:36.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.435+0000 7f8c95fff700 1 -- 172.21.15.136:0/3214315488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c9015c3e0 msgr2=0x7f8c900d3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.435+0000 7f8c95fff700 1 --2- 172.21.15.136:0/3214315488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c9015c3e0 0x7f8c900d3310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009840 tx=0x7f8c80009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:36.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.435+0000 7f8c95fff700 1 -- 172.21.15.136:0/3214315488 shutdown_connections 2023-06-23T19:01:36.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.435+0000 7f8c95fff700 1 --2- 172.21.15.136:0/3214315488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c9015c3e0 0x7f8c900d3310 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.435+0000 7f8c95fff700 1 --2- 172.21.15.136:0/3214315488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900d2040 0x7f8c900cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.435+0000 7f8c95fff700 1 -- 172.21.15.136:0/3214315488 >> 172.21.15.136:0/3214315488 conn(0x7f8c9006b340 msgr2=0x7f8c9006b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:36.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.435+0000 7f8c95fff700 1 -- 172.21.15.136:0/3214315488 shutdown_connections 2023-06-23T19:01:36.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.435+0000 7f8c95fff700 1 -- 172.21.15.136:0/3214315488 wait complete. 2023-06-23T19:01:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.437+0000 7f8c95fff700 1 Processor -- start 2023-06-23T19:01:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.437+0000 7f8c95fff700 1 -- start start 2023-06-23T19:01:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c95fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900cf4e0 0x7f8c9014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c95fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c900d2040 0x7f8c901f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c95fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015c3e0 0x7f8c900cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c95fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900c6630 con 0x7f8c9015c3e0 2023-06-23T19:01:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c95fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9014d4f0 con 0x7f8c900d2040 2023-06-23T19:01:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c95fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900c7170 con 0x7f8c900cf4e0 2023-06-23T19:01:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c8ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015c3e0 0x7f8c900cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c8ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015c3e0 0x7f8c900cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46422/0 (socket says 172.21.15.136:46422) 2023-06-23T19:01:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c8ffff700 1 -- 172.21.15.136:0/686554219 learned_addr learned my addr 172.21.15.136:0/686554219 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c8f7fe700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900cf4e0 0x7f8c9014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.438+0000 7f8c87fff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c900d2040 0x7f8c901f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c8ffff700 1 -- 172.21.15.136:0/686554219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900cf4e0 msgr2=0x7f8c9014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c8ffff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900cf4e0 0x7f8c9014cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c8ffff700 1 -- 172.21.15.136:0/686554219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c900d2040 msgr2=0x7f8c901f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c8ffff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c900d2040 0x7f8c901f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c8ffff700 1 -- 172.21.15.136:0/686554219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c88009a70 con 0x7f8c9015c3e0 2023-06-23T19:01:36.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c8ffff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015c3e0 0x7f8c900cb550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800efc0 tx=0x7f8c8800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:36.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c8cff9700 1 -- 172.21.15.136:0/686554219 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800cae0 con 0x7f8c9015c3e0 2023-06-23T19:01:36.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c8cff9700 1 -- 172.21.15.136:0/686554219 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8800f040 con 0x7f8c9015c3e0 2023-06-23T19:01:36.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c8cff9700 1 -- 172.21.15.136:0/686554219 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800ce80 con 0x7f8c9015c3e0 2023-06-23T19:01:36.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c800094a0 con 0x7f8c9015c3e0 2023-06-23T19:01:36.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.439+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c901f3590 con 0x7f8c9015c3e0 2023-06-23T19:01:36.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.440+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c90073910 con 0x7f8c9015c3e0 2023-06-23T19:01:36.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.441+0000 7f8c8cff9700 1 -- 172.21.15.136:0/686554219 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c88014480 con 0x7f8c9015c3e0 2023-06-23T19:01:36.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.442+0000 7f8c8cff9700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8c7006ace0 0x7f8c7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.442+0000 7f8c8cff9700 1 -- 172.21.15.136:0/686554219 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c88089e60 con 0x7f8c9015c3e0 2023-06-23T19:01:36.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.442+0000 7f8c8f7fe700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8c7006ace0 0x7f8c7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.443+0000 7f8c8f7fe700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8c7006ace0 0x7f8c7006d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c80000c00 tx=0x7f8c80008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:36.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.447+0000 7f8c8cff9700 1 -- 172.21.15.136:0/686554219 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c88054c20 con 0x7f8c9015c3e0 2023-06-23T19:01:36.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.638+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 --> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c900cd640 con 0x7f8c7006ace0 2023-06-23T19:01:36.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.648+0000 7f8c8cff9700 1 -- 172.21.15.136:0/686554219 <== mgr.4105 v2:172.21.15.136:6832/2653877961 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367286 (secure 0 0 0) 0x7f8c80011b00 con 0x7f8c7006ace0 2023-06-23T19:01:36.656 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:36.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8c7006ace0 msgr2=0x7f8c7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8c7006ace0 0x7f8c7006d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c80000c00 tx=0x7f8c80008030 comp rx=0 tx=0).stop 2023-06-23T19:01:36.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015c3e0 msgr2=0x7f8c900cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015c3e0 0x7f8c900cb550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800efc0 tx=0x7f8c8800c3a0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 shutdown_connections 2023-06-23T19:01:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8c7006ace0 0x7f8c7006d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015c3e0 0x7f8c900cb550 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900cf4e0 0x7f8c9014cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 --2- 172.21.15.136:0/686554219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c900d2040 0x7f8c901f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 >> 172.21.15.136:0/686554219 conn(0x7f8c9006b340 msgr2=0x7f8c900b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 shutdown_connections 2023-06-23T19:01:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.653+0000 7f8c95fff700 1 -- 172.21.15.136:0/686554219 wait complete. 2023-06-23T19:01:36.660 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2023-06-23T19:01:36.675 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2023-06-23T19:01:34.940221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219240,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755480,"statfs":{"total":773094113280,"available":772869611520,"internally_reserved":0,"allocated":3710976,"data_stored":2197048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005059"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870887+0000","last_change":"2023-06-23T19:01:04.378688+0000","last_active":"2023-06-23T19:01:08.870887+0000","last_peered":"2023-06-23T19:01:08.870887+0000","last_clean":"2023-06-23T19:01:08.870887+0000","last_became_active":"2023-06-23T19:01:04.378277+0000","last_became_peered":"2023-06-23T19:01:04.378277+0000","last_unstale":"2023-06-23T19:01:08.870887+0000","last_undegraded":"2023-06-23T19:01:08.870887+0000","last_fullsized":"2023-06-23T19:01:08.870887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:32:11.850600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282720+0000","last_change":"2023-06-23T19:01:04.385368+0000","last_active":"2023-06-23T19:01:09.282720+0000","last_peered":"2023-06-23T19:01:09.282720+0000","last_clean":"2023-06-23T19:01:09.282720+0000","last_became_active":"2023-06-23T19:01:04.385091+0000","last_became_peered":"2023-06-23T19:01:04.385091+0000","last_unstale":"2023-06-23T19:01:09.282720+0000","last_undegraded":"2023-06-23T19:01:09.282720+0000","last_fullsized":"2023-06-23T19:01:09.282720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:02.533488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282796+0000","last_change":"2023-06-23T19:01:04.382104+0000","last_active":"2023-06-23T19:01:09.282796+0000","last_peered":"2023-06-23T19:01:09.282796+0000","last_clean":"2023-06-23T19:01:09.282796+0000","last_became_active":"2023-06-23T19:01:04.381827+0000","last_became_peered":"2023-06-23T19:01:04.381827+0000","last_unstale":"2023-06-23T19:01:09.282796+0000","last_undegraded":"2023-06-23T19:01:09.282796+0000","last_fullsized":"2023-06-23T19:01:09.282796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:28:01.174081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156752+0000","last_change":"2023-06-23T19:01:04.376037+0000","last_active":"2023-06-23T19:01:09.156752+0000","last_peered":"2023-06-23T19:01:09.156752+0000","last_clean":"2023-06-23T19:01:09.156752+0000","last_became_active":"2023-06-23T19:01:04.375479+0000","last_became_peered":"2023-06-23T19:01:04.375479+0000","last_unstale":"2023-06-23T19:01:09.156752+0000","last_undegraded":"2023-06-23T19:01:09.156752+0000","last_fullsized":"2023-06-23T19:01:09.156752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:42:12.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873331+0000","last_change":"2023-06-23T19:01:04.383574+0000","last_active":"2023-06-23T19:01:08.873331+0000","last_peered":"2023-06-23T19:01:08.873331+0000","last_clean":"2023-06-23T19:01:08.873331+0000","last_became_active":"2023-06-23T19:01:04.383178+0000","last_became_peered":"2023-06-23T19:01:04.383178+0000","last_unstale":"2023-06-23T19:01:08.873331+0000","last_undegraded":"2023-06-23T19:01:08.873331+0000","last_fullsized":"2023-06-23T19:01:08.873331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:08.703615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282561+0000","last_change":"2023-06-23T19:01:04.378592+0000","last_active":"2023-06-23T19:01:09.282561+0000","last_peered":"2023-06-23T19:01:09.282561+0000","last_clean":"2023-06-23T19:01:09.282561+0000","last_became_active":"2023-06-23T19:01:04.378270+0000","last_became_peered":"2023-06-23T19:01:04.378270+0000","last_unstale":"2023-06-23T19:01:09.282561+0000","last_undegraded":"2023-06-23T19:01:09.282561+0000","last_fullsized":"2023-06-23T19:01:09.282561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:03:42.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281650+0000","last_change":"2023-06-23T19:01:04.388383+0000","last_active":"2023-06-23T19:01:09.281650+0000","last_peered":"2023-06-23T19:01:09.281650+0000","last_clean":"2023-06-23T19:01:09.281650+0000","last_became_active":"2023-06-23T19:01:04.388104+0000","last_became_peered":"2023-06-23T19:01:04.388104+0000","last_unstale":"2023-06-23T19:01:09.281650+0000","last_undegraded":"2023-06-23T19:01:09.281650+0000","last_fullsized":"2023-06-23T19:01:09.281650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:59.746450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281560+0000","last_change":"2023-06-23T19:01:04.383152+0000","last_active":"2023-06-23T19:01:09.281560+0000","last_peered":"2023-06-23T19:01:09.281560+0000","last_clean":"2023-06-23T19:01:09.281560+0000","last_became_active":"2023-06-23T19:01:04.382712+0000","last_became_peered":"2023-06-23T19:01:04.382712+0000","last_unstale":"2023-06-23T19:01:09.281560+0000","last_undegraded":"2023-06-23T19:01:09.281560+0000","last_fullsized":"2023-06-23T19:01:09.281560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873324+0000","last_change":"2023-06-23T19:01:04.382700+0000","last_active":"2023-06-23T19:01:08.873324+0000","last_peered":"2023-06-23T19:01:08.873324+0000","last_clean":"2023-06-23T19:01:08.873324+0000","last_became_active":"2023-06-23T19:01:04.382201+0000","last_became_peered":"2023-06-23T19:01:04.382201+0000","last_unstale":"2023-06-23T19:01:08.873324+0000","last_undegraded":"2023-06-23T19:01:08.873324+0000","last_fullsized":"2023-06-23T19:01:08.873324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283207+0000","last_change":"2023-06-23T19:01:04.376595+0000","last_active":"2023-06-23T19:01:09.283207+0000","last_peered":"2023-06-23T19:01:09.283207+0000","last_clean":"2023-06-23T19:01:09.283207+0000","last_became_active":"2023-06-23T19:01:04.376392+0000","last_became_peered":"2023-06-23T19:01:04.376392+0000","last_unstale":"2023-06-23T19:01:09.283207+0000","last_undegraded":"2023-06-23T19:01:09.283207+0000","last_fullsized":"2023-06-23T19:01:09.283207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:30:56.096215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282762+0000","last_change":"2023-06-23T19:01:04.388979+0000","last_active":"2023-06-23T19:01:09.282762+0000","last_peered":"2023-06-23T19:01:09.282762+0000","last_clean":"2023-06-23T19:01:09.282762+0000","last_became_active":"2023-06-23T19:01:04.388676+0000","last_became_peered":"2023-06-23T19:01:04.388676+0000","last_unstale":"2023-06-23T19:01:09.282762+0000","last_undegraded":"2023-06-23T19:01:09.282762+0000","last_fullsized":"2023-06-23T19:01:09.282762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:29:33.177223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871107+0000","last_change":"2023-06-23T19:01:04.391858+0000","last_active":"2023-06-23T19:01:08.871107+0000","last_peered":"2023-06-23T19:01:08.871107+0000","last_clean":"2023-06-23T19:01:08.871107+0000","last_became_active":"2023-06-23T19:01:04.391669+0000","last_became_peered":"2023-06-23T19:01:04.391669+0000","last_unstale":"2023-06-23T19:01:08.871107+0000","last_undegraded":"2023-06-23T19:01:08.871107+0000","last_fullsized":"2023-06-23T19:01:08.871107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:03.089060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870980+0000","last_change":"2023-06-23T19:01:04.372094+0000","last_active":"2023-06-23T19:01:08.870980+0000","last_peered":"2023-06-23T19:01:08.870980+0000","last_clean":"2023-06-23T19:01:08.870980+0000","last_became_active":"2023-06-23T19:01:04.370416+0000","last_became_peered":"2023-06-23T19:01:04.370416+0000","last_unstale":"2023-06-23T19:01:08.870980+0000","last_undegraded":"2023-06-23T19:01:08.870980+0000","last_fullsized":"2023-06-23T19:01:08.870980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:50.510315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282222+0000","last_change":"2023-06-23T19:01:04.380048+0000","last_active":"2023-06-23T19:01:09.282222+0000","last_peered":"2023-06-23T19:01:09.282222+0000","last_clean":"2023-06-23T19:01:09.282222+0000","last_became_active":"2023-06-23T19:01:04.379845+0000","last_became_peered":"2023-06-23T19:01:04.379845+0000","last_unstale":"2023-06-23T19:01:09.282222+0000","last_undegraded":"2023-06-23T19:01:09.282222+0000","last_fullsized":"2023-06-23T19:01:09.282222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:34.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281323+0000","last_change":"2023-06-23T19:01:04.388881+0000","last_active":"2023-06-23T19:01:09.281323+0000","last_peered":"2023-06-23T19:01:09.281323+0000","last_clean":"2023-06-23T19:01:09.281323+0000","last_became_active":"2023-06-23T19:01:04.388417+0000","last_became_peered":"2023-06-23T19:01:04.388417+0000","last_unstale":"2023-06-23T19:01:09.281323+0000","last_undegraded":"2023-06-23T19:01:09.281323+0000","last_fullsized":"2023-06-23T19:01:09.281323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:22.486690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281157+0000","last_change":"2023-06-23T19:01:04.383317+0000","last_active":"2023-06-23T19:01:09.281157+0000","last_peered":"2023-06-23T19:01:09.281157+0000","last_clean":"2023-06-23T19:01:09.281157+0000","last_became_active":"2023-06-23T19:01:04.378678+0000","last_became_peered":"2023-06-23T19:01:04.378678+0000","last_unstale":"2023-06-23T19:01:09.281157+0000","last_undegraded":"2023-06-23T19:01:09.281157+0000","last_fullsized":"2023-06-23T19:01:09.281157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:01:47.617327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873389+0000","last_change":"2023-06-23T19:01:04.382482+0000","last_active":"2023-06-23T19:01:08.873389+0000","last_peered":"2023-06-23T19:01:08.873389+0000","last_clean":"2023-06-23T19:01:08.873389+0000","last_became_active":"2023-06-23T19:01:04.381876+0000","last_became_peered":"2023-06-23T19:01:04.381876+0000","last_unstale":"2023-06-23T19:01:08.873389+0000","last_undegraded":"2023-06-23T19:01:08.873389+0000","last_fullsized":"2023-06-23T19:01:08.873389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:34.423477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282971+0000","last_change":"2023-06-23T19:01:04.382129+0000","last_active":"2023-06-23T19:01:09.282971+0000","last_peered":"2023-06-23T19:01:09.282971+0000","last_clean":"2023-06-23T19:01:09.282971+0000","last_became_active":"2023-06-23T19:01:04.381462+0000","last_became_peered":"2023-06-23T19:01:04.381462+0000","last_unstale":"2023-06-23T19:01:09.282971+0000","last_undegraded":"2023-06-23T19:01:09.282971+0000","last_fullsized":"2023-06-23T19:01:09.282971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:51:17.974676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870818+0000","last_change":"2023-06-23T19:01:04.367952+0000","last_active":"2023-06-23T19:01:08.870818+0000","last_peered":"2023-06-23T19:01:08.870818+0000","last_clean":"2023-06-23T19:01:08.870818+0000","last_became_active":"2023-06-23T19:01:04.367677+0000","last_became_peered":"2023-06-23T19:01:04.367677+0000","last_unstale":"2023-06-23T19:01:08.870818+0000","last_undegraded":"2023-06-23T19:01:08.870818+0000","last_fullsized":"2023-06-23T19:01:08.870818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:28:28.127638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281961+0000","last_change":"2023-06-23T19:01:04.374187+0000","last_active":"2023-06-23T19:01:09.281961+0000","last_peered":"2023-06-23T19:01:09.281961+0000","last_clean":"2023-06-23T19:01:09.281961+0000","last_became_active":"2023-06-23T19:01:04.373921+0000","last_became_peered":"2023-06-23T19:01:04.373921+0000","last_unstale":"2023-06-23T19:01:09.281961+0000","last_undegraded":"2023-06-23T19:01:09.281961+0000","last_fullsized":"2023-06-23T19:01:09.281961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:14:17.383712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282957+0000","last_change":"2023-06-23T19:01:04.386537+0000","last_active":"2023-06-23T19:01:09.282957+0000","last_peered":"2023-06-23T19:01:09.282957+0000","last_clean":"2023-06-23T19:01:09.282957+0000","last_became_active":"2023-06-23T19:01:04.386192+0000","last_became_peered":"2023-06-23T19:01:04.386192+0000","last_unstale":"2023-06-23T19:01:09.282957+0000","last_undegraded":"2023-06-23T19:01:09.282957+0000","last_fullsized":"2023-06-23T19:01:09.282957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:02.220770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872398+0000","last_change":"2023-06-23T19:01:04.388749+0000","last_active":"2023-06-23T19:01:08.872398+0000","last_peered":"2023-06-23T19:01:08.872398+0000","last_clean":"2023-06-23T19:01:08.872398+0000","last_became_active":"2023-06-23T19:01:04.388450+0000","last_became_peered":"2023-06-23T19:01:04.388450+0000","last_unstale":"2023-06-23T19:01:08.872398+0000","last_undegraded":"2023-06-23T19:01:08.872398+0000","last_fullsized":"2023-06-23T19:01:08.872398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:59.683785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280402+0000","last_change":"2023-06-23T19:01:04.374228+0000","last_active":"2023-06-23T19:01:09.280402+0000","last_peered":"2023-06-23T19:01:09.280402+0000","last_clean":"2023-06-23T19:01:09.280402+0000","last_became_active":"2023-06-23T19:01:04.373934+0000","last_became_peered":"2023-06-23T19:01:04.373934+0000","last_unstale":"2023-06-23T19:01:09.280402+0000","last_undegraded":"2023-06-23T19:01:09.280402+0000","last_fullsized":"2023-06-23T19:01:09.280402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:09.120268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283074+0000","last_change":"2023-06-23T19:01:04.384671+0000","last_active":"2023-06-23T19:01:09.283074+0000","last_peered":"2023-06-23T19:01:09.283074+0000","last_clean":"2023-06-23T19:01:09.283074+0000","last_became_active":"2023-06-23T19:01:04.384373+0000","last_became_peered":"2023-06-23T19:01:04.384373+0000","last_unstale":"2023-06-23T19:01:09.283074+0000","last_undegraded":"2023-06-23T19:01:09.283074+0000","last_fullsized":"2023-06-23T19:01:09.283074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:13.294523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872724+0000","last_change":"2023-06-23T19:01:04.374136+0000","last_active":"2023-06-23T19:01:08.872724+0000","last_peered":"2023-06-23T19:01:08.872724+0000","last_clean":"2023-06-23T19:01:08.872724+0000","last_became_active":"2023-06-23T19:01:04.373867+0000","last_became_peered":"2023-06-23T19:01:04.373867+0000","last_unstale":"2023-06-23T19:01:08.872724+0000","last_undegraded":"2023-06-23T19:01:08.872724+0000","last_fullsized":"2023-06-23T19:01:08.872724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.507284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873820+0000","last_change":"2023-06-23T19:01:04.384724+0000","last_active":"2023-06-23T19:01:08.873820+0000","last_peered":"2023-06-23T19:01:08.873820+0000","last_clean":"2023-06-23T19:01:08.873820+0000","last_became_active":"2023-06-23T19:01:04.384514+0000","last_became_peered":"2023-06-23T19:01:04.384514+0000","last_unstale":"2023-06-23T19:01:08.873820+0000","last_undegraded":"2023-06-23T19:01:08.873820+0000","last_fullsized":"2023-06-23T19:01:08.873820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:59.746450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283574+0000","last_change":"2023-06-23T19:01:04.380891+0000","last_active":"2023-06-23T19:01:09.283574+0000","last_peered":"2023-06-23T19:01:09.283574+0000","last_clean":"2023-06-23T19:01:09.283574+0000","last_became_active":"2023-06-23T19:01:04.380336+0000","last_became_peered":"2023-06-23T19:01:04.380336+0000","last_unstale":"2023-06-23T19:01:09.283574+0000","last_undegraded":"2023-06-23T19:01:09.283574+0000","last_fullsized":"2023-06-23T19:01:09.283574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:00.026037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282369+0000","last_change":"2023-06-23T19:01:08.395986+0000","last_active":"2023-06-23T19:01:09.282369+0000","last_peered":"2023-06-23T19:01:09.282369+0000","last_clean":"2023-06-23T19:01:09.282369+0000","last_became_active":"2023-06-23T19:01:08.395550+0000","last_became_peered":"2023-06-23T19:01:08.395550+0000","last_unstale":"2023-06-23T19:01:09.282369+0000","last_undegraded":"2023-06-23T19:01:09.282369+0000","last_fullsized":"2023-06-23T19:01:09.282369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:55:35.582136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282386+0000","last_change":"2023-06-23T19:01:03.877831+0000","last_active":"2023-06-23T19:01:09.282386+0000","last_peered":"2023-06-23T19:01:09.282386+0000","last_clean":"2023-06-23T19:01:09.282386+0000","last_became_active":"2023-06-23T19:01:03.877541+0000","last_became_peered":"2023-06-23T19:01:03.877541+0000","last_unstale":"2023-06-23T19:01:09.282386+0000","last_undegraded":"2023-06-23T19:01:09.282386+0000","last_fullsized":"2023-06-23T19:01:09.282386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:02:36.669063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280914+0000","last_change":"2023-06-23T19:01:04.386920+0000","last_active":"2023-06-23T19:01:09.280914+0000","last_peered":"2023-06-23T19:01:09.280914+0000","last_clean":"2023-06-23T19:01:09.280914+0000","last_became_active":"2023-06-23T19:01:04.386357+0000","last_became_peered":"2023-06-23T19:01:04.386357+0000","last_unstale":"2023-06-23T19:01:09.280914+0000","last_undegraded":"2023-06-23T19:01:09.280914+0000","last_fullsized":"2023-06-23T19:01:09.280914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:47:30.538293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157090+0000","last_change":"2023-06-23T19:01:08.399323+0000","last_active":"2023-06-23T19:01:09.157090+0000","last_peered":"2023-06-23T19:01:09.157090+0000","last_clean":"2023-06-23T19:01:09.157090+0000","last_became_active":"2023-06-23T19:01:08.398808+0000","last_became_peered":"2023-06-23T19:01:08.398808+0000","last_unstale":"2023-06-23T19:01:09.157090+0000","last_undegraded":"2023-06-23T19:01:09.157090+0000","last_fullsized":"2023-06-23T19:01:09.157090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:35.871412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871893+0000","last_change":"2023-06-23T19:01:03.885277+0000","last_active":"2023-06-23T19:01:08.871893+0000","last_peered":"2023-06-23T19:01:08.871893+0000","last_clean":"2023-06-23T19:01:08.871893+0000","last_became_active":"2023-06-23T19:01:03.885059+0000","last_became_peered":"2023-06-23T19:01:03.885059+0000","last_unstale":"2023-06-23T19:01:08.871893+0000","last_undegraded":"2023-06-23T19:01:08.871893+0000","last_fullsized":"2023-06-23T19:01:08.871893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:50.138012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872568+0000","last_change":"2023-06-23T19:01:04.381825+0000","last_active":"2023-06-23T19:01:08.872568+0000","last_peered":"2023-06-23T19:01:08.872568+0000","last_clean":"2023-06-23T19:01:08.872568+0000","last_became_active":"2023-06-23T19:01:04.381313+0000","last_became_peered":"2023-06-23T19:01:04.381313+0000","last_unstale":"2023-06-23T19:01:08.872568+0000","last_undegraded":"2023-06-23T19:01:08.872568+0000","last_fullsized":"2023-06-23T19:01:08.872568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:15.464343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872863+0000","last_change":"2023-06-23T19:01:08.393931+0000","last_active":"2023-06-23T19:01:08.872863+0000","last_peered":"2023-06-23T19:01:08.872863+0000","last_clean":"2023-06-23T19:01:08.872863+0000","last_became_active":"2023-06-23T19:01:08.393556+0000","last_became_peered":"2023-06-23T19:01:08.393556+0000","last_unstale":"2023-06-23T19:01:08.872863+0000","last_undegraded":"2023-06-23T19:01:08.872863+0000","last_fullsized":"2023-06-23T19:01:08.872863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:27.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280805+0000","last_change":"2023-06-23T19:01:03.873568+0000","last_active":"2023-06-23T19:01:09.280805+0000","last_peered":"2023-06-23T19:01:09.280805+0000","last_clean":"2023-06-23T19:01:09.280805+0000","last_became_active":"2023-06-23T19:01:03.873256+0000","last_became_peered":"2023-06-23T19:01:03.873256+0000","last_unstale":"2023-06-23T19:01:09.280805+0000","last_undegraded":"2023-06-23T19:01:09.280805+0000","last_fullsized":"2023-06-23T19:01:09.280805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:22:44.177756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157154+0000","last_change":"2023-06-23T19:01:04.370281+0000","last_active":"2023-06-23T19:01:09.157154+0000","last_peered":"2023-06-23T19:01:09.157154+0000","last_clean":"2023-06-23T19:01:09.157154+0000","last_became_active":"2023-06-23T19:01:04.369996+0000","last_became_peered":"2023-06-23T19:01:04.369996+0000","last_unstale":"2023-06-23T19:01:09.157154+0000","last_undegraded":"2023-06-23T19:01:09.157154+0000","last_fullsized":"2023-06-23T19:01:09.157154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:05:09.392936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156729+0000","last_change":"2023-06-23T19:01:08.397782+0000","last_active":"2023-06-23T19:01:09.156729+0000","last_peered":"2023-06-23T19:01:09.156729+0000","last_clean":"2023-06-23T19:01:09.156729+0000","last_became_active":"2023-06-23T19:01:08.397312+0000","last_became_peered":"2023-06-23T19:01:08.397312+0000","last_unstale":"2023-06-23T19:01:09.156729+0000","last_undegraded":"2023-06-23T19:01:09.156729+0000","last_fullsized":"2023-06-23T19:01:09.156729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:38:36.950113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873470+0000","last_change":"2023-06-23T19:01:03.875654+0000","last_active":"2023-06-23T19:01:08.873470+0000","last_peered":"2023-06-23T19:01:08.873470+0000","last_clean":"2023-06-23T19:01:08.873470+0000","last_became_active":"2023-06-23T19:01:03.875197+0000","last_became_peered":"2023-06-23T19:01:03.875197+0000","last_unstale":"2023-06-23T19:01:08.873470+0000","last_undegraded":"2023-06-23T19:01:08.873470+0000","last_fullsized":"2023-06-23T19:01:08.873470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:21.482936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280620+0000","last_change":"2023-06-23T19:01:04.385872+0000","last_active":"2023-06-23T19:01:09.280620+0000","last_peered":"2023-06-23T19:01:09.280620+0000","last_clean":"2023-06-23T19:01:09.280620+0000","last_became_active":"2023-06-23T19:01:04.385605+0000","last_became_peered":"2023-06-23T19:01:04.385605+0000","last_unstale":"2023-06-23T19:01:09.280620+0000","last_undegraded":"2023-06-23T19:01:09.280620+0000","last_fullsized":"2023-06-23T19:01:09.280620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:30:07.714637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281074+0000","last_change":"2023-06-23T19:01:08.392127+0000","last_active":"2023-06-23T19:01:09.281074+0000","last_peered":"2023-06-23T19:01:09.281074+0000","last_clean":"2023-06-23T19:01:09.281074+0000","last_became_active":"2023-06-23T19:01:08.391726+0000","last_became_peered":"2023-06-23T19:01:08.391726+0000","last_unstale":"2023-06-23T19:01:09.281074+0000","last_undegraded":"2023-06-23T19:01:09.281074+0000","last_fullsized":"2023-06-23T19:01:09.281074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:03.540201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282960+0000","last_change":"2023-06-23T19:01:03.872890+0000","last_active":"2023-06-23T19:01:09.282960+0000","last_peered":"2023-06-23T19:01:09.282960+0000","last_clean":"2023-06-23T19:01:09.282960+0000","last_became_active":"2023-06-23T19:01:03.872477+0000","last_became_peered":"2023-06-23T19:01:03.872477+0000","last_unstale":"2023-06-23T19:01:09.282960+0000","last_undegraded":"2023-06-23T19:01:09.282960+0000","last_fullsized":"2023-06-23T19:01:09.282960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:16:35.893488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280412+0000","last_change":"2023-06-23T19:01:04.372079+0000","last_active":"2023-06-23T19:01:09.280412+0000","last_peered":"2023-06-23T19:01:09.280412+0000","last_clean":"2023-06-23T19:01:09.280412+0000","last_became_active":"2023-06-23T19:01:04.371764+0000","last_became_peered":"2023-06-23T19:01:04.371764+0000","last_unstale":"2023-06-23T19:01:09.280412+0000","last_undegraded":"2023-06-23T19:01:09.280412+0000","last_fullsized":"2023-06-23T19:01:09.280412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:39.705880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280820+0000","last_change":"2023-06-23T19:01:08.408231+0000","last_active":"2023-06-23T19:01:09.280820+0000","last_peered":"2023-06-23T19:01:09.280820+0000","last_clean":"2023-06-23T19:01:09.280820+0000","last_became_active":"2023-06-23T19:01:08.407872+0000","last_became_peered":"2023-06-23T19:01:08.407872+0000","last_unstale":"2023-06-23T19:01:09.280820+0000","last_undegraded":"2023-06-23T19:01:09.280820+0000","last_fullsized":"2023-06-23T19:01:09.280820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:41:47.186941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281857+0000","last_change":"2023-06-23T19:01:03.884943+0000","last_active":"2023-06-23T19:01:09.281857+0000","last_peered":"2023-06-23T19:01:09.281857+0000","last_clean":"2023-06-23T19:01:09.281857+0000","last_became_active":"2023-06-23T19:01:03.884670+0000","last_became_peered":"2023-06-23T19:01:03.884670+0000","last_unstale":"2023-06-23T19:01:09.281857+0000","last_undegraded":"2023-06-23T19:01:09.281857+0000","last_fullsized":"2023-06-23T19:01:09.281857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:01.529734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872631+0000","last_change":"2023-06-23T19:01:04.378162+0000","last_active":"2023-06-23T19:01:08.872631+0000","last_peered":"2023-06-23T19:01:08.872631+0000","last_clean":"2023-06-23T19:01:08.872631+0000","last_became_active":"2023-06-23T19:01:04.377889+0000","last_became_peered":"2023-06-23T19:01:04.377889+0000","last_unstale":"2023-06-23T19:01:08.872631+0000","last_undegraded":"2023-06-23T19:01:08.872631+0000","last_fullsized":"2023-06-23T19:01:08.872631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:15.464343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872077+0000","last_change":"2023-06-23T19:01:08.407720+0000","last_active":"2023-06-23T19:01:08.872077+0000","last_peered":"2023-06-23T19:01:08.872077+0000","last_clean":"2023-06-23T19:01:08.872077+0000","last_became_active":"2023-06-23T19:01:08.407375+0000","last_became_peered":"2023-06-23T19:01:08.407375+0000","last_unstale":"2023-06-23T19:01:08.872077+0000","last_undegraded":"2023-06-23T19:01:08.872077+0000","last_fullsized":"2023-06-23T19:01:08.872077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:52:30.461408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:22.099711+0000","last_change":"2023-06-23T19:01:03.874324+0000","last_active":"2023-06-23T19:01:22.099711+0000","last_peered":"2023-06-23T19:01:22.099711+0000","last_clean":"2023-06-23T19:01:22.099711+0000","last_became_active":"2023-06-23T19:01:03.873875+0000","last_became_peered":"2023-06-23T19:01:03.873875+0000","last_unstale":"2023-06-23T19:01:22.099711+0000","last_undegraded":"2023-06-23T19:01:22.099711+0000","last_fullsized":"2023-06-23T19:01:22.099711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:08:09.258254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281733+0000","last_change":"2023-06-23T19:01:04.386473+0000","last_active":"2023-06-23T19:01:09.281733+0000","last_peered":"2023-06-23T19:01:09.281733+0000","last_clean":"2023-06-23T19:01:09.281733+0000","last_became_active":"2023-06-23T19:01:04.386168+0000","last_became_peered":"2023-06-23T19:01:04.386168+0000","last_unstale":"2023-06-23T19:01:09.281733+0000","last_undegraded":"2023-06-23T19:01:09.281733+0000","last_fullsized":"2023-06-23T19:01:09.281733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:21.315691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283666+0000","last_change":"2023-06-23T19:01:08.403704+0000","last_active":"2023-06-23T19:01:09.283666+0000","last_peered":"2023-06-23T19:01:09.283666+0000","last_clean":"2023-06-23T19:01:09.283666+0000","last_became_active":"2023-06-23T19:01:08.401409+0000","last_became_peered":"2023-06-23T19:01:08.401409+0000","last_unstale":"2023-06-23T19:01:09.283666+0000","last_undegraded":"2023-06-23T19:01:09.283666+0000","last_fullsized":"2023-06-23T19:01:09.283666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:12.955870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281472+0000","last_change":"2023-06-23T19:01:03.879123+0000","last_active":"2023-06-23T19:01:09.281472+0000","last_peered":"2023-06-23T19:01:09.281472+0000","last_clean":"2023-06-23T19:01:09.281472+0000","last_became_active":"2023-06-23T19:01:03.878849+0000","last_became_peered":"2023-06-23T19:01:03.878849+0000","last_unstale":"2023-06-23T19:01:09.281472+0000","last_undegraded":"2023-06-23T19:01:09.281472+0000","last_fullsized":"2023-06-23T19:01:09.281472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:08.437952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280990+0000","last_change":"2023-06-23T19:01:04.386760+0000","last_active":"2023-06-23T19:01:09.280990+0000","last_peered":"2023-06-23T19:01:09.280990+0000","last_clean":"2023-06-23T19:01:09.280990+0000","last_became_active":"2023-06-23T19:01:04.386378+0000","last_became_peered":"2023-06-23T19:01:04.386378+0000","last_unstale":"2023-06-23T19:01:09.280990+0000","last_undegraded":"2023-06-23T19:01:09.280990+0000","last_fullsized":"2023-06-23T19:01:09.280990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:04:32.211071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280924+0000","last_change":"2023-06-23T19:01:08.398632+0000","last_active":"2023-06-23T19:01:09.280924+0000","last_peered":"2023-06-23T19:01:09.280924+0000","last_clean":"2023-06-23T19:01:09.280924+0000","last_became_active":"2023-06-23T19:01:08.397912+0000","last_became_peered":"2023-06-23T19:01:08.397912+0000","last_unstale":"2023-06-23T19:01:09.280924+0000","last_undegraded":"2023-06-23T19:01:09.280924+0000","last_fullsized":"2023-06-23T19:01:09.280924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:53:09.486798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872187+0000","last_change":"2023-06-23T19:01:03.868975+0000","last_active":"2023-06-23T19:01:08.872187+0000","last_peered":"2023-06-23T19:01:08.872187+0000","last_clean":"2023-06-23T19:01:08.872187+0000","last_became_active":"2023-06-23T19:01:03.868673+0000","last_became_peered":"2023-06-23T19:01:03.868673+0000","last_unstale":"2023-06-23T19:01:08.872187+0000","last_undegraded":"2023-06-23T19:01:08.872187+0000","last_fullsized":"2023-06-23T19:01:08.872187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:45:30.544760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283480+0000","last_change":"2023-06-23T19:01:04.380621+0000","last_active":"2023-06-23T19:01:09.283480+0000","last_peered":"2023-06-23T19:01:09.283480+0000","last_clean":"2023-06-23T19:01:09.283480+0000","last_became_active":"2023-06-23T19:01:04.379977+0000","last_became_peered":"2023-06-23T19:01:04.379977+0000","last_unstale":"2023-06-23T19:01:09.283480+0000","last_undegraded":"2023-06-23T19:01:09.283480+0000","last_fullsized":"2023-06-23T19:01:09.283480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:13.294523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281097+0000","last_change":"2023-06-23T19:01:08.399057+0000","last_active":"2023-06-23T19:01:09.281097+0000","last_peered":"2023-06-23T19:01:09.281097+0000","last_clean":"2023-06-23T19:01:09.281097+0000","last_became_active":"2023-06-23T19:01:08.398665+0000","last_became_peered":"2023-06-23T19:01:08.398665+0000","last_unstale":"2023-06-23T19:01:09.281097+0000","last_undegraded":"2023-06-23T19:01:09.281097+0000","last_fullsized":"2023-06-23T19:01:09.281097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:54:48.546637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281472+0000","last_change":"2023-06-23T19:01:03.876992+0000","last_active":"2023-06-23T19:01:09.281472+0000","last_peered":"2023-06-23T19:01:09.281472+0000","last_clean":"2023-06-23T19:01:09.281472+0000","last_became_active":"2023-06-23T19:01:03.876802+0000","last_became_peered":"2023-06-23T19:01:03.876802+0000","last_unstale":"2023-06-23T19:01:09.281472+0000","last_undegraded":"2023-06-23T19:01:09.281472+0000","last_fullsized":"2023-06-23T19:01:09.281472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:10.929312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872681+0000","last_change":"2023-06-23T19:01:04.382339+0000","last_active":"2023-06-23T19:01:08.872681+0000","last_peered":"2023-06-23T19:01:08.872681+0000","last_clean":"2023-06-23T19:01:08.872681+0000","last_became_active":"2023-06-23T19:01:04.382080+0000","last_became_peered":"2023-06-23T19:01:04.382080+0000","last_unstale":"2023-06-23T19:01:08.872681+0000","last_undegraded":"2023-06-23T19:01:08.872681+0000","last_fullsized":"2023-06-23T19:01:08.872681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:37:39.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282568+0000","last_change":"2023-06-23T19:01:08.405608+0000","last_active":"2023-06-23T19:01:09.282568+0000","last_peered":"2023-06-23T19:01:09.282568+0000","last_clean":"2023-06-23T19:01:09.282568+0000","last_became_active":"2023-06-23T19:01:08.405237+0000","last_became_peered":"2023-06-23T19:01:08.405237+0000","last_unstale":"2023-06-23T19:01:09.282568+0000","last_undegraded":"2023-06-23T19:01:09.282568+0000","last_fullsized":"2023-06-23T19:01:09.282568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:03.260614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156916+0000","last_change":"2023-06-23T19:01:03.869001+0000","last_active":"2023-06-23T19:01:09.156916+0000","last_peered":"2023-06-23T19:01:09.156916+0000","last_clean":"2023-06-23T19:01:09.156916+0000","last_became_active":"2023-06-23T19:01:03.868685+0000","last_became_peered":"2023-06-23T19:01:03.868685+0000","last_unstale":"2023-06-23T19:01:09.156916+0000","last_undegraded":"2023-06-23T19:01:09.156916+0000","last_fullsized":"2023-06-23T19:01:09.156916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:23:13.817453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281267+0000","last_change":"2023-06-23T19:01:04.374785+0000","last_active":"2023-06-23T19:01:09.281267+0000","last_peered":"2023-06-23T19:01:09.281267+0000","last_clean":"2023-06-23T19:01:09.281267+0000","last_became_active":"2023-06-23T19:01:04.374406+0000","last_became_peered":"2023-06-23T19:01:04.374406+0000","last_unstale":"2023-06-23T19:01:09.281267+0000","last_undegraded":"2023-06-23T19:01:09.281267+0000","last_fullsized":"2023-06-23T19:01:09.281267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:09:07.414494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282780+0000","last_change":"2023-06-23T19:01:08.393879+0000","last_active":"2023-06-23T19:01:09.282780+0000","last_peered":"2023-06-23T19:01:09.282780+0000","last_clean":"2023-06-23T19:01:09.282780+0000","last_became_active":"2023-06-23T19:01:08.393451+0000","last_became_peered":"2023-06-23T19:01:08.393451+0000","last_unstale":"2023-06-23T19:01:09.282780+0000","last_undegraded":"2023-06-23T19:01:09.282780+0000","last_fullsized":"2023-06-23T19:01:09.282780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:30:59.610379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282080+0000","last_change":"2023-06-23T19:01:03.880187+0000","last_active":"2023-06-23T19:01:09.282080+0000","last_peered":"2023-06-23T19:01:09.282080+0000","last_clean":"2023-06-23T19:01:09.282080+0000","last_became_active":"2023-06-23T19:01:03.879883+0000","last_became_peered":"2023-06-23T19:01:03.879883+0000","last_unstale":"2023-06-23T19:01:09.282080+0000","last_undegraded":"2023-06-23T19:01:09.282080+0000","last_fullsized":"2023-06-23T19:01:09.282080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:36:36.334076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281403+0000","last_change":"2023-06-23T19:01:04.374578+0000","last_active":"2023-06-23T19:01:09.281403+0000","last_peered":"2023-06-23T19:01:09.281403+0000","last_clean":"2023-06-23T19:01:09.281403+0000","last_became_active":"2023-06-23T19:01:04.374334+0000","last_became_peered":"2023-06-23T19:01:04.374334+0000","last_unstale":"2023-06-23T19:01:09.281403+0000","last_undegraded":"2023-06-23T19:01:09.281403+0000","last_fullsized":"2023-06-23T19:01:09.281403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.507284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870687+0000","last_change":"2023-06-23T19:01:08.401653+0000","last_active":"2023-06-23T19:01:08.870687+0000","last_peered":"2023-06-23T19:01:08.870687+0000","last_clean":"2023-06-23T19:01:08.870687+0000","last_became_active":"2023-06-23T19:01:08.401248+0000","last_became_peered":"2023-06-23T19:01:08.401248+0000","last_unstale":"2023-06-23T19:01:08.870687+0000","last_undegraded":"2023-06-23T19:01:08.870687+0000","last_fullsized":"2023-06-23T19:01:08.870687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:26.097068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281971+0000","last_change":"2023-06-23T19:01:03.877753+0000","last_active":"2023-06-23T19:01:09.281971+0000","last_peered":"2023-06-23T19:01:09.281971+0000","last_clean":"2023-06-23T19:01:09.281971+0000","last_became_active":"2023-06-23T19:01:03.877504+0000","last_became_peered":"2023-06-23T19:01:03.877504+0000","last_unstale":"2023-06-23T19:01:09.281971+0000","last_undegraded":"2023-06-23T19:01:09.281971+0000","last_fullsized":"2023-06-23T19:01:09.281971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:29.477822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281456+0000","last_change":"2023-06-23T19:01:04.388674+0000","last_active":"2023-06-23T19:01:09.281456+0000","last_peered":"2023-06-23T19:01:09.281456+0000","last_clean":"2023-06-23T19:01:09.281456+0000","last_became_active":"2023-06-23T19:01:04.386268+0000","last_became_peered":"2023-06-23T19:01:04.386268+0000","last_unstale":"2023-06-23T19:01:09.281456+0000","last_undegraded":"2023-06-23T19:01:09.281456+0000","last_fullsized":"2023-06-23T19:01:09.281456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:50:00.709971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870883+0000","last_change":"2023-06-23T19:01:08.403947+0000","last_active":"2023-06-23T19:01:08.870883+0000","last_peered":"2023-06-23T19:01:08.870883+0000","last_clean":"2023-06-23T19:01:08.870883+0000","last_became_active":"2023-06-23T19:01:08.403536+0000","last_became_peered":"2023-06-23T19:01:08.403536+0000","last_unstale":"2023-06-23T19:01:08.870883+0000","last_undegraded":"2023-06-23T19:01:08.870883+0000","last_fullsized":"2023-06-23T19:01:08.870883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:53:39.593981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282198+0000","last_change":"2023-06-23T19:01:03.874658+0000","last_active":"2023-06-23T19:01:09.282198+0000","last_peered":"2023-06-23T19:01:09.282198+0000","last_clean":"2023-06-23T19:01:09.282198+0000","last_became_active":"2023-06-23T19:01:03.874261+0000","last_became_peered":"2023-06-23T19:01:03.874261+0000","last_unstale":"2023-06-23T19:01:09.282198+0000","last_undegraded":"2023-06-23T19:01:09.282198+0000","last_fullsized":"2023-06-23T19:01:09.282198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:15.133048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156399+0000","last_change":"2023-06-23T19:01:04.375757+0000","last_active":"2023-06-23T19:01:09.156399+0000","last_peered":"2023-06-23T19:01:09.156399+0000","last_clean":"2023-06-23T19:01:09.156399+0000","last_became_active":"2023-06-23T19:01:04.375467+0000","last_became_peered":"2023-06-23T19:01:04.375467+0000","last_unstale":"2023-06-23T19:01:09.156399+0000","last_undegraded":"2023-06-23T19:01:09.156399+0000","last_fullsized":"2023-06-23T19:01:09.156399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:53:12.454851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870906+0000","last_change":"2023-06-23T19:01:08.400551+0000","last_active":"2023-06-23T19:01:08.870906+0000","last_peered":"2023-06-23T19:01:08.870906+0000","last_clean":"2023-06-23T19:01:08.870906+0000","last_became_active":"2023-06-23T19:01:08.400104+0000","last_became_peered":"2023-06-23T19:01:08.400104+0000","last_unstale":"2023-06-23T19:01:08.870906+0000","last_undegraded":"2023-06-23T19:01:08.870906+0000","last_fullsized":"2023-06-23T19:01:08.870906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:30:02.757178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281582+0000","last_change":"2023-06-23T19:01:03.879522+0000","last_active":"2023-06-23T19:01:09.281582+0000","last_peered":"2023-06-23T19:01:09.281582+0000","last_clean":"2023-06-23T19:01:09.281582+0000","last_became_active":"2023-06-23T19:01:03.879221+0000","last_became_peered":"2023-06-23T19:01:03.879221+0000","last_unstale":"2023-06-23T19:01:09.281582+0000","last_undegraded":"2023-06-23T19:01:09.281582+0000","last_fullsized":"2023-06-23T19:01:09.281582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:07.699862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873612+0000","last_change":"2023-06-23T19:01:04.387840+0000","last_active":"2023-06-23T19:01:08.873612+0000","last_peered":"2023-06-23T19:01:08.873612+0000","last_clean":"2023-06-23T19:01:08.873612+0000","last_became_active":"2023-06-23T19:01:04.387567+0000","last_became_peered":"2023-06-23T19:01:04.387567+0000","last_unstale":"2023-06-23T19:01:08.873612+0000","last_undegraded":"2023-06-23T19:01:08.873612+0000","last_fullsized":"2023-06-23T19:01:08.873612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:13:02.533488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871125+0000","last_change":"2023-06-23T19:01:08.403923+0000","last_active":"2023-06-23T19:01:08.871125+0000","last_peered":"2023-06-23T19:01:08.871125+0000","last_clean":"2023-06-23T19:01:08.871125+0000","last_became_active":"2023-06-23T19:01:08.403522+0000","last_became_peered":"2023-06-23T19:01:08.403522+0000","last_unstale":"2023-06-23T19:01:08.871125+0000","last_undegraded":"2023-06-23T19:01:08.871125+0000","last_fullsized":"2023-06-23T19:01:08.871125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:53:15.969015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280578+0000","last_change":"2023-06-23T19:01:03.873462+0000","last_active":"2023-06-23T19:01:09.280578+0000","last_peered":"2023-06-23T19:01:09.280578+0000","last_clean":"2023-06-23T19:01:09.280578+0000","last_became_active":"2023-06-23T19:01:03.873149+0000","last_became_peered":"2023-06-23T19:01:03.873149+0000","last_unstale":"2023-06-23T19:01:09.280578+0000","last_undegraded":"2023-06-23T19:01:09.280578+0000","last_fullsized":"2023-06-23T19:01:09.280578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:49:07.995821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281801+0000","last_change":"2023-06-23T19:01:04.374748+0000","last_active":"2023-06-23T19:01:09.281801+0000","last_peered":"2023-06-23T19:01:09.281801+0000","last_clean":"2023-06-23T19:01:09.281801+0000","last_became_active":"2023-06-23T19:01:04.374472+0000","last_became_peered":"2023-06-23T19:01:04.374472+0000","last_unstale":"2023-06-23T19:01:09.281801+0000","last_undegraded":"2023-06-23T19:01:09.281801+0000","last_fullsized":"2023-06-23T19:01:09.281801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:18:56.549266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872716+0000","last_change":"2023-06-23T19:01:08.401582+0000","last_active":"2023-06-23T19:01:08.872716+0000","last_peered":"2023-06-23T19:01:08.872716+0000","last_clean":"2023-06-23T19:01:08.872716+0000","last_became_active":"2023-06-23T19:01:08.401005+0000","last_became_peered":"2023-06-23T19:01:08.401005+0000","last_unstale":"2023-06-23T19:01:08.872716+0000","last_undegraded":"2023-06-23T19:01:08.872716+0000","last_fullsized":"2023-06-23T19:01:08.872716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:27.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156410+0000","last_change":"2023-06-23T19:01:03.875624+0000","last_active":"2023-06-23T19:01:09.156410+0000","last_peered":"2023-06-23T19:01:09.156410+0000","last_clean":"2023-06-23T19:01:09.156410+0000","last_became_active":"2023-06-23T19:01:03.875128+0000","last_became_peered":"2023-06-23T19:01:03.875128+0000","last_unstale":"2023-06-23T19:01:09.156410+0000","last_undegraded":"2023-06-23T19:01:09.156410+0000","last_fullsized":"2023-06-23T19:01:09.156410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:49.506561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282467+0000","last_change":"2023-06-23T19:01:04.378623+0000","last_active":"2023-06-23T19:01:09.282467+0000","last_peered":"2023-06-23T19:01:09.282467+0000","last_clean":"2023-06-23T19:01:09.282467+0000","last_became_active":"2023-06-23T19:01:04.378293+0000","last_became_peered":"2023-06-23T19:01:04.378293+0000","last_unstale":"2023-06-23T19:01:09.282467+0000","last_undegraded":"2023-06-23T19:01:09.282467+0000","last_fullsized":"2023-06-23T19:01:09.282467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:56:02.598277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282984+0000","last_change":"2023-06-23T19:01:08.401075+0000","last_active":"2023-06-23T19:01:09.282984+0000","last_peered":"2023-06-23T19:01:09.282984+0000","last_clean":"2023-06-23T19:01:09.282984+0000","last_became_active":"2023-06-23T19:01:08.400426+0000","last_became_peered":"2023-06-23T19:01:08.400426+0000","last_unstale":"2023-06-23T19:01:09.282984+0000","last_undegraded":"2023-06-23T19:01:09.282984+0000","last_fullsized":"2023-06-23T19:01:09.282984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:36:40.851994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281070+0000","last_change":"2023-06-23T19:01:03.874770+0000","last_active":"2023-06-23T19:01:09.281070+0000","last_peered":"2023-06-23T19:01:09.281070+0000","last_clean":"2023-06-23T19:01:09.281070+0000","last_became_active":"2023-06-23T19:01:03.874431+0000","last_became_peered":"2023-06-23T19:01:03.874431+0000","last_unstale":"2023-06-23T19:01:09.281070+0000","last_undegraded":"2023-06-23T19:01:09.281070+0000","last_fullsized":"2023-06-23T19:01:09.281070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:53:08.437952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283093+0000","last_change":"2023-06-23T19:01:04.386778+0000","last_active":"2023-06-23T19:01:09.283093+0000","last_peered":"2023-06-23T19:01:09.283093+0000","last_clean":"2023-06-23T19:01:09.283093+0000","last_became_active":"2023-06-23T19:01:04.386495+0000","last_became_peered":"2023-06-23T19:01:04.386495+0000","last_unstale":"2023-06-23T19:01:09.283093+0000","last_undegraded":"2023-06-23T19:01:09.283093+0000","last_fullsized":"2023-06-23T19:01:09.283093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:27:49.477353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282367+0000","last_change":"2023-06-23T19:01:08.404383+0000","last_active":"2023-06-23T19:01:09.282367+0000","last_peered":"2023-06-23T19:01:09.282367+0000","last_clean":"2023-06-23T19:01:09.282367+0000","last_became_active":"2023-06-23T19:01:08.404012+0000","last_became_peered":"2023-06-23T19:01:08.404012+0000","last_unstale":"2023-06-23T19:01:09.282367+0000","last_undegraded":"2023-06-23T19:01:09.282367+0000","last_fullsized":"2023-06-23T19:01:09.282367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:03:20.177798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280656+0000","last_change":"2023-06-23T19:01:03.878586+0000","last_active":"2023-06-23T19:01:09.280656+0000","last_peered":"2023-06-23T19:01:09.280656+0000","last_clean":"2023-06-23T19:01:09.280656+0000","last_became_active":"2023-06-23T19:01:03.878175+0000","last_became_peered":"2023-06-23T19:01:03.878175+0000","last_unstale":"2023-06-23T19:01:09.280656+0000","last_undegraded":"2023-06-23T19:01:09.280656+0000","last_fullsized":"2023-06-23T19:01:09.280656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:57:18.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873170+0000","last_change":"2023-06-23T19:01:04.379321+0000","last_active":"2023-06-23T19:01:08.873170+0000","last_peered":"2023-06-23T19:01:08.873170+0000","last_clean":"2023-06-23T19:01:08.873170+0000","last_became_active":"2023-06-23T19:01:04.379070+0000","last_became_peered":"2023-06-23T19:01:04.379070+0000","last_unstale":"2023-06-23T19:01:08.873170+0000","last_undegraded":"2023-06-23T19:01:08.873170+0000","last_fullsized":"2023-06-23T19:01:08.873170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:11.933066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873029+0000","last_change":"2023-06-23T19:01:08.408901+0000","last_active":"2023-06-23T19:01:08.873029+0000","last_peered":"2023-06-23T19:01:08.873029+0000","last_clean":"2023-06-23T19:01:08.873029+0000","last_became_active":"2023-06-23T19:01:08.407480+0000","last_became_peered":"2023-06-23T19:01:08.407480+0000","last_unstale":"2023-06-23T19:01:08.873029+0000","last_undegraded":"2023-06-23T19:01:08.873029+0000","last_fullsized":"2023-06-23T19:01:08.873029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:37.021448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872745+0000","last_change":"2023-06-23T19:00:58.992193+0000","last_active":"2023-06-23T19:01:08.872745+0000","last_peered":"2023-06-23T19:01:08.872745+0000","last_clean":"2023-06-23T19:01:08.872745+0000","last_became_active":"2023-06-23T19:00:58.991974+0000","last_became_peered":"2023-06-23T19:00:58.991974+0000","last_unstale":"2023-06-23T19:01:08.872745+0000","last_undegraded":"2023-06-23T19:01:08.872745+0000","last_fullsized":"2023-06-23T19:01:08.872745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:28.142431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283350+0000","last_change":"2023-06-23T19:01:03.879405+0000","last_active":"2023-06-23T19:01:09.283350+0000","last_peered":"2023-06-23T19:01:09.283350+0000","last_clean":"2023-06-23T19:01:09.283350+0000","last_became_active":"2023-06-23T19:01:03.879131+0000","last_became_peered":"2023-06-23T19:01:03.879131+0000","last_unstale":"2023-06-23T19:01:09.283350+0000","last_undegraded":"2023-06-23T19:01:09.283350+0000","last_fullsized":"2023-06-23T19:01:09.283350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:01.217016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872450+0000","last_change":"2023-06-23T19:01:04.371729+0000","last_active":"2023-06-23T19:01:08.872450+0000","last_peered":"2023-06-23T19:01:08.872450+0000","last_clean":"2023-06-23T19:01:08.872450+0000","last_became_active":"2023-06-23T19:01:04.371442+0000","last_became_peered":"2023-06-23T19:01:04.371442+0000","last_unstale":"2023-06-23T19:01:08.872450+0000","last_undegraded":"2023-06-23T19:01:08.872450+0000","last_fullsized":"2023-06-23T19:01:08.872450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:59.683785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873522+0000","last_change":"2023-06-23T19:01:08.403859+0000","last_active":"2023-06-23T19:01:08.873522+0000","last_peered":"2023-06-23T19:01:08.873522+0000","last_clean":"2023-06-23T19:01:08.873522+0000","last_became_active":"2023-06-23T19:01:08.402403+0000","last_became_peered":"2023-06-23T19:01:08.402403+0000","last_unstale":"2023-06-23T19:01:08.873522+0000","last_undegraded":"2023-06-23T19:01:08.873522+0000","last_fullsized":"2023-06-23T19:01:08.873522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:15.447230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282362+0000","last_change":"2023-06-23T19:00:58.032255+0000","last_active":"2023-06-23T19:01:09.282362+0000","last_peered":"2023-06-23T19:01:09.282362+0000","last_clean":"2023-06-23T19:01:09.282362+0000","last_became_active":"2023-06-23T19:00:58.031815+0000","last_became_peered":"2023-06-23T19:00:58.031815+0000","last_unstale":"2023-06-23T19:01:09.282362+0000","last_undegraded":"2023-06-23T19:01:09.282362+0000","last_fullsized":"2023-06-23T19:01:09.282362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:15.657801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281431+0000","last_change":"2023-06-23T19:01:03.878338+0000","last_active":"2023-06-23T19:01:09.281431+0000","last_peered":"2023-06-23T19:01:09.281431+0000","last_clean":"2023-06-23T19:01:09.281431+0000","last_became_active":"2023-06-23T19:01:03.873345+0000","last_became_peered":"2023-06-23T19:01:03.873345+0000","last_unstale":"2023-06-23T19:01:09.281431+0000","last_undegraded":"2023-06-23T19:01:09.281431+0000","last_fullsized":"2023-06-23T19:01:09.281431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:44:57.209204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872632+0000","last_change":"2023-06-23T19:01:04.385034+0000","last_active":"2023-06-23T19:01:08.872632+0000","last_peered":"2023-06-23T19:01:08.872632+0000","last_clean":"2023-06-23T19:01:08.872632+0000","last_became_active":"2023-06-23T19:01:04.384747+0000","last_became_peered":"2023-06-23T19:01:04.384747+0000","last_unstale":"2023-06-23T19:01:08.872632+0000","last_undegraded":"2023-06-23T19:01:08.872632+0000","last_fullsized":"2023-06-23T19:01:08.872632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:37:39.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871252+0000","last_change":"2023-06-23T19:01:08.404982+0000","last_active":"2023-06-23T19:01:08.871252+0000","last_peered":"2023-06-23T19:01:08.871252+0000","last_clean":"2023-06-23T19:01:08.871252+0000","last_became_active":"2023-06-23T19:01:08.404577+0000","last_became_peered":"2023-06-23T19:01:08.404577+0000","last_unstale":"2023-06-23T19:01:08.871252+0000","last_undegraded":"2023-06-23T19:01:08.871252+0000","last_fullsized":"2023-06-23T19:01:08.871252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:38:36.950113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.870787+0000","last_change":"2023-06-23T19:00:58.810848+0000","last_active":"2023-06-23T19:01:08.870787+0000","last_peered":"2023-06-23T19:01:08.870787+0000","last_clean":"2023-06-23T19:01:08.870787+0000","last_became_active":"2023-06-23T19:00:58.810530+0000","last_became_peered":"2023-06-23T19:00:58.810530+0000","last_unstale":"2023-06-23T19:01:08.870787+0000","last_undegraded":"2023-06-23T19:01:08.870787+0000","last_fullsized":"2023-06-23T19:01:08.870787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:08:44.162030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871989+0000","last_change":"2023-06-23T19:01:03.878115+0000","last_active":"2023-06-23T19:01:08.871989+0000","last_peered":"2023-06-23T19:01:08.871989+0000","last_clean":"2023-06-23T19:01:08.871989+0000","last_became_active":"2023-06-23T19:01:03.877772+0000","last_became_peered":"2023-06-23T19:01:03.877772+0000","last_unstale":"2023-06-23T19:01:08.871989+0000","last_undegraded":"2023-06-23T19:01:08.871989+0000","last_fullsized":"2023-06-23T19:01:08.871989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:45:30.544760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872856+0000","last_change":"2023-06-23T19:01:04.371163+0000","last_active":"2023-06-23T19:01:08.872856+0000","last_peered":"2023-06-23T19:01:08.872856+0000","last_clean":"2023-06-23T19:01:08.872856+0000","last_became_active":"2023-06-23T19:01:04.370885+0000","last_became_peered":"2023-06-23T19:01:04.370885+0000","last_unstale":"2023-06-23T19:01:08.872856+0000","last_undegraded":"2023-06-23T19:01:08.872856+0000","last_fullsized":"2023-06-23T19:01:08.872856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:08.703615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281165+0000","last_change":"2023-06-23T19:01:08.403027+0000","last_active":"2023-06-23T19:01:09.281165+0000","last_peered":"2023-06-23T19:01:09.281165+0000","last_clean":"2023-06-23T19:01:09.281165+0000","last_became_active":"2023-06-23T19:01:08.402697+0000","last_became_peered":"2023-06-23T19:01:08.402697+0000","last_unstale":"2023-06-23T19:01:09.281165+0000","last_undegraded":"2023-06-23T19:01:09.281165+0000","last_fullsized":"2023-06-23T19:01:09.281165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:38.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282502+0000","last_change":"2023-06-23T19:00:58.032352+0000","last_active":"2023-06-23T19:01:09.282502+0000","last_peered":"2023-06-23T19:01:09.282502+0000","last_clean":"2023-06-23T19:01:09.282502+0000","last_became_active":"2023-06-23T19:00:58.031905+0000","last_became_peered":"2023-06-23T19:00:58.031905+0000","last_unstale":"2023-06-23T19:01:09.282502+0000","last_undegraded":"2023-06-23T19:01:09.282502+0000","last_fullsized":"2023-06-23T19:01:09.282502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:05.104177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281370+0000","last_change":"2023-06-23T19:00:50.002765+0000","last_active":"2023-06-23T19:01:09.281370+0000","last_peered":"2023-06-23T19:01:09.281370+0000","last_clean":"2023-06-23T19:01:09.281370+0000","last_became_active":"2023-06-23T19:00:50.002445+0000","last_became_peered":"2023-06-23T19:00:50.002445+0000","last_unstale":"2023-06-23T19:01:09.281370+0000","last_undegraded":"2023-06-23T19:01:09.281370+0000","last_fullsized":"2023-06-23T19:01:09.281370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_clean_scrub_stamp":"2023-06-23T19:00:48.989242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:33.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280695+0000","last_change":"2023-06-23T19:01:03.873914+0000","last_active":"2023-06-23T19:01:09.280695+0000","last_peered":"2023-06-23T19:01:09.280695+0000","last_clean":"2023-06-23T19:01:09.280695+0000","last_became_active":"2023-06-23T19:01:03.873592+0000","last_became_peered":"2023-06-23T19:01:03.873592+0000","last_unstale":"2023-06-23T19:01:09.280695+0000","last_undegraded":"2023-06-23T19:01:09.280695+0000","last_fullsized":"2023-06-23T19:01:09.280695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:15.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156830+0000","last_change":"2023-06-23T19:01:04.387883+0000","last_active":"2023-06-23T19:01:09.156830+0000","last_peered":"2023-06-23T19:01:09.156830+0000","last_clean":"2023-06-23T19:01:09.156830+0000","last_became_active":"2023-06-23T19:01:04.387600+0000","last_became_peered":"2023-06-23T19:01:04.387600+0000","last_unstale":"2023-06-23T19:01:09.156830+0000","last_undegraded":"2023-06-23T19:01:09.156830+0000","last_fullsized":"2023-06-23T19:01:09.156830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:16:44.300439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282713+0000","last_change":"2023-06-23T19:01:08.401404+0000","last_active":"2023-06-23T19:01:09.282713+0000","last_peered":"2023-06-23T19:01:09.282713+0000","last_clean":"2023-06-23T19:01:09.282713+0000","last_became_active":"2023-06-23T19:01:08.400568+0000","last_became_peered":"2023-06-23T19:01:08.400568+0000","last_unstale":"2023-06-23T19:01:09.282713+0000","last_undegraded":"2023-06-23T19:01:09.282713+0000","last_fullsized":"2023-06-23T19:01:09.282713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:33.995739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283199+0000","last_change":"2023-06-23T19:00:58.034045+0000","last_active":"2023-06-23T19:01:09.283199+0000","last_peered":"2023-06-23T19:01:09.283199+0000","last_clean":"2023-06-23T19:01:09.283199+0000","last_became_active":"2023-06-23T19:00:58.033654+0000","last_became_peered":"2023-06-23T19:00:58.033654+0000","last_unstale":"2023-06-23T19:01:09.283199+0000","last_undegraded":"2023-06-23T19:01:09.283199+0000","last_fullsized":"2023-06-23T19:01:09.283199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:01:40.788438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872071+0000","last_change":"2023-06-23T19:01:03.877003+0000","last_active":"2023-06-23T19:01:08.872071+0000","last_peered":"2023-06-23T19:01:08.872071+0000","last_clean":"2023-06-23T19:01:08.872071+0000","last_became_active":"2023-06-23T19:01:03.876599+0000","last_became_peered":"2023-06-23T19:01:03.876599+0000","last_unstale":"2023-06-23T19:01:08.872071+0000","last_undegraded":"2023-06-23T19:01:08.872071+0000","last_fullsized":"2023-06-23T19:01:08.872071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:50.138012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872292+0000","last_change":"2023-06-23T19:01:04.388623+0000","last_active":"2023-06-23T19:01:08.872292+0000","last_peered":"2023-06-23T19:01:08.872292+0000","last_clean":"2023-06-23T19:01:08.872292+0000","last_became_active":"2023-06-23T19:01:04.388354+0000","last_became_peered":"2023-06-23T19:01:04.388354+0000","last_unstale":"2023-06-23T19:01:08.872292+0000","last_undegraded":"2023-06-23T19:01:08.872292+0000","last_fullsized":"2023-06-23T19:01:08.872292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:52:26.947243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156779+0000","last_change":"2023-06-23T19:01:08.405177+0000","last_active":"2023-06-23T19:01:09.156779+0000","last_peered":"2023-06-23T19:01:09.156779+0000","last_clean":"2023-06-23T19:01:09.156779+0000","last_became_active":"2023-06-23T19:01:08.404747+0000","last_became_peered":"2023-06-23T19:01:08.404747+0000","last_unstale":"2023-06-23T19:01:09.156779+0000","last_undegraded":"2023-06-23T19:01:09.156779+0000","last_fullsized":"2023-06-23T19:01:09.156779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:17:06.369020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282026+0000","last_change":"2023-06-23T19:00:58.992645+0000","last_active":"2023-06-23T19:01:09.282026+0000","last_peered":"2023-06-23T19:01:09.282026+0000","last_clean":"2023-06-23T19:01:09.282026+0000","last_became_active":"2023-06-23T19:00:58.992291+0000","last_became_peered":"2023-06-23T19:00:58.992291+0000","last_unstale":"2023-06-23T19:01:09.282026+0000","last_undegraded":"2023-06-23T19:01:09.282026+0000","last_fullsized":"2023-06-23T19:01:09.282026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:16:30.068353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873413+0000","last_change":"2023-06-23T19:01:03.878082+0000","last_active":"2023-06-23T19:01:08.873413+0000","last_peered":"2023-06-23T19:01:08.873413+0000","last_clean":"2023-06-23T19:01:08.873413+0000","last_became_active":"2023-06-23T19:01:03.877747+0000","last_became_peered":"2023-06-23T19:01:03.877747+0000","last_unstale":"2023-06-23T19:01:08.873413+0000","last_undegraded":"2023-06-23T19:01:08.873413+0000","last_fullsized":"2023-06-23T19:01:08.873413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:25:21.482936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873397+0000","last_change":"2023-06-23T19:01:04.374320+0000","last_active":"2023-06-23T19:01:08.873397+0000","last_peered":"2023-06-23T19:01:08.873397+0000","last_clean":"2023-06-23T19:01:08.873397+0000","last_became_active":"2023-06-23T19:01:04.374031+0000","last_became_peered":"2023-06-23T19:01:04.374031+0000","last_unstale":"2023-06-23T19:01:08.873397+0000","last_undegraded":"2023-06-23T19:01:08.873397+0000","last_fullsized":"2023-06-23T19:01:08.873397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:34.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281624+0000","last_change":"2023-06-23T19:01:08.394556+0000","last_active":"2023-06-23T19:01:09.281624+0000","last_peered":"2023-06-23T19:01:09.281624+0000","last_clean":"2023-06-23T19:01:09.281624+0000","last_became_active":"2023-06-23T19:01:08.393875+0000","last_became_peered":"2023-06-23T19:01:08.393875+0000","last_unstale":"2023-06-23T19:01:09.281624+0000","last_undegraded":"2023-06-23T19:01:09.281624+0000","last_fullsized":"2023-06-23T19:01:09.281624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:07:00.398165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281299+0000","last_change":"2023-06-23T19:01:03.870177+0000","last_active":"2023-06-23T19:01:09.281299+0000","last_peered":"2023-06-23T19:01:09.281299+0000","last_clean":"2023-06-23T19:01:09.281299+0000","last_became_active":"2023-06-23T19:01:03.869846+0000","last_became_peered":"2023-06-23T19:01:03.869846+0000","last_unstale":"2023-06-23T19:01:09.281299+0000","last_undegraded":"2023-06-23T19:01:09.281299+0000","last_fullsized":"2023-06-23T19:01:09.281299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:16:04.856211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873658+0000","last_change":"2023-06-23T19:00:58.034828+0000","last_active":"2023-06-23T19:01:08.873658+0000","last_peered":"2023-06-23T19:01:08.873658+0000","last_clean":"2023-06-23T19:01:08.873658+0000","last_became_active":"2023-06-23T19:00:58.034502+0000","last_became_peered":"2023-06-23T19:00:58.034502+0000","last_unstale":"2023-06-23T19:01:08.873658+0000","last_undegraded":"2023-06-23T19:01:08.873658+0000","last_fullsized":"2023-06-23T19:01:08.873658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:41.813074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280470+0000","last_change":"2023-06-23T19:01:04.377485+0000","last_active":"2023-06-23T19:01:09.280470+0000","last_peered":"2023-06-23T19:01:09.280470+0000","last_clean":"2023-06-23T19:01:09.280470+0000","last_became_active":"2023-06-23T19:01:04.377242+0000","last_became_peered":"2023-06-23T19:01:04.377242+0000","last_unstale":"2023-06-23T19:01:09.280470+0000","last_undegraded":"2023-06-23T19:01:09.280470+0000","last_fullsized":"2023-06-23T19:01:09.280470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:49.389492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280412+0000","last_change":"2023-06-23T19:01:08.399309+0000","last_active":"2023-06-23T19:01:09.280412+0000","last_peered":"2023-06-23T19:01:09.280412+0000","last_clean":"2023-06-23T19:01:09.280412+0000","last_became_active":"2023-06-23T19:01:08.398913+0000","last_became_peered":"2023-06-23T19:01:08.398913+0000","last_unstale":"2023-06-23T19:01:09.280412+0000","last_undegraded":"2023-06-23T19:01:09.280412+0000","last_fullsized":"2023-06-23T19:01:09.280412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:05:26.164184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.157050+0000","last_change":"2023-06-23T19:00:58.035530+0000","last_active":"2023-06-23T19:01:09.157050+0000","last_peered":"2023-06-23T19:01:09.157050+0000","last_clean":"2023-06-23T19:01:09.157050+0000","last_became_active":"2023-06-23T19:00:58.035130+0000","last_became_peered":"2023-06-23T19:00:58.035130+0000","last_unstale":"2023-06-23T19:01:09.157050+0000","last_undegraded":"2023-06-23T19:01:09.157050+0000","last_fullsized":"2023-06-23T19:01:09.157050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:11.697702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872441+0000","last_change":"2023-06-23T19:01:03.875213+0000","last_active":"2023-06-23T19:01:08.872441+0000","last_peered":"2023-06-23T19:01:08.872441+0000","last_clean":"2023-06-23T19:01:08.872441+0000","last_became_active":"2023-06-23T19:01:03.874930+0000","last_became_peered":"2023-06-23T19:01:03.874930+0000","last_unstale":"2023-06-23T19:01:08.872441+0000","last_undegraded":"2023-06-23T19:01:08.872441+0000","last_fullsized":"2023-06-23T19:01:08.872441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:08:23.340468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281216+0000","last_change":"2023-06-23T19:01:04.381558+0000","last_active":"2023-06-23T19:01:09.281216+0000","last_peered":"2023-06-23T19:01:09.281216+0000","last_clean":"2023-06-23T19:01:09.281216+0000","last_became_active":"2023-06-23T19:01:04.381261+0000","last_became_peered":"2023-06-23T19:01:04.381261+0000","last_unstale":"2023-06-23T19:01:09.281216+0000","last_undegraded":"2023-06-23T19:01:09.281216+0000","last_fullsized":"2023-06-23T19:01:09.281216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:19:13.412736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872856+0000","last_change":"2023-06-23T19:01:08.396210+0000","last_active":"2023-06-23T19:01:08.872856+0000","last_peered":"2023-06-23T19:01:08.872856+0000","last_clean":"2023-06-23T19:01:08.872856+0000","last_became_active":"2023-06-23T19:01:08.395784+0000","last_became_peered":"2023-06-23T19:01:08.395784+0000","last_unstale":"2023-06-23T19:01:08.872856+0000","last_undegraded":"2023-06-23T19:01:08.872856+0000","last_fullsized":"2023-06-23T19:01:08.872856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:37.937641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873475+0000","last_change":"2023-06-23T19:01:03.880745+0000","last_active":"2023-06-23T19:01:08.873475+0000","last_peered":"2023-06-23T19:01:08.873475+0000","last_clean":"2023-06-23T19:01:08.873475+0000","last_became_active":"2023-06-23T19:01:03.880470+0000","last_became_peered":"2023-06-23T19:01:03.880470+0000","last_unstale":"2023-06-23T19:01:08.873475+0000","last_undegraded":"2023-06-23T19:01:08.873475+0000","last_fullsized":"2023-06-23T19:01:08.873475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:47.638210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.871233+0000","last_change":"2023-06-23T19:01:04.374095+0000","last_active":"2023-06-23T19:01:08.871233+0000","last_peered":"2023-06-23T19:01:08.871233+0000","last_clean":"2023-06-23T19:01:08.871233+0000","last_became_active":"2023-06-23T19:01:04.373775+0000","last_became_peered":"2023-06-23T19:01:04.373775+0000","last_unstale":"2023-06-23T19:01:08.871233+0000","last_undegraded":"2023-06-23T19:01:08.871233+0000","last_fullsized":"2023-06-23T19:01:08.871233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:17:02.854856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281073+0000","last_change":"2023-06-23T19:01:08.394708+0000","last_active":"2023-06-23T19:01:09.281073+0000","last_peered":"2023-06-23T19:01:09.281073+0000","last_clean":"2023-06-23T19:01:09.281073+0000","last_became_active":"2023-06-23T19:01:08.394307+0000","last_became_peered":"2023-06-23T19:01:08.394307+0000","last_unstale":"2023-06-23T19:01:09.281073+0000","last_undegraded":"2023-06-23T19:01:09.281073+0000","last_fullsized":"2023-06-23T19:01:09.281073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:37.937641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281731+0000","last_change":"2023-06-23T19:01:03.881055+0000","last_active":"2023-06-23T19:01:09.281731+0000","last_peered":"2023-06-23T19:01:09.281731+0000","last_clean":"2023-06-23T19:01:09.281731+0000","last_became_active":"2023-06-23T19:01:03.880783+0000","last_became_peered":"2023-06-23T19:01:03.880783+0000","last_unstale":"2023-06-23T19:01:09.281731+0000","last_undegraded":"2023-06-23T19:01:09.281731+0000","last_fullsized":"2023-06-23T19:01:09.281731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:33.419724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281290+0000","last_change":"2023-06-23T19:01:04.384460+0000","last_active":"2023-06-23T19:01:09.281290+0000","last_peered":"2023-06-23T19:01:09.281290+0000","last_clean":"2023-06-23T19:01:09.281290+0000","last_became_active":"2023-06-23T19:01:04.384176+0000","last_became_peered":"2023-06-23T19:01:04.384176+0000","last_unstale":"2023-06-23T19:01:09.281290+0000","last_undegraded":"2023-06-23T19:01:09.281290+0000","last_fullsized":"2023-06-23T19:01:09.281290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:22:29.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282471+0000","last_change":"2023-06-23T19:01:08.400916+0000","last_active":"2023-06-23T19:01:09.282471+0000","last_peered":"2023-06-23T19:01:09.282471+0000","last_clean":"2023-06-23T19:01:09.282471+0000","last_became_active":"2023-06-23T19:01:08.400414+0000","last_became_peered":"2023-06-23T19:01:08.400414+0000","last_unstale":"2023-06-23T19:01:09.282471+0000","last_undegraded":"2023-06-23T19:01:09.282471+0000","last_fullsized":"2023-06-23T19:01:09.282471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:52.156128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.283145+0000","last_change":"2023-06-23T19:01:03.881189+0000","last_active":"2023-06-23T19:01:09.283145+0000","last_peered":"2023-06-23T19:01:09.283145+0000","last_clean":"2023-06-23T19:01:09.283145+0000","last_became_active":"2023-06-23T19:01:03.880951+0000","last_became_peered":"2023-06-23T19:01:03.880951+0000","last_unstale":"2023-06-23T19:01:09.283145+0000","last_undegraded":"2023-06-23T19:01:09.283145+0000","last_fullsized":"2023-06-23T19:01:09.283145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:15.133048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282217+0000","last_change":"2023-06-23T19:01:04.384653+0000","last_active":"2023-06-23T19:01:09.282217+0000","last_peered":"2023-06-23T19:01:09.282217+0000","last_clean":"2023-06-23T19:01:09.282217+0000","last_became_active":"2023-06-23T19:01:04.384329+0000","last_became_peered":"2023-06-23T19:01:04.384329+0000","last_unstale":"2023-06-23T19:01:09.282217+0000","last_undegraded":"2023-06-23T19:01:09.282217+0000","last_fullsized":"2023-06-23T19:01:09.282217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:34:32.935523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280710+0000","last_change":"2023-06-23T19:01:08.395019+0000","last_active":"2023-06-23T19:01:09.280710+0000","last_peered":"2023-06-23T19:01:09.280710+0000","last_clean":"2023-06-23T19:01:09.280710+0000","last_became_active":"2023-06-23T19:01:08.394627+0000","last_became_peered":"2023-06-23T19:01:08.394627+0000","last_unstale":"2023-06-23T19:01:09.280710+0000","last_undegraded":"2023-06-23T19:01:09.280710+0000","last_fullsized":"2023-06-23T19:01:09.280710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:47:00.590205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281012+0000","last_change":"2023-06-23T19:01:03.865046+0000","last_active":"2023-06-23T19:01:09.281012+0000","last_peered":"2023-06-23T19:01:09.281012+0000","last_clean":"2023-06-23T19:01:09.281012+0000","last_became_active":"2023-06-23T19:01:03.864670+0000","last_became_peered":"2023-06-23T19:01:03.864670+0000","last_unstale":"2023-06-23T19:01:09.281012+0000","last_undegraded":"2023-06-23T19:01:09.281012+0000","last_fullsized":"2023-06-23T19:01:09.281012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:12.906392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280997+0000","last_change":"2023-06-23T19:01:04.378240+0000","last_active":"2023-06-23T19:01:09.280997+0000","last_peered":"2023-06-23T19:01:09.280997+0000","last_clean":"2023-06-23T19:01:09.280997+0000","last_became_active":"2023-06-23T19:01:04.377992+0000","last_became_peered":"2023-06-23T19:01:04.377992+0000","last_unstale":"2023-06-23T19:01:09.280997+0000","last_undegraded":"2023-06-23T19:01:09.280997+0000","last_fullsized":"2023-06-23T19:01:09.280997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:32:02.858761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872457+0000","last_change":"2023-06-23T19:01:08.407782+0000","last_active":"2023-06-23T19:01:08.872457+0000","last_peered":"2023-06-23T19:01:08.872457+0000","last_clean":"2023-06-23T19:01:08.872457+0000","last_became_active":"2023-06-23T19:01:08.407314+0000","last_became_peered":"2023-06-23T19:01:08.407314+0000","last_unstale":"2023-06-23T19:01:08.872457+0000","last_undegraded":"2023-06-23T19:01:08.872457+0000","last_fullsized":"2023-06-23T19:01:08.872457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:07.358675+0000","last_clean_scrub_stamp":"2023-06-23T19:01:07.358675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:08:27.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.873611+0000","last_change":"2023-06-23T19:01:03.875481+0000","last_active":"2023-06-23T19:01:08.873611+0000","last_peered":"2023-06-23T19:01:08.873611+0000","last_clean":"2023-06-23T19:01:08.873611+0000","last_became_active":"2023-06-23T19:01:03.874826+0000","last_became_peered":"2023-06-23T19:01:03.874826+0000","last_unstale":"2023-06-23T19:01:08.873611+0000","last_undegraded":"2023-06-23T19:01:08.873611+0000","last_fullsized":"2023-06-23T19:01:08.873611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:02.840757+0000","last_clean_scrub_stamp":"2023-06-23T19:01:02.840757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:19:58.742697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280899+0000","last_change":"2023-06-23T19:01:04.378819+0000","last_active":"2023-06-23T19:01:09.280899+0000","last_peered":"2023-06-23T19:01:09.280899+0000","last_clean":"2023-06-23T19:01:09.280899+0000","last_became_active":"2023-06-23T19:01:04.378183+0000","last_became_peered":"2023-06-23T19:01:04.378183+0000","last_unstale":"2023-06-23T19:01:09.280899+0000","last_undegraded":"2023-06-23T19:01:09.280899+0000","last_fullsized":"2023-06-23T19:01:09.280899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:36:00.026037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.156609+0000","last_change":"2023-06-23T19:01:04.375991+0000","last_active":"2023-06-23T19:01:09.156609+0000","last_peered":"2023-06-23T19:01:09.156609+0000","last_clean":"2023-06-23T19:01:09.156609+0000","last_became_active":"2023-06-23T19:01:04.375767+0000","last_became_peered":"2023-06-23T19:01:04.375767+0000","last_unstale":"2023-06-23T19:01:09.156609+0000","last_undegraded":"2023-06-23T19:01:09.156609+0000","last_fullsized":"2023-06-23T19:01:09.156609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:03.089060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.281270+0000","last_change":"2023-06-23T19:01:04.386075+0000","last_active":"2023-06-23T19:01:09.281270+0000","last_peered":"2023-06-23T19:01:09.281270+0000","last_clean":"2023-06-23T19:01:09.281270+0000","last_became_active":"2023-06-23T19:01:04.385788+0000","last_became_peered":"2023-06-23T19:01:04.385788+0000","last_unstale":"2023-06-23T19:01:09.281270+0000","last_undegraded":"2023-06-23T19:01:09.281270+0000","last_fullsized":"2023-06-23T19:01:09.281270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:38:17.246142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.282773+0000","last_change":"2023-06-23T19:01:04.378811+0000","last_active":"2023-06-23T19:01:09.282773+0000","last_peered":"2023-06-23T19:01:09.282773+0000","last_clean":"2023-06-23T19:01:09.282773+0000","last_became_active":"2023-06-23T19:01:04.378217+0000","last_became_peered":"2023-06-23T19:01:04.378217+0000","last_unstale":"2023-06-23T19:01:09.282773+0000","last_undegraded":"2023-06-23T19:01:09.282773+0000","last_fullsized":"2023-06-23T19:01:09.282773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:21:41.388818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:09.280565+0000","last_change":"2023-06-23T19:01:04.378198+0000","last_active":"2023-06-23T19:01:09.280565+0000","last_peered":"2023-06-23T19:01:09.280565+0000","last_clean":"2023-06-23T19:01:09.280565+0000","last_became_active":"2023-06-23T19:01:04.377778+0000","last_became_peered":"2023-06-23T19:01:04.377778+0000","last_unstale":"2023-06-23T19:01:09.280565+0000","last_undegraded":"2023-06-23T19:01:09.280565+0000","last_fullsized":"2023-06-23T19:01:09.280565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:10:45.255508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-06-23T19:01:08.872832+0000","last_change":"2023-06-23T19:01:04.375219+0000","last_active":"2023-06-23T19:01:08.872832+0000","last_peered":"2023-06-23T19:01:08.872832+0000","last_clean":"2023-06-23T19:01:08.872832+0000","last_became_active":"2023-06-23T19:01:04.372075+0000","last_became_peered":"2023-06-23T19:01:04.372075+0000","last_unstale":"2023-06-23T19:01:08.872832+0000","last_undegraded":"2023-06-23T19:01:08.872832+0000","last_fullsized":"2023-06-23T19:01:08.872832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:01:03.844510+0000","last_clean_scrub_stamp":"2023-06-23T19:01:03.844510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:13:42.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476748,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":716841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":126543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.165}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0939999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9770000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":125891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":327680,"data_stored":129741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":929792,"data_stored":720269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.992}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7849999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T19:01:36.684 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-23T19:01:36.684 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-23T19:01:36.685 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-23T19:01:36.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-23T19:01:36.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.904+0000 7f6740fff700 1 Processor -- start 2023-06-23T19:01:36.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.904+0000 7f6740fff700 1 -- start start 2023-06-23T19:01:36.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.905+0000 7f6740fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f673c15c570 0x7f673c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.905+0000 7f6740fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f673c160a50 0x7f673c0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.905+0000 7f6740fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c160e70 con 0x7f673c0cd660 2023-06-23T19:01:36.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.905+0000 7f6740fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c15d670 con 0x7f673c160a50 2023-06-23T19:01:36.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.905+0000 7f6740fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c0cdae0 con 0x7f673c15c570 2023-06-23T19:01:36.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.906+0000 7f673ad9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f673c160a50 0x7f673c0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.906+0000 7f673ad9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f673c160a50 0x7f673c0d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46432/0 (socket says 172.21.15.136:46432) 2023-06-23T19:01:36.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.906+0000 7f673ad9d700 1 -- 172.21.15.136:0/1492658551 learned_addr learned my addr 172.21.15.136:0/1492658551 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:36.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.906+0000 7f673a59c700 1 --2- 172.21.15.136:0/1492658551 >> v2:172.21.15.178:3300/0 conn(0x7f673c15c570 0x7f673c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.906+0000 7f673ad9d700 1 -- 172.21.15.136:0/1492658551 >> v2:172.21.15.178:3300/0 conn(0x7f673c15c570 msgr2=0x7f673c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:36.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.906+0000 7f673ad9d700 1 --2- 172.21.15.136:0/1492658551 >> v2:172.21.15.178:3300/0 conn(0x7f673c15c570 0x7f673c0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.906+0000 7f673ad9d700 1 -- 172.21.15.136:0/1492658551 >> v1:172.21.15.178:6789/0 conn(0x7f673c0cd660 legacy=0x7f673c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.906+0000 7f673ad9d700 1 -- 172.21.15.136:0/1492658551 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c1610a0 con 0x7f673c160a50 2023-06-23T19:01:36.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.906+0000 7f673ad9d700 1 --2- 172.21.15.136:0/1492658551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c160a50 0x7f673c0d0bb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f673c08bd60 tx=0x7f673400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e84d877ed2db44c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:36.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f673959a700 1 -- 172.21.15.136:0/1492658551 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400e070 con 0x7f673c160a50 2023-06-23T19:01:36.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f673959a700 1 -- 172.21.15.136:0/1492658551 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673400b9c0 con 0x7f673c160a50 2023-06-23T19:01:36.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f673959a700 1 -- 172.21.15.136:0/1492658551 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400bd70 con 0x7f673c160a50 2023-06-23T19:01:36.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f6740fff700 1 -- 172.21.15.136:0/1492658551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c160a50 msgr2=0x7f673c0d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f6740fff700 1 --2- 172.21.15.136:0/1492658551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c160a50 0x7f673c0d0bb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f673c08bd60 tx=0x7f673400b330 comp rx=0 tx=0).stop 2023-06-23T19:01:36.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f6740fff700 1 -- 172.21.15.136:0/1492658551 shutdown_connections 2023-06-23T19:01:36.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f6740fff700 1 --2- 172.21.15.136:0/1492658551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c160a50 0x7f673c0d0bb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f6740fff700 1 --2- 172.21.15.136:0/1492658551 >> v2:172.21.15.178:3300/0 conn(0x7f673c15c570 0x7f673c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f6740fff700 1 -- 172.21.15.136:0/1492658551 >> 172.21.15.136:0/1492658551 conn(0x7f673c071620 msgr2=0x7f673c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:36.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f6740fff700 1 -- 172.21.15.136:0/1492658551 shutdown_connections 2023-06-23T19:01:36.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.907+0000 7f6740fff700 1 -- 172.21.15.136:0/1492658551 wait complete. 2023-06-23T19:01:36.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.909+0000 7f6740fff700 1 Processor -- start 2023-06-23T19:01:36.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.909+0000 7f6740fff700 1 -- start start 2023-06-23T19:01:36.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f6740fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0cd660 0x7f673c1f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f6740fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c15c570 0x7f673c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f6740fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c160a50 0x7f673c0b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f6740fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0c9f80 con 0x7f673c15c570 2023-06-23T19:01:36.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f6740fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c147380 con 0x7f673c0cd660 2023-06-23T19:01:36.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f6740fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0b65c0 con 0x7f673c160a50 2023-06-23T19:01:36.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f6739d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c15c570 0x7f673c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f6739d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c15c570 0x7f673c0b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46434/0 (socket says 172.21.15.136:46434) 2023-06-23T19:01:36.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f6739d9b700 1 -- 172.21.15.136:0/2289838586 learned_addr learned my addr 172.21.15.136:0/2289838586 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:36.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.910+0000 7f673ad9d700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c160a50 0x7f673c0b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f673a59c700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0cd660 0x7f673c1f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f6739d9b700 1 -- 172.21.15.136:0/2289838586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c160a50 msgr2=0x7f673c0b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f6739d9b700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c160a50 0x7f673c0b7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f6739d9b700 1 -- 172.21.15.136:0/2289838586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0cd660 msgr2=0x7f673c1f19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:36.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f6739d9b700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0cd660 0x7f673c1f19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:36.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f6739d9b700 1 -- 172.21.15.136:0/2289838586 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734009b30 con 0x7f673c15c570 2023-06-23T19:01:36.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f6739d9b700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c15c570 0x7f673c0b78b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f673000c510 tx=0x7f673000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:36.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f672affd700 1 -- 172.21.15.136:0/2289838586 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300052d0 con 0x7f673c15c570 2023-06-23T19:01:36.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f672affd700 1 -- 172.21.15.136:0/2289838586 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6730005430 con 0x7f673c15c570 2023-06-23T19:01:36.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f672affd700 1 -- 172.21.15.136:0/2289838586 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300038c0 con 0x7f673c15c570 2023-06-23T19:01:36.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c0b68a0 con 0x7f673c15c570 2023-06-23T19:01:36.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.911+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c0c9ba0 con 0x7f673c15c570 2023-06-23T19:01:36.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.912+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c073910 con 0x7f673c15c570 2023-06-23T19:01:36.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.913+0000 7f672affd700 1 -- 172.21.15.136:0/2289838586 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6730003a20 con 0x7f673c15c570 2023-06-23T19:01:36.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.914+0000 7f672affd700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:36.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.914+0000 7f672affd700 1 -- 172.21.15.136:0/2289838586 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6730088b50 con 0x7f673c15c570 2023-06-23T19:01:36.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.914+0000 7f673a59c700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:36.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.915+0000 7f673a59c700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f672c0099d0 tx=0x7f672c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:36.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:36.918+0000 7f672affd700 1 -- 172.21.15.136:0/2289838586 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6730053870 con 0x7f673c15c570 2023-06-23T19:01:37.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.162+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f673c151910 con 0x7f673c15c570 2023-06-23T19:01:37.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.162+0000 7f672affd700 1 -- 172.21.15.136:0/2289838586 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6730056e90 con 0x7f673c15c570 2023-06-23T19:01:37.166 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:37.166 INFO:teuthology.orchestra.run.smithi136.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-23T19:01:37.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 msgr2=0x7f671c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f672c0099d0 tx=0x7f672c008040 comp rx=0 tx=0).stop 2023-06-23T19:01:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c15c570 msgr2=0x7f673c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c15c570 0x7f673c0b78b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f673000c510 tx=0x7f673000c820 comp rx=0 tx=0).stop 2023-06-23T19:01:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 shutdown_connections 2023-06-23T19:01:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0cd660 0x7f673c1f19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c160a50 0x7f673c0b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 --2- 172.21.15.136:0/2289838586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c15c570 0x7f673c0b78b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 >> 172.21.15.136:0/2289838586 conn(0x7f673c071620 msgr2=0x7f673c0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:37.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 shutdown_connections 2023-06-23T19:01:37.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.165+0000 7f6740fff700 1 -- 172.21.15.136:0/2289838586 wait complete. 2023-06-23T19:01:37.186 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-23T19:01:37.187 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:37.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.375+0000 7fcdf8fff700 1 Processor -- start 2023-06-23T19:01:37.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.375+0000 7fcdf8fff700 1 -- start start 2023-06-23T19:01:37.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.376+0000 7fcdf8fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcdf415c570 0x7fcdf40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.376+0000 7fcdf8fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 0x7fcdf4160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.376+0000 7fcdf8fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcdf4160880 0x7fcdf406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.376+0000 7fcdf8fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf415d670 con 0x7fcdf415c570 2023-06-23T19:01:37.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.376+0000 7fcdf8fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf40cdab0 con 0x7fcdf4160880 2023-06-23T19:01:37.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.376+0000 7fcdf8fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf41610a0 con 0x7fcdf40cd660 2023-06-23T19:01:37.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.376+0000 7fcdf259c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcdf415c570 0x7fcdf40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.376+0000 7fcdf259c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcdf415c570 0x7fcdf40cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46442/0 (socket says 172.21.15.136:46442) 2023-06-23T19:01:37.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.376+0000 7fcdf259c700 1 -- 172.21.15.136:0/324108550 learned_addr learned my addr 172.21.15.136:0/324108550 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:37.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf2d9d700 1 --2- 172.21.15.136:0/324108550 >> v2:172.21.15.178:3300/0 conn(0x7fcdf4160880 0x7fcdf406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf1d9b700 1 --2- 172.21.15.136:0/324108550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 0x7fcdf4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf259c700 1 -- 172.21.15.136:0/324108550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 msgr2=0x7fcdf4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:37.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf259c700 1 --2- 172.21.15.136:0/324108550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 0x7fcdf4160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf259c700 1 -- 172.21.15.136:0/324108550 >> v2:172.21.15.178:3300/0 conn(0x7fcdf4160880 msgr2=0x7fcdf406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:37.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf259c700 1 --2- 172.21.15.136:0/324108550 >> v2:172.21.15.178:3300/0 conn(0x7fcdf4160880 0x7fcdf406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf259c700 1 -- 172.21.15.136:0/324108550 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf415da90 con 0x7fcdf415c570 2023-06-23T19:01:37.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf259c700 1 --2- 172.21.15.136:0/324108550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf415c570 0x7fcdf40cd120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40d06a0 tx=0x7fcde4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5cfcc4fe3a3daa server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:37.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf159a700 1 -- 172.21.15.136:0/324108550 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4011830 con 0x7fcdf415c570 2023-06-23T19:01:37.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf159a700 1 -- 172.21.15.136:0/324108550 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde4011990 con 0x7fcdf415c570 2023-06-23T19:01:37.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.377+0000 7fcdf159a700 1 -- 172.21.15.136:0/324108550 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4011d20 con 0x7fcdf415c570 2023-06-23T19:01:37.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.378+0000 7fcdf8fff700 1 -- 172.21.15.136:0/324108550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf415c570 msgr2=0x7fcdf40cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.378+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/324108550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf415c570 0x7fcdf40cd120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40d06a0 tx=0x7fcde4009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.378+0000 7fcdf8fff700 1 -- 172.21.15.136:0/324108550 shutdown_connections 2023-06-23T19:01:37.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.378+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/324108550 >> v2:172.21.15.178:3300/0 conn(0x7fcdf4160880 0x7fcdf406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.378+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/324108550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf415c570 0x7fcdf40cd120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.378+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/324108550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 0x7fcdf4160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.378+0000 7fcdf8fff700 1 -- 172.21.15.136:0/324108550 >> 172.21.15.136:0/324108550 conn(0x7fcdf4071620 msgr2=0x7fcdf40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:37.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.378+0000 7fcdf8fff700 1 -- 172.21.15.136:0/324108550 shutdown_connections 2023-06-23T19:01:37.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.378+0000 7fcdf8fff700 1 -- 172.21.15.136:0/324108550 wait complete. 2023-06-23T19:01:37.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.380+0000 7fcdf8fff700 1 Processor -- start 2023-06-23T19:01:37.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.381+0000 7fcdf8fff700 1 -- start start 2023-06-23T19:01:37.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf8fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 0x7fcdf4150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf8fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf415c570 0x7fcdf414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf8fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf4160880 0x7fcdf40b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf8fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf414fe70 con 0x7fcdf4160880 2023-06-23T19:01:37.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf8fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40b7ac0 con 0x7fcdf415c570 2023-06-23T19:01:37.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf8fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf41e60b0 con 0x7fcdf40cd660 2023-06-23T19:01:37.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf2d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf4160880 0x7fcdf40b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf2d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf4160880 0x7fcdf40b72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46450/0 (socket says 172.21.15.136:46450) 2023-06-23T19:01:37.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf2d9d700 1 -- 172.21.15.136:0/3850141439 learned_addr learned my addr 172.21.15.136:0/3850141439 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:37.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf259c700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 0x7fcdf4150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.382+0000 7fcdf1d9b700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf415c570 0x7fcdf414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcdf2d9d700 1 -- 172.21.15.136:0/3850141439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 msgr2=0x7fcdf4150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcdf2d9d700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 0x7fcdf4150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcdf2d9d700 1 -- 172.21.15.136:0/3850141439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf415c570 msgr2=0x7fcdf414f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcdf2d9d700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf415c570 0x7fcdf414f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcdf2d9d700 1 -- 172.21.15.136:0/3850141439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde4009550 con 0x7fcdf4160880 2023-06-23T19:01:37.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcdf2d9d700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf4160880 0x7fcdf40b72e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00efc0 tx=0x7fcdec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:37.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcde2ffd700 1 -- 172.21.15.136:0/3850141439 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec009ea0 con 0x7fcdf4160880 2023-06-23T19:01:37.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcde2ffd700 1 -- 172.21.15.136:0/3850141439 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec00f040 con 0x7fcdf4160880 2023-06-23T19:01:37.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf40b7820 con 0x7fcdf4160880 2023-06-23T19:01:37.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcde2ffd700 1 -- 172.21.15.136:0/3850141439 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec00ced0 con 0x7fcdf4160880 2023-06-23T19:01:37.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.383+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf41e6630 con 0x7fcdf4160880 2023-06-23T19:01:37.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.384+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf4073910 con 0x7fcdf4160880 2023-06-23T19:01:37.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.385+0000 7fcde2ffd700 1 -- 172.21.15.136:0/3850141439 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcdec014480 con 0x7fcdf4160880 2023-06-23T19:01:37.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.386+0000 7fcde2ffd700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd406ace0 0x7fcdd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.386+0000 7fcde2ffd700 1 -- 172.21.15.136:0/3850141439 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdec08a270 con 0x7fcdf4160880 2023-06-23T19:01:37.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.387+0000 7fcdf259c700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd406ace0 0x7fcdd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.387+0000 7fcdf259c700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd406ace0 0x7fcdd406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcde4014040 tx=0x7fcde4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:37.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.390+0000 7fcde2ffd700 1 -- 172.21.15.136:0/3850141439 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcdec055020 con 0x7fcdf4160880 2023-06-23T19:01:37.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.588+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdf40b5360 con 0x7fcdf4160880 2023-06-23T19:01:37.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.589+0000 7fcde2ffd700 1 -- 172.21.15.136:0/3850141439 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7fcdec058640 con 0x7fcdf4160880 2023-06-23T19:01:37.593 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:37.594 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:37.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd406ace0 msgr2=0x7fcdd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd406ace0 0x7fcdd406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcde4014040 tx=0x7fcde4008030 comp rx=0 tx=0).stop 2023-06-23T19:01:37.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf4160880 msgr2=0x7fcdf40b72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf4160880 0x7fcdf40b72e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00efc0 tx=0x7fcdec00c3a0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 shutdown_connections 2023-06-23T19:01:37.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd406ace0 0x7fcdd406d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf4160880 0x7fcdf40b72e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40cd660 0x7fcdf4150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 --2- 172.21.15.136:0/3850141439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf415c570 0x7fcdf414f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 >> 172.21.15.136:0/3850141439 conn(0x7fcdf4071620 msgr2=0x7fcdf40d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:37.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 shutdown_connections 2023-06-23T19:01:37.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.592+0000 7fcdf8fff700 1 -- 172.21.15.136:0/3850141439 wait complete. 2023-06-23T19:01:37.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:01:37.616 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:01:37.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.807+0000 7f80905ff700 1 Processor -- start 2023-06-23T19:01:37.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.807+0000 7f80905ff700 1 -- start start 2023-06-23T19:01:37.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.808+0000 7f80905ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f80880d0a60 0x7f80880b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.808+0000 7f80905ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880b51d0 0x7f80880cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.808+0000 7f80905ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80880cd9d0 con 0x7f80880d0e30 2023-06-23T19:01:37.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.808+0000 7f80905ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80880d0060 con 0x7f80880d0a60 2023-06-23T19:01:37.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.808+0000 7f80905ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80880cfe50 con 0x7f80880b51d0 2023-06-23T19:01:37.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.808+0000 7f808eb9c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f80880d0e30 0x7f80880d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42180/0 (socket says 172.21.15.136:42180) 2023-06-23T19:01:37.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.808+0000 7f808eb9c700 1 -- 172.21.15.136:0/820286494 learned_addr learned my addr 172.21.15.136:0/820286494 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:37.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.808+0000 7f808e39b700 1 --2- 172.21.15.136:0/820286494 >> v2:172.21.15.178:3300/0 conn(0x7f80880d0a60 0x7f80880b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.808+0000 7f808db9a700 1 --2- 172.21.15.136:0/820286494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880b51d0 0x7f80880cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808d399700 1 -- 172.21.15.136:0/820286494 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069849119 0 0) 0x7f80880cd9d0 con 0x7f80880d0e30 2023-06-23T19:01:37.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808d399700 1 -- 172.21.15.136:0/820286494 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80740035b0 con 0x7f80880d0e30 2023-06-23T19:01:37.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808e39b700 1 -- 172.21.15.136:0/820286494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880b51d0 msgr2=0x7f80880cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:37.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808e39b700 1 --2- 172.21.15.136:0/820286494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880b51d0 0x7f80880cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808e39b700 1 -- 172.21.15.136:0/820286494 >> v1:172.21.15.136:6789/0 conn(0x7f80880d0e30 legacy=0x7f80880d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808e39b700 1 -- 172.21.15.136:0/820286494 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80880b5620 con 0x7f80880d0a60 2023-06-23T19:01:37.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808db9a700 1 --2- 172.21.15.136:0/820286494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880b51d0 0x7f80880cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:37.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808e39b700 1 --2- 172.21.15.136:0/820286494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80880d0a60 0x7f80880b5a70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8084009840 tx=0x7f8084009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad36a8788a051b32 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:37.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808d399700 1 -- 172.21.15.136:0/820286494 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084011830 con 0x7f80880d0a60 2023-06-23T19:01:37.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808d399700 1 -- 172.21.15.136:0/820286494 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8084011990 con 0x7f80880d0a60 2023-06-23T19:01:37.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.809+0000 7f808d399700 1 -- 172.21.15.136:0/820286494 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084011d20 con 0x7f80880d0a60 2023-06-23T19:01:37.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.810+0000 7f80905ff700 1 -- 172.21.15.136:0/820286494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80880d0a60 msgr2=0x7f80880b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.810+0000 7f80905ff700 1 --2- 172.21.15.136:0/820286494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80880d0a60 0x7f80880b5a70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8084009840 tx=0x7f8084009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:37.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.810+0000 7f80905ff700 1 -- 172.21.15.136:0/820286494 shutdown_connections 2023-06-23T19:01:37.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.810+0000 7f80905ff700 1 --2- 172.21.15.136:0/820286494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80880d0a60 0x7f80880b5a70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.810+0000 7f80905ff700 1 --2- 172.21.15.136:0/820286494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880b51d0 0x7f80880cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.810+0000 7f80905ff700 1 -- 172.21.15.136:0/820286494 >> 172.21.15.136:0/820286494 conn(0x7f8088071620 msgr2=0x7f80880719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:37.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.810+0000 7f80905ff700 1 -- 172.21.15.136:0/820286494 shutdown_connections 2023-06-23T19:01:37.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.810+0000 7f80905ff700 1 -- 172.21.15.136:0/820286494 wait complete. 2023-06-23T19:01:37.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.812+0000 7f80905ff700 1 Processor -- start 2023-06-23T19:01:37.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.812+0000 7f80905ff700 1 -- start start 2023-06-23T19:01:37.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f80905ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80880b51d0 0x7f80881e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f80905ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80880d0a60 0x7f80880b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f80905ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880d0e30 0x7f80880b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f80905ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80880a98a0 con 0x7f80880b51d0 2023-06-23T19:01:37.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f80905ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80881f1cf0 con 0x7f80880d0a60 2023-06-23T19:01:37.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f80905ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80881e4e00 con 0x7f80880d0e30 2023-06-23T19:01:37.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808e39b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80880b51d0 0x7f80881e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808e39b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80880b51d0 0x7f80881e75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46460/0 (socket says 172.21.15.136:46460) 2023-06-23T19:01:37.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808e39b700 1 -- 172.21.15.136:0/2795737960 learned_addr learned my addr 172.21.15.136:0/2795737960 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808eb9c700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880d0e30 0x7f80880b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808db9a700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80880d0a60 0x7f80880b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808e39b700 1 -- 172.21.15.136:0/2795737960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880d0e30 msgr2=0x7f80880b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808e39b700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880d0e30 0x7f80880b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808e39b700 1 -- 172.21.15.136:0/2795737960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80880d0a60 msgr2=0x7f80880b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808e39b700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80880d0a60 0x7f80880b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.813+0000 7f808e39b700 1 -- 172.21.15.136:0/2795737960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80780094a0 con 0x7f80880b51d0 2023-06-23T19:01:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.814+0000 7f808e39b700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80880b51d0 0x7f80881e75c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f80840090b0 tx=0x7f8084004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:37.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.814+0000 7f807effd700 1 -- 172.21.15.136:0/2795737960 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80840036a0 con 0x7f80880b51d0 2023-06-23T19:01:37.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.814+0000 7f807effd700 1 -- 172.21.15.136:0/2795737960 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808401f070 con 0x7f80880b51d0 2023-06-23T19:01:37.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.814+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80840094a0 con 0x7f80880b51d0 2023-06-23T19:01:37.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.814+0000 7f807effd700 1 -- 172.21.15.136:0/2795737960 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084003a40 con 0x7f80880b51d0 2023-06-23T19:01:37.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.814+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80881e53c0 con 0x7f80880b51d0 2023-06-23T19:01:37.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.815+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808804ea20 con 0x7f80880b51d0 2023-06-23T19:01:37.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.816+0000 7f807effd700 1 -- 172.21.15.136:0/2795737960 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8084003ba0 con 0x7f80880b51d0 2023-06-23T19:01:37.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.817+0000 7f807effd700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f806c06ace0 0x7f806c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:37.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.817+0000 7f807effd700 1 -- 172.21.15.136:0/2795737960 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8084021070 con 0x7f80880b51d0 2023-06-23T19:01:37.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.817+0000 7f808db9a700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f806c06ace0 0x7f806c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:37.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.818+0000 7f808db9a700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f806c06ace0 0x7f806c06d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f80880c8bb0 tx=0x7f8078008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:37.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:37.821+0000 7f807effd700 1 -- 172.21.15.136:0/2795737960 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8084055de0 con 0x7f80880b51d0 2023-06-23T19:01:38.022 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.018+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80880cdac0 con 0x7f80880b51d0 2023-06-23T19:01:38.022 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.019+0000 7f807effd700 1 -- 172.21.15.136:0/2795737960 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8084059400 con 0x7f80880b51d0 2023-06-23T19:01:38.023 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:01:38.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f806c06ace0 msgr2=0x7f806c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f806c06ace0 0x7f806c06d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f80880c8bb0 tx=0x7f8078008040 comp rx=0 tx=0).stop 2023-06-23T19:01:38.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80880b51d0 msgr2=0x7f80881e75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80880b51d0 0x7f80881e75c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f80840090b0 tx=0x7f8084004750 comp rx=0 tx=0).stop 2023-06-23T19:01:38.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 shutdown_connections 2023-06-23T19:01:38.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f806c06ace0 0x7f806c06d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80880d0e30 0x7f80880b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.026 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80880b51d0 0x7f80881e75c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 --2- 172.21.15.136:0/2795737960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80880d0a60 0x7f80880b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 >> 172.21.15.136:0/2795737960 conn(0x7f8088071620 msgr2=0x7f80880c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:38.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 shutdown_connections 2023-06-23T19:01:38.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.021+0000 7f80905ff700 1 -- 172.21.15.136:0/2795737960 wait complete. 2023-06-23T19:01:38.043 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:01:38.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.237+0000 7f2f44dff700 1 Processor -- start 2023-06-23T19:01:38.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.237+0000 7f2f44dff700 1 -- start start 2023-06-23T19:01:38.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.238+0000 7f2f44dff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f400d0a60 0x7f2f400b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.242 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.238+0000 7f2f44dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f400cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.242 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.238+0000 7f2f44dff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f400cd9d0 con 0x7f2f400d0e30 2023-06-23T19:01:38.242 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.238+0000 7f2f44dff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f400d0060 con 0x7f2f400d0a60 2023-06-23T19:01:38.242 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.238+0000 7f2f44dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400cfe50 con 0x7f2f400b51d0 2023-06-23T19:01:38.244 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.238+0000 7f2f3e59c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f400d0a60 0x7f2f400b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.244 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.238+0000 7f2f3ed9d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2f400d0e30 0x7f2f400d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:35406/0 (socket says 172.21.15.136:35406) 2023-06-23T19:01:38.244 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3dd9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f400cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.244 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3ed9d700 1 -- 172.21.15.136:0/1466940388 learned_addr learned my addr 172.21.15.136:0/1466940388 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:38.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3d59a700 1 -- 172.21.15.136:0/1466940388 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590774391 0 0) 0x7f2f400cd9d0 con 0x7f2f400d0e30 2023-06-23T19:01:38.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3d59a700 1 -- 172.21.15.136:0/1466940388 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f280035b0 con 0x7f2f400d0e30 2023-06-23T19:01:38.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3e59c700 1 -- 172.21.15.136:0/1466940388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 msgr2=0x7f2f400cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:38.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3e59c700 1 --2- 172.21.15.136:0/1466940388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f400cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3e59c700 1 -- 172.21.15.136:0/1466940388 >> v1:172.21.15.178:6789/0 conn(0x7f2f400d0e30 legacy=0x7f2f400d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3e59c700 1 -- 172.21.15.136:0/1466940388 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f400b5620 con 0x7f2f400d0a60 2023-06-23T19:01:38.245 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3dd9b700 1 --2- 172.21.15.136:0/1466940388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f400cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:38.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.239+0000 7f2f3e59c700 1 --2- 172.21.15.136:0/1466940388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0a60 0x7f2f400b5a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009840 tx=0x7f2f30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6380f36e3fd9561b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:38.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f3d59a700 1 -- 172.21.15.136:0/1466940388 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011830 con 0x7f2f400d0a60 2023-06-23T19:01:38.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f3d59a700 1 -- 172.21.15.136:0/1466940388 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f30011990 con 0x7f2f400d0a60 2023-06-23T19:01:38.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f3d59a700 1 -- 172.21.15.136:0/1466940388 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011d20 con 0x7f2f400d0a60 2023-06-23T19:01:38.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f44dff700 1 -- 172.21.15.136:0/1466940388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0a60 msgr2=0x7f2f400b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f44dff700 1 --2- 172.21.15.136:0/1466940388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0a60 0x7f2f400b5a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009840 tx=0x7f2f30009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:38.246 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f44dff700 1 -- 172.21.15.136:0/1466940388 shutdown_connections 2023-06-23T19:01:38.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f44dff700 1 --2- 172.21.15.136:0/1466940388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0a60 0x7f2f400b5a70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f44dff700 1 --2- 172.21.15.136:0/1466940388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f400cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f44dff700 1 -- 172.21.15.136:0/1466940388 >> 172.21.15.136:0/1466940388 conn(0x7f2f40071620 msgr2=0x7f2f400719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:38.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f44dff700 1 -- 172.21.15.136:0/1466940388 shutdown_connections 2023-06-23T19:01:38.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.240+0000 7f2f44dff700 1 -- 172.21.15.136:0/1466940388 wait complete. 2023-06-23T19:01:38.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.242+0000 7f2f44dff700 1 Processor -- start 2023-06-23T19:01:38.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.242+0000 7f2f44dff700 1 -- start start 2023-06-23T19:01:38.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f44dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f4015bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f44dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f400d0a60 0x7f2f400c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f44dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0e30 0x7f2f401f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f44dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f401f5cb0 con 0x7f2f400d0a60 2023-06-23T19:01:38.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f44dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4015c9b0 con 0x7f2f400d0e30 2023-06-23T19:01:38.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f44dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4015cc90 con 0x7f2f400b51d0 2023-06-23T19:01:38.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f3dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f400d0a60 0x7f2f400c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f3dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f400d0a60 0x7f2f400c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46462/0 (socket says 172.21.15.136:46462) 2023-06-23T19:01:38.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f3dd9b700 1 -- 172.21.15.136:0/1535878494 learned_addr learned my addr 172.21.15.136:0/1535878494 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:38.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.243+0000 7f2f3ed9d700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0e30 0x7f2f401f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f3e59c700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f4015bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f3dd9b700 1 -- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 msgr2=0x7f2f4015bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f3dd9b700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f4015bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f3dd9b700 1 -- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0e30 msgr2=0x7f2f401f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f3dd9b700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0e30 0x7f2f401f5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f3dd9b700 1 -- 172.21.15.136:0/1535878494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340094a0 con 0x7f2f400d0a60 2023-06-23T19:01:38.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f3ed9d700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0e30 0x7f2f401f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:38.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f3e59c700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f4015bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:38.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f3dd9b700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f400d0a60 0x7f2f400c7840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400ebe0 tx=0x7f2f34009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:38.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f2effd700 1 -- 172.21.15.136:0/1535878494 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400c910 con 0x7f2f400d0a60 2023-06-23T19:01:38.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f2effd700 1 -- 172.21.15.136:0/1535878494 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3400ca70 con 0x7f2f400d0a60 2023-06-23T19:01:38.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f300094a0 con 0x7f2f400d0a60 2023-06-23T19:01:38.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f2effd700 1 -- 172.21.15.136:0/1535878494 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400cde0 con 0x7f2f400d0a60 2023-06-23T19:01:38.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.244+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4015e6a0 con 0x7f2f400d0a60 2023-06-23T19:01:38.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.246+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4015e500 con 0x7f2f400d0a60 2023-06-23T19:01:38.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.247+0000 7f2f2effd700 1 -- 172.21.15.136:0/1535878494 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f34013470 con 0x7f2f400d0a60 2023-06-23T19:01:38.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.248+0000 7f2f2effd700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2f2006ace0 0x7f2f2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.248+0000 7f2f2effd700 1 -- 172.21.15.136:0/1535878494 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f34089a50 con 0x7f2f400d0a60 2023-06-23T19:01:38.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.248+0000 7f2f3e59c700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2f2006ace0 0x7f2f2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.249+0000 7f2f3e59c700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2f2006ace0 0x7f2f2006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f30000c00 tx=0x7f2f30008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:38.256 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.252+0000 7f2f2effd700 1 -- 172.21.15.136:0/1535878494 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f4015e500 con 0x7f2f400d0a60 2023-06-23T19:01:38.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.446+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f4015e500 con 0x7f2f400d0a60 2023-06-23T19:01:38.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.446+0000 7f2f2effd700 1 -- 172.21.15.136:0/1535878494 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f4015e500 con 0x7f2f400d0a60 2023-06-23T19:01:38.450 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:01:38.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.448+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2f2006ace0 msgr2=0x7f2f2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.448+0000 7f2f44dff700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2f2006ace0 0x7f2f2006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f30000c00 tx=0x7f2f30008030 comp rx=0 tx=0).stop 2023-06-23T19:01:38.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.448+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f400d0a60 msgr2=0x7f2f400c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.448+0000 7f2f44dff700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f400d0a60 0x7f2f400c7840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400ebe0 tx=0x7f2f34009ec0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.449+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 shutdown_connections 2023-06-23T19:01:38.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.449+0000 7f2f44dff700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2f2006ace0 0x7f2f2006d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.449+0000 7f2f44dff700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f400d0e30 0x7f2f401f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.449+0000 7f2f44dff700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f400b51d0 0x7f2f4015bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.449+0000 7f2f44dff700 1 --2- 172.21.15.136:0/1535878494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f400d0a60 0x7f2f400c7840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.449+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 >> 172.21.15.136:0/1535878494 conn(0x7f2f40071620 msgr2=0x7f2f400d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:38.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.449+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 shutdown_connections 2023-06-23T19:01:38.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.449+0000 7f2f44dff700 1 -- 172.21.15.136:0/1535878494 wait complete. 2023-06-23T19:01:38.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:01:38.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.668+0000 7f114abff700 1 Processor -- start 2023-06-23T19:01:38.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.668+0000 7f114abff700 1 -- start start 2023-06-23T19:01:38.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.670+0000 7f114abff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1144158ad0 0x7f11440702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.670+0000 7f114abff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11440b0e80 0x7f1144070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.670+0000 7f114abff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440c55e0 con 0x7f114406ded0 2023-06-23T19:01:38.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.670+0000 7f114abff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11440b4420 con 0x7f11440b0e80 2023-06-23T19:01:38.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.670+0000 7f114abff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114415d0e0 con 0x7f1144158ad0 2023-06-23T19:01:38.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.670+0000 7f114919c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f114406ded0 0x7f114406c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42188/0 (socket says 172.21.15.136:42188) 2023-06-23T19:01:38.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.670+0000 7f114919c700 1 -- 172.21.15.136:0/407383398 learned_addr learned my addr 172.21.15.136:0/407383398 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:38.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.670+0000 7f1143fff700 1 --2- 172.21.15.136:0/407383398 >> v2:172.21.15.178:3300/0 conn(0x7f11440b0e80 0x7f1144070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.670+0000 7f114899b700 1 --2- 172.21.15.136:0/407383398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1144158ad0 0x7f11440702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f11437fe700 1 -- 172.21.15.136:0/407383398 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792229592 0 0) 0x7f11440c55e0 con 0x7f114406ded0 2023-06-23T19:01:38.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f11437fe700 1 -- 172.21.15.136:0/407383398 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11340035b0 con 0x7f114406ded0 2023-06-23T19:01:38.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f1143fff700 1 -- 172.21.15.136:0/407383398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1144158ad0 msgr2=0x7f11440702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:38.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f1143fff700 1 --2- 172.21.15.136:0/407383398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1144158ad0 0x7f11440702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f1143fff700 1 -- 172.21.15.136:0/407383398 >> v1:172.21.15.136:6789/0 conn(0x7f114406ded0 legacy=0x7f114406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f1143fff700 1 -- 172.21.15.136:0/407383398 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114415d570 con 0x7f11440b0e80 2023-06-23T19:01:38.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f114899b700 1 --2- 172.21.15.136:0/407383398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1144158ad0 0x7f11440702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:38.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f1143fff700 1 --2- 172.21.15.136:0/407383398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11440b0e80 0x7f1144070820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1130009840 tx=0x7f1130009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec6e4de349c17145 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:38.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f11437fe700 1 -- 172.21.15.136:0/407383398 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130011830 con 0x7f11440b0e80 2023-06-23T19:01:38.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f11437fe700 1 -- 172.21.15.136:0/407383398 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130011990 con 0x7f11440b0e80 2023-06-23T19:01:38.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.671+0000 7f11437fe700 1 -- 172.21.15.136:0/407383398 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130011d20 con 0x7f11440b0e80 2023-06-23T19:01:38.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.672+0000 7f114abff700 1 -- 172.21.15.136:0/407383398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11440b0e80 msgr2=0x7f1144070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.672+0000 7f114abff700 1 --2- 172.21.15.136:0/407383398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11440b0e80 0x7f1144070820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1130009840 tx=0x7f1130009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:38.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.672+0000 7f114abff700 1 -- 172.21.15.136:0/407383398 shutdown_connections 2023-06-23T19:01:38.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.672+0000 7f114abff700 1 --2- 172.21.15.136:0/407383398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1144158ad0 0x7f11440702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.672+0000 7f114abff700 1 --2- 172.21.15.136:0/407383398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11440b0e80 0x7f1144070820 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.672+0000 7f114abff700 1 -- 172.21.15.136:0/407383398 >> 172.21.15.136:0/407383398 conn(0x7f114406ab80 msgr2=0x7f11440ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:38.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.672+0000 7f114abff700 1 -- 172.21.15.136:0/407383398 shutdown_connections 2023-06-23T19:01:38.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.672+0000 7f114abff700 1 -- 172.21.15.136:0/407383398 wait complete. 2023-06-23T19:01:38.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.674+0000 7f114abff700 1 Processor -- start 2023-06-23T19:01:38.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.675+0000 7f114abff700 1 -- start start 2023-06-23T19:01:38.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114abff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f114406ded0 0x7f11440cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114abff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440b0e80 0x7f1144144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114abff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1144158ad0 0x7f11440cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114abff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440cc790 con 0x7f114406ded0 2023-06-23T19:01:38.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114abff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11441544d0 con 0x7f1144158ad0 2023-06-23T19:01:38.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114abff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11440cd5b0 con 0x7f11440b0e80 2023-06-23T19:01:38.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114899b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f114406ded0 0x7f11440cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.688 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114899b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f114406ded0 0x7f11440cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46470/0 (socket says 172.21.15.136:46470) 2023-06-23T19:01:38.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114899b700 1 -- 172.21.15.136:0/363065449 learned_addr learned my addr 172.21.15.136:0/363065449 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:38.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114919c700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1144158ad0 0x7f11440cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f1143fff700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440b0e80 0x7f1144144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114899b700 1 -- 172.21.15.136:0/363065449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440b0e80 msgr2=0x7f1144144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114899b700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440b0e80 0x7f1144144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114899b700 1 -- 172.21.15.136:0/363065449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1144158ad0 msgr2=0x7f11440cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.676+0000 7f114899b700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1144158ad0 0x7f11440cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.677+0000 7f114899b700 1 -- 172.21.15.136:0/363065449 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380094a0 con 0x7f114406ded0 2023-06-23T19:01:38.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.677+0000 7f114919c700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1144158ad0 0x7f11440cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:38.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.677+0000 7f114899b700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f114406ded0 0x7f11440cc250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f113800ebe0 tx=0x7f1138009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:38.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.677+0000 7f11417fa700 1 -- 172.21.15.136:0/363065449 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800c8b0 con 0x7f114406ded0 2023-06-23T19:01:38.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.677+0000 7f11417fa700 1 -- 172.21.15.136:0/363065449 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113800ca10 con 0x7f114406ded0 2023-06-23T19:01:38.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.677+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11300094a0 con 0x7f114406ded0 2023-06-23T19:01:38.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.677+0000 7f11417fa700 1 -- 172.21.15.136:0/363065449 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800cd80 con 0x7f114406ded0 2023-06-23T19:01:38.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.677+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11440ccc80 con 0x7f114406ded0 2023-06-23T19:01:38.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.678+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114404ea20 con 0x7f114406ded0 2023-06-23T19:01:38.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.679+0000 7f11417fa700 1 -- 172.21.15.136:0/363065449 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1138013470 con 0x7f114406ded0 2023-06-23T19:01:38.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.681+0000 7f11417fa700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f112806ace0 0x7f112806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:38.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.681+0000 7f11417fa700 1 -- 172.21.15.136:0/363065449 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1138089a70 con 0x7f114406ded0 2023-06-23T19:01:38.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.681+0000 7f1143fff700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f112806ace0 0x7f112806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:38.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.682+0000 7f1143fff700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f112806ace0 0x7f112806d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1130000c00 tx=0x7f1130008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:38.692 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.685+0000 7f11417fa700 1 -- 172.21.15.136:0/363065449 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1138054700 con 0x7f114406ded0 2023-06-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.884+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11440714b0 con 0x7f114406ded0 2023-06-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.884+0000 7f11417fa700 1 -- 172.21.15.136:0/363065449 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1138057d20 con 0x7f114406ded0 2023-06-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.886+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f112806ace0 msgr2=0x7f112806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.886+0000 7f114abff700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f112806ace0 0x7f112806d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1130000c00 tx=0x7f1130008030 comp rx=0 tx=0).stop 2023-06-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f114406ded0 msgr2=0x7f11440cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f114406ded0 0x7f11440cc250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f113800ebe0 tx=0x7f1138009ec0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 shutdown_connections 2023-06-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f112806ace0 0x7f112806d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1144158ad0 0x7f11440cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f114406ded0 0x7f11440cc250 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 --2- 172.21.15.136:0/363065449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440b0e80 0x7f1144144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 >> 172.21.15.136:0/363065449 conn(0x7f114406ab80 msgr2=0x7f11440c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 shutdown_connections 2023-06-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:38.887+0000 7f114abff700 1 -- 172.21.15.136:0/363065449 wait complete. 2023-06-23T19:01:38.909 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:01:39.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.104+0000 7fc9f01ff700 1 Processor -- start 2023-06-23T19:01:39.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.104+0000 7fc9f01ff700 1 -- start start 2023-06-23T19:01:39.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.105+0000 7fc9f01ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc9e80d0a60 0x7fc9e80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.105+0000 7fc9f01ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80b51d0 0x7fc9e80cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.105+0000 7fc9f01ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc9e80d0e30 0x7fc9e80d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.105+0000 7fc9f01ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e80d0060 con 0x7fc9e80d0a60 2023-06-23T19:01:39.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.105+0000 7fc9f01ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e80cfe50 con 0x7fc9e80d0e30 2023-06-23T19:01:39.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.105+0000 7fc9f01ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e80cd9d0 con 0x7fc9e80b51d0 2023-06-23T19:01:39.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.105+0000 7fc9edf9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc9e80d0a60 0x7fc9e80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.105+0000 7fc9edf9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc9e80d0a60 0x7fc9e80b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46486/0 (socket says 172.21.15.136:46486) 2023-06-23T19:01:39.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9edf9b700 1 -- 172.21.15.136:0/2261042588 learned_addr learned my addr 172.21.15.136:0/2261042588 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:39.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9ee79c700 1 --2- 172.21.15.136:0/2261042588 >> v2:172.21.15.178:3300/0 conn(0x7fc9e80d0e30 0x7fc9e80d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9ed79a700 1 --2- 172.21.15.136:0/2261042588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80b51d0 0x7fc9e80cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9edf9b700 1 -- 172.21.15.136:0/2261042588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80b51d0 msgr2=0x7fc9e80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:39.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9edf9b700 1 --2- 172.21.15.136:0/2261042588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80b51d0 0x7fc9e80cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9edf9b700 1 -- 172.21.15.136:0/2261042588 >> v2:172.21.15.178:3300/0 conn(0x7fc9e80d0e30 msgr2=0x7fc9e80d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:39.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9edf9b700 1 --2- 172.21.15.136:0/2261042588 >> v2:172.21.15.178:3300/0 conn(0x7fc9e80d0e30 0x7fc9e80d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9edf9b700 1 -- 172.21.15.136:0/2261042588 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e80b5620 con 0x7fc9e80d0a60 2023-06-23T19:01:39.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9edf9b700 1 --2- 172.21.15.136:0/2261042588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80d0a60 0x7fc9e80b5a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80b24d0 tx=0x7fc9e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1176bf2d5027df38 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:39.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9ecf99700 1 -- 172.21.15.136:0/2261042588 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400b870 con 0x7fc9e80d0a60 2023-06-23T19:01:39.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9ecf99700 1 -- 172.21.15.136:0/2261042588 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e400b9d0 con 0x7fc9e80d0a60 2023-06-23T19:01:39.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.106+0000 7fc9ecf99700 1 -- 172.21.15.136:0/2261042588 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400bd60 con 0x7fc9e80d0a60 2023-06-23T19:01:39.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.107+0000 7fc9f01ff700 1 -- 172.21.15.136:0/2261042588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80d0a60 msgr2=0x7fc9e80b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.107+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/2261042588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80d0a60 0x7fc9e80b5a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80b24d0 tx=0x7fc9e4009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.107+0000 7fc9f01ff700 1 -- 172.21.15.136:0/2261042588 shutdown_connections 2023-06-23T19:01:39.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.107+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/2261042588 >> v2:172.21.15.178:3300/0 conn(0x7fc9e80d0e30 0x7fc9e80d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.107+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/2261042588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80d0a60 0x7fc9e80b5a70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.107+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/2261042588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80b51d0 0x7fc9e80cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.107+0000 7fc9f01ff700 1 -- 172.21.15.136:0/2261042588 >> 172.21.15.136:0/2261042588 conn(0x7fc9e8071620 msgr2=0x7fc9e80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:39.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.107+0000 7fc9f01ff700 1 -- 172.21.15.136:0/2261042588 shutdown_connections 2023-06-23T19:01:39.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.107+0000 7fc9f01ff700 1 -- 172.21.15.136:0/2261042588 wait complete. 2023-06-23T19:01:39.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.109+0000 7fc9f01ff700 1 Processor -- start 2023-06-23T19:01:39.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.109+0000 7fc9f01ff700 1 -- start start 2023-06-23T19:01:39.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.110+0000 7fc9f01ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80b51d0 0x7fc9e81f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.110+0000 7fc9f01ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80d0a60 0x7fc9e80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.110+0000 7fc9f01ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e80d0e30 0x7fc9e80cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.110+0000 7fc9f01ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8148940 con 0x7fc9e80b51d0 2023-06-23T19:01:39.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.110+0000 7fc9f01ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8148c20 con 0x7fc9e80d0e30 2023-06-23T19:01:39.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.110+0000 7fc9f01ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8148f00 con 0x7fc9e80d0a60 2023-06-23T19:01:39.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.110+0000 7fc9edf9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80b51d0 0x7fc9e81f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.110+0000 7fc9edf9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80b51d0 0x7fc9e81f1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46488/0 (socket says 172.21.15.136:46488) 2023-06-23T19:01:39.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.110+0000 7fc9edf9b700 1 -- 172.21.15.136:0/701416086 learned_addr learned my addr 172.21.15.136:0/701416086 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:39.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9ed79a700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80d0a60 0x7fc9e80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9edf9b700 1 -- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80d0a60 msgr2=0x7fc9e80cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9edf9b700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80d0a60 0x7fc9e80cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9ee79c700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e80d0e30 0x7fc9e80cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9edf9b700 1 -- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e80d0e30 msgr2=0x7fc9e80cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9edf9b700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e80d0e30 0x7fc9e80cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9edf9b700 1 -- 172.21.15.136:0/701416086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4009550 con 0x7fc9e80b51d0 2023-06-23T19:01:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9ed79a700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80d0a60 0x7fc9e80cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9ee79c700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e80d0e30 0x7fc9e80cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9edf9b700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80b51d0 0x7fc9e81f1200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4000c00 tx=0x7fc9e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9de7fc700 1 -- 172.21.15.136:0/701416086 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4004540 con 0x7fc9e80b51d0 2023-06-23T19:01:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9de7fc700 1 -- 172.21.15.136:0/701416086 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e40036a0 con 0x7fc9e80b51d0 2023-06-23T19:01:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e81491e0 con 0x7fc9e80b51d0 2023-06-23T19:01:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9de7fc700 1 -- 172.21.15.136:0/701416086 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4003a50 con 0x7fc9e80b51d0 2023-06-23T19:01:39.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.111+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e8149700 con 0x7fc9e80b51d0 2023-06-23T19:01:39.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.112+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e804ea20 con 0x7fc9e80b51d0 2023-06-23T19:01:39.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.113+0000 7fc9de7fc700 1 -- 172.21.15.136:0/701416086 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9e4021070 con 0x7fc9e80b51d0 2023-06-23T19:01:39.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.115+0000 7fc9de7fc700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc9cc06ace0 0x7fc9cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.115+0000 7fc9de7fc700 1 -- 172.21.15.136:0/701416086 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc9e408aeb0 con 0x7fc9e80b51d0 2023-06-23T19:01:39.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.115+0000 7fc9ed79a700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc9cc06ace0 0x7fc9cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.115+0000 7fc9ed79a700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc9cc06ace0 0x7fc9cc06d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc9e815bd70 tx=0x7fc9d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:39.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.119+0000 7fc9de7fc700 1 -- 172.21.15.136:0/701416086 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc9e4055c60 con 0x7fc9e80b51d0 2023-06-23T19:01:39.321 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.317+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9e80d1500 con 0x7fc9e80b51d0 2023-06-23T19:01:39.321 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.318+0000 7fc9de7fc700 1 -- 172.21.15.136:0/701416086 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9e4029020 con 0x7fc9e80b51d0 2023-06-23T19:01:39.322 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:01:39.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc9cc06ace0 msgr2=0x7fc9cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc9cc06ace0 0x7fc9cc06d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc9e815bd70 tx=0x7fc9d8008040 comp rx=0 tx=0).stop 2023-06-23T19:01:39.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80b51d0 msgr2=0x7fc9e81f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80b51d0 0x7fc9e81f1200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4000c00 tx=0x7fc9e4004750 comp rx=0 tx=0).stop 2023-06-23T19:01:39.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 shutdown_connections 2023-06-23T19:01:39.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc9cc06ace0 0x7fc9cc06d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e80d0e30 0x7fc9e80cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9e80b51d0 0x7fc9e81f1200 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 --2- 172.21.15.136:0/701416086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e80d0a60 0x7fc9e80cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 >> 172.21.15.136:0/701416086 conn(0x7fc9e8071620 msgr2=0x7fc9e80b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:39.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 shutdown_connections 2023-06-23T19:01:39.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.320+0000 7fc9f01ff700 1 -- 172.21.15.136:0/701416086 wait complete. 2023-06-23T19:01:39.342 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.535+0000 7f1d74fff700 1 Processor -- start 2023-06-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.535+0000 7f1d74fff700 1 -- start start 2023-06-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d74fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1d700b5a70 0x7f1d700b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d74fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d700cf910 0x7f1d700d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d74fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d700b5ec0 con 0x7f1d700d0a60 2023-06-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d74fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d700d0060 con 0x7f1d700b5a70 2023-06-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d74fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d700cd9d0 con 0x7f1d700cf910 2023-06-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d67fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1d700b5a70 0x7f1d700b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d67fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1d700b5a70 0x7f1d700b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46502/0 (socket says 172.21.15.136:46502) 2023-06-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d67fff700 1 -- 172.21.15.136:0/4119437890 learned_addr learned my addr 172.21.15.136:0/4119437890 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d6ed9d700 1 --2- 172.21.15.136:0/4119437890 >> v2:172.21.15.178:3300/0 conn(0x7f1d700cf910 0x7f1d700d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d67fff700 1 -- 172.21.15.136:0/4119437890 >> v2:172.21.15.178:3300/0 conn(0x7f1d700cf910 msgr2=0x7f1d700d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d67fff700 1 --2- 172.21.15.136:0/4119437890 >> v2:172.21.15.178:3300/0 conn(0x7f1d700cf910 0x7f1d700d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d67fff700 1 -- 172.21.15.136:0/4119437890 >> v1:172.21.15.178:6789/0 conn(0x7f1d700d0a60 legacy=0x7f1d700d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d67fff700 1 -- 172.21.15.136:0/4119437890 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700cd410 con 0x7f1d700b5a70 2023-06-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.537+0000 7f1d6ed9d700 1 --2- 172.21.15.136:0/4119437890 >> v2:172.21.15.178:3300/0 conn(0x7f1d700cf910 0x7f1d700d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.538+0000 7f1d67fff700 1 --2- 172.21.15.136:0/4119437890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700b5a70 0x7f1d700b51d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1d700b2610 tx=0x7f1d58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1000166aaf61c5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.538+0000 7f1d6dd9b700 1 -- 172.21.15.136:0/4119437890 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5800b870 con 0x7f1d700b5a70 2023-06-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.538+0000 7f1d6dd9b700 1 -- 172.21.15.136:0/4119437890 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5800b9d0 con 0x7f1d700b5a70 2023-06-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.538+0000 7f1d6dd9b700 1 -- 172.21.15.136:0/4119437890 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5800bd60 con 0x7f1d700b5a70 2023-06-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.538+0000 7f1d74fff700 1 -- 172.21.15.136:0/4119437890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700b5a70 msgr2=0x7f1d700b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.538+0000 7f1d74fff700 1 --2- 172.21.15.136:0/4119437890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700b5a70 0x7f1d700b51d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1d700b2610 tx=0x7f1d58009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.539+0000 7f1d74fff700 1 -- 172.21.15.136:0/4119437890 shutdown_connections 2023-06-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.539+0000 7f1d74fff700 1 --2- 172.21.15.136:0/4119437890 >> v2:172.21.15.178:3300/0 conn(0x7f1d700cf910 0x7f1d700d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.539+0000 7f1d74fff700 1 --2- 172.21.15.136:0/4119437890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700b5a70 0x7f1d700b51d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.539+0000 7f1d74fff700 1 -- 172.21.15.136:0/4119437890 >> 172.21.15.136:0/4119437890 conn(0x7f1d70071620 msgr2=0x7f1d700719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.539+0000 7f1d74fff700 1 -- 172.21.15.136:0/4119437890 shutdown_connections 2023-06-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.539+0000 7f1d74fff700 1 -- 172.21.15.136:0/4119437890 wait complete. 2023-06-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.540+0000 7f1d74fff700 1 Processor -- start 2023-06-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.540+0000 7f1d74fff700 1 -- start start 2023-06-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.541+0000 7f1d74fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700b5a70 0x7f1d701490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.541+0000 7f1d74fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700cf910 0x7f1d700c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.541+0000 7f1d74fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700d0a60 0x7f1d701f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.541+0000 7f1d74fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d701495f0 con 0x7f1d700cf910 2023-06-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.541+0000 7f1d74fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70158d70 con 0x7f1d700b5a70 2023-06-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.541+0000 7f1d74fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700c8260 con 0x7f1d700d0a60 2023-06-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d67fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700cf910 0x7f1d700c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d67fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700cf910 0x7f1d700c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46518/0 (socket says 172.21.15.136:46518) 2023-06-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d67fff700 1 -- 172.21.15.136:0/2294831060 learned_addr learned my addr 172.21.15.136:0/2294831060 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d6e59c700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700b5a70 0x7f1d701490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d6ed9d700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700d0a60 0x7f1d701f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d67fff700 1 -- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700d0a60 msgr2=0x7f1d701f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d67fff700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700d0a60 0x7f1d701f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d67fff700 1 -- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700b5a70 msgr2=0x7f1d701490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d67fff700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700b5a70 0x7f1d701490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d67fff700 1 -- 172.21.15.136:0/2294831060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58009550 con 0x7f1d700cf910 2023-06-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d6e59c700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700b5a70 0x7f1d701490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d6ed9d700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700d0a60 0x7f1d701f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d67fff700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700cf910 0x7f1d700c86f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009fd0 tx=0x7f1d58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d66ffd700 1 -- 172.21.15.136:0/2294831060 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58004310 con 0x7f1d700cf910 2023-06-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d66ffd700 1 -- 172.21.15.136:0/2294831060 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5801f070 con 0x7f1d700cf910 2023-06-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.542+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d700c7650 con 0x7f1d700cf910 2023-06-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.543+0000 7f1d66ffd700 1 -- 172.21.15.136:0/2294831060 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d580036a0 con 0x7f1d700cf910 2023-06-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.543+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d700c7c10 con 0x7f1d700cf910 2023-06-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.544+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7004ea20 con 0x7f1d700cf910 2023-06-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.544+0000 7f1d66ffd700 1 -- 172.21.15.136:0/2294831060 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d58021030 con 0x7f1d700cf910 2023-06-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.545+0000 7f1d66ffd700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1d5006ace0 0x7f1d5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.545+0000 7f1d66ffd700 1 -- 172.21.15.136:0/2294831060 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1d5808ab70 con 0x7f1d700cf910 2023-06-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.546+0000 7f1d6e59c700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1d5006ace0 0x7f1d5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.546+0000 7f1d6e59c700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1d5006ace0 0x7f1d5006d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1d60000f60 tx=0x7f1d60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.550+0000 7f1d66ffd700 1 -- 172.21.15.136:0/2294831060 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1d580559c0 con 0x7f1d700cf910 2023-06-23T19:01:39.750 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.746+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1d700d3a10 con 0x7f1d700cf910 2023-06-23T19:01:39.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.747+0000 7f1d66ffd700 1 -- 172.21.15.136:0/2294831060 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1d58015020 con 0x7f1d700cf910 2023-06-23T19:01:39.751 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:01:39.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1d5006ace0 msgr2=0x7f1d5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1d5006ace0 0x7f1d5006d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1d60000f60 tx=0x7f1d60009040 comp rx=0 tx=0).stop 2023-06-23T19:01:39.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700cf910 msgr2=0x7f1d700c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700cf910 0x7f1d700c86f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009fd0 tx=0x7f1d58004750 comp rx=0 tx=0).stop 2023-06-23T19:01:39.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 shutdown_connections 2023-06-23T19:01:39.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1d5006ace0 0x7f1d5006d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700b5a70 0x7f1d701490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700d0a60 0x7f1d701f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 --2- 172.21.15.136:0/2294831060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d700cf910 0x7f1d700c86f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 >> 172.21.15.136:0/2294831060 conn(0x7f1d70071620 msgr2=0x7f1d700b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:39.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 shutdown_connections 2023-06-23T19:01:39.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.749+0000 7f1d74fff700 1 -- 172.21.15.136:0/2294831060 wait complete. 2023-06-23T19:01:39.771 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:01:39.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.960+0000 7fc0fb7ff700 1 Processor -- start 2023-06-23T19:01:39.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.960+0000 7fc0fb7ff700 1 -- start start 2023-06-23T19:01:39.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.961+0000 7fc0fb7ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc0f415c570 0x7fc0f40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.961+0000 7fc0fb7ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f4160e70 con 0x7fc0f40cd660 2023-06-23T19:01:39.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.961+0000 7fc0fb7ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f41610a0 con 0x7fc0f4160a50 2023-06-23T19:01:39.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.961+0000 7fc0fb7ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f415d670 con 0x7fc0f415c570 2023-06-23T19:01:39.969 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0f8d9a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc0f40cd660 0x7fc0f4160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42204/0 (socket says 172.21.15.136:42204) 2023-06-23T19:01:39.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0f8d9a700 1 -- 172.21.15.136:0/2132935604 learned_addr learned my addr 172.21.15.136:0/2132935604 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:39.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0f959b700 1 --2- 172.21.15.136:0/2132935604 >> v2:172.21.15.178:3300/0 conn(0x7fc0f415c570 0x7fc0f40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483919571 0 0) 0x7fc0f4160e70 con 0x7fc0f40cd660 2023-06-23T19:01:39.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e00035b0 con 0x7fc0f40cd660 2023-06-23T19:01:39.970 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086677522 0 0) 0x7fc0f41610a0 con 0x7fc0f4160a50 2023-06-23T19:01:39.971 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f4160e70 con 0x7fc0f4160a50 2023-06-23T19:01:39.971 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3761309147 0 0) 0x7fc0e00035b0 con 0x7fc0f40cd660 2023-06-23T19:01:39.971 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 >> v2:172.21.15.178:3300/0 conn(0x7fc0f415c570 msgr2=0x7fc0f40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:39.971 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 --2- 172.21.15.136:0/2132935604 >> v2:172.21.15.178:3300/0 conn(0x7fc0f415c570 0x7fc0f40cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.972 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 >> v1:172.21.15.178:6789/0 conn(0x7fc0f4160a50 legacy=0x7fc0f40d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.972 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f415da90 con 0x7fc0f40cd660 2023-06-23T19:01:39.972 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.962+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fc0e4001670 con 0x7fc0f40cd660 2023-06-23T19:01:39.972 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 >> v1:172.21.15.136:6789/0 conn(0x7fc0f40cd660 legacy=0x7fc0f4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.972 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0ebfff700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0e0003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0ebfff700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0e0004850 0x7fc0e0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0ebfff700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0e0005200 0x7fc0e000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f415d670 con 0x7fc0e0003be0 2023-06-23T19:01:39.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e000c0e0 con 0x7fc0e0005200 2023-06-23T19:01:39.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e000c270 con 0x7fc0e0004850 2023-06-23T19:01:39.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f959b700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0e0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f8d9a700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0e0004850 0x7fc0e0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f9d9c700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0e0005200 0x7fc0e000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f959b700 1 -- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0e0004850 msgr2=0x7fc0e0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:39.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f959b700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0e0004850 0x7fc0e0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f959b700 1 -- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0e0005200 msgr2=0x7fc0e000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:39.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f959b700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0e0005200 0x7fc0e000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f959b700 1 -- 172.21.15.136:0/2132935604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00035b0 con 0x7fc0e0003be0 2023-06-23T19:01:39.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f8d9a700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0e0004850 0x7fc0e0004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:39.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f9d9c700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0e0005200 0x7fc0e000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:39.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.963+0000 7fc0f9d9c700 1 -- 172.21.15.136:0/2132935604 reap_dead start 2023-06-23T19:01:39.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0f959b700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0e0003fd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009b30 tx=0x7fc0e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f296ed455c88f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:39.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000e6c0 con 0x7fc0e0003be0 2023-06-23T19:01:39.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f000e820 con 0x7fc0e0003be0 2023-06-23T19:01:39.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0ebfff700 1 -- 172.21.15.136:0/2132935604 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000eb90 con 0x7fc0e0003be0 2023-06-23T19:01:39.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/2132935604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 msgr2=0x7fc0e0003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0fb7ff700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0e0003fd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009b30 tx=0x7fc0e0005880 comp rx=0 tx=0).stop 2023-06-23T19:01:39.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/2132935604 shutdown_connections 2023-06-23T19:01:39.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0fb7ff700 1 --2- 172.21.15.136:0/2132935604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0e0003fd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/2132935604 >> 172.21.15.136:0/2132935604 conn(0x7fc0f4071620 msgr2=0x7fc0f40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:39.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/2132935604 shutdown_connections 2023-06-23T19:01:39.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.964+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/2132935604 wait complete. 2023-06-23T19:01:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.966+0000 7fc0fb7ff700 1 Processor -- start 2023-06-23T19:01:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.966+0000 7fc0fb7ff700 1 -- start start 2023-06-23T19:01:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.967+0000 7fc0fb7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0f40c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.967+0000 7fc0fb7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0f414fd10 0x7fc0f40b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.967+0000 7fc0fb7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0f40b40a0 0x7fc0f40c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.967+0000 7fc0fb7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f40b7cc0 con 0x7fc0e0003be0 2023-06-23T19:01:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.967+0000 7fc0fb7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f40c77c0 con 0x7fc0f40b40a0 2023-06-23T19:01:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.967+0000 7fc0fb7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f40b4510 con 0x7fc0f414fd10 2023-06-23T19:01:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.967+0000 7fc0f959b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0f40c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.967+0000 7fc0f959b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0f40c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46530/0 (socket says 172.21.15.136:46530) 2023-06-23T19:01:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.967+0000 7fc0f959b700 1 -- 172.21.15.136:0/1630496958 learned_addr learned my addr 172.21.15.136:0/1630496958 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0f8d9a700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0f414fd10 0x7fc0f40b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0f9d9c700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0f40b40a0 0x7fc0f40c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0f959b700 1 -- 172.21.15.136:0/1630496958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0f414fd10 msgr2=0x7fc0f40b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0f959b700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0f414fd10 0x7fc0f40b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0f959b700 1 -- 172.21.15.136:0/1630496958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0f40b40a0 msgr2=0x7fc0f40c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0f959b700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0f40b40a0 0x7fc0f40c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0f959b700 1 -- 172.21.15.136:0/1630496958 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f40c9240 con 0x7fc0e0003be0 2023-06-23T19:01:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0f959b700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0f40c7280 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000efd0 tx=0x7fc0f00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0e9ffb700 1 -- 172.21.15.136:0/1630496958 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000e6c0 con 0x7fc0e0003be0 2023-06-23T19:01:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.968+0000 7fc0e9ffb700 1 -- 172.21.15.136:0/1630496958 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f00038c0 con 0x7fc0e0003be0 2023-06-23T19:01:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.969+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f40c67a0 con 0x7fc0e0003be0 2023-06-23T19:01:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.969+0000 7fc0e9ffb700 1 -- 172.21.15.136:0/1630496958 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0003c70 con 0x7fc0e0003be0 2023-06-23T19:01:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.969+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f40c6d60 con 0x7fc0e0003be0 2023-06-23T19:01:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.970+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f40c6600 con 0x7fc0e0003be0 2023-06-23T19:01:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.970+0000 7fc0e9ffb700 1 -- 172.21.15.136:0/1630496958 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc0f0013470 con 0x7fc0e0003be0 2023-06-23T19:01:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.971+0000 7fc0e9ffb700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0d806ace0 0x7fc0d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:39.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.971+0000 7fc0e9ffb700 1 -- 172.21.15.136:0/1630496958 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc0f008aea0 con 0x7fc0e0003be0 2023-06-23T19:01:39.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.972+0000 7fc0f8d9a700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0d806ace0 0x7fc0d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:39.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.972+0000 7fc0f8d9a700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0d806ace0 0x7fc0d806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40b4840 tx=0x7fc0e4007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:39.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:39.976+0000 7fc0e9ffb700 1 -- 172.21.15.136:0/1630496958 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc0f40c6600 con 0x7fc0e0003be0 2023-06-23T19:01:40.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.215+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0f415cf90 con 0x7fc0e0003be0 2023-06-23T19:01:40.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.216+0000 7fc0e9ffb700 1 -- 172.21.15.136:0/1630496958 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7fc0f415cf90 con 0x7fc0e0003be0 2023-06-23T19:01:40.220 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:40.220 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:31.031767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T19:01:40.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0d806ace0 msgr2=0x7fc0d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0d806ace0 0x7fc0d806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40b4840 tx=0x7fc0e4007040 comp rx=0 tx=0).stop 2023-06-23T19:01:40.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 msgr2=0x7fc0f40c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0f40c7280 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000efd0 tx=0x7fc0f00047c0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 shutdown_connections 2023-06-23T19:01:40.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc0d806ace0 0x7fc0d806d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0f40b40a0 0x7fc0f40c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0e0003be0 0x7fc0f40c7280 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 --2- 172.21.15.136:0/1630496958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0f414fd10 0x7fc0f40b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.218+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 >> 172.21.15.136:0/1630496958 conn(0x7fc0f4071620 msgr2=0x7fc0f40d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:40.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.219+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 shutdown_connections 2023-06-23T19:01:40.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.219+0000 7fc0fb7ff700 1 -- 172.21.15.136:0/1630496958 wait complete. 2023-06-23T19:01:40.226 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2023-06-23T19:01:40.240 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:40.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.433+0000 7eff21bff700 1 Processor -- start 2023-06-23T19:01:40.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.434+0000 7eff21bff700 1 -- start start 2023-06-23T19:01:40.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff21bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0cd830 0x7eff1c160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff21bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7eff1c160880 0x7eff1c0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff21bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c1610a0 con 0x7eff1c15c570 2023-06-23T19:01:40.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff21bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c15d670 con 0x7eff1c160880 2023-06-23T19:01:40.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff21bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c15da90 con 0x7eff1c0cd830 2023-06-23T19:01:40.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff1b7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7eff1c15c570 0x7eff1c0cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42212/0 (socket says 172.21.15.136:42212) 2023-06-23T19:01:40.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff1b7fe700 1 -- 172.21.15.136:0/2456626388 learned_addr learned my addr 172.21.15.136:0/2456626388 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:40.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff1bfff700 1 --2- 172.21.15.136:0/2456626388 >> v2:172.21.15.136:3300/0 conn(0x7eff1c160880 0x7eff1c0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff13fff700 1 --2- 172.21.15.136:0/2456626388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0cd830 0x7eff1c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.435+0000 7eff1affd700 1 -- 172.21.15.136:0/2456626388 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621146379 0 0) 0x7eff1c1610a0 con 0x7eff1c15c570 2023-06-23T19:01:40.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff1bfff700 1 -- 172.21.15.136:0/2456626388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0cd830 msgr2=0x7eff1c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:40.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff1bfff700 1 --2- 172.21.15.136:0/2456626388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0cd830 0x7eff1c160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff1bfff700 1 -- 172.21.15.136:0/2456626388 >> v1:172.21.15.136:6789/0 conn(0x7eff1c15c570 legacy=0x7eff1c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff1bfff700 1 -- 172.21.15.136:0/2456626388 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c15ccd0 con 0x7eff1c160880 2023-06-23T19:01:40.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff13fff700 1 --2- 172.21.15.136:0/2456626388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0cd830 0x7eff1c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:40.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff1bfff700 1 --2- 172.21.15.136:0/2456626388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 0x7eff1c0d0bb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff14009d90 tx=0x7eff1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a0932721bae8dd server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:40.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff1affd700 1 -- 172.21.15.136:0/2456626388 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400e070 con 0x7eff1c160880 2023-06-23T19:01:40.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff1affd700 1 -- 172.21.15.136:0/2456626388 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1400bbd0 con 0x7eff1c160880 2023-06-23T19:01:40.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff1affd700 1 -- 172.21.15.136:0/2456626388 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14012430 con 0x7eff1c160880 2023-06-23T19:01:40.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff21bff700 1 -- 172.21.15.136:0/2456626388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 msgr2=0x7eff1c0d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.436+0000 7eff21bff700 1 --2- 172.21.15.136:0/2456626388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 0x7eff1c0d0bb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff14009d90 tx=0x7eff1400b330 comp rx=0 tx=0).stop 2023-06-23T19:01:40.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.437+0000 7eff21bff700 1 -- 172.21.15.136:0/2456626388 shutdown_connections 2023-06-23T19:01:40.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.437+0000 7eff21bff700 1 --2- 172.21.15.136:0/2456626388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 0x7eff1c0d0bb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.437+0000 7eff21bff700 1 --2- 172.21.15.136:0/2456626388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0cd830 0x7eff1c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.437+0000 7eff21bff700 1 -- 172.21.15.136:0/2456626388 >> 172.21.15.136:0/2456626388 conn(0x7eff1c071620 msgr2=0x7eff1c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:40.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.437+0000 7eff21bff700 1 -- 172.21.15.136:0/2456626388 shutdown_connections 2023-06-23T19:01:40.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.437+0000 7eff21bff700 1 -- 172.21.15.136:0/2456626388 wait complete. 2023-06-23T19:01:40.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.438+0000 7eff21bff700 1 Processor -- start 2023-06-23T19:01:40.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.439+0000 7eff21bff700 1 -- start start 2023-06-23T19:01:40.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.439+0000 7eff21bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c0cd830 0x7eff1c1f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.439+0000 7eff21bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c15c570 0x7eff1c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.439+0000 7eff21bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 0x7eff1c0c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.439+0000 7eff21bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c14c660 con 0x7eff1c160880 2023-06-23T19:01:40.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.439+0000 7eff21bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1f62a0 con 0x7eff1c0cd830 2023-06-23T19:01:40.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.439+0000 7eff21bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0b5b70 con 0x7eff1c15c570 2023-06-23T19:01:40.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 0x7eff1c0c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 0x7eff1c0c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46552/0 (socket says 172.21.15.136:46552) 2023-06-23T19:01:40.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1bfff700 1 -- 172.21.15.136:0/1801923891 learned_addr learned my addr 172.21.15.136:0/1801923891 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:40.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff13fff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c15c570 0x7eff1c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1b7fe700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c0cd830 0x7eff1c1f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1bfff700 1 -- 172.21.15.136:0/1801923891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c15c570 msgr2=0x7eff1c0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1bfff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c15c570 0x7eff1c0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1bfff700 1 -- 172.21.15.136:0/1801923891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c0cd830 msgr2=0x7eff1c1f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1bfff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c0cd830 0x7eff1c1f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1bfff700 1 -- 172.21.15.136:0/1801923891 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14009a70 con 0x7eff1c160880 2023-06-23T19:01:40.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.440+0000 7eff1bfff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 0x7eff1c0c7640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7eff14012810 tx=0x7eff14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:40.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.441+0000 7eff18ff9700 1 -- 172.21.15.136:0/1801923891 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14012430 con 0x7eff1c160880 2023-06-23T19:01:40.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.441+0000 7eff18ff9700 1 -- 172.21.15.136:0/1801923891 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14020070 con 0x7eff1c160880 2023-06-23T19:01:40.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.441+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c1f5a00 con 0x7eff1c160880 2023-06-23T19:01:40.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.441+0000 7eff18ff9700 1 -- 172.21.15.136:0/1801923891 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14004280 con 0x7eff1c160880 2023-06-23T19:01:40.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.441+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c1f5fc0 con 0x7eff1c160880 2023-06-23T19:01:40.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.442+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c073910 con 0x7eff1c160880 2023-06-23T19:01:40.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.443+0000 7eff18ff9700 1 -- 172.21.15.136:0/1801923891 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff140043e0 con 0x7eff1c160880 2023-06-23T19:01:40.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.444+0000 7eff18ff9700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efefc06ace0 0x7efefc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.444+0000 7eff18ff9700 1 -- 172.21.15.136:0/1801923891 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7eff14022070 con 0x7eff1c160880 2023-06-23T19:01:40.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.444+0000 7eff1b7fe700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efefc06ace0 0x7efefc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.445+0000 7eff1b7fe700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efefc06ace0 0x7efefc06d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7eff0c000f60 tx=0x7eff0c007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:40.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.448+0000 7eff18ff9700 1 -- 172.21.15.136:0/1801923891 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff140566f0 con 0x7eff1c160880 2023-06-23T19:01:40.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.644+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff1c0b5cb0 con 0x7eff1c160880 2023-06-23T19:01:40.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.646+0000 7eff18ff9700 1 -- 172.21.15.136:0/1801923891 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20144 (secure 0 0 0) 0x7eff14059d10 con 0x7eff1c160880 2023-06-23T19:01:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:40.650 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":29,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:08.865205+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:40.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efefc06ace0 msgr2=0x7efefc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efefc06ace0 0x7efefc06d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7eff0c000f60 tx=0x7eff0c007c00 comp rx=0 tx=0).stop 2023-06-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 msgr2=0x7eff1c0c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 0x7eff1c0c7640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7eff14012810 tx=0x7eff14004ad0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 shutdown_connections 2023-06-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efefc06ace0 0x7efefc06d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c0cd830 0x7eff1c1f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff1c160880 0x7eff1c0c7640 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 --2- 172.21.15.136:0/1801923891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c15c570 0x7eff1c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 >> 172.21.15.136:0/1801923891 conn(0x7eff1c071620 msgr2=0x7eff1c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 shutdown_connections 2023-06-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.648+0000 7eff21bff700 1 -- 172.21.15.136:0/1801923891 wait complete. 2023-06-23T19:01:40.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:01:40.671 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:01:40.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.863+0000 7fd926fff700 1 Processor -- start 2023-06-23T19:01:40.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.864+0000 7fd926fff700 1 -- start start 2023-06-23T19:01:40.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd926fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd9200d0a60 0x7fd9200b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd926fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd926fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9200cd9d0 con 0x7fd9200d0e30 2023-06-23T19:01:40.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd926fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9200d0060 con 0x7fd9200d0a60 2023-06-23T19:01:40.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd926fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9200cfe50 con 0x7fd9200b51d0 2023-06-23T19:01:40.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd91ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd92559c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd9200d0e30 0x7fd9200d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:35434/0 (socket says 172.21.15.136:35434) 2023-06-23T19:01:40.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd91ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:42036/0 (socket says 172.21.15.136:42036) 2023-06-23T19:01:40.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd92559c700 1 -- 172.21.15.136:0/3667564086 learned_addr learned my addr 172.21.15.136:0/3667564086 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:40.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.865+0000 7fd924d9b700 1 --2- 172.21.15.136:0/3667564086 >> v2:172.21.15.178:3300/0 conn(0x7fd9200d0a60 0x7fd9200b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91f7fe700 1 -- 172.21.15.136:0/3667564086 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569991565 0 0) 0x7fd9200cd9d0 con 0x7fd9200d0e30 2023-06-23T19:01:40.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91f7fe700 1 -- 172.21.15.136:0/3667564086 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9100035b0 con 0x7fd9200d0e30 2023-06-23T19:01:40.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91ffff700 1 -- 172.21.15.136:0/3667564086 >> v2:172.21.15.178:3300/0 conn(0x7fd9200d0a60 msgr2=0x7fd9200b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:40.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91ffff700 1 --2- 172.21.15.136:0/3667564086 >> v2:172.21.15.178:3300/0 conn(0x7fd9200d0a60 0x7fd9200b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91ffff700 1 -- 172.21.15.136:0/3667564086 >> v1:172.21.15.178:6789/0 conn(0x7fd9200d0e30 legacy=0x7fd9200d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91ffff700 1 -- 172.21.15.136:0/3667564086 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9200b5620 con 0x7fd9200b51d0 2023-06-23T19:01:40.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd924d9b700 1 --2- 172.21.15.136:0/3667564086 >> v2:172.21.15.178:3300/0 conn(0x7fd9200d0a60 0x7fd9200b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:40.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91ffff700 1 --2- 172.21.15.136:0/3667564086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200cf910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009840 tx=0x7fd90c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c9537ee1ec1956a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:40.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91f7fe700 1 -- 172.21.15.136:0/3667564086 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c011830 con 0x7fd9200b51d0 2023-06-23T19:01:40.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91f7fe700 1 -- 172.21.15.136:0/3667564086 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c011990 con 0x7fd9200b51d0 2023-06-23T19:01:40.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.866+0000 7fd91f7fe700 1 -- 172.21.15.136:0/3667564086 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c011d20 con 0x7fd9200b51d0 2023-06-23T19:01:40.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.867+0000 7fd926fff700 1 -- 172.21.15.136:0/3667564086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 msgr2=0x7fd9200cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.867+0000 7fd926fff700 1 --2- 172.21.15.136:0/3667564086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200cf910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009840 tx=0x7fd90c009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:40.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.867+0000 7fd926fff700 1 -- 172.21.15.136:0/3667564086 shutdown_connections 2023-06-23T19:01:40.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.867+0000 7fd926fff700 1 --2- 172.21.15.136:0/3667564086 >> v2:172.21.15.178:3300/0 conn(0x7fd9200d0a60 0x7fd9200b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.867+0000 7fd926fff700 1 --2- 172.21.15.136:0/3667564086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200cf910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.867+0000 7fd926fff700 1 -- 172.21.15.136:0/3667564086 >> 172.21.15.136:0/3667564086 conn(0x7fd920071620 msgr2=0x7fd9200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:40.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.867+0000 7fd926fff700 1 -- 172.21.15.136:0/3667564086 shutdown_connections 2023-06-23T19:01:40.874 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.867+0000 7fd926fff700 1 -- 172.21.15.136:0/3667564086 wait complete. 2023-06-23T19:01:40.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.869+0000 7fd926fff700 1 Processor -- start 2023-06-23T19:01:40.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.870+0000 7fd926fff700 1 -- start start 2023-06-23T19:01:40.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd926fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd926fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9200d0a60 0x7fd920157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd926fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9200d0e30 0x7fd92015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd926fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd920159a90 con 0x7fd9200d0e30 2023-06-23T19:01:40.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd926fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9201f27b0 con 0x7fd9200d0a60 2023-06-23T19:01:40.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd926fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9201f2a90 con 0x7fd9200b51d0 2023-06-23T19:01:40.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd92559c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9200d0e30 0x7fd92015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd91ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9200d0a60 0x7fd920157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd924d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd92559c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9200d0e30 0x7fd92015a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46564/0 (socket says 172.21.15.136:46564) 2023-06-23T19:01:40.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd92559c700 1 -- 172.21.15.136:0/3877708409 learned_addr learned my addr 172.21.15.136:0/3877708409 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:40.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd92559c700 1 -- 172.21.15.136:0/3877708409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 msgr2=0x7fd9200c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd92559c700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd92559c700 1 -- 172.21.15.136:0/3877708409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9200d0a60 msgr2=0x7fd920157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:40.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd92559c700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9200d0a60 0x7fd920157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:40.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.871+0000 7fd92559c700 1 -- 172.21.15.136:0/3877708409 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140094a0 con 0x7fd9200d0e30 2023-06-23T19:01:40.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.872+0000 7fd92559c700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9200d0e30 0x7fd92015a450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd91800caa0 tx=0x7fd91800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:40.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.872+0000 7fd91d7fa700 1 -- 172.21.15.136:0/3877708409 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91800a9e0 con 0x7fd9200d0e30 2023-06-23T19:01:40.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.872+0000 7fd91d7fa700 1 -- 172.21.15.136:0/3877708409 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91800ab40 con 0x7fd9200d0e30 2023-06-23T19:01:40.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.872+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90c0094a0 con 0x7fd9200d0e30 2023-06-23T19:01:40.879 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.872+0000 7fd91d7fa700 1 -- 172.21.15.136:0/3877708409 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918012400 con 0x7fd9200d0e30 2023-06-23T19:01:40.879 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.872+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9200c6a90 con 0x7fd9200d0e30 2023-06-23T19:01:40.879 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.873+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9200ccb40 con 0x7fd9200d0e30 2023-06-23T19:01:40.879 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.874+0000 7fd91d7fa700 1 -- 172.21.15.136:0/3877708409 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd91801b3b0 con 0x7fd9200d0e30 2023-06-23T19:01:40.879 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.875+0000 7fd91d7fa700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd90406ace0 0x7fd90406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:40.880 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.875+0000 7fd91d7fa700 1 -- 172.21.15.136:0/3877708409 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd918089430 con 0x7fd9200d0e30 2023-06-23T19:01:40.880 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.875+0000 7fd924d9b700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd90406ace0 0x7fd90406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:40.880 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.876+0000 7fd924d9b700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd90406ace0 0x7fd90406d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9200cbf30 tx=0x7fd914009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:40.883 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:40.880+0000 7fd91d7fa700 1 -- 172.21.15.136:0/3877708409 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd918054210 con 0x7fd9200d0e30 2023-06-23T19:01:41.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.077+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd92004ea20 con 0x7fd9200d0e30 2023-06-23T19:01:41.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.078+0000 7fd91d7fa700 1 -- 172.21.15.136:0/3877708409 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd918057830 con 0x7fd9200d0e30 2023-06-23T19:01:41.082 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:01:41.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd90406ace0 msgr2=0x7fd90406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd90406ace0 0x7fd90406d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9200cbf30 tx=0x7fd914009210 comp rx=0 tx=0).stop 2023-06-23T19:01:41.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9200d0e30 msgr2=0x7fd92015a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9200d0e30 0x7fd92015a450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd91800caa0 tx=0x7fd91800cdb0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 shutdown_connections 2023-06-23T19:01:41.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd90406ace0 0x7fd90406d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9200d0e30 0x7fd92015a450 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9200b51d0 0x7fd9200c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 --2- 172.21.15.136:0/3877708409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9200d0a60 0x7fd920157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 >> 172.21.15.136:0/3877708409 conn(0x7fd920071620 msgr2=0x7fd9200b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:41.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 shutdown_connections 2023-06-23T19:01:41.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.080+0000 7fd926fff700 1 -- 172.21.15.136:0/3877708409 wait complete. 2023-06-23T19:01:41.103 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:01:41.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.295+0000 7f374e5ff700 1 Processor -- start 2023-06-23T19:01:41.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.295+0000 7f374e5ff700 1 -- start start 2023-06-23T19:01:41.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374e5ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37480b5a70 0x7f37480b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374e5ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f37480cf910 0x7f37480d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374e5ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37480b5ec0 con 0x7f37480d0a60 2023-06-23T19:01:41.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374e5ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37480d0060 con 0x7f37480cf910 2023-06-23T19:01:41.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374e5ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37480cd9d0 con 0x7f37480b5a70 2023-06-23T19:01:41.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374cb9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f37480cf910 0x7f37480d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374cb9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f37480cf910 0x7f37480d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46572/0 (socket says 172.21.15.136:46572) 2023-06-23T19:01:41.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374cb9c700 1 -- 172.21.15.136:0/383623389 learned_addr learned my addr 172.21.15.136:0/383623389 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:41.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f37477fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37480b5a70 0x7f37480b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.303 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374cb9c700 1 -- 172.21.15.136:0/383623389 >> v2:172.21.15.178:3300/0 conn(0x7f37480b5a70 msgr2=0x7f37480b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:41.303 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374cb9c700 1 --2- 172.21.15.136:0/383623389 >> v2:172.21.15.178:3300/0 conn(0x7f37480b5a70 0x7f37480b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.303 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374cb9c700 1 -- 172.21.15.136:0/383623389 >> v1:172.21.15.178:6789/0 conn(0x7f37480d0a60 legacy=0x7f37480d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f374cb9c700 1 -- 172.21.15.136:0/383623389 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480cd410 con 0x7f37480cf910 2023-06-23T19:01:41.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.297+0000 7f3746ffd700 1 -- 172.21.15.136:0/383623389 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805925627 0 0) 0x7f37480b5ec0 con 0x7f37480d0a60 2023-06-23T19:01:41.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.298+0000 7f374cb9c700 1 --2- 172.21.15.136:0/383623389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 0x7f37480d2e00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f37480d07a0 tx=0x7f374000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a3fb66e10ec4c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:41.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.298+0000 7f3746ffd700 1 -- 172.21.15.136:0/383623389 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000e070 con 0x7f37480cf910 2023-06-23T19:01:41.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.298+0000 7f3746ffd700 1 -- 172.21.15.136:0/383623389 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374000b910 con 0x7f37480cf910 2023-06-23T19:01:41.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.298+0000 7f3746ffd700 1 -- 172.21.15.136:0/383623389 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000bcc0 con 0x7f37480cf910 2023-06-23T19:01:41.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.298+0000 7f374e5ff700 1 -- 172.21.15.136:0/383623389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 msgr2=0x7f37480d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.298+0000 7f374e5ff700 1 --2- 172.21.15.136:0/383623389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 0x7f37480d2e00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f37480d07a0 tx=0x7f374000b330 comp rx=0 tx=0).stop 2023-06-23T19:01:41.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.299+0000 7f374e5ff700 1 -- 172.21.15.136:0/383623389 shutdown_connections 2023-06-23T19:01:41.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.299+0000 7f374e5ff700 1 --2- 172.21.15.136:0/383623389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 0x7f37480d2e00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.299+0000 7f374e5ff700 1 --2- 172.21.15.136:0/383623389 >> v2:172.21.15.178:3300/0 conn(0x7f37480b5a70 0x7f37480b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.299+0000 7f374e5ff700 1 -- 172.21.15.136:0/383623389 >> 172.21.15.136:0/383623389 conn(0x7f3748071620 msgr2=0x7f37480719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:41.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.299+0000 7f374e5ff700 1 -- 172.21.15.136:0/383623389 shutdown_connections 2023-06-23T19:01:41.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.299+0000 7f374e5ff700 1 -- 172.21.15.136:0/383623389 wait complete. 2023-06-23T19:01:41.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.301+0000 7f374e5ff700 1 Processor -- start 2023-06-23T19:01:41.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.301+0000 7f374e5ff700 1 -- start start 2023-06-23T19:01:41.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.302+0000 7f374e5ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37480b5a70 0x7f37480cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.302+0000 7f374e5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 0x7f37480c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.302+0000 7f374e5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37480d0a60 0x7f37480c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f374e5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37481e4ef0 con 0x7f37480cf910 2023-06-23T19:01:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f374e5ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37480ccb50 con 0x7f37480b5a70 2023-06-23T19:01:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f374e5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37481f1a40 con 0x7f37480d0a60 2023-06-23T19:01:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f37477fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 0x7f37480c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f37477fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 0x7f37480c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46582/0 (socket says 172.21.15.136:46582) 2023-06-23T19:01:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f37477fe700 1 -- 172.21.15.136:0/1098882993 learned_addr learned my addr 172.21.15.136:0/1098882993 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f37477fe700 1 -- 172.21.15.136:0/1098882993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37480d0a60 msgr2=0x7f37480c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f37477fe700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37480d0a60 0x7f37480c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f37477fe700 1 -- 172.21.15.136:0/1098882993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37480b5a70 msgr2=0x7f37480cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f37477fe700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37480b5a70 0x7f37480cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f37477fe700 1 -- 172.21.15.136:0/1098882993 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740009b30 con 0x7f37480cf910 2023-06-23T19:01:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f37477fe700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 0x7f37480c6710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f373c00e9b0 tx=0x7f373c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.303+0000 7f3744ff9700 1 -- 172.21.15.136:0/1098882993 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c009710 con 0x7f37480cf910 2023-06-23T19:01:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.304+0000 7f3744ff9700 1 -- 172.21.15.136:0/1098882993 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c00c850 con 0x7f37480cf910 2023-06-23T19:01:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.304+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37480c9370 con 0x7f37480cf910 2023-06-23T19:01:41.310 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.304+0000 7f3744ff9700 1 -- 172.21.15.136:0/1098882993 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c00cbc0 con 0x7f37480cf910 2023-06-23T19:01:41.310 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.304+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37480c9930 con 0x7f37480cf910 2023-06-23T19:01:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.305+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3748074140 con 0x7f37480cf910 2023-06-23T19:01:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.306+0000 7f3744ff9700 1 -- 172.21.15.136:0/1098882993 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f373c00cd20 con 0x7f37480cf910 2023-06-23T19:01:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.306+0000 7f3744ff9700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f373406ace0 0x7f373406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.307+0000 7f3744ff9700 1 -- 172.21.15.136:0/1098882993 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f373c0897f0 con 0x7f37480cf910 2023-06-23T19:01:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.307+0000 7f3747fff700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f373406ace0 0x7f373406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.307+0000 7f3747fff700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f373406ace0 0x7f373406d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3738001600 tx=0x7f37380079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:41.314 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.311+0000 7f3744ff9700 1 -- 172.21.15.136:0/1098882993 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f373c0580d0 con 0x7f37480cf910 2023-06-23T19:01:41.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.507+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f374804ea20 con 0x7f37480cf910 2023-06-23T19:01:41.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.507+0000 7f3744ff9700 1 -- 172.21.15.136:0/1098882993 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f373c057c60 con 0x7f37480cf910 2023-06-23T19:01:41.511 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:01:41.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f373406ace0 msgr2=0x7f373406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f373406ace0 0x7f373406d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3738001600 tx=0x7f37380079c0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 msgr2=0x7f37480c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 0x7f37480c6710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f373c00e9b0 tx=0x7f373c00ed70 comp rx=0 tx=0).stop 2023-06-23T19:01:41.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 shutdown_connections 2023-06-23T19:01:41.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f373406ace0 0x7f373406d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37480b5a70 0x7f37480cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37480d0a60 0x7f37480c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 --2- 172.21.15.136:0/1098882993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37480cf910 0x7f37480c6710 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 >> 172.21.15.136:0/1098882993 conn(0x7f3748071620 msgr2=0x7f37480b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:41.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 shutdown_connections 2023-06-23T19:01:41.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.509+0000 7f374e5ff700 1 -- 172.21.15.136:0/1098882993 wait complete. 2023-06-23T19:01:41.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:01:41.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.724+0000 7f8a5d9ff700 1 Processor -- start 2023-06-23T19:01:41.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.725+0000 7f8a5d9ff700 1 -- start start 2023-06-23T19:01:41.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a5d9ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a5815a5a0 0x7f8a580b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a5d9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 0x7f8a580702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a5d9ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5806d130 con 0x7f8a58070820 2023-06-23T19:01:41.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a5d9ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a580cf6a0 con 0x7f8a5815a5a0 2023-06-23T19:01:41.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a5d9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58070cc0 con 0x7f8a580b2b40 2023-06-23T19:01:41.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a56ffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a5815a5a0 0x7f8a580b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a56ffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a5815a5a0 0x7f8a580b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46590/0 (socket says 172.21.15.136:46590) 2023-06-23T19:01:41.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a56ffd700 1 -- 172.21.15.136:0/1885848009 learned_addr learned my addr 172.21.15.136:0/1885848009 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:41.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a567fc700 1 --2- 172.21.15.136:0/1885848009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 0x7f8a580702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a56ffd700 1 -- 172.21.15.136:0/1885848009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 msgr2=0x7f8a580702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:41.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a56ffd700 1 --2- 172.21.15.136:0/1885848009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 0x7f8a580702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.726+0000 7f8a56ffd700 1 -- 172.21.15.136:0/1885848009 >> v1:172.21.15.136:6789/0 conn(0x7f8a58070820 legacy=0x7f8a5806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.727+0000 7f8a56ffd700 1 -- 172.21.15.136:0/1885848009 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5806c520 con 0x7f8a5815a5a0 2023-06-23T19:01:41.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.727+0000 7f8a56ffd700 1 --2- 172.21.15.136:0/1885848009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a5815a5a0 0x7f8a580b4210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a480098f0 tx=0x7f8a48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b4b3d94a46bcd6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:41.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.727+0000 7f8a55ffb700 1 -- 172.21.15.136:0/1885848009 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4800b8a0 con 0x7f8a5815a5a0 2023-06-23T19:01:41.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.727+0000 7f8a55ffb700 1 -- 172.21.15.136:0/1885848009 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4800ba00 con 0x7f8a5815a5a0 2023-06-23T19:01:41.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.727+0000 7f8a55ffb700 1 -- 172.21.15.136:0/1885848009 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4800bd90 con 0x7f8a5815a5a0 2023-06-23T19:01:41.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.727+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/1885848009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a5815a5a0 msgr2=0x7f8a580b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.727+0000 7f8a5d9ff700 1 --2- 172.21.15.136:0/1885848009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a5815a5a0 0x7f8a580b4210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a480098f0 tx=0x7f8a48009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:41.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.728+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/1885848009 shutdown_connections 2023-06-23T19:01:41.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.728+0000 7f8a5d9ff700 1 --2- 172.21.15.136:0/1885848009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a5815a5a0 0x7f8a580b4210 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.728+0000 7f8a5d9ff700 1 --2- 172.21.15.136:0/1885848009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 0x7f8a580702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.728+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/1885848009 >> 172.21.15.136:0/1885848009 conn(0x7f8a5806ab80 msgr2=0x7f8a580ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:41.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.728+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/1885848009 shutdown_connections 2023-06-23T19:01:41.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.728+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/1885848009 wait complete. 2023-06-23T19:01:41.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.729+0000 7f8a5d9ff700 1 Processor -- start 2023-06-23T19:01:41.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.730+0000 7f8a5d9ff700 1 -- start start 2023-06-23T19:01:41.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.730+0000 7f8a5d9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a58070820 0x7f8a5815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.730+0000 7f8a5d9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 0x7f8a58151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.730+0000 7f8a5d9ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a5815a5a0 0x7f8a58152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.730+0000 7f8a5d9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c2d20 con 0x7f8a58070820 2023-06-23T19:01:41.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.730+0000 7f8a5d9ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c35c0 con 0x7f8a5815a5a0 2023-06-23T19:01:41.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.730+0000 7f8a5d9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58155a80 con 0x7f8a580b2b40 2023-06-23T19:01:41.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a56ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a58070820 0x7f8a5815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a56ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a58070820 0x7f8a5815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46606/0 (socket says 172.21.15.136:46606) 2023-06-23T19:01:41.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a56ffd700 1 -- 172.21.15.136:0/2399226914 learned_addr learned my addr 172.21.15.136:0/2399226914 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:41.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a567fc700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 0x7f8a58151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a577fe700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a5815a5a0 0x7f8a58152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a56ffd700 1 -- 172.21.15.136:0/2399226914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 msgr2=0x7f8a58151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a56ffd700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 0x7f8a58151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a56ffd700 1 -- 172.21.15.136:0/2399226914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a5815a5a0 msgr2=0x7f8a58152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a56ffd700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a5815a5a0 0x7f8a58152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a56ffd700 1 -- 172.21.15.136:0/2399226914 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a48009550 con 0x7f8a58070820 2023-06-23T19:01:41.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.731+0000 7f8a56ffd700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a58070820 0x7f8a5815b9c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009c40 tx=0x7f8a48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:41.739 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.732+0000 7f8a3ffff700 1 -- 172.21.15.136:0/2399226914 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48004380 con 0x7f8a58070820 2023-06-23T19:01:41.739 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.732+0000 7f8a3ffff700 1 -- 172.21.15.136:0/2399226914 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4801f070 con 0x7f8a58070820 2023-06-23T19:01:41.739 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.732+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a580c2f70 con 0x7f8a58070820 2023-06-23T19:01:41.739 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.732+0000 7f8a3ffff700 1 -- 172.21.15.136:0/2399226914 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480036a0 con 0x7f8a58070820 2023-06-23T19:01:41.739 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.732+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5815bf00 con 0x7f8a58070820 2023-06-23T19:01:41.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.733+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5804ea20 con 0x7f8a58070820 2023-06-23T19:01:41.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.734+0000 7f8a3ffff700 1 -- 172.21.15.136:0/2399226914 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a48021030 con 0x7f8a58070820 2023-06-23T19:01:41.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.734+0000 7f8a3ffff700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8a4406ace0 0x7f8a4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:41.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.735+0000 7f8a3ffff700 1 -- 172.21.15.136:0/2399226914 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8a4808ab40 con 0x7f8a58070820 2023-06-23T19:01:41.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.735+0000 7f8a567fc700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8a4406ace0 0x7f8a4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:41.741 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.735+0000 7f8a567fc700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8a4406ace0 0x7f8a4406d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c006b20 tx=0x7f8a4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:41.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.739+0000 7f8a3ffff700 1 -- 172.21.15.136:0/2399226914 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8a480558f0 con 0x7f8a58070820 2023-06-23T19:01:41.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.939+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a580c4fe0 con 0x7f8a58070820 2023-06-23T19:01:41.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.939+0000 7f8a3ffff700 1 -- 172.21.15.136:0/2399226914 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a48058f10 con 0x7f8a58070820 2023-06-23T19:01:41.943 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:01:41.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8a4406ace0 msgr2=0x7f8a4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8a4406ace0 0x7f8a4406d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c006b20 tx=0x7f8a4c008040 comp rx=0 tx=0).stop 2023-06-23T19:01:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a58070820 msgr2=0x7f8a5815b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a58070820 0x7f8a5815b9c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009c40 tx=0x7f8a48004750 comp rx=0 tx=0).stop 2023-06-23T19:01:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 shutdown_connections 2023-06-23T19:01:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8a4406ace0 0x7f8a4406d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a5815a5a0 0x7f8a58152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a58070820 0x7f8a5815b9c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 --2- 172.21.15.136:0/2399226914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580b2b40 0x7f8a58151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:41.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 >> 172.21.15.136:0/2399226914 conn(0x7f8a5806ab80 msgr2=0x7f8a580c77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:41.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 shutdown_connections 2023-06-23T19:01:41.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:41.942+0000 7f8a5d9ff700 1 -- 172.21.15.136:0/2399226914 wait complete. 2023-06-23T19:01:41.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:01:42.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.156+0000 7f5ea67ff700 1 Processor -- start 2023-06-23T19:01:42.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.157+0000 7f5ea67ff700 1 -- start start 2023-06-23T19:01:42.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea67ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5ea00b5a70 0x7f5ea00b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea67ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5ea00cf910 0x7f5ea00d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea67ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea00b5ec0 con 0x7f5ea00d0a60 2023-06-23T19:01:42.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea67ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea00d0060 con 0x7f5ea00cf910 2023-06-23T19:01:42.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea67ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea00cd9d0 con 0x7f5ea00b5a70 2023-06-23T19:01:42.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea4d9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5ea00cf910 0x7f5ea00d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5e9ffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5ea00d0a60 0x7f5ea00d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42234/0 (socket says 172.21.15.136:42234) 2023-06-23T19:01:42.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5e9ffff700 1 -- 172.21.15.136:0/4208802629 learned_addr learned my addr 172.21.15.136:0/4208802629 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:42.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5e97fff700 1 --2- 172.21.15.136:0/4208802629 >> v2:172.21.15.178:3300/0 conn(0x7f5ea00b5a70 0x7f5ea00b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea4d9c700 1 -- 172.21.15.136:0/4208802629 >> v2:172.21.15.178:3300/0 conn(0x7f5ea00b5a70 msgr2=0x7f5ea00b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:42.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea4d9c700 1 --2- 172.21.15.136:0/4208802629 >> v2:172.21.15.178:3300/0 conn(0x7f5ea00b5a70 0x7f5ea00b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea4d9c700 1 -- 172.21.15.136:0/4208802629 >> v1:172.21.15.136:6789/0 conn(0x7f5ea00d0a60 legacy=0x7f5ea00d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5ea4d9c700 1 -- 172.21.15.136:0/4208802629 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00cd410 con 0x7f5ea00cf910 2023-06-23T19:01:42.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.158+0000 7f5e9f7fe700 1 -- 172.21.15.136:0/4208802629 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322081212 0 0) 0x7f5ea00b5ec0 con 0x7f5ea00d0a60 2023-06-23T19:01:42.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.159+0000 7f5ea4d9c700 1 --2- 172.21.15.136:0/4208802629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00cf910 0x7f5ea00d2e00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00d07a0 tx=0x7f5e9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fa2b0628551c9a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:42.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.159+0000 7f5e9f7fe700 1 -- 172.21.15.136:0/4208802629 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800e070 con 0x7f5ea00cf910 2023-06-23T19:01:42.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.159+0000 7f5e9f7fe700 1 -- 172.21.15.136:0/4208802629 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9800bb20 con 0x7f5ea00cf910 2023-06-23T19:01:42.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.159+0000 7f5e9f7fe700 1 -- 172.21.15.136:0/4208802629 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e98012430 con 0x7f5ea00cf910 2023-06-23T19:01:42.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.159+0000 7f5ea67ff700 1 -- 172.21.15.136:0/4208802629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00cf910 msgr2=0x7f5ea00d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.159+0000 7f5ea67ff700 1 --2- 172.21.15.136:0/4208802629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00cf910 0x7f5ea00d2e00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00d07a0 tx=0x7f5e9800b330 comp rx=0 tx=0).stop 2023-06-23T19:01:42.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.160+0000 7f5ea67ff700 1 -- 172.21.15.136:0/4208802629 shutdown_connections 2023-06-23T19:01:42.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.160+0000 7f5ea67ff700 1 --2- 172.21.15.136:0/4208802629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00cf910 0x7f5ea00d2e00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.160+0000 7f5ea67ff700 1 --2- 172.21.15.136:0/4208802629 >> v2:172.21.15.178:3300/0 conn(0x7f5ea00b5a70 0x7f5ea00b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.160+0000 7f5ea67ff700 1 -- 172.21.15.136:0/4208802629 >> 172.21.15.136:0/4208802629 conn(0x7f5ea0071620 msgr2=0x7f5ea00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:42.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.160+0000 7f5ea67ff700 1 -- 172.21.15.136:0/4208802629 shutdown_connections 2023-06-23T19:01:42.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.160+0000 7f5ea67ff700 1 -- 172.21.15.136:0/4208802629 wait complete. 2023-06-23T19:01:42.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.161+0000 7f5ea67ff700 1 Processor -- start 2023-06-23T19:01:42.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.161+0000 7f5ea67ff700 1 -- start start 2023-06-23T19:01:42.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.162+0000 7f5ea67ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea00b5a70 0x7f5ea0148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.162+0000 7f5ea67ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea00cf910 0x7f5ea00ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.162+0000 7f5ea67ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00d0a60 0x7f5ea00c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.162+0000 7f5ea67ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea015c6d0 con 0x7f5ea00d0a60 2023-06-23T19:01:42.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.162+0000 7f5ea67ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea015bda0 con 0x7f5ea00b5a70 2023-06-23T19:01:42.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.162+0000 7f5ea67ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea015c080 con 0x7f5ea00cf910 2023-06-23T19:01:42.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5ea4d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00d0a60 0x7f5ea00c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5ea4d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00d0a60 0x7f5ea00c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46616/0 (socket says 172.21.15.136:46616) 2023-06-23T19:01:42.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5ea4d9c700 1 -- 172.21.15.136:0/540329752 learned_addr learned my addr 172.21.15.136:0/540329752 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:42.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5e9ffff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea00b5a70 0x7f5ea0148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5e97fff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea00cf910 0x7f5ea00ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5ea4d9c700 1 -- 172.21.15.136:0/540329752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea00cf910 msgr2=0x7f5ea00ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5ea4d9c700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea00cf910 0x7f5ea00ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5ea4d9c700 1 -- 172.21.15.136:0/540329752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea00b5a70 msgr2=0x7f5ea0148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5ea4d9c700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea00b5a70 0x7f5ea0148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5ea4d9c700 1 -- 172.21.15.136:0/540329752 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98009a70 con 0x7f5ea00d0a60 2023-06-23T19:01:42.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5ea4d9c700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00d0a60 0x7f5ea00c9140 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00d3d20 tx=0x7f5e98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:42.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.163+0000 7f5e9d7fa700 1 -- 172.21.15.136:0/540329752 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e98012430 con 0x7f5ea00d0a60 2023-06-23T19:01:42.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.164+0000 7f5e9d7fa700 1 -- 172.21.15.136:0/540329752 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e98020070 con 0x7f5ea00d0a60 2023-06-23T19:01:42.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.164+0000 7f5e9d7fa700 1 -- 172.21.15.136:0/540329752 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e98004280 con 0x7f5ea00d0a60 2023-06-23T19:01:42.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.164+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea015c360 con 0x7f5ea00d0a60 2023-06-23T19:01:42.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.164+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea0149300 con 0x7f5ea00d0a60 2023-06-23T19:01:42.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.165+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea004ea20 con 0x7f5ea00d0a60 2023-06-23T19:01:42.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.166+0000 7f5e9d7fa700 1 -- 172.21.15.136:0/540329752 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e980043e0 con 0x7f5ea00d0a60 2023-06-23T19:01:42.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.167+0000 7f5e9d7fa700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e8006ace0 0x7f5e8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.167+0000 7f5e9d7fa700 1 -- 172.21.15.136:0/540329752 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e98022070 con 0x7f5ea00d0a60 2023-06-23T19:01:42.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.167+0000 7f5e9ffff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e8006ace0 0x7f5e8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.167+0000 7f5e9ffff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e8006ace0 0x7f5e8006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e90000f60 tx=0x7f5e90007e70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:42.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.171+0000 7f5e9d7fa700 1 -- 172.21.15.136:0/540329752 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e98056190 con 0x7f5ea00d0a60 2023-06-23T19:01:42.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.370+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ea00b2a00 con 0x7f5ea00d0a60 2023-06-23T19:01:42.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.370+0000 7f5e9d7fa700 1 -- 172.21.15.136:0/540329752 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e980597b0 con 0x7f5ea00d0a60 2023-06-23T19:01:42.374 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:01:42.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e8006ace0 msgr2=0x7f5e8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e8006ace0 0x7f5e8006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e90000f60 tx=0x7f5e90007e70 comp rx=0 tx=0).stop 2023-06-23T19:01:42.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00d0a60 msgr2=0x7f5ea00c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00d0a60 0x7f5ea00c9140 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00d3d20 tx=0x7f5e98004ad0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 shutdown_connections 2023-06-23T19:01:42.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e8006ace0 0x7f5e8006d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea00b5a70 0x7f5ea0148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00d0a60 0x7f5ea00c9140 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 --2- 172.21.15.136:0/540329752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea00cf910 0x7f5ea00ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.372+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 >> 172.21.15.136:0/540329752 conn(0x7f5ea0071620 msgr2=0x7f5ea00d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:42.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.373+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 shutdown_connections 2023-06-23T19:01:42.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.373+0000 7f5ea67ff700 1 -- 172.21.15.136:0/540329752 wait complete. 2023-06-23T19:01:42.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:01:42.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.586+0000 7fe6157ff700 1 Processor -- start 2023-06-23T19:01:42.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.586+0000 7fe6157ff700 1 -- start start 2023-06-23T19:01:42.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.587+0000 7fe6157ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 0x7fe6100b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.587+0000 7fe6157ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6100cd9d0 con 0x7fe6100b51d0 2023-06-23T19:01:42.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.587+0000 7fe6157ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6100b5640 con 0x7fe6100cf910 2023-06-23T19:01:42.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.587+0000 7fe6157ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100d0060 con 0x7fe6100d0a60 2023-06-23T19:01:42.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.587+0000 7fe607fff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe6100b51d0 0x7fe6100d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42236/0 (socket says 172.21.15.136:42236) 2023-06-23T19:01:42.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.587+0000 7fe607fff700 1 -- 172.21.15.136:0/2679824882 learned_addr learned my addr 172.21.15.136:0/2679824882 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:42.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.587+0000 7fe60effd700 1 --2- 172.21.15.136:0/2679824882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 0x7fe6100b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60e7fc700 1 -- 172.21.15.136:0/2679824882 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935667811 0 0) 0x7fe6100cd9d0 con 0x7fe6100b51d0 2023-06-23T19:01:42.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60e7fc700 1 -- 172.21.15.136:0/2679824882 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5fc0035b0 con 0x7fe6100b51d0 2023-06-23T19:01:42.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60e7fc700 1 -- 172.21.15.136:0/2679824882 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820448725 0 0) 0x7fe6100b5640 con 0x7fe6100cf910 2023-06-23T19:01:42.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60e7fc700 1 -- 172.21.15.136:0/2679824882 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6100cd9d0 con 0x7fe6100cf910 2023-06-23T19:01:42.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60effd700 1 -- 172.21.15.136:0/2679824882 >> v1:172.21.15.178:6789/0 conn(0x7fe6100cf910 legacy=0x7fe6100d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60effd700 1 -- 172.21.15.136:0/2679824882 >> v1:172.21.15.136:6789/0 conn(0x7fe6100b51d0 legacy=0x7fe6100d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60effd700 1 -- 172.21.15.136:0/2679824882 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100cfd90 con 0x7fe6100d0a60 2023-06-23T19:01:42.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60effd700 1 --2- 172.21.15.136:0/2679824882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 0x7fe6100b5a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe600009870 tx=0x7fe600009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3827124eb9aa74bc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:42.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60e7fc700 1 -- 172.21.15.136:0/2679824882 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600011830 con 0x7fe6100d0a60 2023-06-23T19:01:42.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60e7fc700 1 -- 172.21.15.136:0/2679824882 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe600011990 con 0x7fe6100d0a60 2023-06-23T19:01:42.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.588+0000 7fe60e7fc700 1 -- 172.21.15.136:0/2679824882 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600011d20 con 0x7fe6100d0a60 2023-06-23T19:01:42.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.589+0000 7fe6157ff700 1 -- 172.21.15.136:0/2679824882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 msgr2=0x7fe6100b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.589+0000 7fe6157ff700 1 --2- 172.21.15.136:0/2679824882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 0x7fe6100b5a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe600009870 tx=0x7fe600009b80 comp rx=0 tx=0).stop 2023-06-23T19:01:42.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.589+0000 7fe6157ff700 1 -- 172.21.15.136:0/2679824882 shutdown_connections 2023-06-23T19:01:42.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.589+0000 7fe6157ff700 1 --2- 172.21.15.136:0/2679824882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 0x7fe6100b5a70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.589+0000 7fe6157ff700 1 -- 172.21.15.136:0/2679824882 >> 172.21.15.136:0/2679824882 conn(0x7fe610071620 msgr2=0x7fe6100719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:42.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.589+0000 7fe6157ff700 1 -- 172.21.15.136:0/2679824882 shutdown_connections 2023-06-23T19:01:42.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.589+0000 7fe6157ff700 1 -- 172.21.15.136:0/2679824882 wait complete. 2023-06-23T19:01:42.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.591+0000 7fe6157ff700 1 Processor -- start 2023-06-23T19:01:42.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.592+0000 7fe6157ff700 1 -- start start 2023-06-23T19:01:42.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe6157ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6100b51d0 0x7fe610159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe6157ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6100cf910 0x7fe6101507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe6157ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 0x7fe610154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe6157ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe610154980 con 0x7fe6100cf910 2023-06-23T19:01:42.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe6157ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61015f420 con 0x7fe6100b51d0 2023-06-23T19:01:42.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe6157ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe610153d00 con 0x7fe6100d0a60 2023-06-23T19:01:42.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe607fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6100cf910 0x7fe6101507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe607fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6100cf910 0x7fe6101507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46630/0 (socket says 172.21.15.136:46630) 2023-06-23T19:01:42.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe607fff700 1 -- 172.21.15.136:0/1742473363 learned_addr learned my addr 172.21.15.136:0/1742473363 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:42.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe60f7fe700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 0x7fe610154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe60effd700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6100b51d0 0x7fe610159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe607fff700 1 -- 172.21.15.136:0/1742473363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 msgr2=0x7fe610154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.593+0000 7fe607fff700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 0x7fe610154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.594+0000 7fe607fff700 1 -- 172.21.15.136:0/1742473363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6100b51d0 msgr2=0x7fe610159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.594+0000 7fe607fff700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6100b51d0 0x7fe610159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.594+0000 7fe607fff700 1 -- 172.21.15.136:0/1742473363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000094a0 con 0x7fe6100cf910 2023-06-23T19:01:42.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.594+0000 7fe607fff700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6100cf910 0x7fe6101507b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c700 tx=0x7fe5f800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:42.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.594+0000 7fe6077fe700 1 -- 172.21.15.136:0/1742473363 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8005d70 con 0x7fe6100cf910 2023-06-23T19:01:42.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.594+0000 7fe6077fe700 1 -- 172.21.15.136:0/1742473363 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80070d0 con 0x7fe6100cf910 2023-06-23T19:01:42.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.594+0000 7fe6077fe700 1 -- 172.21.15.136:0/1742473363 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8007460 con 0x7fe6100cf910 2023-06-23T19:01:42.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.594+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe610153fe0 con 0x7fe6100cf910 2023-06-23T19:01:42.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.594+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6101545a0 con 0x7fe6100cf910 2023-06-23T19:01:42.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.595+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe610154ac0 con 0x7fe6100cf910 2023-06-23T19:01:42.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.596+0000 7fe6077fe700 1 -- 172.21.15.136:0/1742473363 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5f80075c0 con 0x7fe6100cf910 2023-06-23T19:01:42.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.597+0000 7fe6077fe700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe5f006ace0 0x7fe5f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:42.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.598+0000 7fe6077fe700 1 -- 172.21.15.136:0/1742473363 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5f8088de0 con 0x7fe6100cf910 2023-06-23T19:01:42.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.598+0000 7fe60effd700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe5f006ace0 0x7fe5f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:42.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.598+0000 7fe60effd700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe5f006ace0 0x7fe5f006d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6000097c0 tx=0x7fe60001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:42.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.602+0000 7fe6077fe700 1 -- 172.21.15.136:0/1742473363 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe610154ac0 con 0x7fe6100cf910 2023-06-23T19:01:42.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.799+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe610154ac0 con 0x7fe6100cf910 2023-06-23T19:01:42.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.799+0000 7fe6077fe700 1 -- 172.21.15.136:0/1742473363 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe610154ac0 con 0x7fe6100cf910 2023-06-23T19:01:42.804 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:01:42.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.801+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe5f006ace0 msgr2=0x7fe5f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.801+0000 7fe6157ff700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe5f006ace0 0x7fe5f006d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6000097c0 tx=0x7fe60001c040 comp rx=0 tx=0).stop 2023-06-23T19:01:42.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.801+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6100cf910 msgr2=0x7fe6101507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:42.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.801+0000 7fe6157ff700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6100cf910 0x7fe6101507b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c700 tx=0x7fe5f800cac0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.802+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 shutdown_connections 2023-06-23T19:01:42.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.802+0000 7fe6157ff700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe5f006ace0 0x7fe5f006d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.802+0000 7fe6157ff700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6100b51d0 0x7fe610159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.802+0000 7fe6157ff700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6100d0a60 0x7fe610154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.802+0000 7fe6157ff700 1 --2- 172.21.15.136:0/1742473363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6100cf910 0x7fe6101507b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:42.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.802+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 >> 172.21.15.136:0/1742473363 conn(0x7fe610071620 msgr2=0x7fe6100ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:42.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.802+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 shutdown_connections 2023-06-23T19:01:42.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:42.802+0000 7fe6157ff700 1 -- 172.21.15.136:0/1742473363 wait complete. 2023-06-23T19:01:42.824 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:01:43.019 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.015+0000 7f8ce7bff700 1 Processor -- start 2023-06-23T19:01:43.020 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.016+0000 7f8ce7bff700 1 -- start start 2023-06-23T19:01:43.022 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.017+0000 7f8ce7bff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8ce015c2e0 0x7f8ce00ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.022 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.017+0000 7f8ce7bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce006ccc0 0x7f8ce015fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.017+0000 7f8ce7bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce00afdb0 con 0x7f8ce0160340 2023-06-23T19:01:43.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.017+0000 7f8ce7bff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce015c6b0 con 0x7f8ce015c2e0 2023-06-23T19:01:43.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.017+0000 7f8ce7bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00b0000 con 0x7f8ce006ccc0 2023-06-23T19:01:43.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.017+0000 7f8ce519a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce006ccc0 0x7f8ce015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.017+0000 7f8ce599b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8ce015c2e0 0x7f8ce00ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.023 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.017+0000 7f8ce619c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f8ce0160340 0x7f8ce00d0840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:35464/0 (socket says 172.21.15.136:35464) 2023-06-23T19:01:43.024 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.017+0000 7f8ce619c700 1 -- 172.21.15.136:0/1134547710 learned_addr learned my addr 172.21.15.136:0/1134547710 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:43.024 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.018+0000 7f8ce4999700 1 -- 172.21.15.136:0/1134547710 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696703376 0 0) 0x7f8ce00afdb0 con 0x7f8ce0160340 2023-06-23T19:01:43.024 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.018+0000 7f8ce4999700 1 -- 172.21.15.136:0/1134547710 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ccc0035b0 con 0x7f8ce0160340 2023-06-23T19:01:43.024 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.018+0000 7f8ce519a700 1 -- 172.21.15.136:0/1134547710 >> v2:172.21.15.178:3300/0 conn(0x7f8ce015c2e0 msgr2=0x7f8ce00ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:43.024 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.018+0000 7f8ce519a700 1 --2- 172.21.15.136:0/1134547710 >> v2:172.21.15.178:3300/0 conn(0x7f8ce015c2e0 0x7f8ce00ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.024 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.018+0000 7f8ce519a700 1 -- 172.21.15.136:0/1134547710 >> v1:172.21.15.178:6789/0 conn(0x7f8ce0160340 legacy=0x7f8ce00d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.024 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.018+0000 7f8ce519a700 1 -- 172.21.15.136:0/1134547710 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce006ba10 con 0x7f8ce006ccc0 2023-06-23T19:01:43.024 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.018+0000 7f8ce599b700 1 --2- 172.21.15.136:0/1134547710 >> v2:172.21.15.178:3300/0 conn(0x7f8ce015c2e0 0x7f8ce00ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:43.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.018+0000 7f8ce519a700 1 --2- 172.21.15.136:0/1134547710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce006ccc0 0x7f8ce015fe00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009840 tx=0x7f8cd0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1ee264d8c8d85f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:43.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.018+0000 7f8ce4999700 1 -- 172.21.15.136:0/1134547710 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0011830 con 0x7f8ce006ccc0 2023-06-23T19:01:43.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce4999700 1 -- 172.21.15.136:0/1134547710 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0011990 con 0x7f8ce006ccc0 2023-06-23T19:01:43.025 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce4999700 1 -- 172.21.15.136:0/1134547710 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0011d20 con 0x7f8ce006ccc0 2023-06-23T19:01:43.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce7bff700 1 -- 172.21.15.136:0/1134547710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce006ccc0 msgr2=0x7f8ce015fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce7bff700 1 --2- 172.21.15.136:0/1134547710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce006ccc0 0x7f8ce015fe00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009840 tx=0x7f8cd0009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:43.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce7bff700 1 -- 172.21.15.136:0/1134547710 shutdown_connections 2023-06-23T19:01:43.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce7bff700 1 --2- 172.21.15.136:0/1134547710 >> v2:172.21.15.178:3300/0 conn(0x7f8ce015c2e0 0x7f8ce00ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce7bff700 1 --2- 172.21.15.136:0/1134547710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce006ccc0 0x7f8ce015fe00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce7bff700 1 -- 172.21.15.136:0/1134547710 >> 172.21.15.136:0/1134547710 conn(0x7f8ce006e530 msgr2=0x7f8ce006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:43.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce7bff700 1 -- 172.21.15.136:0/1134547710 shutdown_connections 2023-06-23T19:01:43.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.019+0000 7f8ce7bff700 1 -- 172.21.15.136:0/1134547710 wait complete. 2023-06-23T19:01:43.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.021+0000 7f8ce7bff700 1 Processor -- start 2023-06-23T19:01:43.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.021+0000 7f8ce7bff700 1 -- start start 2023-06-23T19:01:43.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce7bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce006ccc0 0x7f8ce015b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce7bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce015c2e0 0x7f8ce00b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce7bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ce0160340 0x7f8ce00b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce7bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce015add0 con 0x7f8ce006ccc0 2023-06-23T19:01:43.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce7bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce015a150 con 0x7f8ce0160340 2023-06-23T19:01:43.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce7bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce015a430 con 0x7f8ce015c2e0 2023-06-23T19:01:43.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce599b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce006ccc0 0x7f8ce015b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce599b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce006ccc0 0x7f8ce015b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46640/0 (socket says 172.21.15.136:46640) 2023-06-23T19:01:43.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce599b700 1 -- 172.21.15.136:0/343037372 learned_addr learned my addr 172.21.15.136:0/343037372 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:43.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce519a700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce015c2e0 0x7f8ce00b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.031 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.022+0000 7f8ce619c700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ce0160340 0x7f8ce00b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8ce599b700 1 -- 172.21.15.136:0/343037372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce015c2e0 msgr2=0x7f8ce00b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8ce599b700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce015c2e0 0x7f8ce00b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.032 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8ce599b700 1 -- 172.21.15.136:0/343037372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ce0160340 msgr2=0x7f8ce00b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8ce599b700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ce0160340 0x7f8ce00b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8ce599b700 1 -- 172.21.15.136:0/343037372 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0094a0 con 0x7f8ce006ccc0 2023-06-23T19:01:43.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8ce519a700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce015c2e0 0x7f8ce00b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:43.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8ce599b700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce006ccc0 0x7f8ce015b1f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00ebe0 tx=0x7f8cdc009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:43.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8cd67fc700 1 -- 172.21.15.136:0/343037372 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc00c910 con 0x7f8ce006ccc0 2023-06-23T19:01:43.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8cd67fc700 1 -- 172.21.15.136:0/343037372 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc00ca70 con 0x7f8ce006ccc0 2023-06-23T19:01:43.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8cd67fc700 1 -- 172.21.15.136:0/343037372 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc00cde0 con 0x7f8ce006ccc0 2023-06-23T19:01:43.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd00094a0 con 0x7f8ce006ccc0 2023-06-23T19:01:43.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.023+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce015a9f0 con 0x7f8ce006ccc0 2023-06-23T19:01:43.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.024+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce0073910 con 0x7f8ce006ccc0 2023-06-23T19:01:43.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.025+0000 7f8cd67fc700 1 -- 172.21.15.136:0/343037372 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cdc013470 con 0x7f8ce006ccc0 2023-06-23T19:01:43.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.027+0000 7f8cd67fc700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8cc406ace0 0x7f8cc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.027+0000 7f8cd67fc700 1 -- 172.21.15.136:0/343037372 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8cdc089990 con 0x7f8ce006ccc0 2023-06-23T19:01:43.037 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.027+0000 7f8ce519a700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8cc406ace0 0x7f8cc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.037 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.028+0000 7f8ce519a700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8cc406ace0 0x7f8cc406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0000c00 tx=0x7f8cd001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:43.037 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.031+0000 7f8cd67fc700 1 -- 172.21.15.136:0/343037372 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8cdc054760 con 0x7f8ce006ccc0 2023-06-23T19:01:43.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.279+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce00cec70 con 0x7f8ce006ccc0 2023-06-23T19:01:43.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.279+0000 7f8cd67fc700 1 -- 172.21.15.136:0/343037372 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f8cdc057d80 con 0x7f8ce006ccc0 2023-06-23T19:01:43.283 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:43.284 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:31.031767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T19:01:43.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.281+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8cc406ace0 msgr2=0x7f8cc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.281+0000 7f8ce7bff700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8cc406ace0 0x7f8cc406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0000c00 tx=0x7f8cd001c040 comp rx=0 tx=0).stop 2023-06-23T19:01:43.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce006ccc0 msgr2=0x7f8ce015b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce006ccc0 0x7f8ce015b1f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00ebe0 tx=0x7f8cdc009ec0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 shutdown_connections 2023-06-23T19:01:43.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8cc406ace0 0x7f8cc406d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ce0160340 0x7f8ce00b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce006ccc0 0x7f8ce015b1f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 --2- 172.21.15.136:0/343037372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ce015c2e0 0x7f8ce00b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 >> 172.21.15.136:0/343037372 conn(0x7f8ce006e530 msgr2=0x7f8ce006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:43.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 shutdown_connections 2023-06-23T19:01:43.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.282+0000 7f8ce7bff700 1 -- 172.21.15.136:0/343037372 wait complete. 2023-06-23T19:01:43.287 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2023-06-23T19:01:43.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:43.496 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.493+0000 7f2fd89ff700 1 Processor -- start 2023-06-23T19:01:43.497 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.493+0000 7f2fd89ff700 1 -- start start 2023-06-23T19:01:43.498 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.494+0000 7f2fd89ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2fd40cd830 0x7f2fd4160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.498 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.494+0000 7f2fd89ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd41610a0 con 0x7f2fd415c570 2023-06-23T19:01:43.498 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.494+0000 7f2fd89ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd415da90 con 0x7f2fd4160880 2023-06-23T19:01:43.498 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.494+0000 7f2fd89ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd415d670 con 0x7f2fd40cd830 2023-06-23T19:01:43.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.494+0000 7f2fd1d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2fd40cd830 0x7f2fd4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.495+0000 7f2fd1d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2fd40cd830 0x7f2fd4160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46650/0 (socket says 172.21.15.136:46650) 2023-06-23T19:01:43.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.495+0000 7f2fd1d9b700 1 -- 172.21.15.136:0/2329507926 learned_addr learned my addr 172.21.15.136:0/2329507926 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:43.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.495+0000 7f2fd259c700 1 --1- 172.21.15.136:0/2329507926 >> v1:172.21.15.136:6789/0 conn(0x7f2fd415c570 0x7f2fd40cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42246/0 (socket says 172.21.15.136:42246) 2023-06-23T19:01:43.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.495+0000 7f2fd1d9b700 1 -- 172.21.15.136:0/2329507926 >> v1:172.21.15.178:6789/0 conn(0x7f2fd4160880 legacy=0x7f2fd40d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.495+0000 7f2fd1d9b700 1 -- 172.21.15.136:0/2329507926 >> v1:172.21.15.136:6789/0 conn(0x7f2fd415c570 legacy=0x7f2fd40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.495+0000 7f2fd1d9b700 1 -- 172.21.15.136:0/2329507926 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd415ccd0 con 0x7f2fd40cd830 2023-06-23T19:01:43.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.495+0000 7f2fd1d9b700 1 --2- 172.21.15.136:0/2329507926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd40cd830 0x7f2fd4160340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80098f0 tx=0x7f2fc8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401c6c181388cf4c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:43.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.495+0000 7f2fd159a700 1 -- 172.21.15.136:0/2329507926 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800b8a0 con 0x7f2fd40cd830 2023-06-23T19:01:43.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.496+0000 7f2fd159a700 1 -- 172.21.15.136:0/2329507926 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc800ba00 con 0x7f2fd40cd830 2023-06-23T19:01:43.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.496+0000 7f2fd159a700 1 -- 172.21.15.136:0/2329507926 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800bd90 con 0x7f2fd40cd830 2023-06-23T19:01:43.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.496+0000 7f2fd89ff700 1 -- 172.21.15.136:0/2329507926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd40cd830 msgr2=0x7f2fd4160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.496+0000 7f2fd89ff700 1 --2- 172.21.15.136:0/2329507926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd40cd830 0x7f2fd4160340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80098f0 tx=0x7f2fc8009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:43.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.496+0000 7f2fd89ff700 1 -- 172.21.15.136:0/2329507926 shutdown_connections 2023-06-23T19:01:43.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.496+0000 7f2fd89ff700 1 --2- 172.21.15.136:0/2329507926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd40cd830 0x7f2fd4160340 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.496+0000 7f2fd89ff700 1 -- 172.21.15.136:0/2329507926 >> 172.21.15.136:0/2329507926 conn(0x7f2fd4071620 msgr2=0x7f2fd40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:43.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.496+0000 7f2fd89ff700 1 -- 172.21.15.136:0/2329507926 shutdown_connections 2023-06-23T19:01:43.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.496+0000 7f2fd89ff700 1 -- 172.21.15.136:0/2329507926 wait complete. 2023-06-23T19:01:43.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.498+0000 7f2fd89ff700 1 Processor -- start 2023-06-23T19:01:43.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.498+0000 7f2fd89ff700 1 -- start start 2023-06-23T19:01:43.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd89ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd40cd830 0x7f2fd40b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd89ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd415c570 0x7f2fd4144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd89ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd4160880 0x7f2fd40cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd89ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd4144f40 con 0x7f2fd415c570 2023-06-23T19:01:43.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd89ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40b7a20 con 0x7f2fd4160880 2023-06-23T19:01:43.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd89ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40b7d00 con 0x7f2fd40cd830 2023-06-23T19:01:43.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd1d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd415c570 0x7f2fd4144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd1d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd415c570 0x7f2fd4144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46658/0 (socket says 172.21.15.136:46658) 2023-06-23T19:01:43.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd1d9b700 1 -- 172.21.15.136:0/543709184 learned_addr learned my addr 172.21.15.136:0/543709184 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:43.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd259c700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd40cd830 0x7f2fd40b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd2d9d700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd4160880 0x7f2fd40cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd1d9b700 1 -- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd40cd830 msgr2=0x7f2fd40b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd1d9b700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd40cd830 0x7f2fd40b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd1d9b700 1 -- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd4160880 msgr2=0x7f2fd40cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.499+0000 7f2fd1d9b700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd4160880 0x7f2fd40cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.500+0000 7f2fd1d9b700 1 -- 172.21.15.136:0/543709184 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc8009550 con 0x7f2fd415c570 2023-06-23T19:01:43.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.500+0000 7f2fd2d9d700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd4160880 0x7f2fd40cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:43.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.500+0000 7f2fd259c700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd40cd830 0x7f2fd40b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:43.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.500+0000 7f2fd1d9b700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd415c570 0x7f2fd4144a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8000c00 tx=0x7f2fc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:43.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.500+0000 7f2fc2ffd700 1 -- 172.21.15.136:0/543709184 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8004570 con 0x7f2fd415c570 2023-06-23T19:01:43.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.500+0000 7f2fc2ffd700 1 -- 172.21.15.136:0/543709184 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc801f070 con 0x7f2fd415c570 2023-06-23T19:01:43.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.500+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd40b7fe0 con 0x7f2fd415c570 2023-06-23T19:01:43.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.500+0000 7f2fc2ffd700 1 -- 172.21.15.136:0/543709184 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80038e0 con 0x7f2fd415c570 2023-06-23T19:01:43.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.500+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd40cc980 con 0x7f2fd415c570 2023-06-23T19:01:43.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.501+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd40b85f0 con 0x7f2fd415c570 2023-06-23T19:01:43.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.502+0000 7f2fc2ffd700 1 -- 172.21.15.136:0/543709184 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fc8021030 con 0x7f2fd415c570 2023-06-23T19:01:43.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.503+0000 7f2fc2ffd700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2fb406acb0 0x7f2fb406d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.503+0000 7f2fc2ffd700 1 -- 172.21.15.136:0/543709184 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2fc808acd0 con 0x7f2fd415c570 2023-06-23T19:01:43.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.503+0000 7f2fd259c700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2fb406acb0 0x7f2fb406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.504+0000 7f2fd259c700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2fb406acb0 0x7f2fb406d160 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000f60 tx=0x7f2fc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:43.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.507+0000 7f2fc2ffd700 1 -- 172.21.15.136:0/543709184 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fc8055a40 con 0x7f2fd415c570 2023-06-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.703+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fd404ea20 con 0x7f2fd415c570 2023-06-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.705+0000 7f2fc2ffd700 1 -- 172.21.15.136:0/543709184 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f2fc8059060 con 0x7f2fd415c570 2023-06-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":30,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:43.097024+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2fb406acb0 msgr2=0x7f2fb406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2fb406acb0 0x7f2fb406d160 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000f60 tx=0x7f2fc4009040 comp rx=0 tx=0).stop 2023-06-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd415c570 msgr2=0x7f2fd4144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd415c570 0x7f2fd4144a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8000c00 tx=0x7f2fc8004750 comp rx=0 tx=0).stop 2023-06-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 shutdown_connections 2023-06-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2fb406acb0 0x7f2fb406d160 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd4160880 0x7f2fd40cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd40cd830 0x7f2fd40b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 --2- 172.21.15.136:0/543709184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd415c570 0x7f2fd4144a00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 >> 172.21.15.136:0/543709184 conn(0x7f2fd4071620 msgr2=0x7f2fd40d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 shutdown_connections 2023-06-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.707+0000 7f2fd89ff700 1 -- 172.21.15.136:0/543709184 wait complete. 2023-06-23T19:01:43.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:01:43.927 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.923+0000 7f0cc759e700 1 Processor -- start 2023-06-23T19:01:43.927 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.924+0000 7f0cc759e700 1 -- start start 2023-06-23T19:01:43.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.925+0000 7f0cc759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc80d0500 0x7f0cc806cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.925+0000 7f0cc759e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc80cd470 con 0x7f0cc80b1dc0 2023-06-23T19:01:43.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.925+0000 7f0cc759e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc80d10a0 con 0x7f0cc80cfa50 2023-06-23T19:01:43.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.925+0000 7f0cc759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80b2190 con 0x7f0cc80d0500 2023-06-23T19:01:43.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.925+0000 7f0cc659c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0cc80b1dc0 0x7f0cc80cf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42262/0 (socket says 172.21.15.136:42262) 2023-06-23T19:01:43.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.925+0000 7f0cc659c700 1 -- 172.21.15.136:0/766779517 learned_addr learned my addr 172.21.15.136:0/766779517 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:43.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.925+0000 7f0cc6d9d700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc80d0500 0x7f0cc806cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.925+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711310477 0 0) 0x7f0cc80cd470 con 0x7f0cc80b1dc0 2023-06-23T19:01:43.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.925+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb00035b0 con 0x7f0cc80b1dc0 2023-06-23T19:01:43.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004010078 0 0) 0x7f0cc80d10a0 con 0x7f0cc80cfa50 2023-06-23T19:01:43.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc80cd470 con 0x7f0cc80cfa50 2023-06-23T19:01:43.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 171811710 0 0) 0x7f0cb00035b0 con 0x7f0cc80b1dc0 2023-06-23T19:01:43.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc80d0500 msgr2=0x7f0cc806cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:43.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc80d0500 0x7f0cc806cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 >> v1:172.21.15.178:6789/0 conn(0x7f0cc80cfa50 legacy=0x7f0cc80cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc80d0ae0 con 0x7f0cc80b1dc0 2023-06-23T19:01:43.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7f0cb80017f0 con 0x7f0cc80b1dc0 2023-06-23T19:01:43.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 >> v1:172.21.15.136:6789/0 conn(0x7f0cc80b1dc0 legacy=0x7f0cc80cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cb0003bc0 0x7f0cb0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cb0004850 0x7f0cb0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc80d0500 0x7f0cb0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80b2190 con 0x7f0cb0003bc0 2023-06-23T19:01:43.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb000bac0 con 0x7f0cb0004850 2023-06-23T19:01:43.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb000bc80 con 0x7f0cc80d0500 2023-06-23T19:01:43.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc659c700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cb0003bc0 0x7f0cb0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc6d9d700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc80d0500 0x7f0cb0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.926+0000 7f0cc5d9b700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cb0004850 0x7f0cb0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.927+0000 7f0cc659c700 1 -- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc80d0500 msgr2=0x7f0cb0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:43.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.927+0000 7f0cc659c700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc80d0500 0x7f0cb0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.927+0000 7f0cc659c700 1 -- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cb0004850 msgr2=0x7f0cb0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:43.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.927+0000 7f0cc659c700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cb0004850 0x7f0cb0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.927+0000 7f0cc659c700 1 -- 172.21.15.136:0/766779517 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00035b0 con 0x7f0cb0003bc0 2023-06-23T19:01:43.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.927+0000 7f0cc659c700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cb0003bc0 0x7f0cb0003fb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c0e0 tx=0x7f0cb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb5c5bb6ebcec89 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:43.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.927+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800cc80 con 0x7f0cb0003bc0 2023-06-23T19:01:43.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.927+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb800ce00 con 0x7f0cb0003bc0 2023-06-23T19:01:43.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.927+0000 7f0cc559a700 1 -- 172.21.15.136:0/766779517 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8007310 con 0x7f0cb0003bc0 2023-06-23T19:01:43.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.928+0000 7f0cc759e700 1 -- 172.21.15.136:0/766779517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cb0003bc0 msgr2=0x7f0cb0003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.928+0000 7f0cc759e700 1 --2- 172.21.15.136:0/766779517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cb0003bc0 0x7f0cb0003fb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c0e0 tx=0x7f0cb0005880 comp rx=0 tx=0).stop 2023-06-23T19:01:43.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.928+0000 7f0cc6d9d700 1 -- 172.21.15.136:0/766779517 reap_dead start 2023-06-23T19:01:43.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.928+0000 7f0cc759e700 1 -- 172.21.15.136:0/766779517 shutdown_connections 2023-06-23T19:01:43.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.928+0000 7f0cc759e700 1 -- 172.21.15.136:0/766779517 >> 172.21.15.136:0/766779517 conn(0x7f0cc809bbf0 msgr2=0x7f0cc80d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:43.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.928+0000 7f0cc759e700 1 -- 172.21.15.136:0/766779517 shutdown_connections 2023-06-23T19:01:43.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.928+0000 7f0cc759e700 1 -- 172.21.15.136:0/766779517 wait complete. 2023-06-23T19:01:43.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.929+0000 7f0cc759e700 1 Processor -- start 2023-06-23T19:01:43.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.930+0000 7f0cc759e700 1 -- start start 2023-06-23T19:01:43.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.930+0000 7f0cc759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cb0003bc0 0x7f0cc81f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.930+0000 7f0cc759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc815d9c0 0x7f0cc815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.930+0000 7f0cc759e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc815e480 0x7f0cc815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc759e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc81f28c0 con 0x7f0cc815e480 2023-06-23T19:01:43.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc815c100 con 0x7f0cc815d9c0 2023-06-23T19:01:43.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc815d530 con 0x7f0cb0003bc0 2023-06-23T19:01:43.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc6d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc815e480 0x7f0cc815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc6d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc815e480 0x7f0cc815ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46674/0 (socket says 172.21.15.136:46674) 2023-06-23T19:01:43.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc6d9d700 1 -- 172.21.15.136:0/991503999 learned_addr learned my addr 172.21.15.136:0/991503999 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:43.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc5d9b700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc815d9c0 0x7f0cc815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc659c700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cb0003bc0 0x7f0cc81f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc6d9d700 1 -- 172.21.15.136:0/991503999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cb0003bc0 msgr2=0x7f0cc81f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc6d9d700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cb0003bc0 0x7f0cc81f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc6d9d700 1 -- 172.21.15.136:0/991503999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc815d9c0 msgr2=0x7f0cc815bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:43.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc6d9d700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc815d9c0 0x7f0cc815bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:43.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc6d9d700 1 -- 172.21.15.136:0/991503999 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc815c920 con 0x7f0cc815e480 2023-06-23T19:01:43.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.931+0000 7f0cc6d9d700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc815e480 0x7f0cc815ed80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80b54e0 tx=0x7f0cc000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:43.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.932+0000 7f0cb6ffd700 1 -- 172.21.15.136:0/991503999 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000e040 con 0x7f0cc815e480 2023-06-23T19:01:43.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.932+0000 7f0cb6ffd700 1 -- 172.21.15.136:0/991503999 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc000f040 con 0x7f0cc815e480 2023-06-23T19:01:43.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.932+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc815cc00 con 0x7f0cc815e480 2023-06-23T19:01:43.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.932+0000 7f0cb6ffd700 1 -- 172.21.15.136:0/991503999 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0015430 con 0x7f0cc815e480 2023-06-23T19:01:43.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.932+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc815d1c0 con 0x7f0cc815e480 2023-06-23T19:01:43.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.933+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc815d6c0 con 0x7f0cc815e480 2023-06-23T19:01:43.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.934+0000 7f0cb6ffd700 1 -- 172.21.15.136:0/991503999 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cc00155b0 con 0x7f0cc815e480 2023-06-23T19:01:43.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.934+0000 7f0cb6ffd700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0ca806ace0 0x7f0ca806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:43.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.935+0000 7f0cb6ffd700 1 -- 172.21.15.136:0/991503999 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0cc0089e50 con 0x7f0cc815e480 2023-06-23T19:01:43.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.935+0000 7f0cc659c700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0ca806ace0 0x7f0ca806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:43.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.935+0000 7f0cc659c700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0ca806ace0 0x7f0ca806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8000c00 tx=0x7f0cb8007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:43.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:43.939+0000 7f0cb6ffd700 1 -- 172.21.15.136:0/991503999 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0cc0054b30 con 0x7f0cc815e480 2023-06-23T19:01:44.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.184+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cc804ea20 con 0x7f0cc815e480 2023-06-23T19:01:44.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.185+0000 7f0cb6ffd700 1 -- 172.21.15.136:0/991503999 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f0cc0058150 con 0x7f0cc815e480 2023-06-23T19:01:44.189 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:44.189 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:31.031767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T19:01:44.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.187+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0ca806ace0 msgr2=0x7f0ca806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.187+0000 7f0cc759e700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0ca806ace0 0x7f0ca806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8000c00 tx=0x7f0cb8007000 comp rx=0 tx=0).stop 2023-06-23T19:01:44.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.187+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc815e480 msgr2=0x7f0cc815ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.187+0000 7f0cc759e700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc815e480 0x7f0cc815ed80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80b54e0 tx=0x7f0cc000f490 comp rx=0 tx=0).stop 2023-06-23T19:01:44.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.188+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 shutdown_connections 2023-06-23T19:01:44.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.188+0000 7f0cc759e700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0ca806ace0 0x7f0ca806d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.188+0000 7f0cc759e700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc815e480 0x7f0cc815ed80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.188+0000 7f0cc759e700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cb0003bc0 0x7f0cc81f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.188+0000 7f0cc759e700 1 --2- 172.21.15.136:0/991503999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc815d9c0 0x7f0cc815bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.188+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 >> 172.21.15.136:0/991503999 conn(0x7f0cc809bbf0 msgr2=0x7f0cc80cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:44.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.188+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 shutdown_connections 2023-06-23T19:01:44.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.188+0000 7f0cc759e700 1 -- 172.21.15.136:0/991503999 wait complete. 2023-06-23T19:01:44.193 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2023-06-23T19:01:44.612 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-23T19:01:04.348357+0000', 'modified': '2023-06-23T19:01:31.031767+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/329757975', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 329757975}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 329757975}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-23T19:01:44.613 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-23T19:01:44.614 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-23T19:01:44.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.806+0000 7f0d5d1ff700 1 Processor -- start 2023-06-23T19:01:44.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.806+0000 7f0d5d1ff700 1 -- start start 2023-06-23T19:01:44.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.807+0000 7f0d5d1ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0d58160a50 0x7f0d581674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.807+0000 7f0d5d1ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d58160e70 con 0x7f0d580cd830 2023-06-23T19:01:44.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.807+0000 7f0d5d1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d581610a0 con 0x7f0d5815c570 2023-06-23T19:01:44.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.807+0000 7f0d5d1ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5815d670 con 0x7f0d58160a50 2023-06-23T19:01:44.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.807+0000 7f0d5759e700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0d58160a50 0x7f0d581674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.807+0000 7f0d4ffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0d580cd830 0x7f0d58160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:42270/0 (socket says 172.21.15.136:42270) 2023-06-23T19:01:44.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.807+0000 7f0d4ffff700 1 -- 172.21.15.136:0/3650174539 learned_addr learned my addr 172.21.15.136:0/3650174539 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:44.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.808+0000 7f0d5759e700 1 -- 172.21.15.136:0/3650174539 >> v1:172.21.15.178:6789/0 conn(0x7f0d5815c570 legacy=0x7f0d580cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.808+0000 7f0d5759e700 1 -- 172.21.15.136:0/3650174539 >> v1:172.21.15.136:6789/0 conn(0x7f0d580cd830 legacy=0x7f0d58160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.808+0000 7f0d5759e700 1 -- 172.21.15.136:0/3650174539 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5815da90 con 0x7f0d58160a50 2023-06-23T19:01:44.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.808+0000 7f0d5759e700 1 --2- 172.21.15.136:0/3650174539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d58160a50 0x7f0d581674d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009d90 tx=0x7f0d5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce79eb9412de1f5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:44.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.808+0000 7f0d5659c700 1 -- 172.21.15.136:0/3650174539 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000e070 con 0x7f0d58160a50 2023-06-23T19:01:44.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.808+0000 7f0d5659c700 1 -- 172.21.15.136:0/3650174539 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5000bbd0 con 0x7f0d58160a50 2023-06-23T19:01:44.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.808+0000 7f0d5659c700 1 -- 172.21.15.136:0/3650174539 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50012430 con 0x7f0d58160a50 2023-06-23T19:01:44.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.809+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/3650174539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d58160a50 msgr2=0x7f0d581674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.809+0000 7f0d5d1ff700 1 --2- 172.21.15.136:0/3650174539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d58160a50 0x7f0d581674d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009d90 tx=0x7f0d5000b330 comp rx=0 tx=0).stop 2023-06-23T19:01:44.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.809+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/3650174539 shutdown_connections 2023-06-23T19:01:44.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.809+0000 7f0d5d1ff700 1 --2- 172.21.15.136:0/3650174539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d58160a50 0x7f0d581674d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.809+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/3650174539 >> 172.21.15.136:0/3650174539 conn(0x7f0d58071620 msgr2=0x7f0d580719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:44.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.809+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/3650174539 shutdown_connections 2023-06-23T19:01:44.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.809+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/3650174539 wait complete. 2023-06-23T19:01:44.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.811+0000 7f0d5d1ff700 1 Processor -- start 2023-06-23T19:01:44.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.811+0000 7f0d5d1ff700 1 -- start start 2023-06-23T19:01:44.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d5d1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d580cd830 0x7f0d580d1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d5d1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d5815c570 0x7f0d580b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d5d1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d58160a50 0x7f0d580b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d5d1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58155e20 con 0x7f0d580cd830 2023-06-23T19:01:44.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d5d1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580b8480 con 0x7f0d58160a50 2023-06-23T19:01:44.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d5d1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58156680 con 0x7f0d5815c570 2023-06-23T19:01:44.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d56d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d580cd830 0x7f0d580d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d56d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d580cd830 0x7f0d580d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46688/0 (socket says 172.21.15.136:46688) 2023-06-23T19:01:44.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d56d9d700 1 -- 172.21.15.136:0/590820100 learned_addr learned my addr 172.21.15.136:0/590820100 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:44.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d5759e700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d58160a50 0x7f0d580b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d5815c570 0x7f0d580b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d56d9d700 1 -- 172.21.15.136:0/590820100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d5815c570 msgr2=0x7f0d580b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d5815c570 0x7f0d580b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d56d9d700 1 -- 172.21.15.136:0/590820100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d58160a50 msgr2=0x7f0d580b7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d58160a50 0x7f0d580b7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.812+0000 7f0d56d9d700 1 -- 172.21.15.136:0/590820100 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50009a70 con 0x7f0d580cd830 2023-06-23T19:01:44.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.813+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d580cd830 0x7f0d580d1630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c4e0 tx=0x7f0d4800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:44.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.813+0000 7f0d4f7fe700 1 -- 172.21.15.136:0/590820100 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480052d0 con 0x7f0d580cd830 2023-06-23T19:01:44.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.813+0000 7f0d4f7fe700 1 -- 172.21.15.136:0/590820100 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48005430 con 0x7f0d580cd830 2023-06-23T19:01:44.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.813+0000 7f0d4f7fe700 1 -- 172.21.15.136:0/590820100 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480038c0 con 0x7f0d580cd830 2023-06-23T19:01:44.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.813+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/590820100 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d580b86c0 con 0x7f0d580cd830 2023-06-23T19:01:44.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.813+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/590820100 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d58156310 con 0x7f0d580cd830 2023-06-23T19:01:44.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.815+0000 7f0d4f7fe700 1 -- 172.21.15.136:0/590820100 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d48003a20 con 0x7f0d580cd830 2023-06-23T19:01:44.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.816+0000 7f0d4f7fe700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0d3806ace0 0x7f0d3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.816+0000 7f0d4f7fe700 1 -- 172.21.15.136:0/590820100 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d48088cf0 con 0x7f0d580cd830 2023-06-23T19:01:44.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.816+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0d3806ace0 0x7f0d3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.817+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0d3806ace0 0x7f0d3806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d581f5a50 tx=0x7f0d40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:44.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.818+0000 7f0d70ae1b80 1 Processor -- start 2023-06-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.818+0000 7f0d70ae1b80 1 -- start start 2023-06-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 0x5593fe69c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe5a0c60 con 0x5593fe6c3d80 2023-06-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe5f39f0 con 0x5593fe699740 2023-06-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fe5ece80 con 0x5593fe69bf50 2023-06-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d4ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d4ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46696/0 (socket says 172.21.15.136:46696) 2023-06-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d56d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 0x5593fe69c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d4ffff700 1 -- 172.21.15.136:0/2901223846 learned_addr learned my addr 172.21.15.136:0/2901223846 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.819+0000 7f0d5759e700 1 --2- 172.21.15.136:0/2901223846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.820+0000 7f0d4ffff700 1 -- 172.21.15.136:0/2901223846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 msgr2=0x5593fe69c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.820+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/2901223846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 0x5593fe69c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.820+0000 7f0d4ffff700 1 -- 172.21.15.136:0/2901223846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 msgr2=0x5593fe6c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.820+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/2901223846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.820+0000 7f0d4ffff700 1 -- 172.21.15.136:0/2901223846 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593fe46e5e0 con 0x5593fe6c3d80 2023-06-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.820+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/2901223846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c2820 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d40005b30 tx=0x7f0d40011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddf73a3fac5c04b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.820+0000 7f0d4cff9700 1 -- 172.21.15.136:0/2901223846 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40005e40 con 0x5593fe6c3d80 2023-06-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.820+0000 7f0d4cff9700 1 -- 172.21.15.136:0/2901223846 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40007770 con 0x5593fe6c3d80 2023-06-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.820+0000 7f0d4cff9700 1 -- 172.21.15.136:0/2901223846 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40021650 con 0x5593fe6c3d80 2023-06-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.821+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/2901223846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 msgr2=0x5593fe6c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.821+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/2901223846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c2820 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d40005b30 tx=0x7f0d40011000 comp rx=0 tx=0).stop 2023-06-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.821+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/2901223846 shutdown_connections 2023-06-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.821+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/2901223846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.821+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/2901223846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 0x5593fe69c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.821+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/2901223846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c2820 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.821+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/2901223846 >> 172.21.15.136:0/2901223846 conn(0x5593fe690fc0 msgr2=0x5593fe6e11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.821+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/2901223846 shutdown_connections 2023-06-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.821+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/2901223846 wait complete. 2023-06-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.822+0000 7f0d70ae1b80 1 -- start start 2023-06-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.822+0000 7f0d70ae1b80 1 Processor -- start 2023-06-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6e2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe69bf50 0x5593fe699b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 0x5593fe69a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe58ca70 con 0x5593fe69bf50 2023-06-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe58c770 con 0x5593fe699740 2023-06-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fe4708d0 con 0x5593fe6c3d80 2023-06-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d70ae1b80 10 client.0 _ll_register_callbacks cb 0x5593fe592210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d4ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe69bf50 0x5593fe699b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d4ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe69bf50 0x5593fe699b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:36748/0 (socket says 172.21.15.136:36748) 2023-06-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d4ffff700 1 -- 172.21.15.136:0/726427053 learned_addr learned my addr 172.21.15.136:0/726427053 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d5759e700 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 0x5593fe69a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.824+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6e2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d4ffff700 1 -- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 msgr2=0x5593fe69a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 0x5593fe69a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d4ffff700 1 -- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 msgr2=0x5593fe6e2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6e2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d4ffff700 1 -- 172.21.15.136:0/726427053 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4000f040 con 0x5593fe69bf50 2023-06-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe69bf50 0x5593fe699b70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d40014000 tx=0x7f0d40000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517f9de65cb1f253 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-06-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d35ffb700 1 -- 172.21.15.136:0/726427053 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40027070 con 0x5593fe69bf50 2023-06-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/726427053 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593fe68e780 con 0x5593fe69bf50 2023-06-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d35ffb700 1 -- 172.21.15.136:0/726427053 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d40005e40 con 0x5593fe69bf50 2023-06-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d35ffb700 1 -- 172.21.15.136:0/726427053 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d400229a0 con 0x5593fe69bf50 2023-06-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d70ae1b80 10 client.4821 fetch_fsmap learned FSMap version 9 2023-06-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.825+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/726427053 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5593fe41ad90 con 0x5593fe69bf50 2023-06-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.826+0000 7f0d35ffb700 1 -- 172.21.15.136:0/726427053 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5593fe68e780 con 0x5593fe69bf50 2023-06-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.826+0000 7f0d35ffb700 1 -- 172.21.15.136:0/726427053 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0d40022b00 con 0x5593fe69bf50 2023-06-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.826+0000 7f0d70ae1b80 10 client.4821 fetch_fsmap finished waiting for FSMap version 9 2023-06-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.826+0000 7f0d70ae1b80 10 client.4821 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.826+0000 7f0d70ae1b80 20 client.4821 populate_metadata read hostname 'smithi136' 2023-06-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.826+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x5593fe6deea0 0x5593fe6df270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.826+0000 7f0d70ae1b80 4 client.4821 mds_command: new command op to 4296 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.826+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/726427053 --> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5593fe5e5e60 con 0x5593fe6deea0 2023-06-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.826+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x5593fe6deea0 0x5593fe6df270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.827+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x5593fe6deea0 0x5593fe6df270 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb868f4af03c9068 server_cookie=6a42942f491497d3 in_seq=0 out_seq=0 2023-06-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.827+0000 7f0d35ffb700 10 client.4821 ms_handle_connect on v2:172.21.15.178:6834/329757975 2023-06-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.827+0000 7f0d35ffb700 1 -- 172.21.15.136:0/726427053 <== mds.0 v2:172.21.15.178:6834/329757975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5593fe5e5e60 con 0x5593fe6deea0 2023-06-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.827+0000 7f0d35ffb700 10 client.4821 handle_command_reply: tid=0 2023-06-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 client.4821 shutdown 2023-06-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/726427053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe69bf50 msgr2=0x5593fe699b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe69bf50 0x5593fe699b70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d40014000 tx=0x7f0d40000ed0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/726427053 shutdown_connections 2023-06-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x5593fe6deea0 0x5593fe6df270 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6e2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 0x5593fe69a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/726427053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe69bf50 0x5593fe699b70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/726427053 >> 172.21.15.136:0/726427053 conn(0x5593fe690fc0 msgr2=0x5593fe6e1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d35ffb700 0 client.4821 ms_handle_reset on v2:172.21.15.178:6834/329757975 2023-06-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/726427053 shutdown_connections 2023-06-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/726427053 wait complete. 2023-06-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.828+0000 7f0d70ae1b80 20 client.4821 trim_cache size 0 max 16384 2023-06-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.846+0000 7f0d70ae1b80 1 Processor -- start 2023-06-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.846+0000 7f0d70ae1b80 1 -- start start 2023-06-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.847+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6f9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.847+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 0x5593fe6c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.847+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.847+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe6e4a10 con 0x5593fe6c3d80 2023-06-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.847+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe6ca2d0 con 0x5593fe699740 2023-06-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.847+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fe699420 con 0x5593fe69bf50 2023-06-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.847+0000 7f0d5759e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.847+0000 7f0d5759e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:36760/0 (socket says 172.21.15.136:36760) 2023-06-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.847+0000 7f0d5759e700 1 -- 172.21.15.136:0/3458273943 learned_addr learned my addr 172.21.15.136:0/3458273943 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6f9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d5759e700 1 -- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 msgr2=0x5593fe6c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 0x5593fe6c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d5759e700 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 0x5593fe6c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d5759e700 1 -- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 msgr2=0x5593fe6f9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d5759e700 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6f9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d5759e700 1 -- 172.21.15.136:0/3458273943 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593fe403c10 con 0x5593fe6c3d80 2023-06-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6f9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 0x5593fe6c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d5759e700 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c32a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000d010 tx=0x7f0d50011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3c3b4f59c43bc4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d4d7fa700 1 -- 172.21.15.136:0/3458273943 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5002c070 con 0x5593fe6c3d80 2023-06-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d4d7fa700 1 -- 172.21.15.136:0/3458273943 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d500125e0 con 0x5593fe6c3d80 2023-06-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.848+0000 7f0d4d7fa700 1 -- 172.21.15.136:0/3458273943 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50021040 con 0x5593fe6c3d80 2023-06-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.849+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/3458273943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 msgr2=0x5593fe6c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.849+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c32a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000d010 tx=0x7f0d50011000 comp rx=0 tx=0).stop 2023-06-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.849+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/3458273943 shutdown_connections 2023-06-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.849+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe699740 0x5593fe6f9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.849+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe6c3d80 0x5593fe6c32a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.849+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/3458273943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe69bf50 0x5593fe6c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.849+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/3458273943 >> 172.21.15.136:0/3458273943 conn(0x5593fe690fc0 msgr2=0x5593fe6dab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.849+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/3458273943 shutdown_connections 2023-06-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.849+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/3458273943 wait complete. 2023-06-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.850+0000 7f0d70ae1b80 1 -- start start 2023-06-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.850+0000 7f0d70ae1b80 1 Processor -- start 2023-06-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe699740 0x5593fe747330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe69bf50 0x5593fe69a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d70ae1b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 0x5593fe6f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe747db0 con 0x5593fe699740 2023-06-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe6dd4c0 con 0x5593fe69bf50 2023-06-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d70ae1b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fe6c5d90 con 0x5593fe6c3d80 2023-06-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d70ae1b80 10 client.0 _ll_register_callbacks cb 0x7f0d50009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d56d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe699740 0x5593fe747330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d56d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe699740 0x5593fe747330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:36776/0 (socket says 172.21.15.136:36776) 2023-06-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d56d9d700 1 -- 172.21.15.136:0/1299492059 learned_addr learned my addr 172.21.15.136:0/1299492059 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d5759e700 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 0x5593fe6f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe69bf50 0x5593fe69a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d56d9d700 1 -- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 msgr2=0x5593fe6f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 0x5593fe6f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d56d9d700 1 -- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe69bf50 msgr2=0x5593fe69a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe69bf50 0x5593fe69a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d56d9d700 1 -- 172.21.15.136:0/1299492059 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5815da90 con 0x5593fe699740 2023-06-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe69bf50 0x5593fe69a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d56d9d700 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe699740 0x5593fe747330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0d48053b90 tx=0x7f0d480539d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749f901a5cdef708 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.851+0000 7f0d35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-06-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d35ffb700 1 -- 172.21.15.136:0/1299492059 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48055af0 con 0x5593fe699740 2023-06-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d35ffb700 1 -- 172.21.15.136:0/1299492059 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d48053480 con 0x5593fe699740 2023-06-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/1299492059 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d40007770 con 0x5593fe699740 2023-06-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d35ffb700 1 -- 172.21.15.136:0/1299492059 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d48053640 con 0x5593fe699740 2023-06-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d70ae1b80 10 client.4827 fetch_fsmap learned FSMap version 9 2023-06-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/1299492059 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5593fe441200 con 0x5593fe699740 2023-06-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d35ffb700 1 -- 172.21.15.136:0/1299492059 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40007770 con 0x5593fe699740 2023-06-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d35ffb700 1 -- 172.21.15.136:0/1299492059 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0d480565f0 con 0x5593fe699740 2023-06-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d70ae1b80 10 client.4827 fetch_fsmap finished waiting for FSMap version 9 2023-06-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d70ae1b80 10 client.4827 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d70ae1b80 20 client.4827 populate_metadata read hostname 'smithi136' 2023-06-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x5593fe6c2d60 0x5593fe6c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d70ae1b80 4 client.4827 mds_command: new command op to 4296 tid=0[{"prefix": "status"}] 2023-06-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/1299492059 --> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5593fe5a8000 con 0x5593fe6c2d60 2023-06-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.852+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x5593fe6c2d60 0x5593fe6c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d4ffff700 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x5593fe6c2d60 0x5593fe6c3130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=439b5724087fe85a server_cookie=9dadc9c4027e0bf0 in_seq=0 out_seq=0 2023-06-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d35ffb700 10 client.4827 ms_handle_connect on v2:172.21.15.178:6834/329757975 2023-06-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d35ffb700 1 -- 172.21.15.136:0/1299492059 <== mds.0 v2:172.21.15.178:6834/329757975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5593fe5a8000 con 0x5593fe6c2d60 2023-06-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d35ffb700 10 client.4827 handle_command_reply: tid=0 2023-06-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d70ae1b80 1 client.4827 shutdown 2023-06-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/1299492059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe699740 msgr2=0x5593fe747330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe699740 0x5593fe747330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0d48053b90 tx=0x7f0d480539d0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/1299492059 shutdown_connections 2023-06-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:6834/329757975,v1:172.21.15.178:6835/329757975] conn(0x5593fe6c2d60 0x5593fe6c3130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593fe6c3d80 0x5593fe6f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5593fe699740 0x5593fe747330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d70ae1b80 1 --2- 172.21.15.136:0/1299492059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593fe69bf50 0x5593fe69a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.853+0000 7f0d35ffb700 0 client.4827 ms_handle_reset on v2:172.21.15.178:6834/329757975 2023-06-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/1299492059 >> 172.21.15.136:0/1299492059 conn(0x5593fe690fc0 msgr2=0x5593fe6dad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/1299492059 shutdown_connections 2023-06-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d70ae1b80 1 -- 172.21.15.136:0/1299492059 wait complete. 2023-06-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d70ae1b80 20 client.4827 trim_cache size 0 max 16384 2023-06-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2023-06-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "ad363bec-53b9-481a-9d11-1e4839eb0e65", 2023-06-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 0, 2023-06-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4296, 2023-06-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2023-06-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2023-06-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2023-06-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 40.503344122999998, 2023-06-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 9, 2023-06-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 31, 2023-06-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 29, 2023-06-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 46.629020844999999 2023-06-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi136.stdout:} 2023-06-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0d3806ace0 msgr2=0x7f0d3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0d3806ace0 0x7f0d3806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d581f5a50 tx=0x7f0d40009040 comp rx=0 tx=0).stop 2023-06-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d580cd830 msgr2=0x7f0d580d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d580cd830 0x7f0d580d1630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c4e0 tx=0x7f0d4800c7f0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/590820100 shutdown_connections 2023-06-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f0d3806ace0 0x7f0d3806d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d58160a50 0x7f0d580b7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d580cd830 0x7f0d580d1630 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 --2- 172.21.15.136:0/590820100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d5815c570 0x7f0d580b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.854+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/590820100 >> 172.21.15.136:0/590820100 conn(0x7f0d58071620 msgr2=0x7f0d5815f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.855+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/590820100 shutdown_connections 2023-06-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:44.855+0000 7f0d5d1ff700 1 -- 172.21.15.136:0/590820100 wait complete. 2023-06-23T19:01:44.876 INFO:teuthology.run_tasks:Running task kclient... 2023-06-23T19:01:44.889 INFO:tasks.kclient:Mounting kernel clients... 2023-06-23T19:01:44.889 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-23T19:01:44.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:44.890 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-06-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-06-23T19:01:44.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:44.935 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-23T19:01:45.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:45.042 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2023-06-23T19:01:45.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:45.154 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-06-23T19:01:45.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:45.202 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2023-06-23T19:01:45.273 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2023-06-23T19:01:45.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T19:01:45.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:45.277 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-06-23T19:01:45.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:45.326 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2023-06-23T19:01:45.401 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2023-06-23T19:01:45.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T19:01:45.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:45.405 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-06-23T19:01:45.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:45.449 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2023-06-23T19:01:45.558 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2023-06-23T19:01:45.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T19:01:45.561 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-06-23T19:01:45.562 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T19:01:45.562 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-23T19:01:45.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T19:01:45.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.755+0000 7f19c05ff700 1 Processor -- start 2023-06-23T19:01:45.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.755+0000 7f19c05ff700 1 -- start start 2023-06-23T19:01:45.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19c05ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8158550 0x7f19b806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:45.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19c05ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f19b806d5a0 0x7f19b8069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:45.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19c05ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19b806a430 0x7f19b80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:45.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19c05ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b80c8ce0 con 0x7f19b806d5a0 2023-06-23T19:01:45.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19c05ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b806e190 con 0x7f19b806a430 2023-06-23T19:01:45.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19c05ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b806a870 con 0x7f19b8158550 2023-06-23T19:01:45.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19bdb9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f19b806d5a0 0x7f19b8069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:45.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19beb9c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19b806a430 0x7f19b80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:45.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19be39b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8158550 0x7f19b806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:45.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19bdb9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f19b806d5a0 0x7f19b8069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:36780/0 (socket says 172.21.15.136:36780) 2023-06-23T19:01:45.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.756+0000 7f19bdb9a700 1 -- 172.21.15.136:0/1761785758 learned_addr learned my addr 172.21.15.136:0/1761785758 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:45.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19bdb9a700 1 -- 172.21.15.136:0/1761785758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8158550 msgr2=0x7f19b806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:45.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19bdb9a700 1 --2- 172.21.15.136:0/1761785758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8158550 0x7f19b806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:45.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19bdb9a700 1 -- 172.21.15.136:0/1761785758 >> v2:172.21.15.178:3300/0 conn(0x7f19b806a430 msgr2=0x7f19b80702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:45.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19bdb9a700 1 --2- 172.21.15.136:0/1761785758 >> v2:172.21.15.178:3300/0 conn(0x7f19b806a430 0x7f19b80702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:45.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19bdb9a700 1 -- 172.21.15.136:0/1761785758 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80ccdc0 con 0x7f19b806d5a0 2023-06-23T19:01:45.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19beb9c700 1 --2- 172.21.15.136:0/1761785758 >> v2:172.21.15.178:3300/0 conn(0x7f19b806a430 0x7f19b80702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:45.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19bdb9a700 1 --2- 172.21.15.136:0/1761785758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b806d5a0 0x7f19b8069ef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f19b80ce5a0 tx=0x7f19a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c5a6de99886d9a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:45.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19bd399700 1 -- 172.21.15.136:0/1761785758 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8011830 con 0x7f19b806d5a0 2023-06-23T19:01:45.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19bd399700 1 -- 172.21.15.136:0/1761785758 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8011990 con 0x7f19b806d5a0 2023-06-23T19:01:45.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.757+0000 7f19bd399700 1 -- 172.21.15.136:0/1761785758 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8011d20 con 0x7f19b806d5a0 2023-06-23T19:01:45.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.758+0000 7f19c05ff700 1 -- 172.21.15.136:0/1761785758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b806d5a0 msgr2=0x7f19b8069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:45.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.758+0000 7f19c05ff700 1 --2- 172.21.15.136:0/1761785758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b806d5a0 0x7f19b8069ef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f19b80ce5a0 tx=0x7f19a8009bd0 comp rx=0 tx=0).stop 2023-06-23T19:01:45.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.758+0000 7f19c05ff700 1 -- 172.21.15.136:0/1761785758 shutdown_connections 2023-06-23T19:01:45.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.758+0000 7f19c05ff700 1 --2- 172.21.15.136:0/1761785758 >> v2:172.21.15.178:3300/0 conn(0x7f19b806a430 0x7f19b80702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:45.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.758+0000 7f19c05ff700 1 --2- 172.21.15.136:0/1761785758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8158550 0x7f19b806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:45.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.758+0000 7f19c05ff700 1 --2- 172.21.15.136:0/1761785758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b806d5a0 0x7f19b8069ef0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:45.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.758+0000 7f19c05ff700 1 -- 172.21.15.136:0/1761785758 >> 172.21.15.136:0/1761785758 conn(0x7f19b80b0ef0 msgr2=0x7f19b80ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:45.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.758+0000 7f19c05ff700 1 -- 172.21.15.136:0/1761785758 shutdown_connections 2023-06-23T19:01:45.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.758+0000 7f19c05ff700 1 -- 172.21.15.136:0/1761785758 wait complete. 2023-06-23T19:01:45.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.760+0000 7f19c05ff700 1 Processor -- start 2023-06-23T19:01:45.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.760+0000 7f19c05ff700 1 -- start start 2023-06-23T19:01:45.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19c05ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b806a430 0x7f19b80c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:45.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19c05ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806d5a0 0x7f19b80c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:45.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19c05ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b8158550 0x7f19b80c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:45.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19c05ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80ac2e0 con 0x7f19b8158550 2023-06-23T19:01:45.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19c05ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80b1d90 con 0x7f19b806a430 2023-06-23T19:01:45.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19c05ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80ac580 con 0x7f19b806d5a0 2023-06-23T19:01:45.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19beb9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b8158550 0x7f19b80c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:45.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19bdb9a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806d5a0 0x7f19b80c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:45.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19be39b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b806a430 0x7f19b80c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:45.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19beb9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b8158550 0x7f19b80c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:36792/0 (socket says 172.21.15.136:36792) 2023-06-23T19:01:45.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19beb9c700 1 -- 172.21.15.136:0/49335406 learned_addr learned my addr 172.21.15.136:0/49335406 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:45.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.761+0000 7f19bdb9a700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806d5a0 0x7f19b80c2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:55174/0 (socket says 172.21.15.136:55174) 2023-06-23T19:01:45.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19bdb9a700 1 -- 172.21.15.136:0/49335406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b806a430 msgr2=0x7f19b80c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:45.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19bdb9a700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b806a430 0x7f19b80c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:45.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19bdb9a700 1 -- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b8158550 msgr2=0x7f19b80c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:45.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19bdb9a700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b8158550 0x7f19b80c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:45.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19bdb9a700 1 -- 172.21.15.136:0/49335406 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0009a70 con 0x7f19b806d5a0 2023-06-23T19:01:45.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19beb9c700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b8158550 0x7f19b80c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:01:45.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19bdb9a700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806d5a0 0x7f19b80c2c40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f19a8016000 tx=0x7f19a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:45.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19aeffd700 1 -- 172.21.15.136:0/49335406 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8004240 con 0x7f19b806d5a0 2023-06-23T19:01:45.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19aeffd700 1 -- 172.21.15.136:0/49335406 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a801f070 con 0x7f19b806d5a0 2023-06-23T19:01:45.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19aeffd700 1 -- 172.21.15.136:0/49335406 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80045e0 con 0x7f19b806d5a0 2023-06-23T19:01:45.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.762+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a8009550 con 0x7f19b806d5a0 2023-06-23T19:01:45.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.763+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b80acb40 con 0x7f19b806d5a0 2023-06-23T19:01:45.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.763+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b8073910 con 0x7f19b806d5a0 2023-06-23T19:01:45.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.765+0000 7f19aeffd700 1 -- 172.21.15.136:0/49335406 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19a8021030 con 0x7f19b806d5a0 2023-06-23T19:01:45.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.766+0000 7f19aeffd700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f199c06ace0 0x7f199c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:45.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.766+0000 7f19aeffd700 1 -- 172.21.15.136:0/49335406 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f19a808add0 con 0x7f19b806d5a0 2023-06-23T19:01:45.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.766+0000 7f19be39b700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f199c06ace0 0x7f199c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:45.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.766+0000 7f19be39b700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f199c06ace0 0x7f199c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009ac0 tx=0x7f19b4009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:45.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:45.769+0000 7f19aeffd700 1 -- 172.21.15.136:0/49335406 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19a8055bc0 con 0x7f19b806d5a0 2023-06-23T19:01:46.015 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.012+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19b80ac6c0 con 0x7f19b806d5a0 2023-06-23T19:01:46.016 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.012+0000 7f19aeffd700 1 -- 172.21.15.136:0/49335406 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f19b80ac6c0 con 0x7f19b806d5a0 2023-06-23T19:01:46.016 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T19:01:46.018 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f199c06ace0 msgr2=0x7f199c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:46.019 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f199c06ace0 0x7f199c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009ac0 tx=0x7f19b4009210 comp rx=0 tx=0).stop 2023-06-23T19:01:46.019 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806d5a0 msgr2=0x7f19b80c2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:46.019 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806d5a0 0x7f19b80c2c40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f19a8016000 tx=0x7f19a8004750 comp rx=0 tx=0).stop 2023-06-23T19:01:46.019 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 shutdown_connections 2023-06-23T19:01:46.019 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f199c06ace0 0x7f199c06d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:46.019 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b806a430 0x7f19b80c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:46.020 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b8158550 0x7f19b80c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:46.020 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 --2- 172.21.15.136:0/49335406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806d5a0 0x7f19b80c2c40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:46.020 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 >> 172.21.15.136:0/49335406 conn(0x7f19b80b0ef0 msgr2=0x7f19b80b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:46.020 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 shutdown_connections 2023-06-23T19:01:46.020 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:46.015+0000 7f19c05ff700 1 -- 172.21.15.136:0/49335406 wait complete. 2023-06-23T19:01:46.037 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-23T19:01:46.037 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T19:01:46.038 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2023-06-23T19:01:46.038 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-23T19:01:46.038 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-23T19:01:46.038 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-23T19:01:46.038 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T19:01:46.039 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T19:01:46.039 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-23T19:01:46.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:46.039 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2023-06-23T19:01:46.082 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:01:46.082 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:01:46.082 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:01:46.083 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:46.083 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-06-23T19:01:46.083 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:46.083 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:46.083 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:46.083 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2023-06-23T19:01:46.083 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:46.084 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:46.084 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2023-06-23T19:01:46.084 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:46.084 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:46.084 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T19:01:46.084 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:46.084 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-23T19:01:46.085 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42058sec preferred_lft 42058sec 2023-06-23T19:01:46.085 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::535c:5530:7d0:e32d/64 scope link noprefixroute 2023-06-23T19:01:46.085 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:46.086 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-23T19:01:46.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:46.087 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:46.087 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:46.087 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2023-06-23T19:01:46.087 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2023-06-23T19:01:46.087 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2023-06-23T19:01:46.088 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-23T19:01:46.088 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:46.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:46.321 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T19:01:46.387 INFO:teuthology.orchestra.run.smithi136.stdout:1 2023-06-23T19:01:46.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:46.390 DEBUG:teuthology.orchestra.run.smithi136:> route 2023-06-23T19:01:46.435 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2023-06-23T19:01:46.435 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T19:01:46.435 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T19:01:46.436 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T19:01:46.436 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T19:01:46.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:46.437 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:46.437 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:46.438 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T19:01:46.438 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T19:01:46.438 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T19:01:46.438 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:46.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:46.645 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-06-23T19:01:46.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:46.689 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2023-06-23T19:01:46.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:46.771 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:46.772 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:46.772 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-23T19:01:46.772 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-23T19:01:46.772 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:46.951 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-23T19:01:46.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:46.951 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:46.952 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:46.952 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-23T19:01:46.952 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-23T19:01:46.952 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-23T19:01:46.953 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-23T19:01:46.953 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-23T19:01:46.953 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:47.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:47.193 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:47.193 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:47.193 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2023-06-23T19:01:47.193 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2023-06-23T19:01:47.194 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:47.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:47.370 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-23T19:01:47.412 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-23T19:01:47.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:47.413 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-23T19:01:47.494 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-23T19:01:47.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:47.495 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:47.635 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:47.636 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-06-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 0@ad363bec-53b9-481a-9d11-1e4839eb0e65.cephfs=/ 2023-06-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.136:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-06-23T19:01:48.080 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-23T19:01:48.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:48.081 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-23T19:01:48.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:48.155 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:48.240 INFO:teuthology.orchestra.run.smithi136.stdout:client4836 2023-06-23T19:01:48.241 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:01:48.241 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:01:48.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:48.284 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:48.417 INFO:teuthology.orchestra.run.smithi136.stdout:client4836 2023-06-23T19:01:48.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:48.418 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi136.stdout:client4836 2023-06-23T19:01:48.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:48.507 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ad363bec-53b9-481a-9d11-1e4839eb0e65.client4836/status') 2023-06-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi136.stdout:instance: client.4836 (3)192.168.0.1:0/2297463919 2023-06-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi136.stdout:blocklisted: false 2023-06-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records in 2023-06-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records out 2023-06-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi136.stderr:69 bytes copied, 4.658e-05 s, 1.5 MB/s 2023-06-23T19:01:48.615 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-06-23T19:01:48.615 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T19:01:48.615 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-23T19:01:48.616 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T19:01:48.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.805+0000 7f1f995ff700 1 Processor -- start 2023-06-23T19:01:48.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.806+0000 7f1f995ff700 1 -- start start 2023-06-23T19:01:48.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f995ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 0x7f1f940c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:48.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f995ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1f94069ef0 0x7f1f9406a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:48.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f995ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9406a850 con 0x7f1f9415a0c0 2023-06-23T19:01:48.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f995ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f940cd280 con 0x7f1f94069ef0 2023-06-23T19:01:48.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f995ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f940c9220 con 0x7f1f940cd5d0 2023-06-23T19:01:48.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f937fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1f94069ef0 0x7f1f9406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:48.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f937fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1f94069ef0 0x7f1f9406a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:36798/0 (socket says 172.21.15.136:36798) 2023-06-23T19:01:48.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f937fe700 1 -- 172.21.15.136:0/3581563479 learned_addr learned my addr 172.21.15.136:0/3581563479 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:48.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f8bfff700 1 --2- 172.21.15.136:0/3581563479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 0x7f1f940c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:48.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.807+0000 7f1f937fe700 1 -- 172.21.15.136:0/3581563479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 msgr2=0x7f1f940c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:48.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.808+0000 7f1f937fe700 1 --2- 172.21.15.136:0/3581563479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 0x7f1f940c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:48.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.808+0000 7f1f937fe700 1 -- 172.21.15.136:0/3581563479 >> v1:172.21.15.178:6789/0 conn(0x7f1f9415a0c0 legacy=0x7f1f940ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:48.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.808+0000 7f1f937fe700 1 -- 172.21.15.136:0/3581563479 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f940caea0 con 0x7f1f94069ef0 2023-06-23T19:01:48.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.808+0000 7f1f8bfff700 1 --2- 172.21.15.136:0/3581563479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 0x7f1f940c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:48.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.808+0000 7f1f937fe700 1 --2- 172.21.15.136:0/3581563479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f94069ef0 0x7f1f9406a310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009e80 tx=0x7f1f8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511bf46dc02a4b98 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:48.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.808+0000 7f1f927fc700 1 -- 172.21.15.136:0/3581563479 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00e070 con 0x7f1f94069ef0 2023-06-23T19:01:48.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.808+0000 7f1f927fc700 1 -- 172.21.15.136:0/3581563479 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c00b980 con 0x7f1f94069ef0 2023-06-23T19:01:48.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.808+0000 7f1f927fc700 1 -- 172.21.15.136:0/3581563479 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00bd30 con 0x7f1f94069ef0 2023-06-23T19:01:48.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.809+0000 7f1f995ff700 1 -- 172.21.15.136:0/3581563479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f94069ef0 msgr2=0x7f1f9406a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:48.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.809+0000 7f1f995ff700 1 --2- 172.21.15.136:0/3581563479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f94069ef0 0x7f1f9406a310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009e80 tx=0x7f1f8c00b330 comp rx=0 tx=0).stop 2023-06-23T19:01:48.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.809+0000 7f1f995ff700 1 -- 172.21.15.136:0/3581563479 shutdown_connections 2023-06-23T19:01:48.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.809+0000 7f1f995ff700 1 --2- 172.21.15.136:0/3581563479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f94069ef0 0x7f1f9406a310 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:48.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.809+0000 7f1f995ff700 1 --2- 172.21.15.136:0/3581563479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 0x7f1f940c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:48.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.809+0000 7f1f995ff700 1 -- 172.21.15.136:0/3581563479 >> 172.21.15.136:0/3581563479 conn(0x7f1f940b0ef0 msgr2=0x7f1f940ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:48.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.809+0000 7f1f995ff700 1 -- 172.21.15.136:0/3581563479 shutdown_connections 2023-06-23T19:01:48.817 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.809+0000 7f1f995ff700 1 -- 172.21.15.136:0/3581563479 wait complete. 2023-06-23T19:01:48.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.811+0000 7f1f995ff700 1 Processor -- start 2023-06-23T19:01:48.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.811+0000 7f1f995ff700 1 -- start start 2023-06-23T19:01:48.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f995ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f94069ef0 0x7f1f9415d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:48.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f995ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 0x7f1f94154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:48.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f995ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f9415a0c0 0x7f1f940c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:48.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f995ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f940c68f0 con 0x7f1f9415a0c0 2023-06-23T19:01:48.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f995ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9415c6b0 con 0x7f1f94069ef0 2023-06-23T19:01:48.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f995ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9415c3d0 con 0x7f1f940cd5d0 2023-06-23T19:01:48.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f937fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f9415a0c0 0x7f1f940c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:48.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f937fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f9415a0c0 0x7f1f940c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:36812/0 (socket says 172.21.15.136:36812) 2023-06-23T19:01:48.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f937fe700 1 -- 172.21.15.136:0/3704078672 learned_addr learned my addr 172.21.15.136:0/3704078672 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:48.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f8bfff700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 0x7f1f94154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:48.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f92ffd700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f94069ef0 0x7f1f9415d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:48.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f937fe700 1 -- 172.21.15.136:0/3704078672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 msgr2=0x7f1f94154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:48.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f937fe700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 0x7f1f94154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:48.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f937fe700 1 -- 172.21.15.136:0/3704078672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f94069ef0 msgr2=0x7f1f9415d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:48.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f937fe700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f94069ef0 0x7f1f9415d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:48.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.812+0000 7f1f937fe700 1 -- 172.21.15.136:0/3704078672 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c009b30 con 0x7f1f9415a0c0 2023-06-23T19:01:48.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.813+0000 7f1f937fe700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f9415a0c0 0x7f1f940c6d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1f94072270 tx=0x7f1f8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:48.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.813+0000 7f1f8b7fe700 1 -- 172.21.15.136:0/3704078672 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c004800 con 0x7f1f9415a0c0 2023-06-23T19:01:48.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.813+0000 7f1f8b7fe700 1 -- 172.21.15.136:0/3704078672 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c004960 con 0x7f1f9415a0c0 2023-06-23T19:01:48.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.813+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f940c62a0 con 0x7f1f9415a0c0 2023-06-23T19:01:48.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.813+0000 7f1f8b7fe700 1 -- 172.21.15.136:0/3704078672 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c01c680 con 0x7f1f9415a0c0 2023-06-23T19:01:48.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.813+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f941551b0 con 0x7f1f9415a0c0 2023-06-23T19:01:48.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.814+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f940c6aa0 con 0x7f1f9415a0c0 2023-06-23T19:01:48.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.815+0000 7f1f8b7fe700 1 -- 172.21.15.136:0/3704078672 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f8c01c7e0 con 0x7f1f9415a0c0 2023-06-23T19:01:48.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.816+0000 7f1f8b7fe700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:48.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.817+0000 7f1f8b7fe700 1 -- 172.21.15.136:0/3704078672 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f8c08afe0 con 0x7f1f9415a0c0 2023-06-23T19:01:48.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.817+0000 7f1f92ffd700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:48.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.817+0000 7f1f92ffd700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f84007fd0 tx=0x7f1f84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:48.821+0000 7f1f8b7fe700 1 -- 172.21.15.136:0/3704078672 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f940c6aa0 con 0x7f1f9415a0c0 2023-06-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.061+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f94073910 con 0x7f1f9415a0c0 2023-06-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.062+0000 7f1f8b7fe700 1 -- 172.21.15.136:0/3704078672 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1f8c055d50 con 0x7f1f9415a0c0 2023-06-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 msgr2=0x7f1f7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f84007fd0 tx=0x7f1f84009040 comp rx=0 tx=0).stop 2023-06-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f9415a0c0 msgr2=0x7f1f940c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f9415a0c0 0x7f1f940c6d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1f94072270 tx=0x7f1f8c004ad0 comp rx=0 tx=0).stop 2023-06-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 shutdown_connections 2023-06-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f94069ef0 0x7f1f9415d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f9415a0c0 0x7f1f940c6d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 --2- 172.21.15.136:0/3704078672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f940cd5d0 0x7f1f94154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 >> 172.21.15.136:0/3704078672 conn(0x7f1f940b0ef0 msgr2=0x7f1f940c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 shutdown_connections 2023-06-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:49.064+0000 7f1f995ff700 1 -- 172.21.15.136:0/3704078672 wait complete. 2023-06-23T19:01:49.086 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-23T19:01:49.086 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T19:01:49.087 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2023-06-23T19:01:49.087 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-23T19:01:49.087 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-23T19:01:49.087 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-23T19:01:49.087 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T19:01:49.088 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T19:01:49.088 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-23T19:01:49.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.088 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2023-06-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-06-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2023-06-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2023-06-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42056sec preferred_lft 42056sec 2023-06-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::535c:5530:7d0:e32d/64 scope link noprefixroute 2023-06-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi136.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 3a:2e:88:71:8e:cc brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::3087:eff:fe6b:b7d7/64 scope link 2023-06-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi136.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 3a:2e:88:71:8e:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::382e:88ff:fe71:8ecc/64 scope link 2023-06-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.138 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T19:01:49.242 INFO:teuthology.orchestra.run.smithi136.stdout:1 2023-06-23T19:01:49.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.245 DEBUG:teuthology.orchestra.run.smithi136:> route 2023-06-23T19:01:49.290 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2023-06-23T19:01:49.290 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T19:01:49.290 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T19:01:49.290 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T19:01:49.291 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T19:01:49.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.292 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:49.293 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:49.293 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T19:01:49.293 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T19:01:49.293 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T19:01:49.294 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:49.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.499 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-06-23T19:01:49.542 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-23T19:01:49.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.543 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2023-06-23T19:01:49.624 INFO:teuthology.orchestra.run.smithi136.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-23T19:01:49.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.625 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:49.625 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:49.626 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-23T19:01:49.626 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-23T19:01:49.626 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:49.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.804 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-23T19:01:49.873 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:01:49.873 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:01:49.873 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:01:49.874 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.874 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-06-23T19:01:49.874 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.875 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-23T19:01:49.875 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 66:5c:23:3c:82:e1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-23T19:01:49.875 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-23T19:01:49.875 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.875 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::645c:23ff:fe3c:82e1/64 scope link 2023-06-23T19:01:49.875 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.877 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-23T19:01:49.944 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:01:49.945 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:01:49.945 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:01:49.945 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.945 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-06-23T19:01:49.945 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.945 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-23T19:01:49.946 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 66:5c:23:3c:82:e1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-23T19:01:49.946 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-23T19:01:49.946 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.946 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::645c:23ff:fe3c:82e1/64 scope link 2023-06-23T19:01:49.946 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:49.948 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-23T19:01:49.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:49.948 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:49.949 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:49.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-23T19:01:49.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-23T19:01:49.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-23T19:01:49.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-23T19:01:49.950 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-23T19:01:49.950 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:50.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:50.195 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:01:50.195 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:01:50.195 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.1 up 2023-06-23T19:01:50.195 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.1 master ceph-brx 2023-06-23T19:01:50.196 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:01:50.373 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:50.373 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-23T19:01:50.416 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-23T19:01:50.417 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:50.417 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-23T19:01:50.499 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-06-23T19:01:50.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:50.500 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:50.642 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:50.642 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:01:50.671 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:50.672 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:01:50.672 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-06-23T19:01:50.672 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 2@ad363bec-53b9-481a-9d11-1e4839eb0e65.cephfs=/ 2023-06-23T19:01:50.672 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.136:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-06-23T19:01:50.676 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-23T19:01:50.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:50.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-23T19:01:50.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:50.745 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:50.829 INFO:teuthology.orchestra.run.smithi136.stdout:client4845 2023-06-23T19:01:50.829 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:01:50.830 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:01:50.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:50.875 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:50.998 INFO:teuthology.orchestra.run.smithi136.stdout:client4845 2023-06-23T19:01:50.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:50.999 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:51.083 INFO:teuthology.orchestra.run.smithi136.stdout:client4845 2023-06-23T19:01:51.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:51.085 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ad363bec-53b9-481a-9d11-1e4839eb0e65.client4845/status') 2023-06-23T19:01:51.190 INFO:teuthology.orchestra.run.smithi136.stdout:instance: client.4845 (3)192.168.0.2:0/1515032468 2023-06-23T19:01:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:blocklisted: false 2023-06-23T19:01:51.191 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records in 2023-06-23T19:01:51.191 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records out 2023-06-23T19:01:51.191 INFO:teuthology.orchestra.run.smithi136.stderr:69 bytes copied, 5.4339e-05 s, 1.3 MB/s 2023-06-23T19:01:51.193 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-06-23T19:01:51.193 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T19:01:51.194 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-23T19:01:51.194 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T19:01:51.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.383+0000 7f90889ff700 1 Processor -- start 2023-06-23T19:01:51.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.383+0000 7f90889ff700 1 -- start start 2023-06-23T19:01:51.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.384+0000 7f90889ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f908415c570 0x7f90840cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:51.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.384+0000 7f90889ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9084160e70 con 0x7f9084160a50 2023-06-23T19:01:51.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.384+0000 7f90889ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90841610a0 con 0x7f90840cd660 2023-06-23T19:01:51.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.384+0000 7f90889ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908415d670 con 0x7f908415c570 2023-06-23T19:01:51.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.384+0000 7f908259c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f908415c570 0x7f90840cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:51.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.385+0000 7f9082d9d700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f9084160a50 0x7f90840d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56360/0 (socket says 172.21.15.136:56360) 2023-06-23T19:01:51.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.385+0000 7f9082d9d700 1 -- 172.21.15.136:0/3571055094 learned_addr learned my addr 172.21.15.136:0/3571055094 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:51.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.385+0000 7f908259c700 1 -- 172.21.15.136:0/3571055094 >> v1:172.21.15.178:6789/0 conn(0x7f90840cd660 legacy=0x7f9084160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:51.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.385+0000 7f908259c700 1 -- 172.21.15.136:0/3571055094 >> v1:172.21.15.136:6789/0 conn(0x7f9084160a50 legacy=0x7f90840d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:51.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.385+0000 7f908259c700 1 -- 172.21.15.136:0/3571055094 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908415da90 con 0x7f908415c570 2023-06-23T19:01:51.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.385+0000 7f908259c700 1 --2- 172.21.15.136:0/3571055094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f908415c570 0x7f90840cd120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9074009840 tx=0x7f9074009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c4173d2e95a3ce server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:51.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.385+0000 7f908159a700 1 -- 172.21.15.136:0/3571055094 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074011830 con 0x7f908415c570 2023-06-23T19:01:51.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.385+0000 7f908159a700 1 -- 172.21.15.136:0/3571055094 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9074011990 con 0x7f908415c570 2023-06-23T19:01:51.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.385+0000 7f908159a700 1 -- 172.21.15.136:0/3571055094 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074011d20 con 0x7f908415c570 2023-06-23T19:01:51.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.386+0000 7f90889ff700 1 -- 172.21.15.136:0/3571055094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f908415c570 msgr2=0x7f90840cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:51.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.386+0000 7f90889ff700 1 --2- 172.21.15.136:0/3571055094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f908415c570 0x7f90840cd120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9074009840 tx=0x7f9074009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:51.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.386+0000 7f90889ff700 1 -- 172.21.15.136:0/3571055094 shutdown_connections 2023-06-23T19:01:51.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.386+0000 7f90889ff700 1 --2- 172.21.15.136:0/3571055094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f908415c570 0x7f90840cd120 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:51.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.386+0000 7f90889ff700 1 -- 172.21.15.136:0/3571055094 >> 172.21.15.136:0/3571055094 conn(0x7f9084071620 msgr2=0x7f90840719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:51.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.386+0000 7f90889ff700 1 -- 172.21.15.136:0/3571055094 shutdown_connections 2023-06-23T19:01:51.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.386+0000 7f90889ff700 1 -- 172.21.15.136:0/3571055094 wait complete. 2023-06-23T19:01:51.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.388+0000 7f90889ff700 1 Processor -- start 2023-06-23T19:01:51.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.388+0000 7f90889ff700 1 -- start start 2023-06-23T19:01:51.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f90889ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd660 0x7f90840b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:51.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f90889ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908415c570 0x7f90840b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:51.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f90889ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9084160a50 0x7f9084157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:51.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f90889ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90840b6cf0 con 0x7f90840cd660 2023-06-23T19:01:51.396 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f90889ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908415af70 con 0x7f9084160a50 2023-06-23T19:01:51.396 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f90889ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840b6070 con 0x7f908415c570 2023-06-23T19:01:51.396 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f908259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd660 0x7f90840b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:51.396 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f908259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd660 0x7f90840b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:36826/0 (socket says 172.21.15.136:36826) 2023-06-23T19:01:51.396 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f908259c700 1 -- 172.21.15.136:0/2887190267 learned_addr learned my addr 172.21.15.136:0/2887190267 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:51.396 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f9082d9d700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9084160a50 0x7f9084157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:51.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.389+0000 7f9081d9b700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908415c570 0x7f90840b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:51.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f908259c700 1 -- 172.21.15.136:0/2887190267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908415c570 msgr2=0x7f90840b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:51.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f908259c700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908415c570 0x7f90840b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:51.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f908259c700 1 -- 172.21.15.136:0/2887190267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9084160a50 msgr2=0x7f9084157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:51.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f908259c700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9084160a50 0x7f9084157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:51.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f908259c700 1 -- 172.21.15.136:0/2887190267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740094a0 con 0x7f90840cd660 2023-06-23T19:01:51.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f9081d9b700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908415c570 0x7f90840b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:51.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f908259c700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd660 0x7f90840b8500 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f90740090b0 tx=0x7f9074004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:51.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f9072ffd700 1 -- 172.21.15.136:0/2887190267 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90740038a0 con 0x7f90840cd660 2023-06-23T19:01:51.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f9072ffd700 1 -- 172.21.15.136:0/2887190267 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907401f070 con 0x7f90840cd660 2023-06-23T19:01:51.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f9072ffd700 1 -- 172.21.15.136:0/2887190267 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074003c60 con 0x7f90840cd660 2023-06-23T19:01:51.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90840b6350 con 0x7f90840cd660 2023-06-23T19:01:51.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.390+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90840b6910 con 0x7f90840cd660 2023-06-23T19:01:51.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.391+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90840b6e30 con 0x7f90840cd660 2023-06-23T19:01:51.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.392+0000 7f9072ffd700 1 -- 172.21.15.136:0/2887190267 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f907401a430 con 0x7f90840cd660 2023-06-23T19:01:51.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.393+0000 7f9072ffd700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f906406ace0 0x7f906406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:51.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.393+0000 7f9072ffd700 1 -- 172.21.15.136:0/2887190267 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9074021070 con 0x7f90840cd660 2023-06-23T19:01:51.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.393+0000 7f9081d9b700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f906406ace0 0x7f906406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:51.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.394+0000 7f9081d9b700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f906406ace0 0x7f906406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90840cfc50 tx=0x7f9078009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:51.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.398+0000 7f9072ffd700 1 -- 172.21.15.136:0/2887190267 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f90840b6e30 con 0x7f90840cd660 2023-06-23T19:01:51.642 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.638+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f90840b6e30 con 0x7f90840cd660 2023-06-23T19:01:51.642 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.638+0000 7f9072ffd700 1 -- 172.21.15.136:0/2887190267 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9074055ff0 con 0x7f90840cd660 2023-06-23T19:01:51.643 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T19:01:51.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f906406ace0 msgr2=0x7f906406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:51.645 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f906406ace0 0x7f906406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90840cfc50 tx=0x7f9078009040 comp rx=0 tx=0).stop 2023-06-23T19:01:51.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd660 msgr2=0x7f90840b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:51.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd660 0x7f90840b8500 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f90740090b0 tx=0x7f9074004750 comp rx=0 tx=0).stop 2023-06-23T19:01:51.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 shutdown_connections 2023-06-23T19:01:51.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f906406ace0 0x7f906406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:51.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9084160a50 0x7f9084157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:51.646 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd660 0x7f90840b8500 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:51.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 --2- 172.21.15.136:0/2887190267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908415c570 0x7f90840b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:51.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 >> 172.21.15.136:0/2887190267 conn(0x7f9084071620 msgr2=0x7f90840d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:51.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 shutdown_connections 2023-06-23T19:01:51.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:51.641+0000 7f90889ff700 1 -- 172.21.15.136:0/2887190267 wait complete. 2023-06-23T19:01:51.664 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-23T19:01:51.664 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T19:01:51.665 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2023-06-23T19:01:51.665 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-23T19:01:51.666 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-23T19:01:51.666 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-23T19:01:51.667 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T19:01:51.667 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T19:01:51.668 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-23T19:01:51.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:51.669 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2023-06-23T19:01:51.718 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:01:51.719 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:01:51.719 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:01:51.719 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:51.720 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-06-23T19:01:51.720 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:51.720 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:51.720 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:51.720 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2023-06-23T19:01:51.720 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:51.721 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:51.721 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2023-06-23T19:01:51.721 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:51.721 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:51.722 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T19:01:51.722 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:51.722 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-23T19:01:51.722 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42057sec preferred_lft 42057sec 2023-06-23T19:01:51.722 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::625b:bc7d:15b1:b6f5/64 scope link noprefixroute 2023-06-23T19:01:51.722 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:51.723 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-23T19:01:51.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:51.723 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-06-23T19:01:51.724 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-06-23T19:01:51.725 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add name ceph-brx type bridge 2023-06-23T19:01:51.725 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr flush dev ceph-brx 2023-06-23T19:01:51.725 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set ceph-brx up 2023-06-23T19:01:51.725 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-23T19:01:51.725 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-06-23T19:01:52.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:52.174 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T19:01:52.243 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-06-23T19:01:52.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:52.247 DEBUG:teuthology.orchestra.run.smithi178:> route 2023-06-23T19:01:52.305 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2023-06-23T19:01:52.305 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T19:01:52.306 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T19:01:52.306 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T19:01:52.306 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T19:01:52.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:52.307 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-06-23T19:01:52.307 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-06-23T19:01:52.307 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T19:01:52.307 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T19:01:52.307 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T19:01:52.308 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-06-23T19:01:52.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:52.983 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-06-23T19:01:53.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:53.027 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2023-06-23T19:01:53.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:53.110 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-06-23T19:01:53.110 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-06-23T19:01:53.110 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-23T19:01:53.111 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-23T19:01:53.111 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-06-23T19:01:53.290 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-23T19:01:53.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:53.291 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-06-23T19:01:53.291 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-06-23T19:01:53.291 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-23T19:01:53.292 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-23T19:01:53.292 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-23T19:01:53.292 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-23T19:01:53.293 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-23T19:01:53.293 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-06-23T19:01:53.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:53.571 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-06-23T19:01:53.571 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-06-23T19:01:53.571 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.0 up 2023-06-23T19:01:53.571 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.0 master ceph-brx 2023-06-23T19:01:53.571 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-06-23T19:01:53.748 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:53.749 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi178.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-23T19:01:53.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:53.793 DEBUG:teuthology.orchestra.run.smithi178:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-23T19:01:53.875 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-06-23T19:01:53.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:53.876 DEBUG:teuthology.orchestra.run.smithi178:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:54.029 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:54.029 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:01:54.483 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:54.484 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:01:54.484 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-06-23T19:01:54.484 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with new device syntax: 1@ad363bec-53b9-481a-9d11-1e4839eb0e65.cephfs=/ 2023-06-23T19:01:54.484 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.136:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-06-23T19:01:54.489 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-23T19:01:54.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:54.490 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-23T19:01:54.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:54.558 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:54.646 INFO:teuthology.orchestra.run.smithi178.stdout:client4857 2023-06-23T19:01:54.646 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:01:54.647 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:01:54.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:54.691 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi178.stdout:client4857 2023-06-23T19:01:54.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:54.814 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:54.898 INFO:teuthology.orchestra.run.smithi178.stdout:client4857 2023-06-23T19:01:54.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:54.899 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ad363bec-53b9-481a-9d11-1e4839eb0e65.client4857/status') 2023-06-23T19:01:55.003 INFO:teuthology.orchestra.run.smithi178.stdout:instance: client.4857 (3)172.21.15.178:0/544010725 2023-06-23T19:01:55.003 INFO:teuthology.orchestra.run.smithi178.stdout:blocklisted: false 2023-06-23T19:01:55.004 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records in 2023-06-23T19:01:55.004 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records out 2023-06-23T19:01:55.004 INFO:teuthology.orchestra.run.smithi178.stderr:70 bytes copied, 6.7804e-05 s, 1.0 MB/s 2023-06-23T19:01:55.007 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-06-23T19:01:55.007 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T19:01:55.008 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-23T19:01:55.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T19:01:55.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.208+0000 7f6644fff700 1 Processor -- start 2023-06-23T19:01:55.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.208+0000 7f6644fff700 1 -- start start 2023-06-23T19:01:55.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.209+0000 7f6644fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f664015c570 0x7f66400cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:55.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.209+0000 7f6644fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6640160a50 0x7f66400d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:55.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.209+0000 7f6644fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66401610a0 con 0x7f66400cd660 2023-06-23T19:01:55.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.209+0000 7f6644fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664015d670 con 0x7f6640160a50 2023-06-23T19:01:55.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.209+0000 7f6644fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6640160eb0 con 0x7f664015c570 2023-06-23T19:01:55.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663ed9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6640160a50 0x7f66400d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:55.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663ed9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6640160a50 0x7f66400d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60754/0 (socket says 172.21.15.136:60754) 2023-06-23T19:01:55.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663ed9d700 1 -- 172.21.15.136:0/4174661322 learned_addr learned my addr 172.21.15.136:0/4174661322 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:55.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663e59c700 1 --2- 172.21.15.136:0/4174661322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f664015c570 0x7f66400cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:55.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663ed9d700 1 -- 172.21.15.136:0/4174661322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f664015c570 msgr2=0x7f66400cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:55.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663ed9d700 1 --2- 172.21.15.136:0/4174661322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f664015c570 0x7f66400cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:55.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663ed9d700 1 -- 172.21.15.136:0/4174661322 >> v1:172.21.15.178:6789/0 conn(0x7f66400cd660 legacy=0x7f6640160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:55.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663ed9d700 1 -- 172.21.15.136:0/4174661322 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664015da90 con 0x7f6640160a50 2023-06-23T19:01:55.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663e59c700 1 --2- 172.21.15.136:0/4174661322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f664015c570 0x7f66400cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:55.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.210+0000 7f663ed9d700 1 --2- 172.21.15.136:0/4174661322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6640160a50 0x7f66400d0bb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6638009e80 tx=0x7f663800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516197aa76d370dc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:55.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f663d59a700 1 -- 172.21.15.136:0/4174661322 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800e070 con 0x7f6640160a50 2023-06-23T19:01:55.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f663d59a700 1 -- 172.21.15.136:0/4174661322 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663800b980 con 0x7f6640160a50 2023-06-23T19:01:55.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f663d59a700 1 -- 172.21.15.136:0/4174661322 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800bd30 con 0x7f6640160a50 2023-06-23T19:01:55.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f6644fff700 1 -- 172.21.15.136:0/4174661322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6640160a50 msgr2=0x7f66400d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:55.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f6644fff700 1 --2- 172.21.15.136:0/4174661322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6640160a50 0x7f66400d0bb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6638009e80 tx=0x7f663800b330 comp rx=0 tx=0).stop 2023-06-23T19:01:55.217 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f6644fff700 1 -- 172.21.15.136:0/4174661322 shutdown_connections 2023-06-23T19:01:55.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f6644fff700 1 --2- 172.21.15.136:0/4174661322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6640160a50 0x7f66400d0bb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:55.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f6644fff700 1 --2- 172.21.15.136:0/4174661322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f664015c570 0x7f66400cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:55.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f6644fff700 1 -- 172.21.15.136:0/4174661322 >> 172.21.15.136:0/4174661322 conn(0x7f6640071620 msgr2=0x7f66400719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:55.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f6644fff700 1 -- 172.21.15.136:0/4174661322 shutdown_connections 2023-06-23T19:01:55.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.211+0000 7f6644fff700 1 -- 172.21.15.136:0/4174661322 wait complete. 2023-06-23T19:01:55.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.213+0000 7f6644fff700 1 Processor -- start 2023-06-23T19:01:55.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.213+0000 7f6644fff700 1 -- start start 2023-06-23T19:01:55.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.214+0000 7f6644fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66400cd660 0x7f66400b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:55.224 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.214+0000 7f6644fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f664015c570 0x7f66400b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:55.224 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.214+0000 7f6644fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6640160a50 0x7f664014feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:55.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.214+0000 7f6644fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66400b5d00 con 0x7f66400cd660 2023-06-23T19:01:55.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.214+0000 7f6644fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66400b5fe0 con 0x7f664015c570 2023-06-23T19:01:55.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.214+0000 7f6644fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66400b62c0 con 0x7f6640160a50 2023-06-23T19:01:55.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.214+0000 7f663e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66400cd660 0x7f66400b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:55.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66400cd660 0x7f66400b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60760/0 (socket says 172.21.15.136:60760) 2023-06-23T19:01:55.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663e59c700 1 -- 172.21.15.136:0/4290967367 learned_addr learned my addr 172.21.15.136:0/4290967367 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:55.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663dd9b700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f664015c570 0x7f66400b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:55.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663ed9d700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6640160a50 0x7f664014feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:55.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663e59c700 1 -- 172.21.15.136:0/4290967367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6640160a50 msgr2=0x7f664014feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:55.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663e59c700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6640160a50 0x7f664014feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:55.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663e59c700 1 -- 172.21.15.136:0/4290967367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f664015c570 msgr2=0x7f66400b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:55.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663e59c700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f664015c570 0x7f66400b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:55.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663e59c700 1 -- 172.21.15.136:0/4290967367 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638009b30 con 0x7f66400cd660 2023-06-23T19:01:55.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f663e59c700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66400cd660 0x7f66400b71a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f663000e810 tx=0x7f663000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:55.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f662effd700 1 -- 172.21.15.136:0/4290967367 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000c070 con 0x7f66400cd660 2023-06-23T19:01:55.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f662effd700 1 -- 172.21.15.136:0/4290967367 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6630004230 con 0x7f66400cd660 2023-06-23T19:01:55.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66400b65a0 con 0x7f66400cd660 2023-06-23T19:01:55.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.215+0000 7f662effd700 1 -- 172.21.15.136:0/4290967367 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66300036a0 con 0x7f66400cd660 2023-06-23T19:01:55.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.216+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66400b59b0 con 0x7f66400cd660 2023-06-23T19:01:55.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.217+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6640073910 con 0x7f66400cd660 2023-06-23T19:01:55.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.217+0000 7f662effd700 1 -- 172.21.15.136:0/4290967367 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6630003800 con 0x7f66400cd660 2023-06-23T19:01:55.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.218+0000 7f662effd700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f662006ace0 0x7f662006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:55.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.218+0000 7f662effd700 1 -- 172.21.15.136:0/4290967367 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f66300895b0 con 0x7f66400cd660 2023-06-23T19:01:55.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.219+0000 7f663dd9b700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f662006ace0 0x7f662006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:55.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.219+0000 7f663dd9b700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f662006ace0 0x7f662006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66400b4220 tx=0x7f6634009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:55.233 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.222+0000 7f662effd700 1 -- 172.21.15.136:0/4290967367 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6630054200 con 0x7f66400cd660 2023-06-23T19:01:55.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.461+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f66400b5360 con 0x7f66400cd660 2023-06-23T19:01:55.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.462+0000 7f662effd700 1 -- 172.21.15.136:0/4290967367 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6630057820 con 0x7f66400cd660 2023-06-23T19:01:55.466 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T19:01:55.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f662006ace0 msgr2=0x7f662006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:55.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f662006ace0 0x7f662006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66400b4220 tx=0x7f6634009040 comp rx=0 tx=0).stop 2023-06-23T19:01:55.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66400cd660 msgr2=0x7f66400b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:55.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66400cd660 0x7f66400b71a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f663000e810 tx=0x7f663000eb20 comp rx=0 tx=0).stop 2023-06-23T19:01:55.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 shutdown_connections 2023-06-23T19:01:55.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f662006ace0 0x7f662006d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:55.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6640160a50 0x7f664014feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:55.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66400cd660 0x7f66400b71a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:55.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 --2- 172.21.15.136:0/4290967367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f664015c570 0x7f66400b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:55.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 >> 172.21.15.136:0/4290967367 conn(0x7f6640071620 msgr2=0x7f66400cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:55.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 shutdown_connections 2023-06-23T19:01:55.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:55.464+0000 7f6644fff700 1 -- 172.21.15.136:0/4290967367 wait complete. 2023-06-23T19:01:55.485 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-23T19:01:55.485 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T19:01:55.486 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2023-06-23T19:01:55.486 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-23T19:01:55.486 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-23T19:01:55.487 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-23T19:01:55.487 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T19:01:55.487 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T19:01:55.487 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-23T19:01:55.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:55.488 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2023-06-23T19:01:55.532 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:01:55.532 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:01:55.532 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:01:55.532 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:55.533 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-06-23T19:01:55.533 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:55.533 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:55.533 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:55.534 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2023-06-23T19:01:55.534 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:55.535 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:55.535 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2023-06-23T19:01:55.535 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:01:55.535 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:55.536 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T19:01:55.536 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:55.536 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-23T19:01:55.536 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42053sec preferred_lft 42053sec 2023-06-23T19:01:55.537 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::625b:bc7d:15b1:b6f5/64 scope link noprefixroute 2023-06-23T19:01:55.537 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:55.537 INFO:teuthology.orchestra.run.smithi178.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-23T19:01:55.537 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 12:8d:4c:be:80:7b brd ff:ff:ff:ff:ff:ff 2023-06-23T19:01:55.538 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-23T19:01:55.538 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:55.538 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::d4af:6dff:fe0f:7c14/64 scope link 2023-06-23T19:01:55.538 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:55.539 INFO:teuthology.orchestra.run.smithi178.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-23T19:01:55.539 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 12:8d:4c:be:80:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-23T19:01:55.539 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::108d:4cff:febe:807b/64 scope link 2023-06-23T19:01:55.539 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:55.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:55.541 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T19:01:55.645 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-06-23T19:01:55.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:55.650 DEBUG:teuthology.orchestra.run.smithi178:> route 2023-06-23T19:01:55.695 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2023-06-23T19:01:55.696 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T19:01:55.696 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T19:01:55.696 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T19:01:55.696 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T19:01:55.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:55.698 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-06-23T19:01:55.698 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-06-23T19:01:55.698 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T19:01:55.698 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T19:01:55.699 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T19:01:55.699 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-06-23T19:01:55.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:55.910 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-06-23T19:01:55.953 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-23T19:01:55.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:55.955 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2023-06-23T19:01:56.038 INFO:teuthology.orchestra.run.smithi178.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-23T19:01:56.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:56.040 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-06-23T19:01:56.040 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-06-23T19:01:56.040 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-23T19:01:56.040 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-23T19:01:56.041 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-06-23T19:01:56.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:56.220 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-23T19:01:56.287 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:01:56.288 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:01:56.288 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:01:56.288 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:56.288 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-06-23T19:01:56.289 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:56.289 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-23T19:01:56.289 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether fe:8d:11:f5:61:64 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-23T19:01:56.289 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-23T19:01:56.289 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:56.290 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::fc8d:11ff:fef5:6164/64 scope link 2023-06-23T19:01:56.290 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:56.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:56.291 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-23T19:01:56.314 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:01:56.319 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:01:56.361 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:01:56.361 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:01:56.361 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:01:56.361 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:56.362 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-06-23T19:01:56.362 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:56.362 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-23T19:01:56.362 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether fe:8d:11:f5:61:64 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-23T19:01:56.362 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-23T19:01:56.362 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:56.363 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::fc8d:11ff:fef5:6164/64 scope link 2023-06-23T19:01:56.363 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:01:56.364 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-23T19:01:56.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:56.365 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-06-23T19:01:56.365 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-06-23T19:01:56.366 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-23T19:01:56.367 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-23T19:01:56.367 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-23T19:01:56.367 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-23T19:01:56.368 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-23T19:01:56.368 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-06-23T19:01:56.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:56.645 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-06-23T19:01:56.645 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-06-23T19:01:56.645 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.1 up 2023-06-23T19:01:56.645 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.1 master ceph-brx 2023-06-23T19:01:56.645 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-06-23T19:01:56.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:56.823 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-23T19:01:56.866 INFO:teuthology.orchestra.run.smithi178.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-23T19:01:56.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:01:56.867 DEBUG:teuthology.orchestra.run.smithi178:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-23T19:01:56.948 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-06-23T19:01:56.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:56.950 DEBUG:teuthology.orchestra.run.smithi178:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:57.092 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:57.092 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:01:57.121 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:01:57.122 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:01:57.122 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-06-23T19:01:57.122 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with new device syntax: 3@ad363bec-53b9-481a-9d11-1e4839eb0e65.cephfs=/ 2023-06-23T19:01:57.122 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.136:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-06-23T19:01:57.126 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-23T19:01:57.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:57.127 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-23T19:01:57.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:57.195 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:57.278 INFO:teuthology.orchestra.run.smithi178.stdout:client4828 2023-06-23T19:01:57.279 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:01:57.279 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:01:57.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:57.322 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi178.stdout:client4828 2023-06-23T19:01:57.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:57.447 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:01:57.530 INFO:teuthology.orchestra.run.smithi178.stdout:client4828 2023-06-23T19:01:57.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:01:57.532 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ad363bec-53b9-481a-9d11-1e4839eb0e65.client4828/status') 2023-06-23T19:01:57.637 INFO:teuthology.orchestra.run.smithi178.stdout:instance: client.4828 (3)192.168.0.2:0/469660464 2023-06-23T19:01:57.637 INFO:teuthology.orchestra.run.smithi178.stdout:blocklisted: false 2023-06-23T19:01:57.637 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records in 2023-06-23T19:01:57.637 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records out 2023-06-23T19:01:57.638 INFO:teuthology.orchestra.run.smithi178.stderr:68 bytes copied, 7.8121e-05 s, 870 kB/s 2023-06-23T19:01:57.640 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-23T19:01:57.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:01:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.864+0000 7f910c9ff700 1 Processor -- start 2023-06-23T19:01:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.864+0000 7f910c9ff700 1 -- start start 2023-06-23T19:01:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.865+0000 7f910c9ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91080709f0 0x7f91080cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.865+0000 7f910c9ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91080c9510 con 0x7f9108158ef0 2023-06-23T19:01:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.865+0000 7f910c9ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91080cd6a0 con 0x7f910806c060 2023-06-23T19:01:57.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.865+0000 7f910c9ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91080cd980 con 0x7f91080709f0 2023-06-23T19:01:57.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.866+0000 7f9105d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91080709f0 0x7f91080cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:57.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.866+0000 7f910659c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f9108158ef0 0x7f91080702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41854/0 (socket says 172.21.15.136:41854) 2023-06-23T19:01:57.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.866+0000 7f9105d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91080709f0 0x7f91080cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60770/0 (socket says 172.21.15.136:60770) 2023-06-23T19:01:57.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.866+0000 7f910659c700 1 -- 172.21.15.136:0/3413556067 learned_addr learned my addr 172.21.15.136:0/3413556067 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:57.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.866+0000 7f9105d9b700 1 -- 172.21.15.136:0/3413556067 >> v1:172.21.15.178:6789/0 conn(0x7f910806c060 legacy=0x7f91080ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:57.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.866+0000 7f9105d9b700 1 -- 172.21.15.136:0/3413556067 >> v1:172.21.15.136:6789/0 conn(0x7f9108158ef0 legacy=0x7f91080702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:57.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.866+0000 7f9105d9b700 1 -- 172.21.15.136:0/3413556067 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91080c97b0 con 0x7f91080709f0 2023-06-23T19:01:57.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.866+0000 7f9105d9b700 1 --2- 172.21.15.136:0/3413556067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91080709f0 0x7f91080cf1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00bae0 tx=0x7f90fc00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e14337ba8471cd server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:57.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910559a700 1 -- 172.21.15.136:0/3413556067 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00dd30 con 0x7f91080709f0 2023-06-23T19:01:57.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910559a700 1 -- 172.21.15.136:0/3413556067 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc00de90 con 0x7f91080709f0 2023-06-23T19:01:57.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910559a700 1 -- 172.21.15.136:0/3413556067 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc010690 con 0x7f91080709f0 2023-06-23T19:01:57.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910c9ff700 1 -- 172.21.15.136:0/3413556067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91080709f0 msgr2=0x7f91080cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:57.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910c9ff700 1 --2- 172.21.15.136:0/3413556067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91080709f0 0x7f91080cf1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00bae0 tx=0x7f90fc00bdf0 comp rx=0 tx=0).stop 2023-06-23T19:01:57.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910c9ff700 1 -- 172.21.15.136:0/3413556067 shutdown_connections 2023-06-23T19:01:57.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910c9ff700 1 --2- 172.21.15.136:0/3413556067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91080709f0 0x7f91080cf1e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:57.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910c9ff700 1 -- 172.21.15.136:0/3413556067 >> 172.21.15.136:0/3413556067 conn(0x7f91080b0ef0 msgr2=0x7f91080ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:57.873 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910c9ff700 1 -- 172.21.15.136:0/3413556067 shutdown_connections 2023-06-23T19:01:57.874 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.867+0000 7f910c9ff700 1 -- 172.21.15.136:0/3413556067 wait complete. 2023-06-23T19:01:57.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.869+0000 7f910c9ff700 1 Processor -- start 2023-06-23T19:01:57.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.869+0000 7f910c9ff700 1 -- start start 2023-06-23T19:01:57.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.870+0000 7f910c9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910806c060 0x7f91081514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:57.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.870+0000 7f910c9ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91080709f0 0x7f91080ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:57.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.870+0000 7f910c9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9108158ef0 0x7f910815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:57.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.870+0000 7f910c9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91080cb1a0 con 0x7f910806c060 2023-06-23T19:01:57.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.870+0000 7f910c9ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91080cb440 con 0x7f91080709f0 2023-06-23T19:01:57.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.870+0000 7f910c9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91080cb720 con 0x7f9108158ef0 2023-06-23T19:01:57.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.870+0000 7f910659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910806c060 0x7f91081514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:57.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f910659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910806c060 0x7f91081514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60774/0 (socket says 172.21.15.136:60774) 2023-06-23T19:01:57.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f910659c700 1 -- 172.21.15.136:0/1651590083 learned_addr learned my addr 172.21.15.136:0/1651590083 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:57.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f9106d9d700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9108158ef0 0x7f910815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:57.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f9105d9b700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91080709f0 0x7f91080ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:57.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f910659c700 1 -- 172.21.15.136:0/1651590083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9108158ef0 msgr2=0x7f910815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:57.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f910659c700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9108158ef0 0x7f910815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:57.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f910659c700 1 -- 172.21.15.136:0/1651590083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91080709f0 msgr2=0x7f91080ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:57.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f910659c700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91080709f0 0x7f91080ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:57.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f910659c700 1 -- 172.21.15.136:0/1651590083 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc00b740 con 0x7f910806c060 2023-06-23T19:01:57.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f910659c700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910806c060 0x7f91081514c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f90f800c480 tx=0x7f90f800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:57.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f90f6ffd700 1 -- 172.21.15.136:0/1651590083 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8005d70 con 0x7f910806c060 2023-06-23T19:01:57.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f90f6ffd700 1 -- 172.21.15.136:0/1651590083 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f800ce90 con 0x7f910806c060 2023-06-23T19:01:57.879 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91080cba00 con 0x7f910806c060 2023-06-23T19:01:57.880 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.871+0000 7f90f6ffd700 1 -- 172.21.15.136:0/1651590083 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f80072d0 con 0x7f910806c060 2023-06-23T19:01:57.880 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.872+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9108151a00 con 0x7f910806c060 2023-06-23T19:01:57.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.873+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9108073910 con 0x7f910806c060 2023-06-23T19:01:57.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.874+0000 7f90f6ffd700 1 -- 172.21.15.136:0/1651590083 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90f8007430 con 0x7f910806c060 2023-06-23T19:01:57.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.875+0000 7f90f6ffd700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f90e806ace0 0x7f90e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:57.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.875+0000 7f90f6ffd700 1 -- 172.21.15.136:0/1651590083 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f90f80889d0 con 0x7f910806c060 2023-06-23T19:01:57.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.875+0000 7f9105d9b700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f90e806ace0 0x7f90e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:57.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.875+0000 7f9105d9b700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f90e806ace0 0x7f90e806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00bae0 tx=0x7f90fc013000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:57.883 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:57.879+0000 7f90f6ffd700 1 -- 172.21.15.136:0/1651590083 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f90f80537f0 con 0x7f910806c060 2023-06-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.078+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91080cefc0 con 0x7f910806c060 2023-06-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.080+0000 7f90f6ffd700 1 -- 172.21.15.136:0/1651590083 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f90f8056e10 con 0x7f910806c060 2023-06-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f90e806ace0 msgr2=0x7f90e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f90e806ace0 0x7f90e806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00bae0 tx=0x7f90fc013000 comp rx=0 tx=0).stop 2023-06-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910806c060 msgr2=0x7f91081514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910806c060 0x7f91081514c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f90f800c480 tx=0x7f90f800c790 comp rx=0 tx=0).stop 2023-06-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 shutdown_connections 2023-06-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f90e806ace0 0x7f90e806d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9108158ef0 0x7f910815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910806c060 0x7f91081514c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 --2- 172.21.15.136:0/1651590083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91080709f0 0x7f91080ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 >> 172.21.15.136:0/1651590083 conn(0x7f91080b0ef0 msgr2=0x7f9108152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:58.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 shutdown_connections 2023-06-23T19:01:58.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.082+0000 7f910c9ff700 1 -- 172.21.15.136:0/1651590083 wait complete. 2023-06-23T19:01:58.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:01:58.105 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:01:58.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.297+0000 7fd786bff700 1 Processor -- start 2023-06-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.298+0000 7fd786bff700 1 -- start start 2023-06-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.299+0000 7fd786bff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd7800d0a60 0x7fd7800b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.299+0000 7fd786bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7800cd9d0 con 0x7fd7800b51d0 2023-06-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.299+0000 7fd786bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7800b5620 con 0x7fd7800cf910 2023-06-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.299+0000 7fd786bff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7800d0060 con 0x7fd7800d0a60 2023-06-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.299+0000 7fd77ffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd7800b51d0 0x7fd7800d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41870/0 (socket says 172.21.15.136:41870) 2023-06-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.299+0000 7fd77ffff700 1 -- 172.21.15.136:0/3979934780 learned_addr learned my addr 172.21.15.136:0/3979934780 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.299+0000 7fd78499b700 1 --2- 172.21.15.136:0/3979934780 >> v2:172.21.15.178:3300/0 conn(0x7fd7800d0a60 0x7fd7800b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.299+0000 7fd77f7fe700 1 -- 172.21.15.136:0/3979934780 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099588825 0 0) 0x7fd7800cd9d0 con 0x7fd7800b51d0 2023-06-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.300+0000 7fd77f7fe700 1 -- 172.21.15.136:0/3979934780 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7700035b0 con 0x7fd7800b51d0 2023-06-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.300+0000 7fd78499b700 1 -- 172.21.15.136:0/3979934780 >> v1:172.21.15.178:6789/0 conn(0x7fd7800cf910 legacy=0x7fd7800d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.300+0000 7fd78499b700 1 -- 172.21.15.136:0/3979934780 >> v1:172.21.15.136:6789/0 conn(0x7fd7800b51d0 legacy=0x7fd7800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.300+0000 7fd78499b700 1 -- 172.21.15.136:0/3979934780 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7800cd410 con 0x7fd7800d0a60 2023-06-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.300+0000 7fd78499b700 1 --2- 172.21.15.136:0/3979934780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7800d0a60 0x7fd7800b5a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd774009840 tx=0x7fd774009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49a48aa6fc84db69 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.300+0000 7fd77f7fe700 1 -- 172.21.15.136:0/3979934780 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774011830 con 0x7fd7800d0a60 2023-06-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.300+0000 7fd77f7fe700 1 -- 172.21.15.136:0/3979934780 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd774011990 con 0x7fd7800d0a60 2023-06-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.300+0000 7fd77f7fe700 1 -- 172.21.15.136:0/3979934780 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774011d20 con 0x7fd7800d0a60 2023-06-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.301+0000 7fd786bff700 1 -- 172.21.15.136:0/3979934780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7800d0a60 msgr2=0x7fd7800b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.301+0000 7fd786bff700 1 --2- 172.21.15.136:0/3979934780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7800d0a60 0x7fd7800b5a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd774009840 tx=0x7fd774009b50 comp rx=0 tx=0).stop 2023-06-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.301+0000 7fd786bff700 1 -- 172.21.15.136:0/3979934780 shutdown_connections 2023-06-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.301+0000 7fd786bff700 1 --2- 172.21.15.136:0/3979934780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7800d0a60 0x7fd7800b5a70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.301+0000 7fd786bff700 1 -- 172.21.15.136:0/3979934780 >> 172.21.15.136:0/3979934780 conn(0x7fd780071620 msgr2=0x7fd7800719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.301+0000 7fd786bff700 1 -- 172.21.15.136:0/3979934780 shutdown_connections 2023-06-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.301+0000 7fd786bff700 1 -- 172.21.15.136:0/3979934780 wait complete. 2023-06-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.303+0000 7fd786bff700 1 Processor -- start 2023-06-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.303+0000 7fd786bff700 1 -- start start 2023-06-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd786bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7800b51d0 0x7fd7801f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd786bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7800cf910 0x7fd7800b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd786bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7800d0a60 0x7fd7801f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd786bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7801f2b00 con 0x7fd7800b51d0 2023-06-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd786bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800b5a70 con 0x7fd7800d0a60 2023-06-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd786bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800b5d10 con 0x7fd7800cf910 2023-06-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd78499b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7800b51d0 0x7fd7801f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd78499b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7800b51d0 0x7fd7801f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60776/0 (socket says 172.21.15.136:60776) 2023-06-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd78499b700 1 -- 172.21.15.136:0/3348080724 learned_addr learned my addr 172.21.15.136:0/3348080724 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd78519c700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7800d0a60 0x7fd7801f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd77ffff700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7800cf910 0x7fd7800b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd78499b700 1 -- 172.21.15.136:0/3348080724 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7800cf910 msgr2=0x7fd7800b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd78499b700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7800cf910 0x7fd7800b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd78499b700 1 -- 172.21.15.136:0/3348080724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7800d0a60 msgr2=0x7fd7801f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd78499b700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7800d0a60 0x7fd7801f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.304+0000 7fd78499b700 1 -- 172.21.15.136:0/3348080724 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7740094a0 con 0x7fd7800b51d0 2023-06-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.305+0000 7fd78499b700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7800b51d0 0x7fd7801f25c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd774009b90 tx=0x7fd774004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.305+0000 7fd77d7fa700 1 -- 172.21.15.136:0/3348080724 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740036a0 con 0x7fd7800b51d0 2023-06-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.305+0000 7fd77d7fa700 1 -- 172.21.15.136:0/3348080724 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77401e070 con 0x7fd7800b51d0 2023-06-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.305+0000 7fd77d7fa700 1 -- 172.21.15.136:0/3348080724 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774003a20 con 0x7fd7800b51d0 2023-06-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.305+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7800b5ff0 con 0x7fd7800b51d0 2023-06-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.305+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7800b65b0 con 0x7fd7800b51d0 2023-06-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.306+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78004ea20 con 0x7fd7800b51d0 2023-06-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.307+0000 7fd77d7fa700 1 -- 172.21.15.136:0/3348080724 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd774003b80 con 0x7fd7800b51d0 2023-06-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.308+0000 7fd77d7fa700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd76406ace0 0x7fd76406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.308+0000 7fd77d7fa700 1 -- 172.21.15.136:0/3348080724 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd77408a780 con 0x7fd7800b51d0 2023-06-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.308+0000 7fd77ffff700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd76406ace0 0x7fd76406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.309+0000 7fd77ffff700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd76406ace0 0x7fd76406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd7800c8770 tx=0x7fd76c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.312+0000 7fd77d7fa700 1 -- 172.21.15.136:0/3348080724 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd774055590 con 0x7fd7800b51d0 2023-06-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.509+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7800d20d0 con 0x7fd7800b51d0 2023-06-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.509+0000 7fd77d7fa700 1 -- 172.21.15.136:0/3348080724 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd774058bb0 con 0x7fd7800b51d0 2023-06-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd76406ace0 msgr2=0x7fd76406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd76406ace0 0x7fd76406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd7800c8770 tx=0x7fd76c009040 comp rx=0 tx=0).stop 2023-06-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7800b51d0 msgr2=0x7fd7801f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7800b51d0 0x7fd7801f25c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd774009b90 tx=0x7fd774004750 comp rx=0 tx=0).stop 2023-06-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 shutdown_connections 2023-06-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd76406ace0 0x7fd76406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7800d0a60 0x7fd7801f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7800b51d0 0x7fd7801f25c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 --2- 172.21.15.136:0/3348080724 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7800cf910 0x7fd7800b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 >> 172.21.15.136:0/3348080724 conn(0x7fd780071620 msgr2=0x7fd7800d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 shutdown_connections 2023-06-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.512+0000 7fd786bff700 1 -- 172.21.15.136:0/3348080724 wait complete. 2023-06-23T19:01:58.596 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:01:58.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.790+0000 7f76d1bff700 1 Processor -- start 2023-06-23T19:01:58.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.790+0000 7f76d1bff700 1 -- start start 2023-06-23T19:01:58.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.791+0000 7f76d1bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0a60 0x7f76cc0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.791+0000 7f76d1bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f76cc0b51d0 0x7f76cc0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.791+0000 7f76d1bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc0cd9d0 con 0x7f76cc0d0e30 2023-06-23T19:01:58.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.791+0000 7f76d1bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc0d0060 con 0x7f76cc0b51d0 2023-06-23T19:01:58.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.791+0000 7f76d1bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0cfe50 con 0x7f76cc0d0a60 2023-06-23T19:01:58.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.791+0000 7f76caffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f76cc0b51d0 0x7f76cc0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:58.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.791+0000 7f76caffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f76cc0b51d0 0x7f76cc0cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60790/0 (socket says 172.21.15.136:60790) 2023-06-23T19:01:58.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.791+0000 7f76caffd700 1 -- 172.21.15.136:0/1947241381 learned_addr learned my addr 172.21.15.136:0/1947241381 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:58.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76cb7fe700 1 --2- 172.21.15.136:0/1947241381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0a60 0x7f76cc0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:58.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76caffd700 1 -- 172.21.15.136:0/1947241381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0a60 msgr2=0x7f76cc0b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:58.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76caffd700 1 --2- 172.21.15.136:0/1947241381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0a60 0x7f76cc0b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76caffd700 1 -- 172.21.15.136:0/1947241381 >> v1:172.21.15.136:6789/0 conn(0x7f76cc0d0e30 legacy=0x7f76cc0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76ca7fc700 1 -- 172.21.15.136:0/1947241381 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573374156 0 0) 0x7f76cc0cd9d0 con 0x7f76cc0d0e30 2023-06-23T19:01:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76caffd700 1 -- 172.21.15.136:0/1947241381 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0b5640 con 0x7f76cc0b51d0 2023-06-23T19:01:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76cb7fe700 1 --2- 172.21.15.136:0/1947241381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0a60 0x7f76cc0b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:01:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76caffd700 1 --2- 172.21.15.136:0/1947241381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 0x7f76cc0cf910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f76c00098f0 tx=0x7f76c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca9229f959fb78e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76ca7fc700 1 -- 172.21.15.136:0/1947241381 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c000b8a0 con 0x7f76cc0b51d0 2023-06-23T19:01:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76ca7fc700 1 -- 172.21.15.136:0/1947241381 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c000ba00 con 0x7f76cc0b51d0 2023-06-23T19:01:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.792+0000 7f76ca7fc700 1 -- 172.21.15.136:0/1947241381 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c000bd90 con 0x7f76cc0b51d0 2023-06-23T19:01:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.793+0000 7f76d1bff700 1 -- 172.21.15.136:0/1947241381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 msgr2=0x7f76cc0cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.793+0000 7f76d1bff700 1 --2- 172.21.15.136:0/1947241381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 0x7f76cc0cf910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f76c00098f0 tx=0x7f76c0009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.793+0000 7f76d1bff700 1 -- 172.21.15.136:0/1947241381 shutdown_connections 2023-06-23T19:01:58.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.793+0000 7f76d1bff700 1 --2- 172.21.15.136:0/1947241381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0a60 0x7f76cc0b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.793+0000 7f76d1bff700 1 --2- 172.21.15.136:0/1947241381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 0x7f76cc0cf910 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.793+0000 7f76d1bff700 1 -- 172.21.15.136:0/1947241381 >> 172.21.15.136:0/1947241381 conn(0x7f76cc071620 msgr2=0x7f76cc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:58.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.793+0000 7f76d1bff700 1 -- 172.21.15.136:0/1947241381 shutdown_connections 2023-06-23T19:01:58.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.793+0000 7f76d1bff700 1 -- 172.21.15.136:0/1947241381 wait complete. 2023-06-23T19:01:58.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.795+0000 7f76d1bff700 1 Processor -- start 2023-06-23T19:01:58.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.795+0000 7f76d1bff700 1 -- start start 2023-06-23T19:01:58.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76d1bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 0x7f76cc1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76d1bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76cc0d0a60 0x7f76cc0b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76d1bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0e30 0x7f76cc0b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76d1bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc154cf0 con 0x7f76cc0b51d0 2023-06-23T19:01:58.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76d1bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0b6000 con 0x7f76cc0d0a60 2023-06-23T19:01:58.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76d1bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0b62a0 con 0x7f76cc0d0e30 2023-06-23T19:01:58.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76cb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 0x7f76cc1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:58.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76cb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 0x7f76cc1547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60796/0 (socket says 172.21.15.136:60796) 2023-06-23T19:01:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76cb7fe700 1 -- 172.21.15.136:0/3276959611 learned_addr learned my addr 172.21.15.136:0/3276959611 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76cb7fe700 1 -- 172.21.15.136:0/3276959611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0e30 msgr2=0x7f76cc0b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76cb7fe700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0e30 0x7f76cc0b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76cb7fe700 1 -- 172.21.15.136:0/3276959611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76cc0d0a60 msgr2=0x7f76cc0b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76cb7fe700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76cc0d0a60 0x7f76cc0b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.796+0000 7f76cb7fe700 1 -- 172.21.15.136:0/3276959611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0009550 con 0x7f76cc0b51d0 2023-06-23T19:01:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.797+0000 7f76cb7fe700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 0x7f76cc1547b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c750 tx=0x7f76bc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.797+0000 7f76b3fff700 1 -- 172.21.15.136:0/3276959611 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc011800 con 0x7f76cc0b51d0 2023-06-23T19:01:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.797+0000 7f76b3fff700 1 -- 172.21.15.136:0/3276959611 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc011960 con 0x7f76cc0b51d0 2023-06-23T19:01:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.797+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc15bb00 con 0x7f76cc0b51d0 2023-06-23T19:01:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.797+0000 7f76b3fff700 1 -- 172.21.15.136:0/3276959611 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc011cd0 con 0x7f76cc0b51d0 2023-06-23T19:01:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.797+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc0b6580 con 0x7f76cc0b51d0 2023-06-23T19:01:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.798+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc15c020 con 0x7f76cc0b51d0 2023-06-23T19:01:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.799+0000 7f76b3fff700 1 -- 172.21.15.136:0/3276959611 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76bc021350 con 0x7f76cc0b51d0 2023-06-23T19:01:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.800+0000 7f76b3fff700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f76b806ace0 0x7f76b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.800+0000 7f76b3fff700 1 -- 172.21.15.136:0/3276959611 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f76bc0897a0 con 0x7f76cc0b51d0 2023-06-23T19:01:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.800+0000 7f76caffd700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f76b806ace0 0x7f76b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.801+0000 7f76caffd700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f76b806ace0 0x7f76b806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0b7fb0 tx=0x7f76c0010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:58.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.804+0000 7f76b3fff700 1 -- 172.21.15.136:0/3276959611 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76cc15c020 con 0x7f76cc0b51d0 2023-06-23T19:01:59.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.998+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f76cc15c020 con 0x7f76cc0b51d0 2023-06-23T19:01:59.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:58.999+0000 7f76b3fff700 1 -- 172.21.15.136:0/3276959611 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76bc057fa0 con 0x7f76cc0b51d0 2023-06-23T19:01:59.003 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:01:59.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f76b806ace0 msgr2=0x7f76b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f76b806ace0 0x7f76b806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0b7fb0 tx=0x7f76c0010000 comp rx=0 tx=0).stop 2023-06-23T19:01:59.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 msgr2=0x7f76cc1547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 0x7f76cc1547b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c750 tx=0x7f76bc00cb10 comp rx=0 tx=0).stop 2023-06-23T19:01:59.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 shutdown_connections 2023-06-23T19:01:59.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f76b806ace0 0x7f76b806d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0d0e30 0x7f76cc0b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76cc0b51d0 0x7f76cc1547b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 --2- 172.21.15.136:0/3276959611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76cc0d0a60 0x7f76cc0b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 >> 172.21.15.136:0/3276959611 conn(0x7f76cc071620 msgr2=0x7f76cc0b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:59.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 shutdown_connections 2023-06-23T19:01:59.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.001+0000 7f76d1bff700 1 -- 172.21.15.136:0/3276959611 wait complete. 2023-06-23T19:01:59.023 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:01:59.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.217+0000 7fd7187ff700 1 Processor -- start 2023-06-23T19:01:59.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.217+0000 7fd7187ff700 1 -- start start 2023-06-23T19:01:59.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.218+0000 7fd7187ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7100b5a70 0x7fd7100b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.218+0000 7fd7187ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100b5ec0 con 0x7fd7100d0a60 2023-06-23T19:01:59.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.218+0000 7fd7187ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100cd9d0 con 0x7fd7100cf910 2023-06-23T19:01:59.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.218+0000 7fd7187ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100d0060 con 0x7fd7100b5a70 2023-06-23T19:01:59.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd71659b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd7100d0a60 0x7fd7100d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41884/0 (socket says 172.21.15.136:41884) 2023-06-23T19:01:59.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd71659b700 1 -- 172.21.15.136:0/3913394261 learned_addr learned my addr 172.21.15.136:0/3913394261 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:01:59.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715d9a700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7100b5a70 0x7fd7100b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548533533 0 0) 0x7fd7100b5ec0 con 0x7fd7100d0a60 2023-06-23T19:01:59.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6fc0035b0 con 0x7fd7100d0a60 2023-06-23T19:01:59.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843062085 0 0) 0x7fd7100cd9d0 con 0x7fd7100cf910 2023-06-23T19:01:59.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7100b5ec0 con 0x7fd7100cf910 2023-06-23T19:01:59.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2949626214 0 0) 0x7fd6fc0035b0 con 0x7fd7100d0a60 2023-06-23T19:01:59.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7100b5a70 msgr2=0x7fd7100b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:59.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7100b5a70 0x7fd7100b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 >> v1:172.21.15.178:6789/0 conn(0x7fd7100cf910 legacy=0x7fd7100d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100cfd90 con 0x7fd7100d0a60 2023-06-23T19:01:59.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.219+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fd70c001670 con 0x7fd7100d0a60 2023-06-23T19:01:59.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 >> v1:172.21.15.136:6789/0 conn(0x7fd7100d0a60 legacy=0x7fd7100d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715599700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc003bc0 0x7fd6fc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715599700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6fc004850 0x7fd6fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715599700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7100b5a70 0x7fd6fc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100d0060 con 0x7fd6fc004850 2023-06-23T19:01:59.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc00ba10 con 0x7fd6fc003bc0 2023-06-23T19:01:59.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc00bb80 con 0x7fd7100b5a70 2023-06-23T19:01:59.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715d9a700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6fc004850 0x7fd6fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd71659b700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc003bc0 0x7fd6fc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd716d9c700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7100b5a70 0x7fd6fc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715d9a700 1 -- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7100b5a70 msgr2=0x7fd6fc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:59.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715d9a700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7100b5a70 0x7fd6fc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715d9a700 1 -- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc003bc0 msgr2=0x7fd6fc003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:59.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715d9a700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc003bc0 0x7fd6fc003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715d9a700 1 -- 172.21.15.136:0/3913394261 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0035b0 con 0x7fd6fc004850 2023-06-23T19:01:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd71659b700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc003bc0 0x7fd6fc003f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.220+0000 7fd715d9a700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6fc004850 0x7fd6fc004cc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd700009b60 tx=0x7fd6fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c60cf877e2f14e6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000e6c0 con 0x7fd6fc004850 2023-06-23T19:01:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000e820 con 0x7fd6fc004850 2023-06-23T19:01:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd715599700 1 -- 172.21.15.136:0/3913394261 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000eb90 con 0x7fd6fc004850 2023-06-23T19:01:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd7187ff700 1 -- 172.21.15.136:0/3913394261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6fc004850 msgr2=0x7fd6fc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd7187ff700 1 --2- 172.21.15.136:0/3913394261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6fc004850 0x7fd6fc004cc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd700009b60 tx=0x7fd6fc005880 comp rx=0 tx=0).stop 2023-06-23T19:01:59.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd716d9c700 1 -- 172.21.15.136:0/3913394261 reap_dead start 2023-06-23T19:01:59.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd7187ff700 1 -- 172.21.15.136:0/3913394261 shutdown_connections 2023-06-23T19:01:59.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd7187ff700 1 -- 172.21.15.136:0/3913394261 >> 172.21.15.136:0/3913394261 conn(0x7fd710071620 msgr2=0x7fd7100719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:59.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd7187ff700 1 -- 172.21.15.136:0/3913394261 shutdown_connections 2023-06-23T19:01:59.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.221+0000 7fd7187ff700 1 -- 172.21.15.136:0/3913394261 wait complete. 2023-06-23T19:01:59.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.223+0000 7fd7187ff700 1 Processor -- start 2023-06-23T19:01:59.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.223+0000 7fd7187ff700 1 -- start start 2023-06-23T19:01:59.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd7187ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc004850 0x7fd7101f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd7187ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7101f4770 0x7fd7101f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd7187ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7101f4be0 0x7fd7101f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd7187ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101f5f20 con 0x7fd7101f4770 2023-06-23T19:01:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd7187ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100cad40 con 0x7fd6fc004850 2023-06-23T19:01:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd7187ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101f3090 con 0x7fd7101f4be0 2023-06-23T19:01:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd715d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7101f4770 0x7fd7101f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd715d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7101f4770 0x7fd7101f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60816/0 (socket says 172.21.15.136:60816) 2023-06-23T19:01:59.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd715d9a700 1 -- 172.21.15.136:0/743241860 learned_addr learned my addr 172.21.15.136:0/743241860 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:59.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.224+0000 7fd71659b700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc004850 0x7fd7101f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd716d9c700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7101f4be0 0x7fd7101f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd715d9a700 1 -- 172.21.15.136:0/743241860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7101f4be0 msgr2=0x7fd7101f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd715d9a700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7101f4be0 0x7fd7101f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd715d9a700 1 -- 172.21.15.136:0/743241860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc004850 msgr2=0x7fd7101f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd715d9a700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc004850 0x7fd7101f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd715d9a700 1 -- 172.21.15.136:0/743241860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100c98d0 con 0x7fd7101f4770 2023-06-23T19:01:59.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd715d9a700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7101f4770 0x7fd7101f5030 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0047a0 tx=0x7fd7000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:59.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd706ffd700 1 -- 172.21.15.136:0/743241860 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000e6c0 con 0x7fd7101f4770 2023-06-23T19:01:59.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd706ffd700 1 -- 172.21.15.136:0/743241860 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700003ab0 con 0x7fd7101f4770 2023-06-23T19:01:59.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd706ffd700 1 -- 172.21.15.136:0/743241860 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700003e60 con 0x7fd7101f4770 2023-06-23T19:01:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7100caf90 con 0x7fd7101f4770 2023-06-23T19:01:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.225+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7100cb550 con 0x7fd7101f4770 2023-06-23T19:01:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.226+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71004ea20 con 0x7fd7101f4770 2023-06-23T19:01:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.227+0000 7fd706ffd700 1 -- 172.21.15.136:0/743241860 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd700013470 con 0x7fd7101f4770 2023-06-23T19:01:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.228+0000 7fd706ffd700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd6f406ace0 0x7fd6f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.228+0000 7fd706ffd700 1 -- 172.21.15.136:0/743241860 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd70008af40 con 0x7fd7101f4770 2023-06-23T19:01:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.229+0000 7fd71659b700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd6f406ace0 0x7fd6f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.229+0000 7fd71659b700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd6f406ace0 0x7fd6f406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd70c001eb0 tx=0x7fd70c001a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.232+0000 7fd706ffd700 1 -- 172.21.15.136:0/743241860 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd700055cb0 con 0x7fd7101f4770 2023-06-23T19:01:59.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.429+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd710072e80 con 0x7fd7101f4770 2023-06-23T19:01:59.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.429+0000 7fd706ffd700 1 -- 172.21.15.136:0/743241860 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7000592d0 con 0x7fd7101f4770 2023-06-23T19:01:59.433 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:01:59.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd6f406ace0 msgr2=0x7fd6f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd6f406ace0 0x7fd6f406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd70c001eb0 tx=0x7fd70c001a90 comp rx=0 tx=0).stop 2023-06-23T19:01:59.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7101f4770 msgr2=0x7fd7101f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7101f4770 0x7fd7101f5030 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0047a0 tx=0x7fd7000047c0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 shutdown_connections 2023-06-23T19:01:59.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd6f406ace0 0x7fd6f406d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6fc004850 0x7fd7101f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7101f4be0 0x7fd7101f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 --2- 172.21.15.136:0/743241860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7101f4770 0x7fd7101f5030 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 >> 172.21.15.136:0/743241860 conn(0x7fd710071620 msgr2=0x7fd7100b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:59.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 shutdown_connections 2023-06-23T19:01:59.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.432+0000 7fd7187ff700 1 -- 172.21.15.136:0/743241860 wait complete. 2023-06-23T19:01:59.454 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.647+0000 7f05751ff700 1 Processor -- start 2023-06-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.647+0000 7f05751ff700 1 -- start start 2023-06-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.648+0000 7f05751ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700d0a60 0x7f05700b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.648+0000 7f05751ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f05700b51d0 0x7f05700cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.648+0000 7f05751ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700cd9d0 con 0x7f05700d0e30 2023-06-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.648+0000 7f05751ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700d0060 con 0x7f05700b51d0 2023-06-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.648+0000 7f05751ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05700cfe50 con 0x7f05700d0a60 2023-06-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.648+0000 7f056e59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f05700b51d0 0x7f05700cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.648+0000 7f056e59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f05700b51d0 0x7f05700cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60824/0 (socket says 172.21.15.136:60824) 2023-06-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.648+0000 7f056e59c700 1 -- 172.21.15.136:0/904217970 learned_addr learned my addr 172.21.15.136:0/904217970 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.648+0000 7f056ed9d700 1 --2- 172.21.15.136:0/904217970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700d0a60 0x7f05700b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.649+0000 7f056e59c700 1 -- 172.21.15.136:0/904217970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700d0a60 msgr2=0x7f05700b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.649+0000 7f056e59c700 1 --2- 172.21.15.136:0/904217970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700d0a60 0x7f05700b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.649+0000 7f056e59c700 1 -- 172.21.15.136:0/904217970 >> v1:172.21.15.136:6789/0 conn(0x7f05700d0e30 legacy=0x7f05700d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.649+0000 7f056e59c700 1 -- 172.21.15.136:0/904217970 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700b5640 con 0x7f05700b51d0 2023-06-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.649+0000 7f056ed9d700 1 --2- 172.21.15.136:0/904217970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700d0a60 0x7f05700b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.649+0000 7f056e59c700 1 --2- 172.21.15.136:0/904217970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700b51d0 0x7f05700cf910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f05640098f0 tx=0x7f0564009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a53d7acc39ba4bb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.649+0000 7f056dd9b700 1 -- 172.21.15.136:0/904217970 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400b8a0 con 0x7f05700b51d0 2023-06-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.649+0000 7f056dd9b700 1 -- 172.21.15.136:0/904217970 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056400ba00 con 0x7f05700b51d0 2023-06-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.649+0000 7f056dd9b700 1 -- 172.21.15.136:0/904217970 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400bd90 con 0x7f05700b51d0 2023-06-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.650+0000 7f05751ff700 1 -- 172.21.15.136:0/904217970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700b51d0 msgr2=0x7f05700cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.650+0000 7f05751ff700 1 --2- 172.21.15.136:0/904217970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700b51d0 0x7f05700cf910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f05640098f0 tx=0x7f0564009c00 comp rx=0 tx=0).stop 2023-06-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.650+0000 7f05751ff700 1 -- 172.21.15.136:0/904217970 shutdown_connections 2023-06-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.650+0000 7f05751ff700 1 --2- 172.21.15.136:0/904217970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700d0a60 0x7f05700b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.650+0000 7f05751ff700 1 --2- 172.21.15.136:0/904217970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700b51d0 0x7f05700cf910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.650+0000 7f05751ff700 1 -- 172.21.15.136:0/904217970 >> 172.21.15.136:0/904217970 conn(0x7f0570071620 msgr2=0x7f05700719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.650+0000 7f05751ff700 1 -- 172.21.15.136:0/904217970 shutdown_connections 2023-06-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.650+0000 7f05751ff700 1 -- 172.21.15.136:0/904217970 wait complete. 2023-06-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.651+0000 7f05751ff700 1 Processor -- start 2023-06-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.652+0000 7f05751ff700 1 -- start start 2023-06-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.652+0000 7f05751ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700b51d0 0x7f05701f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.652+0000 7f05751ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700d0a60 0x7f057014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f05751ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05700d0e30 0x7f05700b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f05751ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057015c6b0 con 0x7f05700d0a60 2023-06-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f05751ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701f5a10 con 0x7f05700d0e30 2023-06-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f05751ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05701f5cf0 con 0x7f05700b51d0 2023-06-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700d0a60 0x7f057014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700d0a60 0x7f057014af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60828/0 (socket says 172.21.15.136:60828) 2023-06-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056e59c700 1 -- 172.21.15.136:0/720841 learned_addr learned my addr 172.21.15.136:0/720841 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056ed9d700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700b51d0 0x7f05701f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056f59e700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05700d0e30 0x7f05700b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056e59c700 1 -- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700b51d0 msgr2=0x7f05701f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056e59c700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700b51d0 0x7f05701f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056e59c700 1 -- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05700d0e30 msgr2=0x7f05700b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056e59c700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05700d0e30 0x7f05700b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056e59c700 1 -- 172.21.15.136:0/720841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564009550 con 0x7f05700d0a60 2023-06-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056ed9d700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700b51d0 0x7f05701f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056f59e700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05700d0e30 0x7f05700b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.653+0000 7f056e59c700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700d0a60 0x7f057014af10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0564000c00 tx=0x7f0564004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.654+0000 7f05577fe700 1 -- 172.21.15.136:0/720841 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564004480 con 0x7f05700d0a60 2023-06-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.654+0000 7f05577fe700 1 -- 172.21.15.136:0/720841 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056401f070 con 0x7f05700d0a60 2023-06-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.654+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05701f5fd0 con 0x7f05700d0a60 2023-06-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.654+0000 7f05577fe700 1 -- 172.21.15.136:0/720841 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640038c0 con 0x7f05700d0a60 2023-06-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.654+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05701f5700 con 0x7f05700d0a60 2023-06-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.655+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057004ea20 con 0x7f05700d0a60 2023-06-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.656+0000 7f05577fe700 1 -- 172.21.15.136:0/720841 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0564021030 con 0x7f05700d0a60 2023-06-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.657+0000 7f05577fe700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f055c06ace0 0x7f055c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.657+0000 7f05577fe700 1 -- 172.21.15.136:0/720841 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f056408ad20 con 0x7f05700d0a60 2023-06-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.657+0000 7f056ed9d700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f055c06ace0 0x7f055c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.657+0000 7f056ed9d700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f055c06ace0 0x7f055c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05700b4be0 tx=0x7f0560008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.661+0000 7f05577fe700 1 -- 172.21.15.136:0/720841 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0564055a90 con 0x7f05700d0a60 2023-06-23T19:01:59.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.854+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05700d16a0 con 0x7f05700d0a60 2023-06-23T19:01:59.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.855+0000 7f05577fe700 1 -- 172.21.15.136:0/720841 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05640590b0 con 0x7f05700d0a60 2023-06-23T19:01:59.859 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:01:59.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f055c06ace0 msgr2=0x7f055c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f055c06ace0 0x7f055c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05700b4be0 tx=0x7f0560008040 comp rx=0 tx=0).stop 2023-06-23T19:01:59.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700d0a60 msgr2=0x7f057014af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:01:59.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700d0a60 0x7f057014af10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0564000c00 tx=0x7f0564004750 comp rx=0 tx=0).stop 2023-06-23T19:01:59.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 shutdown_connections 2023-06-23T19:01:59.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f055c06ace0 0x7f055c06d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05700d0e30 0x7f05700b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05700b51d0 0x7f05701f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 --2- 172.21.15.136:0/720841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05700d0a60 0x7f057014af10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:01:59.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 >> 172.21.15.136:0/720841 conn(0x7f0570071620 msgr2=0x7f05700c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:01:59.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 shutdown_connections 2023-06-23T19:01:59.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:01:59.857+0000 7f05751ff700 1 -- 172.21.15.136:0/720841 wait complete. 2023-06-23T19:01:59.879 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:02:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.072+0000 7fa529fff700 1 Processor -- start 2023-06-23T19:02:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.073+0000 7fa529fff700 1 -- start start 2023-06-23T19:02:00.077 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.074+0000 7fa529fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240b51d0 0x7fa5240cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.074+0000 7fa529fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240b5ec0 con 0x7fa5240d0a60 2023-06-23T19:02:00.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.074+0000 7fa529fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240b5650 con 0x7fa5240b5a70 2023-06-23T19:02:00.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.074+0000 7fa529fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240d0060 con 0x7fa5240b51d0 2023-06-23T19:02:00.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.074+0000 7fa5237fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa5240d0a60 0x7fa5240d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41896/0 (socket says 172.21.15.136:41896) 2023-06-23T19:02:00.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.074+0000 7fa5237fe700 1 -- 172.21.15.136:0/3346891725 learned_addr learned my addr 172.21.15.136:0/3346891725 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:00.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.074+0000 7fa523fff700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240b51d0 0x7fa5240cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.074+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681142513 0 0) 0x7fa5240b5ec0 con 0x7fa5240d0a60 2023-06-23T19:02:00.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5100035b0 con 0x7fa5240d0a60 2023-06-23T19:02:00.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3430242888 0 0) 0x7fa5100035b0 con 0x7fa5240d0a60 2023-06-23T19:02:00.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240b51d0 msgr2=0x7fa5240cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:00.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240b51d0 0x7fa5240cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 >> v1:172.21.15.178:6789/0 conn(0x7fa5240b5a70 legacy=0x7fa5240d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5240cd9d0 con 0x7fa5240d0a60 2023-06-23T19:02:00.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fa514001670 con 0x7fa5240d0a60 2023-06-23T19:02:00.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 >> v1:172.21.15.136:6789/0 conn(0x7fa5240d0a60 legacy=0x7fa5240d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa510003a30 0x7fa510003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240b51d0 0x7fa510004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa510004d90 0x7fa510005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240d0060 con 0x7fa510004d90 2023-06-23T19:02:00.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51000bac0 con 0x7fa510003a30 2023-06-23T19:02:00.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51000bc50 con 0x7fa5240b51d0 2023-06-23T19:02:00.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa523fff700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa510004d90 0x7fa510005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa51bfff700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240b51d0 0x7fa510004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.075+0000 7fa5237fe700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa510003a30 0x7fa510003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.076+0000 7fa523fff700 1 -- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240b51d0 msgr2=0x7fa510004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:00.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.076+0000 7fa523fff700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240b51d0 0x7fa510004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.076+0000 7fa523fff700 1 -- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa510003a30 msgr2=0x7fa510003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:00.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.076+0000 7fa523fff700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa510003a30 0x7fa510003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.076+0000 7fa523fff700 1 -- 172.21.15.136:0/3346891725 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5100035b0 con 0x7fa510004d90 2023-06-23T19:02:00.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.076+0000 7fa523fff700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa510004d90 0x7fa510005200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009fc0 tx=0x7fa510005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47cfb0cc09a8c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:00.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.076+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00ec30 con 0x7fa510004d90 2023-06-23T19:02:00.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.076+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c00f040 con 0x7fa510004d90 2023-06-23T19:02:00.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.076+0000 7fa522ffd700 1 -- 172.21.15.136:0/3346891725 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c014480 con 0x7fa510004d90 2023-06-23T19:02:00.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.077+0000 7fa529fff700 1 -- 172.21.15.136:0/3346891725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa510004d90 msgr2=0x7fa510005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.077+0000 7fa529fff700 1 --2- 172.21.15.136:0/3346891725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa510004d90 0x7fa510005200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009fc0 tx=0x7fa510005880 comp rx=0 tx=0).stop 2023-06-23T19:02:00.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.077+0000 7fa523fff700 1 -- 172.21.15.136:0/3346891725 reap_dead start 2023-06-23T19:02:00.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.077+0000 7fa529fff700 1 -- 172.21.15.136:0/3346891725 shutdown_connections 2023-06-23T19:02:00.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.077+0000 7fa529fff700 1 -- 172.21.15.136:0/3346891725 >> 172.21.15.136:0/3346891725 conn(0x7fa524071620 msgr2=0x7fa5240719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:00.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.077+0000 7fa529fff700 1 -- 172.21.15.136:0/3346891725 shutdown_connections 2023-06-23T19:02:00.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.077+0000 7fa529fff700 1 -- 172.21.15.136:0/3346891725 wait complete. 2023-06-23T19:02:00.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.079+0000 7fa529fff700 1 Processor -- start 2023-06-23T19:02:00.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.079+0000 7fa529fff700 1 -- start start 2023-06-23T19:02:00.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa529fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa510004d90 0x7fa5241531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa529fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240c8700 0x7fa5240b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.088 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa529fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5240c8b70 0x7fa5240b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.088 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa529fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240c6710 con 0x7fa5240c8b70 2023-06-23T19:02:00.088 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa529fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240c69f0 con 0x7fa510004d90 2023-06-23T19:02:00.088 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa529fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240c6cd0 con 0x7fa5240c8700 2023-06-23T19:02:00.088 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa523fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5240c8b70 0x7fa5240b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.088 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa523fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5240c8b70 0x7fa5240b8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60840/0 (socket says 172.21.15.136:60840) 2023-06-23T19:02:00.088 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa523fff700 1 -- 172.21.15.136:0/1109237408 learned_addr learned my addr 172.21.15.136:0/1109237408 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:00.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa51bfff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240c8700 0x7fa5240b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa5237fe700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa510004d90 0x7fa5241531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa523fff700 1 -- 172.21.15.136:0/1109237408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240c8700 msgr2=0x7fa5240b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa523fff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240c8700 0x7fa5240b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa523fff700 1 -- 172.21.15.136:0/1109237408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa510004d90 msgr2=0x7fa5241531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa523fff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa510004d90 0x7fa5241531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.080+0000 7fa523fff700 1 -- 172.21.15.136:0/1109237408 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5240c6fb0 con 0x7fa5240c8b70 2023-06-23T19:02:00.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.081+0000 7fa523fff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5240c8b70 0x7fa5240b8530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa51c017040 tx=0x7fa51c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:00.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.081+0000 7fa520ff9700 1 -- 172.21.15.136:0/1109237408 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c007000 con 0x7fa5240c8b70 2023-06-23T19:02:00.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.081+0000 7fa520ff9700 1 -- 172.21.15.136:0/1109237408 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c003e50 con 0x7fa5240c8b70 2023-06-23T19:02:00.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.081+0000 7fa520ff9700 1 -- 172.21.15.136:0/1109237408 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0149f0 con 0x7fa5240c8b70 2023-06-23T19:02:00.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.081+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5240c7290 con 0x7fa5240c8b70 2023-06-23T19:02:00.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.081+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5240c8400 con 0x7fa5240c8b70 2023-06-23T19:02:00.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.082+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52404ea20 con 0x7fa5240c8b70 2023-06-23T19:02:00.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.083+0000 7fa520ff9700 1 -- 172.21.15.136:0/1109237408 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa51c024020 con 0x7fa5240c8b70 2023-06-23T19:02:00.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.084+0000 7fa520ff9700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa50406ace0 0x7fa50406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.084+0000 7fa520ff9700 1 -- 172.21.15.136:0/1109237408 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa51c08aee0 con 0x7fa5240c8b70 2023-06-23T19:02:00.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.085+0000 7fa5237fe700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa50406ace0 0x7fa50406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.085+0000 7fa5237fe700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa50406ace0 0x7fa50406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa514000c00 tx=0x7fa514000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:00.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.089+0000 7fa520ff9700 1 -- 172.21.15.136:0/1109237408 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa51c055cf0 con 0x7fa5240c8b70 2023-06-23T19:02:00.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.285+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa5240d2380 con 0x7fa5240c8b70 2023-06-23T19:02:00.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.285+0000 7fa520ff9700 1 -- 172.21.15.136:0/1109237408 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa51c059310 con 0x7fa5240c8b70 2023-06-23T19:02:00.289 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa50406ace0 msgr2=0x7fa50406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa50406ace0 0x7fa50406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa514000c00 tx=0x7fa514000f80 comp rx=0 tx=0).stop 2023-06-23T19:02:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5240c8b70 msgr2=0x7fa5240b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5240c8b70 0x7fa5240b8530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa51c017040 tx=0x7fa51c009750 comp rx=0 tx=0).stop 2023-06-23T19:02:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 shutdown_connections 2023-06-23T19:02:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa50406ace0 0x7fa50406d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa510004d90 0x7fa5241531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5240c8b70 0x7fa5240b8530 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 --2- 172.21.15.136:0/1109237408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5240c8700 0x7fa5240b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 >> 172.21.15.136:0/1109237408 conn(0x7fa524071620 msgr2=0x7fa5240b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.287+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 shutdown_connections 2023-06-23T19:02:00.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.288+0000 7fa529fff700 1 -- 172.21.15.136:0/1109237408 wait complete. 2023-06-23T19:02:00.310 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:00.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.500+0000 7f4e939ff700 1 Processor -- start 2023-06-23T19:02:00.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.500+0000 7f4e939ff700 1 -- start start 2023-06-23T19:02:00.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.501+0000 7f4e939ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c15c570 0x7f4e8c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.501+0000 7f4e939ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e8c0cd660 0x7f4e8c160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e939ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4e8c160880 0x7f4e8c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e939ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c15d670 con 0x7f4e8c0cd660 2023-06-23T19:02:00.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e939ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c0cdad0 con 0x7f4e8c160880 2023-06-23T19:02:00.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e939ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c1610a0 con 0x7f4e8c15c570 2023-06-23T19:02:00.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e90f9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e8c0cd660 0x7f4e8c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e90f9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e8c0cd660 0x7f4e8c160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60846/0 (socket says 172.21.15.136:60846) 2023-06-23T19:02:00.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e90f9a700 1 -- 172.21.15.136:0/228384461 learned_addr learned my addr 172.21.15.136:0/228384461 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:00.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e9179b700 1 --2- 172.21.15.136:0/228384461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c15c570 0x7f4e8c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e91f9c700 1 --2- 172.21.15.136:0/228384461 >> v2:172.21.15.178:3300/0 conn(0x7f4e8c160880 0x7f4e8c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e90f9a700 1 -- 172.21.15.136:0/228384461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c15c570 msgr2=0x7f4e8c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:00.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e90f9a700 1 --2- 172.21.15.136:0/228384461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c15c570 0x7f4e8c0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e90f9a700 1 -- 172.21.15.136:0/228384461 >> v2:172.21.15.178:3300/0 conn(0x7f4e8c160880 msgr2=0x7f4e8c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:00.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e90f9a700 1 --2- 172.21.15.136:0/228384461 >> v2:172.21.15.178:3300/0 conn(0x7f4e8c160880 0x7f4e8c06b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.502+0000 7f4e90f9a700 1 -- 172.21.15.136:0/228384461 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c15da90 con 0x7f4e8c0cd660 2023-06-23T19:02:00.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.503+0000 7f4e90f9a700 1 --2- 172.21.15.136:0/228384461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0cd660 0x7f4e8c160340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0d06a0 tx=0x7f4e7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28371d7dd443b55 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:00.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.503+0000 7f4e83fff700 1 -- 172.21.15.136:0/228384461 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00b860 con 0x7f4e8c0cd660 2023-06-23T19:02:00.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.503+0000 7f4e83fff700 1 -- 172.21.15.136:0/228384461 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c00b9c0 con 0x7f4e8c0cd660 2023-06-23T19:02:00.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.503+0000 7f4e83fff700 1 -- 172.21.15.136:0/228384461 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00bd50 con 0x7f4e8c0cd660 2023-06-23T19:02:00.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.503+0000 7f4e939ff700 1 -- 172.21.15.136:0/228384461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0cd660 msgr2=0x7f4e8c160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.503+0000 7f4e939ff700 1 --2- 172.21.15.136:0/228384461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0cd660 0x7f4e8c160340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0d06a0 tx=0x7f4e7c009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:00.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.503+0000 7f4e939ff700 1 -- 172.21.15.136:0/228384461 shutdown_connections 2023-06-23T19:02:00.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.503+0000 7f4e939ff700 1 --2- 172.21.15.136:0/228384461 >> v2:172.21.15.178:3300/0 conn(0x7f4e8c160880 0x7f4e8c06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.503+0000 7f4e939ff700 1 --2- 172.21.15.136:0/228384461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c15c570 0x7f4e8c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.504+0000 7f4e939ff700 1 --2- 172.21.15.136:0/228384461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0cd660 0x7f4e8c160340 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.504+0000 7f4e939ff700 1 -- 172.21.15.136:0/228384461 >> 172.21.15.136:0/228384461 conn(0x7f4e8c071620 msgr2=0x7f4e8c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:00.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.504+0000 7f4e939ff700 1 -- 172.21.15.136:0/228384461 shutdown_connections 2023-06-23T19:02:00.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.504+0000 7f4e939ff700 1 -- 172.21.15.136:0/228384461 wait complete. 2023-06-23T19:02:00.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.505+0000 7f4e939ff700 1 Processor -- start 2023-06-23T19:02:00.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.505+0000 7f4e939ff700 1 -- start start 2023-06-23T19:02:00.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.506+0000 7f4e939ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c0cd660 0x7f4e8c1e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.506+0000 7f4e939ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c15c570 0x7f4e8c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.506+0000 7f4e939ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e8c160880 0x7f4e8c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.506+0000 7f4e939ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c158c60 con 0x7f4e8c15c570 2023-06-23T19:02:00.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.506+0000 7f4e939ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c158f40 con 0x7f4e8c160880 2023-06-23T19:02:00.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.506+0000 7f4e939ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c159220 con 0x7f4e8c0cd660 2023-06-23T19:02:00.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e90f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c15c570 0x7f4e8c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e90f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c15c570 0x7f4e8c159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60858/0 (socket says 172.21.15.136:60858) 2023-06-23T19:02:00.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e90f9a700 1 -- 172.21.15.136:0/1416844196 learned_addr learned my addr 172.21.15.136:0/1416844196 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:00.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e9179b700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c0cd660 0x7f4e8c1e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e91f9c700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e8c160880 0x7f4e8c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e90f9a700 1 -- 172.21.15.136:0/1416844196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c0cd660 msgr2=0x7f4e8c1e8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e90f9a700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c0cd660 0x7f4e8c1e8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e90f9a700 1 -- 172.21.15.136:0/1416844196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e8c160880 msgr2=0x7f4e8c15a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e90f9a700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e8c160880 0x7f4e8c15a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e90f9a700 1 -- 172.21.15.136:0/1416844196 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c009550 con 0x7f4e8c15c570 2023-06-23T19:02:00.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e90f9a700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c15c570 0x7f4e8c159dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009130 tx=0x7f4e7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:00.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e81ffb700 1 -- 172.21.15.136:0/1416844196 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0044d0 con 0x7f4e8c15c570 2023-06-23T19:02:00.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e81ffb700 1 -- 172.21.15.136:0/1416844196 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c01e070 con 0x7f4e8c15c570 2023-06-23T19:02:00.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.507+0000 7f4e81ffb700 1 -- 172.21.15.136:0/1416844196 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0038e0 con 0x7f4e8c15c570 2023-06-23T19:02:00.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.508+0000 7f4e939ff700 1 -- 172.21.15.136:0/1416844196 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c159500 con 0x7f4e8c15c570 2023-06-23T19:02:00.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.508+0000 7f4e939ff700 1 -- 172.21.15.136:0/1416844196 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c157ef0 con 0x7f4e8c15c570 2023-06-23T19:02:00.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.509+0000 7f4e6f7fe700 1 -- 172.21.15.136:0/1416844196 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e680052f0 con 0x7f4e8c15c570 2023-06-23T19:02:00.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.510+0000 7f4e81ffb700 1 -- 172.21.15.136:0/1416844196 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e7c003a40 con 0x7f4e8c15c570 2023-06-23T19:02:00.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.511+0000 7f4e81ffb700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e7006ace0 0x7f4e7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.511+0000 7f4e81ffb700 1 -- 172.21.15.136:0/1416844196 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4e7c020070 con 0x7f4e8c15c570 2023-06-23T19:02:00.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.512+0000 7f4e9179b700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e7006ace0 0x7f4e7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.512+0000 7f4e9179b700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e7006ace0 0x7f4e7006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c150c10 tx=0x7f4e88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:00.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.516+0000 7f4e81ffb700 1 -- 172.21.15.136:0/1416844196 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4e7c0559c0 con 0x7f4e8c15c570 2023-06-23T19:02:00.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.713+0000 7f4e6f7fe700 1 -- 172.21.15.136:0/1416844196 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e680055a0 con 0x7f4e8c15c570 2023-06-23T19:02:00.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.715+0000 7f4e81ffb700 1 -- 172.21.15.136:0/1416844196 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f4e7c02a090 con 0x7f4e8c15c570 2023-06-23T19:02:00.719 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:00.719 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:00.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 -- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e7006ace0 msgr2=0x7f4e7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e7006ace0 0x7f4e7006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c150c10 tx=0x7f4e88008040 comp rx=0 tx=0).stop 2023-06-23T19:02:00.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 -- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c15c570 msgr2=0x7f4e8c159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c15c570 0x7f4e8c159dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009130 tx=0x7f4e7c004750 comp rx=0 tx=0).stop 2023-06-23T19:02:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 -- 172.21.15.136:0/1416844196 shutdown_connections 2023-06-23T19:02:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e7006ace0 0x7f4e7006d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e8c160880 0x7f4e8c15a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e8c0cd660 0x7f4e8c1e8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 --2- 172.21.15.136:0/1416844196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c15c570 0x7f4e8c159dc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 -- 172.21.15.136:0/1416844196 >> 172.21.15.136:0/1416844196 conn(0x7f4e8c071620 msgr2=0x7f4e8c0d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:00.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 -- 172.21.15.136:0/1416844196 shutdown_connections 2023-06-23T19:02:00.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.717+0000 7f4e6f7fe700 1 -- 172.21.15.136:0/1416844196 wait complete. 2023-06-23T19:02:00.739 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:02:00.740 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:02:00.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.935+0000 7f7480dff700 1 Processor -- start 2023-06-23T19:02:00.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.935+0000 7f7480dff700 1 -- start start 2023-06-23T19:02:00.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.936+0000 7f7480dff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f747c158ad0 0x7f747c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.936+0000 7f7480dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c0b0e80 0x7f747c070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.936+0000 7f7480dff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f747c06ded0 0x7f747c06c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.936+0000 7f7480dff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0c55e0 con 0x7f747c158ad0 2023-06-23T19:02:00.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.936+0000 7f7480dff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0b4420 con 0x7f747c06ded0 2023-06-23T19:02:00.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.936+0000 7f7480dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c15d0e0 con 0x7f747c0b0e80 2023-06-23T19:02:00.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.936+0000 7f747a59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f747c158ad0 0x7f747c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.936+0000 7f747a59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f747c158ad0 0x7f747c0702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60874/0 (socket says 172.21.15.136:60874) 2023-06-23T19:02:00.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.936+0000 7f747a59c700 1 -- 172.21.15.136:0/3921224556 learned_addr learned my addr 172.21.15.136:0/3921224556 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:00.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f747ad9d700 1 --2- 172.21.15.136:0/3921224556 >> v2:172.21.15.178:3300/0 conn(0x7f747c06ded0 0x7f747c06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f747a59c700 1 -- 172.21.15.136:0/3921224556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c0b0e80 msgr2=0x7f747c070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:00.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f7473fff700 1 --2- 172.21.15.136:0/3921224556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c0b0e80 0x7f747c070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f747a59c700 1 --2- 172.21.15.136:0/3921224556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c0b0e80 0x7f747c070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f747a59c700 1 -- 172.21.15.136:0/3921224556 >> v2:172.21.15.178:3300/0 conn(0x7f747c06ded0 msgr2=0x7f747c06c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:00.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f747a59c700 1 --2- 172.21.15.136:0/3921224556 >> v2:172.21.15.178:3300/0 conn(0x7f747c06ded0 0x7f747c06c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f747a59c700 1 -- 172.21.15.136:0/3921224556 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c15d570 con 0x7f747c158ad0 2023-06-23T19:02:00.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f747ad9d700 1 --2- 172.21.15.136:0/3921224556 >> v2:172.21.15.178:3300/0 conn(0x7f747c06ded0 0x7f747c06c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:00.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f7473fff700 1 --2- 172.21.15.136:0/3921224556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c0b0e80 0x7f747c070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:00.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f747a59c700 1 --2- 172.21.15.136:0/3921224556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c158ad0 0x7f747c0702e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f747c0711c0 tx=0x7f746c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe8acf529c5bcfa server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:00.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f7479d9b700 1 -- 172.21.15.136:0/3921224556 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c00b870 con 0x7f747c158ad0 2023-06-23T19:02:00.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f7479d9b700 1 -- 172.21.15.136:0/3921224556 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c00b9d0 con 0x7f747c158ad0 2023-06-23T19:02:00.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.937+0000 7f7479d9b700 1 -- 172.21.15.136:0/3921224556 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c00bd60 con 0x7f747c158ad0 2023-06-23T19:02:00.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.938+0000 7f7480dff700 1 -- 172.21.15.136:0/3921224556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c158ad0 msgr2=0x7f747c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.938+0000 7f7480dff700 1 --2- 172.21.15.136:0/3921224556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c158ad0 0x7f747c0702e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f747c0711c0 tx=0x7f746c009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.938+0000 7f7480dff700 1 -- 172.21.15.136:0/3921224556 shutdown_connections 2023-06-23T19:02:00.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.938+0000 7f7480dff700 1 --2- 172.21.15.136:0/3921224556 >> v2:172.21.15.178:3300/0 conn(0x7f747c06ded0 0x7f747c06c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.938+0000 7f7480dff700 1 --2- 172.21.15.136:0/3921224556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c158ad0 0x7f747c0702e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.938+0000 7f7480dff700 1 --2- 172.21.15.136:0/3921224556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c0b0e80 0x7f747c070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.938+0000 7f7480dff700 1 -- 172.21.15.136:0/3921224556 >> 172.21.15.136:0/3921224556 conn(0x7f747c06ab80 msgr2=0x7f747c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:00.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.938+0000 7f7480dff700 1 -- 172.21.15.136:0/3921224556 shutdown_connections 2023-06-23T19:02:00.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.938+0000 7f7480dff700 1 -- 172.21.15.136:0/3921224556 wait complete. 2023-06-23T19:02:00.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.940+0000 7f7480dff700 1 Processor -- start 2023-06-23T19:02:00.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.940+0000 7f7480dff700 1 -- start start 2023-06-23T19:02:00.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7480dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c06ded0 0x7f747c144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7480dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c0b0e80 0x7f747c0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7480dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f747c158ad0 0x7f747c14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7480dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c148900 con 0x7f747c0b0e80 2023-06-23T19:02:00.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7480dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c14db50 con 0x7f747c158ad0 2023-06-23T19:02:00.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7480dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c147960 con 0x7f747c06ded0 2023-06-23T19:02:00.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7473fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c0b0e80 0x7f747c0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7473fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c0b0e80 0x7f747c0cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60876/0 (socket says 172.21.15.136:60876) 2023-06-23T19:02:00.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7473fff700 1 -- 172.21.15.136:0/27992075 learned_addr learned my addr 172.21.15.136:0/27992075 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:00.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f747a59c700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c06ded0 0x7f747c144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f747ad9d700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f747c158ad0 0x7f747c14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7473fff700 1 -- 172.21.15.136:0/27992075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c06ded0 msgr2=0x7f747c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7473fff700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c06ded0 0x7f747c144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7473fff700 1 -- 172.21.15.136:0/27992075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f747c158ad0 msgr2=0x7f747c14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:00.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7473fff700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f747c158ad0 0x7f747c14e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:00.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.941+0000 7f7473fff700 1 -- 172.21.15.136:0/27992075 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c009550 con 0x7f747c0b0e80 2023-06-23T19:02:00.950 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.942+0000 7f7473fff700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c0b0e80 0x7f747c0cb670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f746400c780 tx=0x7f746400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:00.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.942+0000 7f7472ffd700 1 -- 172.21.15.136:0/27992075 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464011800 con 0x7f747c0b0e80 2023-06-23T19:02:00.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.942+0000 7f7472ffd700 1 -- 172.21.15.136:0/27992075 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464011960 con 0x7f747c0b0e80 2023-06-23T19:02:00.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.942+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c14ddc0 con 0x7f747c0b0e80 2023-06-23T19:02:00.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.942+0000 7f7472ffd700 1 -- 172.21.15.136:0/27992075 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464011cd0 con 0x7f747c0b0e80 2023-06-23T19:02:00.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.942+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c147c40 con 0x7f747c0b0e80 2023-06-23T19:02:00.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.943+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c14d9b0 con 0x7f747c0b0e80 2023-06-23T19:02:00.951 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.944+0000 7f7472ffd700 1 -- 172.21.15.136:0/27992075 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7464021350 con 0x7f747c0b0e80 2023-06-23T19:02:00.952 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.945+0000 7f7472ffd700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f745c06ace0 0x7f745c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:00.952 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.945+0000 7f7472ffd700 1 -- 172.21.15.136:0/27992075 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7464089790 con 0x7f747c0b0e80 2023-06-23T19:02:00.952 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.945+0000 7f747a59c700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f745c06ace0 0x7f745c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:00.953 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.946+0000 7f747a59c700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f745c06ace0 0x7f745c06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f746c000c00 tx=0x7f746c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:00.953 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:00.950+0000 7f7472ffd700 1 -- 172.21.15.136:0/27992075 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f747c14d9b0 con 0x7f747c0b0e80 2023-06-23T19:02:01.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.146+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f747c14d9b0 con 0x7f747c0b0e80 2023-06-23T19:02:01.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.146+0000 7f7472ffd700 1 -- 172.21.15.136:0/27992075 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f747c14d9b0 con 0x7f747c0b0e80 2023-06-23T19:02:01.150 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:02:01.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f745c06ace0 msgr2=0x7f745c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f745c06ace0 0x7f745c06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f746c000c00 tx=0x7f746c008030 comp rx=0 tx=0).stop 2023-06-23T19:02:01.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c0b0e80 msgr2=0x7f747c0cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c0b0e80 0x7f747c0cb670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f746400c780 tx=0x7f746400cb40 comp rx=0 tx=0).stop 2023-06-23T19:02:01.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 shutdown_connections 2023-06-23T19:02:01.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f745c06ace0 0x7f745c06d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f747c158ad0 0x7f747c14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f747c06ded0 0x7f747c144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 --2- 172.21.15.136:0/27992075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f747c0b0e80 0x7f747c0cb670 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.148+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 >> 172.21.15.136:0/27992075 conn(0x7f747c06ab80 msgr2=0x7f747c0ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:01.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.149+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 shutdown_connections 2023-06-23T19:02:01.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.149+0000 7f7480dff700 1 -- 172.21.15.136:0/27992075 wait complete. 2023-06-23T19:02:01.171 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:02:01.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.364+0000 7f83db5ff700 1 Processor -- start 2023-06-23T19:02:01.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.364+0000 7f83db5ff700 1 -- start start 2023-06-23T19:02:01.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.365+0000 7f83db5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b51d0 0x7f83d40cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.365+0000 7f83db5ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d40b5ec0 con 0x7f83d40d0a60 2023-06-23T19:02:01.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.365+0000 7f83db5ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d40b5650 con 0x7f83d40b5a70 2023-06-23T19:02:01.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.365+0000 7f83db5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d40d0060 con 0x7f83d40b51d0 2023-06-23T19:02:01.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.365+0000 7f83d939b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f83d40d0a60 0x7f83d40d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41906/0 (socket says 172.21.15.136:41906) 2023-06-23T19:02:01.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.365+0000 7f83d939b700 1 -- 172.21.15.136:0/2935889075 learned_addr learned my addr 172.21.15.136:0/2935889075 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:01.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.365+0000 7f83d9b9c700 1 --2- 172.21.15.136:0/2935889075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b51d0 0x7f83d40cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:01.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.366+0000 7f83cbfff700 1 -- 172.21.15.136:0/2935889075 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324495576 0 0) 0x7f83d40b5ec0 con 0x7f83d40d0a60 2023-06-23T19:02:01.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.366+0000 7f83cbfff700 1 -- 172.21.15.136:0/2935889075 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c00035b0 con 0x7f83d40d0a60 2023-06-23T19:02:01.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.366+0000 7f83cbfff700 1 -- 172.21.15.136:0/2935889075 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485595725 0 0) 0x7f83d40b5650 con 0x7f83d40b5a70 2023-06-23T19:02:01.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.366+0000 7f83d9b9c700 1 -- 172.21.15.136:0/2935889075 >> v1:172.21.15.178:6789/0 conn(0x7f83d40b5a70 legacy=0x7f83d40d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.366+0000 7f83d9b9c700 1 -- 172.21.15.136:0/2935889075 >> v1:172.21.15.136:6789/0 conn(0x7f83d40d0a60 legacy=0x7f83d40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.366+0000 7f83d9b9c700 1 -- 172.21.15.136:0/2935889075 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d40cd9d0 con 0x7f83d40b51d0 2023-06-23T19:02:01.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.366+0000 7f83d9b9c700 1 --2- 172.21.15.136:0/2935889075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b51d0 0x7f83d40cf910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009dc0 tx=0x7f83cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=603447f78ff21ef8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:01.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.366+0000 7f83cbfff700 1 -- 172.21.15.136:0/2935889075 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00e070 con 0x7f83d40b51d0 2023-06-23T19:02:01.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.367+0000 7f83cbfff700 1 -- 172.21.15.136:0/2935889075 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc00bb20 con 0x7f83d40b51d0 2023-06-23T19:02:01.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.367+0000 7f83cbfff700 1 -- 172.21.15.136:0/2935889075 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00bed0 con 0x7f83d40b51d0 2023-06-23T19:02:01.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.367+0000 7f83db5ff700 1 -- 172.21.15.136:0/2935889075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b51d0 msgr2=0x7f83d40cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.367+0000 7f83db5ff700 1 --2- 172.21.15.136:0/2935889075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b51d0 0x7f83d40cf910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009dc0 tx=0x7f83cc00b330 comp rx=0 tx=0).stop 2023-06-23T19:02:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.367+0000 7f83db5ff700 1 -- 172.21.15.136:0/2935889075 shutdown_connections 2023-06-23T19:02:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.367+0000 7f83db5ff700 1 --2- 172.21.15.136:0/2935889075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b51d0 0x7f83d40cf910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.367+0000 7f83db5ff700 1 -- 172.21.15.136:0/2935889075 >> 172.21.15.136:0/2935889075 conn(0x7f83d4071620 msgr2=0x7f83d40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.367+0000 7f83db5ff700 1 -- 172.21.15.136:0/2935889075 shutdown_connections 2023-06-23T19:02:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.367+0000 7f83db5ff700 1 -- 172.21.15.136:0/2935889075 wait complete. 2023-06-23T19:02:01.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.369+0000 7f83db5ff700 1 Processor -- start 2023-06-23T19:02:01.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.369+0000 7f83db5ff700 1 -- start start 2023-06-23T19:02:01.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.370+0000 7f83db5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83d40b51d0 0x7f83d414a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.370+0000 7f83db5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b5a70 0x7f83d40c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.370+0000 7f83db5ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83d40d0a60 0x7f83d40b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.370+0000 7f83db5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d415bfd0 con 0x7f83d40b51d0 2023-06-23T19:02:01.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.370+0000 7f83db5ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4156cf0 con 0x7f83d40d0a60 2023-06-23T19:02:01.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.370+0000 7f83db5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4157590 con 0x7f83d40b5a70 2023-06-23T19:02:01.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.370+0000 7f83d939b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83d40b51d0 0x7f83d414a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:01.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.370+0000 7f83d939b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83d40b51d0 0x7f83d414a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60880/0 (socket says 172.21.15.136:60880) 2023-06-23T19:02:01.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.370+0000 7f83d939b700 1 -- 172.21.15.136:0/2480377591 learned_addr learned my addr 172.21.15.136:0/2480377591 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:01.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83d939b700 1 -- 172.21.15.136:0/2480377591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b5a70 msgr2=0x7f83d40c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83d939b700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b5a70 0x7f83d40c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83d939b700 1 -- 172.21.15.136:0/2480377591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83d40d0a60 msgr2=0x7f83d40b72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83d939b700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83d40d0a60 0x7f83d40b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83d939b700 1 -- 172.21.15.136:0/2480377591 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc009a70 con 0x7f83d40b51d0 2023-06-23T19:02:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83d939b700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83d40b51d0 0x7f83d414a130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f83d000c450 tx=0x7f83d000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83c9ffb700 1 -- 172.21.15.136:0/2480377591 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0005d70 con 0x7f83d40b51d0 2023-06-23T19:02:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83c9ffb700 1 -- 172.21.15.136:0/2480377591 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d00070d0 con 0x7f83d40b51d0 2023-06-23T19:02:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d40c8960 con 0x7f83d40b51d0 2023-06-23T19:02:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83c9ffb700 1 -- 172.21.15.136:0/2480377591 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0007440 con 0x7f83d40b51d0 2023-06-23T19:02:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.371+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d4156f40 con 0x7f83d40b51d0 2023-06-23T19:02:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.372+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d404ea20 con 0x7f83d40b51d0 2023-06-23T19:02:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.373+0000 7f83c9ffb700 1 -- 172.21.15.136:0/2480377591 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83d00075a0 con 0x7f83d40b51d0 2023-06-23T19:02:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.374+0000 7f83c9ffb700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f83b806ace0 0x7f83b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.374+0000 7f83c9ffb700 1 -- 172.21.15.136:0/2480377591 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f83d0088bc0 con 0x7f83d40b51d0 2023-06-23T19:02:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.374+0000 7f83d8b9a700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f83b806ace0 0x7f83b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:01.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.375+0000 7f83d8b9a700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f83b806ace0 0x7f83b806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83c4007fd0 tx=0x7f83c40079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:01.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.378+0000 7f83c9ffb700 1 -- 172.21.15.136:0/2480377591 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f83d0053950 con 0x7f83d40b51d0 2023-06-23T19:02:01.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.574+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83d40cfda0 con 0x7f83d40b51d0 2023-06-23T19:02:01.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.574+0000 7f83c9ffb700 1 -- 172.21.15.136:0/2480377591 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83d0017020 con 0x7f83d40b51d0 2023-06-23T19:02:01.579 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:02:01.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f83b806ace0 msgr2=0x7f83b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f83b806ace0 0x7f83b806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83c4007fd0 tx=0x7f83c40079a0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83d40b51d0 msgr2=0x7f83d414a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83d40b51d0 0x7f83d414a130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f83d000c450 tx=0x7f83d000c810 comp rx=0 tx=0).stop 2023-06-23T19:02:01.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 shutdown_connections 2023-06-23T19:02:01.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f83b806ace0 0x7f83b806d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83d40d0a60 0x7f83d40b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83d40b51d0 0x7f83d414a130 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 --2- 172.21.15.136:0/2480377591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83d40b5a70 0x7f83d40c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.576+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 >> 172.21.15.136:0/2480377591 conn(0x7f83d4071620 msgr2=0x7f83d40b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:01.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.577+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 shutdown_connections 2023-06-23T19:02:01.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.577+0000 7f83db5ff700 1 -- 172.21.15.136:0/2480377591 wait complete. 2023-06-23T19:02:01.599 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:02:01.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.792+0000 7f8e8e3ff700 1 Processor -- start 2023-06-23T19:02:01.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.792+0000 7f8e8e3ff700 1 -- start start 2023-06-23T19:02:01.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.793+0000 7f8e8e3ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8e880d0a60 0x7f8e880b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.793+0000 7f8e8e3ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e880b51d0 0x7f8e880cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.793+0000 7f8e8e3ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e880cd9d0 con 0x7f8e880d0e30 2023-06-23T19:02:01.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.793+0000 7f8e8e3ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e880d0060 con 0x7f8e880d0a60 2023-06-23T19:02:01.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.793+0000 7f8e8e3ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e880cfe50 con 0x7f8e880b51d0 2023-06-23T19:02:01.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.794+0000 7f8e87fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8e880d0a60 0x7f8e880b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:01.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.794+0000 7f8e87fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8e880d0a60 0x7f8e880b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60896/0 (socket says 172.21.15.136:60896) 2023-06-23T19:02:01.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.794+0000 7f8e87fff700 1 -- 172.21.15.136:0/3040943745 learned_addr learned my addr 172.21.15.136:0/3040943745 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:01.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.794+0000 7f8e877fe700 1 --2- 172.21.15.136:0/3040943745 >> v2:172.21.15.178:3300/0 conn(0x7f8e880b51d0 0x7f8e880cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:01.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.794+0000 7f8e87fff700 1 -- 172.21.15.136:0/3040943745 >> v2:172.21.15.178:3300/0 conn(0x7f8e880b51d0 msgr2=0x7f8e880cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:01.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.794+0000 7f8e87fff700 1 --2- 172.21.15.136:0/3040943745 >> v2:172.21.15.178:3300/0 conn(0x7f8e880b51d0 0x7f8e880cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.794+0000 7f8e87fff700 1 -- 172.21.15.136:0/3040943745 >> v1:172.21.15.178:6789/0 conn(0x7f8e880d0e30 legacy=0x7f8e880d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:01.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.794+0000 7f8e87fff700 1 -- 172.21.15.136:0/3040943745 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e880b5620 con 0x7f8e880d0a60 2023-06-23T19:02:01.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.794+0000 7f8e87fff700 1 --2- 172.21.15.136:0/3040943745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 0x7f8e880b5a70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e880d07a0 tx=0x7f8e78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4656ad36b35773 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:01.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e86ffd700 1 -- 172.21.15.136:0/3040943745 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7800b870 con 0x7f8e880d0a60 2023-06-23T19:02:01.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e86ffd700 1 -- 172.21.15.136:0/3040943745 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7800b9d0 con 0x7f8e880d0a60 2023-06-23T19:02:01.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e86ffd700 1 -- 172.21.15.136:0/3040943745 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7800bd60 con 0x7f8e880d0a60 2023-06-23T19:02:01.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/3040943745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 msgr2=0x7f8e880b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e8e3ff700 1 --2- 172.21.15.136:0/3040943745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 0x7f8e880b5a70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e880d07a0 tx=0x7f8e78009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/3040943745 shutdown_connections 2023-06-23T19:02:01.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e8e3ff700 1 --2- 172.21.15.136:0/3040943745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 0x7f8e880b5a70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e8e3ff700 1 --2- 172.21.15.136:0/3040943745 >> v2:172.21.15.178:3300/0 conn(0x7f8e880b51d0 0x7f8e880cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/3040943745 >> 172.21.15.136:0/3040943745 conn(0x7f8e88071620 msgr2=0x7f8e880719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:01.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/3040943745 shutdown_connections 2023-06-23T19:02:01.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.795+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/3040943745 wait complete. 2023-06-23T19:02:01.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.797+0000 7f8e8e3ff700 1 Processor -- start 2023-06-23T19:02:01.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.797+0000 7f8e8e3ff700 1 -- start start 2023-06-23T19:02:01.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e8e3ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e880b51d0 0x7f8e8814e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e8e3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 0x7f8e880b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e8e3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e880d0e30 0x7f8e880c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e8e3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880b8100 con 0x7f8e880d0a60 2023-06-23T19:02:01.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e8e3ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880b83e0 con 0x7f8e880b51d0 2023-06-23T19:02:01.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e8e3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880b6520 con 0x7f8e880d0e30 2023-06-23T19:02:01.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e877fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 0x7f8e880b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:01.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e877fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 0x7f8e880b7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60902/0 (socket says 172.21.15.136:60902) 2023-06-23T19:02:01.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e877fe700 1 -- 172.21.15.136:0/4141333540 learned_addr learned my addr 172.21.15.136:0/4141333540 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:01.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e87fff700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e880b51d0 0x7f8e8814e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:01.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.798+0000 7f8e8c99c700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e880d0e30 0x7f8e880c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:01.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e877fe700 1 -- 172.21.15.136:0/4141333540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e880d0e30 msgr2=0x7f8e880c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e877fe700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e880d0e30 0x7f8e880c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.811 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e877fe700 1 -- 172.21.15.136:0/4141333540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e880b51d0 msgr2=0x7f8e8814e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:01.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e877fe700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e880b51d0 0x7f8e8814e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:01.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e877fe700 1 -- 172.21.15.136:0/4141333540 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e78009550 con 0x7f8e880d0a60 2023-06-23T19:02:01.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e877fe700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 0x7f8e880b7000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00e810 tx=0x7f8e7c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:01.812 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e84ff9700 1 -- 172.21.15.136:0/4141333540 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c013610 con 0x7f8e880d0a60 2023-06-23T19:02:01.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e84ff9700 1 -- 172.21.15.136:0/4141333540 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c013770 con 0x7f8e880d0a60 2023-06-23T19:02:01.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e84ff9700 1 -- 172.21.15.136:0/4141333540 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c013b20 con 0x7f8e880d0a60 2023-06-23T19:02:01.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e880b6800 con 0x7f8e880d0a60 2023-06-23T19:02:01.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.799+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e880b7dd0 con 0x7f8e880d0a60 2023-06-23T19:02:01.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.800+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e881e6d40 con 0x7f8e880d0a60 2023-06-23T19:02:01.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.801+0000 7f8e84ff9700 1 -- 172.21.15.136:0/4141333540 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e7c013c80 con 0x7f8e880d0a60 2023-06-23T19:02:01.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.802+0000 7f8e84ff9700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8e7406ad10 0x7f8e7406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:01.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.802+0000 7f8e84ff9700 1 -- 172.21.15.136:0/4141333540 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8e7c0894f0 con 0x7f8e880d0a60 2023-06-23T19:02:01.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.802+0000 7f8e87fff700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8e7406ad10 0x7f8e7406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:01.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.803+0000 7f8e87fff700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8e7406ad10 0x7f8e7406d1c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e78000c00 tx=0x7f8e78008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:01.817 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:01.806+0000 7f8e84ff9700 1 -- 172.21.15.136:0/4141333540 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e7c054150 con 0x7f8e880d0a60 2023-06-23T19:02:02.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.006+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e8804ea20 con 0x7f8e880d0a60 2023-06-23T19:02:02.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.006+0000 7f8e84ff9700 1 -- 172.21.15.136:0/4141333540 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e7c057770 con 0x7f8e880d0a60 2023-06-23T19:02:02.010 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:02.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8e7406ad10 msgr2=0x7f8e7406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8e7406ad10 0x7f8e7406d1c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e78000c00 tx=0x7f8e78008030 comp rx=0 tx=0).stop 2023-06-23T19:02:02.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 msgr2=0x7f8e880b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 0x7f8e880b7000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00e810 tx=0x7f8e7c00eb20 comp rx=0 tx=0).stop 2023-06-23T19:02:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 shutdown_connections 2023-06-23T19:02:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f8e7406ad10 0x7f8e7406d1c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e880b51d0 0x7f8e8814e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e880d0e30 0x7f8e880c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 --2- 172.21.15.136:0/4141333540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e880d0a60 0x7f8e880b7000 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.008+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 >> 172.21.15.136:0/4141333540 conn(0x7f8e88071620 msgr2=0x7f8e880ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.009+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 shutdown_connections 2023-06-23T19:02:02.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.009+0000 7f8e8e3ff700 1 -- 172.21.15.136:0/4141333540 wait complete. 2023-06-23T19:02:02.031 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.225+0000 7f0909dff700 1 Processor -- start 2023-06-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.225+0000 7f0909dff700 1 -- start start 2023-06-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.226+0000 7f0909dff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f09040d0a60 0x7f09040b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.226+0000 7f0909dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09040cd9d0 con 0x7f09040b51d0 2023-06-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.226+0000 7f0909dff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09040b5620 con 0x7f09040cf910 2023-06-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.226+0000 7f0909dff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09040d0060 con 0x7f09040d0a60 2023-06-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.226+0000 7f09037fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f09040d0a60 0x7f09040b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.226+0000 7f09037fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f09040d0a60 0x7f09040b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60908/0 (socket says 172.21.15.136:60908) 2023-06-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.226+0000 7f09037fe700 1 -- 172.21.15.136:0/3573367994 learned_addr learned my addr 172.21.15.136:0/3573367994 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.226+0000 7f08fbfff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f09040b51d0 0x7f09040d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41920/0 (socket says 172.21.15.136:41920) 2023-06-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.226+0000 7f09037fe700 1 -- 172.21.15.136:0/3573367994 >> v1:172.21.15.178:6789/0 conn(0x7f09040cf910 legacy=0x7f09040d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.227+0000 7f09037fe700 1 -- 172.21.15.136:0/3573367994 >> v1:172.21.15.136:6789/0 conn(0x7f09040b51d0 legacy=0x7f09040d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.227+0000 7f0902ffd700 1 -- 172.21.15.136:0/3573367994 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872859536 0 0) 0x7f09040cd9d0 con 0x7f09040b51d0 2023-06-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.227+0000 7f09037fe700 1 -- 172.21.15.136:0/3573367994 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040cd410 con 0x7f09040d0a60 2023-06-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.227+0000 7f09037fe700 1 --2- 172.21.15.136:0/3573367994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040d0a60 0x7f09040b5a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f08f40098f0 tx=0x7f08f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f056497fa0aa679 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.227+0000 7f0902ffd700 1 -- 172.21.15.136:0/3573367994 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4004230 con 0x7f09040d0a60 2023-06-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.227+0000 7f0902ffd700 1 -- 172.21.15.136:0/3573367994 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4004390 con 0x7f09040d0a60 2023-06-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.227+0000 7f0902ffd700 1 -- 172.21.15.136:0/3573367994 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40036a0 con 0x7f09040d0a60 2023-06-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.228+0000 7f0909dff700 1 -- 172.21.15.136:0/3573367994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040d0a60 msgr2=0x7f09040b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.228+0000 7f0909dff700 1 --2- 172.21.15.136:0/3573367994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040d0a60 0x7f09040b5a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f08f40098f0 tx=0x7f08f4009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.228+0000 7f0909dff700 1 -- 172.21.15.136:0/3573367994 shutdown_connections 2023-06-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.228+0000 7f0909dff700 1 --2- 172.21.15.136:0/3573367994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040d0a60 0x7f09040b5a70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.228+0000 7f0909dff700 1 -- 172.21.15.136:0/3573367994 >> 172.21.15.136:0/3573367994 conn(0x7f0904071620 msgr2=0x7f09040719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.228+0000 7f0909dff700 1 -- 172.21.15.136:0/3573367994 shutdown_connections 2023-06-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.228+0000 7f0909dff700 1 -- 172.21.15.136:0/3573367994 wait complete. 2023-06-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.229+0000 7f0909dff700 1 Processor -- start 2023-06-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.229+0000 7f0909dff700 1 -- start start 2023-06-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.230+0000 7f0909dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09040b51d0 0x7f0904156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.230+0000 7f0909dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040cf910 0x7f09040b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.230+0000 7f0909dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040d0a60 0x7f09040cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.230+0000 7f0909dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09040b7bc0 con 0x7f09040cf910 2023-06-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.230+0000 7f0909dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09040b6f80 con 0x7f09040d0a60 2023-06-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.230+0000 7f0909dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09040b7220 con 0x7f09040b51d0 2023-06-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f08fbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040cf910 0x7f09040b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f08fbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040cf910 0x7f09040b6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60910/0 (socket says 172.21.15.136:60910) 2023-06-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f08fbfff700 1 -- 172.21.15.136:0/762164290 learned_addr learned my addr 172.21.15.136:0/762164290 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f09037fe700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09040b51d0 0x7f0904156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f0903fff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040d0a60 0x7f09040cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f08fbfff700 1 -- 172.21.15.136:0/762164290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09040b51d0 msgr2=0x7f0904156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f08fbfff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09040b51d0 0x7f0904156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f08fbfff700 1 -- 172.21.15.136:0/762164290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040d0a60 msgr2=0x7f09040cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f08fbfff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040d0a60 0x7f09040cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f08fbfff700 1 -- 172.21.15.136:0/762164290 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f4009550 con 0x7f09040cf910 2023-06-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f08fbfff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040cf910 0x7f09040b6480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00c520 tx=0x7f08ec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.231+0000 7f0900ff9700 1 -- 172.21.15.136:0/762164290 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec004c80 con 0x7f09040cf910 2023-06-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.232+0000 7f0900ff9700 1 -- 172.21.15.136:0/762164290 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec004de0 con 0x7f09040cf910 2023-06-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.232+0000 7f0900ff9700 1 -- 172.21.15.136:0/762164290 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec007310 con 0x7f09040cf910 2023-06-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.232+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09040b7500 con 0x7f09040cf910 2023-06-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.232+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0904157430 con 0x7f09040cf910 2023-06-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.233+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09040b7d00 con 0x7f09040cf910 2023-06-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.234+0000 7f0900ff9700 1 -- 172.21.15.136:0/762164290 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f08ec007470 con 0x7f09040cf910 2023-06-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.234+0000 7f0900ff9700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08e406ace0 0x7f08e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.235+0000 7f0900ff9700 1 -- 172.21.15.136:0/762164290 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f08ec089450 con 0x7f09040cf910 2023-06-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.235+0000 7f09037fe700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08e406ace0 0x7f08e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.235+0000 7f09037fe700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08e406ace0 0x7f08e406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009130 tx=0x7f08f4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.239+0000 7f0900ff9700 1 -- 172.21.15.136:0/762164290 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09040b7d00 con 0x7f09040cf910 2023-06-23T19:02:02.450 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.447+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09040b7d00 con 0x7f09040cf910 2023-06-23T19:02:02.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.447+0000 7f0900ff9700 1 -- 172.21.15.136:0/762164290 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09040b7d00 con 0x7f09040cf910 2023-06-23T19:02:02.452 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:02:02.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.449+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08e406ace0 msgr2=0x7f08e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.449+0000 7f0909dff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08e406ace0 0x7f08e406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009130 tx=0x7f08f4008030 comp rx=0 tx=0).stop 2023-06-23T19:02:02.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.449+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040cf910 msgr2=0x7f09040b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.449+0000 7f0909dff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040cf910 0x7f09040b6480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00c520 tx=0x7f08ec00c830 comp rx=0 tx=0).stop 2023-06-23T19:02:02.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.450+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 shutdown_connections 2023-06-23T19:02:02.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.450+0000 7f0909dff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08e406ace0 0x7f08e406d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.450+0000 7f0909dff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040d0a60 0x7f09040cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.450+0000 7f0909dff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09040b51d0 0x7f0904156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.450+0000 7f0909dff700 1 --2- 172.21.15.136:0/762164290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09040cf910 0x7f09040b6480 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.450+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 >> 172.21.15.136:0/762164290 conn(0x7f0904071620 msgr2=0x7f09040b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:02.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.450+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 shutdown_connections 2023-06-23T19:02:02.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.450+0000 7f0909dff700 1 -- 172.21.15.136:0/762164290 wait complete. 2023-06-23T19:02:02.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:02:02.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.664+0000 7f99ab9ff700 1 Processor -- start 2023-06-23T19:02:02.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.664+0000 7f99ab9ff700 1 -- start start 2023-06-23T19:02:02.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.665+0000 7f99ab9ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f99a40cd890 0x7f99a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.665+0000 7f99ab9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40cfa30 0x7f99a40b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.665+0000 7f99ab9ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a40cfe60 con 0x7f99a40b1fe0 2023-06-23T19:02:02.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.665+0000 7f99ab9ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a40b5c90 con 0x7f99a40cd890 2023-06-23T19:02:02.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.665+0000 7f99ab9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40b5980 con 0x7f99a40cfa30 2023-06-23T19:02:02.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.666+0000 7f99a9f9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40cfa30 0x7f99a40b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.666+0000 7f99a8f9a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f99a40cd890 0x7f99a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.666+0000 7f99a9f9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40cfa30 0x7f99a40b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:59010/0 (socket says 172.21.15.136:59010) 2023-06-23T19:02:02.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.666+0000 7f99a9f9c700 1 -- 172.21.15.136:0/1961537696 learned_addr learned my addr 172.21.15.136:0/1961537696 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:02.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.666+0000 7f99a8f9a700 1 -- 172.21.15.136:0/1961537696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40cfa30 msgr2=0x7f99a40b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:02.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.666+0000 7f99a8f9a700 1 --2- 172.21.15.136:0/1961537696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40cfa30 0x7f99a40b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.666+0000 7f99a8f9a700 1 -- 172.21.15.136:0/1961537696 >> v1:172.21.15.178:6789/0 conn(0x7f99a40b1fe0 legacy=0x7f99a40cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.667+0000 7f99a8f9a700 1 -- 172.21.15.136:0/1961537696 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a40d1320 con 0x7f99a40cd890 2023-06-23T19:02:02.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.667+0000 7f99a9f9c700 1 --2- 172.21.15.136:0/1961537696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40cfa30 0x7f99a40b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:02.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.667+0000 7f99a8f9a700 1 --2- 172.21.15.136:0/1961537696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cd890 0x7f99a40cf4f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9994009840 tx=0x7f9994009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c7b53ec97cb8e0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:02.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.667+0000 7f999bfff700 1 -- 172.21.15.136:0/1961537696 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994011830 con 0x7f99a40cd890 2023-06-23T19:02:02.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.667+0000 7f999bfff700 1 -- 172.21.15.136:0/1961537696 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9994011990 con 0x7f99a40cd890 2023-06-23T19:02:02.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.667+0000 7f999bfff700 1 -- 172.21.15.136:0/1961537696 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994011d20 con 0x7f99a40cd890 2023-06-23T19:02:02.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.668+0000 7f99ab9ff700 1 -- 172.21.15.136:0/1961537696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cd890 msgr2=0x7f99a40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.668+0000 7f99ab9ff700 1 --2- 172.21.15.136:0/1961537696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cd890 0x7f99a40cf4f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9994009840 tx=0x7f9994009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:02.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.668+0000 7f99ab9ff700 1 -- 172.21.15.136:0/1961537696 shutdown_connections 2023-06-23T19:02:02.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.668+0000 7f99ab9ff700 1 --2- 172.21.15.136:0/1961537696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40cfa30 0x7f99a40b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.668+0000 7f99ab9ff700 1 --2- 172.21.15.136:0/1961537696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cd890 0x7f99a40cf4f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.668+0000 7f99ab9ff700 1 -- 172.21.15.136:0/1961537696 >> 172.21.15.136:0/1961537696 conn(0x7f99a4071620 msgr2=0x7f99a4071a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:02.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.668+0000 7f99ab9ff700 1 -- 172.21.15.136:0/1961537696 shutdown_connections 2023-06-23T19:02:02.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.668+0000 7f99ab9ff700 1 -- 172.21.15.136:0/1961537696 wait complete. 2023-06-23T19:02:02.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.670+0000 7f99ab9ff700 1 Processor -- start 2023-06-23T19:02:02.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.670+0000 7f99ab9ff700 1 -- start start 2023-06-23T19:02:02.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99ab9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99a40b1fe0 0x7f99a40cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99ab9ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cfa30 0x7f99a41f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99ab9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40b30b0 0x7f99a41f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99ab9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40c7a20 con 0x7f99a40b1fe0 2023-06-23T19:02:02.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99ab9ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40b5360 con 0x7f99a40cfa30 2023-06-23T19:02:02.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99ab9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a41f5d60 con 0x7f99a40b30b0 2023-06-23T19:02:02.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99a979b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99a40b1fe0 0x7f99a40cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99a979b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99a40b1fe0 0x7f99a40cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60914/0 (socket says 172.21.15.136:60914) 2023-06-23T19:02:02.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99a979b700 1 -- 172.21.15.136:0/2636529924 learned_addr learned my addr 172.21.15.136:0/2636529924 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:02.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99a9f9c700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40b30b0 0x7f99a41f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99a8f9a700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cfa30 0x7f99a41f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99a979b700 1 -- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40b30b0 msgr2=0x7f99a41f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.671+0000 7f99a979b700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40b30b0 0x7f99a41f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f99a979b700 1 -- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cfa30 msgr2=0x7f99a41f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f99a979b700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cfa30 0x7f99a41f5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f99a979b700 1 -- 172.21.15.136:0/2636529924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c009b30 con 0x7f99a40b1fe0 2023-06-23T19:02:02.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f99a9f9c700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40b30b0 0x7f99a41f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:02.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f99a8f9a700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cfa30 0x7f99a41f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:02.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f99a979b700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99a40b1fe0 0x7f99a40cc350 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c480 tx=0x7f99a000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:02.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f9999ffb700 1 -- 172.21.15.136:0/2636529924 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a00052d0 con 0x7f99a40b1fe0 2023-06-23T19:02:02.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f9999ffb700 1 -- 172.21.15.136:0/2636529924 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a0005430 con 0x7f99a40b1fe0 2023-06-23T19:02:02.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99940094a0 con 0x7f99a40b1fe0 2023-06-23T19:02:02.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f9999ffb700 1 -- 172.21.15.136:0/2636529924 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a00038c0 con 0x7f99a40b1fe0 2023-06-23T19:02:02.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.672+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a40c76b0 con 0x7f99a40b1fe0 2023-06-23T19:02:02.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.673+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a404ea20 con 0x7f99a40b1fe0 2023-06-23T19:02:02.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.674+0000 7f9999ffb700 1 -- 172.21.15.136:0/2636529924 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99a0003a20 con 0x7f99a40b1fe0 2023-06-23T19:02:02.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.675+0000 7f9999ffb700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f998806ace0 0x7f998806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:02.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.675+0000 7f9999ffb700 1 -- 172.21.15.136:0/2636529924 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f99a0088c50 con 0x7f99a40b1fe0 2023-06-23T19:02:02.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.675+0000 7f99a8f9a700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f998806ace0 0x7f998806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:02.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.676+0000 7f99a8f9a700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f998806ace0 0x7f998806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f99a406c2c0 tx=0x7f9994008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:02.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.679+0000 7f9999ffb700 1 -- 172.21.15.136:0/2636529924 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99a008e020 con 0x7f99a40b1fe0 2023-06-23T19:02:02.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.874+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f99a415b480 con 0x7f99a40b1fe0 2023-06-23T19:02:02.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.875+0000 7f9999ffb700 1 -- 172.21.15.136:0/2636529924 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f99a0017020 con 0x7f99a40b1fe0 2023-06-23T19:02:02.879 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:02.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f998806ace0 msgr2=0x7f998806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f998806ace0 0x7f998806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f99a406c2c0 tx=0x7f9994008030 comp rx=0 tx=0).stop 2023-06-23T19:02:02.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99a40b1fe0 msgr2=0x7f99a40cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:02.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99a40b1fe0 0x7f99a40cc350 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c480 tx=0x7f99a000c840 comp rx=0 tx=0).stop 2023-06-23T19:02:02.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 shutdown_connections 2023-06-23T19:02:02.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f998806ace0 0x7f998806d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40b30b0 0x7f99a41f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99a40b1fe0 0x7f99a40cc350 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 --2- 172.21.15.136:0/2636529924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40cfa30 0x7f99a41f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:02.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 >> 172.21.15.136:0/2636529924 conn(0x7f99a4071620 msgr2=0x7f99a40b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:02.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 shutdown_connections 2023-06-23T19:02:02.883 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:02.877+0000 7f99ab9ff700 1 -- 172.21.15.136:0/2636529924 wait complete. 2023-06-23T19:02:02.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:03.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.091+0000 7f99277ff700 1 Processor -- start 2023-06-23T19:02:03.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.091+0000 7f99277ff700 1 -- start start 2023-06-23T19:02:03.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.092+0000 7f99277ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9920160a50 0x7f99201674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.096 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f99277ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9920160e70 con 0x7f99200cd830 2023-06-23T19:02:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f99277ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99201610a0 con 0x7f992015c570 2023-06-23T19:02:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f99277ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992015d670 con 0x7f9920160a50 2023-06-23T19:02:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f9925d9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9920160a50 0x7f99201674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f9925d9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9920160a50 0x7f99201674d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60926/0 (socket says 172.21.15.136:60926) 2023-06-23T19:02:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f9925d9c700 1 -- 172.21.15.136:0/2520474003 learned_addr learned my addr 172.21.15.136:0/2520474003 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:03.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f9924d9a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f99200cd830 0x7f9920160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41926/0 (socket says 172.21.15.136:41926) 2023-06-23T19:02:03.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f9925d9c700 1 -- 172.21.15.136:0/2520474003 >> v1:172.21.15.178:6789/0 conn(0x7f992015c570 legacy=0x7f99200cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:03.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f9925d9c700 1 -- 172.21.15.136:0/2520474003 >> v1:172.21.15.136:6789/0 conn(0x7f99200cd830 legacy=0x7f9920160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f9925d9c700 1 -- 172.21.15.136:0/2520474003 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992015da90 con 0x7f9920160a50 2023-06-23T19:02:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.093+0000 7f9925d9c700 1 --2- 172.21.15.136:0/2520474003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9920160a50 0x7f99201674d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9918009e50 tx=0x7f991800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27c372d0826adde server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f9917fff700 1 -- 172.21.15.136:0/2520474003 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991800e070 con 0x7f9920160a50 2023-06-23T19:02:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f9917fff700 1 -- 172.21.15.136:0/2520474003 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918003a20 con 0x7f9920160a50 2023-06-23T19:02:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f9917fff700 1 -- 172.21.15.136:0/2520474003 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918003dd0 con 0x7f9920160a50 2023-06-23T19:02:03.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f99277ff700 1 -- 172.21.15.136:0/2520474003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9920160a50 msgr2=0x7f99201674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f99277ff700 1 --2- 172.21.15.136:0/2520474003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9920160a50 0x7f99201674d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9918009e50 tx=0x7f991800b330 comp rx=0 tx=0).stop 2023-06-23T19:02:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f99277ff700 1 -- 172.21.15.136:0/2520474003 shutdown_connections 2023-06-23T19:02:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f99277ff700 1 --2- 172.21.15.136:0/2520474003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9920160a50 0x7f99201674d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f99277ff700 1 -- 172.21.15.136:0/2520474003 >> 172.21.15.136:0/2520474003 conn(0x7f9920071620 msgr2=0x7f99200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f99277ff700 1 -- 172.21.15.136:0/2520474003 shutdown_connections 2023-06-23T19:02:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.094+0000 7f99277ff700 1 -- 172.21.15.136:0/2520474003 wait complete. 2023-06-23T19:02:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.096+0000 7f99277ff700 1 Processor -- start 2023-06-23T19:02:03.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.096+0000 7f99277ff700 1 -- start start 2023-06-23T19:02:03.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f99277ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99200cd830 0x7f992015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f99277ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992015c570 0x7f9920149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f99277ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920160a50 0x7f992014a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f99277ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201e8180 con 0x7f99200cd830 2023-06-23T19:02:03.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f99277ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200c8970 con 0x7f992015c570 2023-06-23T19:02:03.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f99277ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200b5f00 con 0x7f9920160a50 2023-06-23T19:02:03.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f992559b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99200cd830 0x7f992015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f992559b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99200cd830 0x7f992015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60934/0 (socket says 172.21.15.136:60934) 2023-06-23T19:02:03.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f992559b700 1 -- 172.21.15.136:0/1738090808 learned_addr learned my addr 172.21.15.136:0/1738090808 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:03.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f9925d9c700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920160a50 0x7f992014a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.097+0000 7f9924d9a700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992015c570 0x7f9920149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f992559b700 1 -- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920160a50 msgr2=0x7f992014a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f992559b700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920160a50 0x7f992014a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f992559b700 1 -- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992015c570 msgr2=0x7f9920149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f992559b700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992015c570 0x7f9920149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f992559b700 1 -- 172.21.15.136:0/1738090808 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918009b30 con 0x7f99200cd830 2023-06-23T19:02:03.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f9925d9c700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920160a50 0x7f992014a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:03.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f9924d9a700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992015c570 0x7f9920149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:03.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f992559b700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99200cd830 0x7f992015f1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f991c00c4d0 tx=0x7f991c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:03.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f9915ffb700 1 -- 172.21.15.136:0/1738090808 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c011790 con 0x7f99200cd830 2023-06-23T19:02:03.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f9915ffb700 1 -- 172.21.15.136:0/1738090808 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c0118f0 con 0x7f99200cd830 2023-06-23T19:02:03.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99201e7570 con 0x7f99200cd830 2023-06-23T19:02:03.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f9915ffb700 1 -- 172.21.15.136:0/1738090808 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c011ca0 con 0x7f99200cd830 2023-06-23T19:02:03.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.098+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99201e7b30 con 0x7f99200cd830 2023-06-23T19:02:03.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.099+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920073910 con 0x7f99200cd830 2023-06-23T19:02:03.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.100+0000 7f9915ffb700 1 -- 172.21.15.136:0/1738090808 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f991c01c460 con 0x7f99200cd830 2023-06-23T19:02:03.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.101+0000 7f9915ffb700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f990406ace0 0x7f990406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.101+0000 7f9915ffb700 1 -- 172.21.15.136:0/1738090808 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f991c089790 con 0x7f99200cd830 2023-06-23T19:02:03.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.101+0000 7f9924d9a700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f990406ace0 0x7f990406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.102+0000 7f9924d9a700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f990406ace0 0x7f990406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f99200c61e0 tx=0x7f9910007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:03.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.105+0000 7f9915ffb700 1 -- 172.21.15.136:0/1738090808 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f991c0543e0 con 0x7f99200cd830 2023-06-23T19:02:03.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.301+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99200c63a0 con 0x7f99200cd830 2023-06-23T19:02:03.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.302+0000 7f9915ffb700 1 -- 172.21.15.136:0/1738090808 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f991c057a00 con 0x7f99200cd830 2023-06-23T19:02:03.306 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:03.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f990406ace0 msgr2=0x7f990406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f990406ace0 0x7f990406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f99200c61e0 tx=0x7f9910007df0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99200cd830 msgr2=0x7f992015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.310 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99200cd830 0x7f992015f1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f991c00c4d0 tx=0x7f991c00c890 comp rx=0 tx=0).stop 2023-06-23T19:02:03.310 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 shutdown_connections 2023-06-23T19:02:03.310 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f990406ace0 0x7f990406d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.310 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920160a50 0x7f992014a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.310 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99200cd830 0x7f992015f1a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.310 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 --2- 172.21.15.136:0/1738090808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992015c570 0x7f9920149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.311 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 >> 172.21.15.136:0/1738090808 conn(0x7f9920071620 msgr2=0x7f992015e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:03.311 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 shutdown_connections 2023-06-23T19:02:03.311 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.305+0000 7f99277ff700 1 -- 172.21.15.136:0/1738090808 wait complete. 2023-06-23T19:02:03.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:02:03.328 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:02:03.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.519+0000 7f6916bff700 1 Processor -- start 2023-06-23T19:02:03.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.519+0000 7f6916bff700 1 -- start start 2023-06-23T19:02:03.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.520+0000 7f6916bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 0x7f691006b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.520+0000 7f6916bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f69100adbb0 0x7f69100ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f6916bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69100b1670 con 0x7f69100b0af0 2023-06-23T19:02:03.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f6916bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691006b910 con 0x7f69100adbb0 2023-06-23T19:02:03.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f6916bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69100b1900 con 0x7f691006b000 2023-06-23T19:02:03.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f691519c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f69100adbb0 0x7f69100ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f691499b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 0x7f691006b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f691519c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f69100adbb0 0x7f69100ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60942/0 (socket says 172.21.15.136:60942) 2023-06-23T19:02:03.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f690ffff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f69100b0af0 0x7f69100b0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:38888/0 (socket says 172.21.15.136:38888) 2023-06-23T19:02:03.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f691519c700 1 -- 172.21.15.136:0/4141081321 learned_addr learned my addr 172.21.15.136:0/4141081321 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:03.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f691499b700 1 --2- 172.21.15.136:0/4141081321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 0x7f691006b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:59046/0 (socket says 172.21.15.136:59046) 2023-06-23T19:02:03.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f691519c700 1 -- 172.21.15.136:0/4141081321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 msgr2=0x7f691006b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:03.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f691519c700 1 --2- 172.21.15.136:0/4141081321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 0x7f691006b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f691519c700 1 -- 172.21.15.136:0/4141081321 >> v1:172.21.15.178:6789/0 conn(0x7f69100b0af0 legacy=0x7f69100b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.521+0000 7f691519c700 1 -- 172.21.15.136:0/4141081321 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100b1be0 con 0x7f69100adbb0 2023-06-23T19:02:03.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f691519c700 1 --2- 172.21.15.136:0/4141081321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 0x7f69100ae030 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6908009e50 tx=0x7f690800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab9b4dfa13f00f2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:03.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f690f7fe700 1 -- 172.21.15.136:0/4141081321 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800e070 con 0x7f69100adbb0 2023-06-23T19:02:03.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f690f7fe700 1 -- 172.21.15.136:0/4141081321 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690800b910 con 0x7f69100adbb0 2023-06-23T19:02:03.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f690f7fe700 1 -- 172.21.15.136:0/4141081321 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800bcc0 con 0x7f69100adbb0 2023-06-23T19:02:03.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f6916bff700 1 -- 172.21.15.136:0/4141081321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 msgr2=0x7f69100ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f6916bff700 1 --2- 172.21.15.136:0/4141081321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 0x7f69100ae030 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6908009e50 tx=0x7f690800b330 comp rx=0 tx=0).stop 2023-06-23T19:02:03.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f6916bff700 1 -- 172.21.15.136:0/4141081321 shutdown_connections 2023-06-23T19:02:03.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f6916bff700 1 --2- 172.21.15.136:0/4141081321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 0x7f69100ae030 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f6916bff700 1 --2- 172.21.15.136:0/4141081321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 0x7f691006b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.522+0000 7f6916bff700 1 -- 172.21.15.136:0/4141081321 >> 172.21.15.136:0/4141081321 conn(0x7f6910099d30 msgr2=0x7f69100d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:03.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.523+0000 7f6916bff700 1 -- 172.21.15.136:0/4141081321 shutdown_connections 2023-06-23T19:02:03.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.523+0000 7f6916bff700 1 -- 172.21.15.136:0/4141081321 wait complete. 2023-06-23T19:02:03.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.524+0000 7f6916bff700 1 Processor -- start 2023-06-23T19:02:03.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.524+0000 7f6916bff700 1 -- start start 2023-06-23T19:02:03.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.525+0000 7f6916bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 0x7f69100cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.525+0000 7f6916bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 0x7f69100c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.525+0000 7f6916bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69100b0af0 0x7f69101f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.525+0000 7f6916bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69100cbd00 con 0x7f69100adbb0 2023-06-23T19:02:03.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.525+0000 7f6916bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69100c6ee0 con 0x7f69100b0af0 2023-06-23T19:02:03.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.525+0000 7f6916bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69100c7760 con 0x7f691006b000 2023-06-23T19:02:03.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.525+0000 7f690ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 0x7f69100c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 0x7f69100c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60950/0 (socket says 172.21.15.136:60950) 2023-06-23T19:02:03.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690ffff700 1 -- 172.21.15.136:0/1600296746 learned_addr learned my addr 172.21.15.136:0/1600296746 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:03.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f691499b700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 0x7f69100cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f691519c700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69100b0af0 0x7f69101f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690ffff700 1 -- 172.21.15.136:0/1600296746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 msgr2=0x7f69100cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690ffff700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 0x7f69100cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690ffff700 1 -- 172.21.15.136:0/1600296746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69100b0af0 msgr2=0x7f69101f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690ffff700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69100b0af0 0x7f69101f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690ffff700 1 -- 172.21.15.136:0/1600296746 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908009b30 con 0x7f69100adbb0 2023-06-23T19:02:03.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690ffff700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 0x7f69100c84c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00c520 tx=0x7f68fc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:03.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690d7fa700 1 -- 172.21.15.136:0/1600296746 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc005cb0 con 0x7f69100adbb0 2023-06-23T19:02:03.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.526+0000 7f690d7fa700 1 -- 172.21.15.136:0/1600296746 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc005e10 con 0x7f69100adbb0 2023-06-23T19:02:03.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.527+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69100c71a0 con 0x7f69100adbb0 2023-06-23T19:02:03.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.527+0000 7f690d7fa700 1 -- 172.21.15.136:0/1600296746 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0072d0 con 0x7f69100adbb0 2023-06-23T19:02:03.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.527+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69100cb990 con 0x7f69100adbb0 2023-06-23T19:02:03.537 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.528+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69100cbe70 con 0x7f69100adbb0 2023-06-23T19:02:03.537 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.528+0000 7f690d7fa700 1 -- 172.21.15.136:0/1600296746 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68fc007430 con 0x7f69100adbb0 2023-06-23T19:02:03.537 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.530+0000 7f690d7fa700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68f406ace0 0x7f68f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.530+0000 7f690d7fa700 1 -- 172.21.15.136:0/1600296746 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f68fc088a50 con 0x7f69100adbb0 2023-06-23T19:02:03.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.530+0000 7f691499b700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68f406ace0 0x7f68f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.530+0000 7f691499b700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68f406ace0 0x7f68f406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6904009b40 tx=0x7f6904009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:03.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.533+0000 7f690d7fa700 1 -- 172.21.15.136:0/1600296746 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68fc053870 con 0x7f69100adbb0 2023-06-23T19:02:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.729+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f691004ea20 con 0x7f69100adbb0 2023-06-23T19:02:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.730+0000 7f690d7fa700 1 -- 172.21.15.136:0/1600296746 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68fc017020 con 0x7f69100adbb0 2023-06-23T19:02:03.735 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:02:03.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68f406ace0 msgr2=0x7f68f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68f406ace0 0x7f68f406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6904009b40 tx=0x7f6904009210 comp rx=0 tx=0).stop 2023-06-23T19:02:03.736 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 msgr2=0x7f69100c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 0x7f69100c84c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00c520 tx=0x7f68fc00c830 comp rx=0 tx=0).stop 2023-06-23T19:02:03.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 shutdown_connections 2023-06-23T19:02:03.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68f406ace0 0x7f68f406d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69100b0af0 0x7f69101f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691006b000 0x7f69100cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 --2- 172.21.15.136:0/1600296746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69100adbb0 0x7f69100c84c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.737 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 >> 172.21.15.136:0/1600296746 conn(0x7f6910099d30 msgr2=0x7f69100ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:03.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 shutdown_connections 2023-06-23T19:02:03.738 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.732+0000 7f6916bff700 1 -- 172.21.15.136:0/1600296746 wait complete. 2023-06-23T19:02:03.755 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.951+0000 7f3b081ff700 1 Processor -- start 2023-06-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.952+0000 7f3b081ff700 1 -- start start 2023-06-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b081ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3b000b5a70 0x7f3b000b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b081ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000cf910 0x7f3b000d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b081ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b5ec0 con 0x7f3b000d0a60 2023-06-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b081ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000d0060 con 0x7f3b000b5a70 2023-06-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b081ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000cd9d0 con 0x7f3b000cf910 2023-06-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b0579a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3b000b5a70 0x7f3b000b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b0679c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000cf910 0x7f3b000d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b0579a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3b000b5a70 0x7f3b000b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:60986/0 (socket says 172.21.15.136:60986) 2023-06-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b0579a700 1 -- 172.21.15.136:0/1831327546 learned_addr learned my addr 172.21.15.136:0/1831327546 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.953+0000 7f3b05f9b700 1 --1- 172.21.15.136:0/1831327546 >> v1:172.21.15.178:6789/0 conn(0x7f3b000d0a60 0x7f3b000d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:38896/0 (socket says 172.21.15.136:38896) 2023-06-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.954+0000 7f3b0579a700 1 -- 172.21.15.136:0/1831327546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000cf910 msgr2=0x7f3b000d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.954+0000 7f3b0579a700 1 --2- 172.21.15.136:0/1831327546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000cf910 0x7f3b000d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.954+0000 7f3b0579a700 1 -- 172.21.15.136:0/1831327546 >> v1:172.21.15.178:6789/0 conn(0x7f3b000d0a60 legacy=0x7f3b000d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.954+0000 7f3b0579a700 1 -- 172.21.15.136:0/1831327546 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000cfd90 con 0x7f3b000b5a70 2023-06-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.954+0000 7f3b0579a700 1 --2- 172.21.15.136:0/1831327546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b000b5a70 0x7f3b000b51d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3af00098f0 tx=0x7f3af0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7946cfec4b16c55 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.954+0000 7f3b04f99700 1 -- 172.21.15.136:0/1831327546 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0011830 con 0x7f3b000b5a70 2023-06-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.954+0000 7f3b04f99700 1 -- 172.21.15.136:0/1831327546 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0011990 con 0x7f3b000b5a70 2023-06-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.954+0000 7f3b04f99700 1 -- 172.21.15.136:0/1831327546 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0011d20 con 0x7f3b000b5a70 2023-06-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.955+0000 7f3b081ff700 1 -- 172.21.15.136:0/1831327546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b000b5a70 msgr2=0x7f3b000b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.955+0000 7f3b081ff700 1 --2- 172.21.15.136:0/1831327546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b000b5a70 0x7f3b000b51d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3af00098f0 tx=0x7f3af0009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.955+0000 7f3b081ff700 1 -- 172.21.15.136:0/1831327546 shutdown_connections 2023-06-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.955+0000 7f3b081ff700 1 --2- 172.21.15.136:0/1831327546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000cf910 0x7f3b000d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.955+0000 7f3b081ff700 1 --2- 172.21.15.136:0/1831327546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b000b5a70 0x7f3b000b51d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.955+0000 7f3b081ff700 1 -- 172.21.15.136:0/1831327546 >> 172.21.15.136:0/1831327546 conn(0x7f3b00071620 msgr2=0x7f3b000719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.955+0000 7f3b081ff700 1 -- 172.21.15.136:0/1831327546 shutdown_connections 2023-06-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.955+0000 7f3b081ff700 1 -- 172.21.15.136:0/1831327546 wait complete. 2023-06-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.957+0000 7f3b081ff700 1 Processor -- start 2023-06-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.958+0000 7f3b081ff700 1 -- start start 2023-06-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b081ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000b5a70 0x7f3b000c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b081ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b000cf910 0x7f3b00156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b081ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b000d0a60 0x7f3b000cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b081ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000c6710 con 0x7f3b000d0a60 2023-06-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b081ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000c6fb0 con 0x7f3b000cf910 2023-06-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b081ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001568c0 con 0x7f3b000b5a70 2023-06-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b0679c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b000d0a60 0x7f3b000cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b0679c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b000d0a60 0x7f3b000cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60966/0 (socket says 172.21.15.136:60966) 2023-06-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b0679c700 1 -- 172.21.15.136:0/4039256848 learned_addr learned my addr 172.21.15.136:0/4039256848 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b05f9b700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000b5a70 0x7f3b000c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.959+0000 7f3b0579a700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b000cf910 0x7f3b00156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3b0679c700 1 -- 172.21.15.136:0/4039256848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000b5a70 msgr2=0x7f3b000c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3b0679c700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000b5a70 0x7f3b000c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3b0679c700 1 -- 172.21.15.136:0/4039256848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b000cf910 msgr2=0x7f3b00156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3b0679c700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b000cf910 0x7f3b00156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3b0679c700 1 -- 172.21.15.136:0/4039256848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0009550 con 0x7f3b000d0a60 2023-06-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3b0679c700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b000d0a60 0x7f3b000cbd00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009dd0 tx=0x7f3af800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3af67fc700 1 -- 172.21.15.136:0/4039256848 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8009c40 con 0x7f3b000d0a60 2023-06-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3af67fc700 1 -- 172.21.15.136:0/4039256848 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af800f040 con 0x7f3b000d0a60 2023-06-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b001f70b0 con 0x7f3b000d0a60 2023-06-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3af67fc700 1 -- 172.21.15.136:0/4039256848 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800ceb0 con 0x7f3b000d0a60 2023-06-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.960+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000c6c40 con 0x7f3b000d0a60 2023-06-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.961+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0004ea20 con 0x7f3b000d0a60 2023-06-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.962+0000 7f3af67fc700 1 -- 172.21.15.136:0/4039256848 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3af8014480 con 0x7f3b000d0a60 2023-06-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.963+0000 7f3af67fc700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3ae406ace0 0x7f3ae406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.963+0000 7f3af67fc700 1 -- 172.21.15.136:0/4039256848 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3af808a070 con 0x7f3b000d0a60 2023-06-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.963+0000 7f3b05f9b700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3ae406ace0 0x7f3ae406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.964+0000 7f3b05f9b700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3ae406ace0 0x7f3ae406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3afc000f60 tx=0x7f3afc007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:03.967+0000 7f3af67fc700 1 -- 172.21.15.136:0/4039256848 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3af80bc310 con 0x7f3b000d0a60 2023-06-23T19:02:04.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.164+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b000c70f0 con 0x7f3b000d0a60 2023-06-23T19:02:04.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.164+0000 7f3af67fc700 1 -- 172.21.15.136:0/4039256848 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3af80180a0 con 0x7f3b000d0a60 2023-06-23T19:02:04.169 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:02:04.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.166+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3ae406ace0 msgr2=0x7f3ae406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.166+0000 7f3b081ff700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3ae406ace0 0x7f3ae406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3afc000f60 tx=0x7f3afc007ed0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.166+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b000d0a60 msgr2=0x7f3b000cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.166+0000 7f3b081ff700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b000d0a60 0x7f3b000cbd00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009dd0 tx=0x7f3af800c3a0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.167+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 shutdown_connections 2023-06-23T19:02:04.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.167+0000 7f3b081ff700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3ae406ace0 0x7f3ae406d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.167+0000 7f3b081ff700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b000d0a60 0x7f3b000cbd00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.167+0000 7f3b081ff700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b000b5a70 0x7f3b000c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.167+0000 7f3b081ff700 1 --2- 172.21.15.136:0/4039256848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b000cf910 0x7f3b00156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.167+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 >> 172.21.15.136:0/4039256848 conn(0x7f3b00071620 msgr2=0x7f3b000b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:04.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.167+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 shutdown_connections 2023-06-23T19:02:04.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.167+0000 7f3b081ff700 1 -- 172.21.15.136:0/4039256848 wait complete. 2023-06-23T19:02:04.189 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:02:04.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.380+0000 7fc1385ff700 1 Processor -- start 2023-06-23T19:02:04.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.380+0000 7fc1385ff700 1 -- start start 2023-06-23T19:02:04.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.381+0000 7fc1385ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc1300d0a60 0x7fc1300b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.381+0000 7fc1385ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1300cd9d0 con 0x7fc1300b51d0 2023-06-23T19:02:04.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.381+0000 7fc1385ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1300b5620 con 0x7fc1300cf910 2023-06-23T19:02:04.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.381+0000 7fc1385ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1300d0060 con 0x7fc1300d0a60 2023-06-23T19:02:04.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.381+0000 7fc135b9a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc1300b51d0 0x7fc1300d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41942/0 (socket says 172.21.15.136:41942) 2023-06-23T19:02:04.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.381+0000 7fc135b9a700 1 -- 172.21.15.136:0/1610062945 learned_addr learned my addr 172.21.15.136:0/1610062945 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:04.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.382+0000 7fc13639b700 1 --2- 172.21.15.136:0/1610062945 >> v2:172.21.15.178:3300/0 conn(0x7fc1300d0a60 0x7fc1300b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.382+0000 7fc135399700 1 -- 172.21.15.136:0/1610062945 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657436950 0 0) 0x7fc1300cd9d0 con 0x7fc1300b51d0 2023-06-23T19:02:04.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.382+0000 7fc135399700 1 -- 172.21.15.136:0/1610062945 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc11c0035b0 con 0x7fc1300b51d0 2023-06-23T19:02:04.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.382+0000 7fc13639b700 1 -- 172.21.15.136:0/1610062945 >> v1:172.21.15.178:6789/0 conn(0x7fc1300cf910 legacy=0x7fc1300d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.382+0000 7fc13639b700 1 -- 172.21.15.136:0/1610062945 >> v1:172.21.15.136:6789/0 conn(0x7fc1300b51d0 legacy=0x7fc1300d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.382+0000 7fc13639b700 1 -- 172.21.15.136:0/1610062945 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300cd410 con 0x7fc1300d0a60 2023-06-23T19:02:04.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.382+0000 7fc13639b700 1 --2- 172.21.15.136:0/1610062945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1300d0a60 0x7fc1300b5a70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009840 tx=0x7fc12c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35a1413884fd7e24 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:04.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc135399700 1 -- 172.21.15.136:0/1610062945 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c011830 con 0x7fc1300d0a60 2023-06-23T19:02:04.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc135399700 1 -- 172.21.15.136:0/1610062945 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c011990 con 0x7fc1300d0a60 2023-06-23T19:02:04.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc135399700 1 -- 172.21.15.136:0/1610062945 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c011d20 con 0x7fc1300d0a60 2023-06-23T19:02:04.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc1385ff700 1 -- 172.21.15.136:0/1610062945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1300d0a60 msgr2=0x7fc1300b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc1385ff700 1 --2- 172.21.15.136:0/1610062945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1300d0a60 0x7fc1300b5a70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009840 tx=0x7fc12c009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:04.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc1385ff700 1 -- 172.21.15.136:0/1610062945 shutdown_connections 2023-06-23T19:02:04.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc1385ff700 1 --2- 172.21.15.136:0/1610062945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1300d0a60 0x7fc1300b5a70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc1385ff700 1 -- 172.21.15.136:0/1610062945 >> 172.21.15.136:0/1610062945 conn(0x7fc130071620 msgr2=0x7fc1300719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:04.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc1385ff700 1 -- 172.21.15.136:0/1610062945 shutdown_connections 2023-06-23T19:02:04.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.383+0000 7fc1385ff700 1 -- 172.21.15.136:0/1610062945 wait complete. 2023-06-23T19:02:04.396 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.385+0000 7fc1385ff700 1 Processor -- start 2023-06-23T19:02:04.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.385+0000 7fc1385ff700 1 -- start start 2023-06-23T19:02:04.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc1385ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1300b51d0 0x7fc1301f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc1385ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1300cf910 0x7fc1300b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc1385ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1300d0a60 0x7fc1301f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc1385ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1301f2b00 con 0x7fc1300d0a60 2023-06-23T19:02:04.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc1385ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300b5a70 con 0x7fc1300cf910 2023-06-23T19:02:04.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc1385ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300b5d10 con 0x7fc1300b51d0 2023-06-23T19:02:04.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc136b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1300d0a60 0x7fc1301f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc136b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1300d0a60 0x7fc1301f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60974/0 (socket says 172.21.15.136:60974) 2023-06-23T19:02:04.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc136b9c700 1 -- 172.21.15.136:0/151930036 learned_addr learned my addr 172.21.15.136:0/151930036 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:04.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.386+0000 7fc135b9a700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1300cf910 0x7fc1300b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc13639b700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1300b51d0 0x7fc1301f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc136b9c700 1 -- 172.21.15.136:0/151930036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1300b51d0 msgr2=0x7fc1301f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc136b9c700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1300b51d0 0x7fc1301f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc136b9c700 1 -- 172.21.15.136:0/151930036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1300cf910 msgr2=0x7fc1300b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc136b9c700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1300cf910 0x7fc1300b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc136b9c700 1 -- 172.21.15.136:0/151930036 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c0094a0 con 0x7fc1300d0a60 2023-06-23T19:02:04.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc13639b700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1300b51d0 0x7fc1301f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:04.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc136b9c700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1300d0a60 0x7fc1301f0f20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc12800cc50 tx=0x7fc12800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:04.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc126ffd700 1 -- 172.21.15.136:0/151930036 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc128003c00 con 0x7fc1300d0a60 2023-06-23T19:02:04.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc126ffd700 1 -- 172.21.15.136:0/151930036 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc128003d60 con 0x7fc1300d0a60 2023-06-23T19:02:04.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1300b5ff0 con 0x7fc1300d0a60 2023-06-23T19:02:04.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc126ffd700 1 -- 172.21.15.136:0/151930036 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12800ab60 con 0x7fc1300d0a60 2023-06-23T19:02:04.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.387+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1300b65b0 con 0x7fc1300d0a60 2023-06-23T19:02:04.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.388+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13004ea20 con 0x7fc1300d0a60 2023-06-23T19:02:04.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.389+0000 7fc126ffd700 1 -- 172.21.15.136:0/151930036 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc12800acc0 con 0x7fc1300d0a60 2023-06-23T19:02:04.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.390+0000 7fc126ffd700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc11406ace0 0x7fc11406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.390+0000 7fc126ffd700 1 -- 172.21.15.136:0/151930036 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc128089890 con 0x7fc1300d0a60 2023-06-23T19:02:04.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.391+0000 7fc13639b700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc11406ace0 0x7fc11406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.391+0000 7fc13639b700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc11406ace0 0x7fc11406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0090b0 tx=0x7fc12c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:04.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.395+0000 7fc126ffd700 1 -- 172.21.15.136:0/151930036 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc128054570 con 0x7fc1300d0a60 2023-06-23T19:02:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.598+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc1300d20d0 con 0x7fc1300d0a60 2023-06-23T19:02:04.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.598+0000 7fc126ffd700 1 -- 172.21.15.136:0/151930036 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc128057b90 con 0x7fc1300d0a60 2023-06-23T19:02:04.602 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:04.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc11406ace0 msgr2=0x7fc11406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc11406ace0 0x7fc11406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0090b0 tx=0x7fc12c01c040 comp rx=0 tx=0).stop 2023-06-23T19:02:04.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1300d0a60 msgr2=0x7fc1301f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1300d0a60 0x7fc1301f0f20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc12800cc50 tx=0x7fc12800cf60 comp rx=0 tx=0).stop 2023-06-23T19:02:04.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 shutdown_connections 2023-06-23T19:02:04.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc11406ace0 0x7fc11406d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1300d0a60 0x7fc1301f0f20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1300b51d0 0x7fc1301f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 --2- 172.21.15.136:0/151930036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1300cf910 0x7fc1300b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 >> 172.21.15.136:0/151930036 conn(0x7fc130071620 msgr2=0x7fc1300d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:04.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 shutdown_connections 2023-06-23T19:02:04.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.601+0000 7fc1385ff700 1 -- 172.21.15.136:0/151930036 wait complete. 2023-06-23T19:02:04.623 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:02:04.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.815+0000 7f4f2ebff700 1 Processor -- start 2023-06-23T19:02:04.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.815+0000 7f4f2ebff700 1 -- start start 2023-06-23T19:02:04.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f2ebff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4f280b5a70 0x7f4f280b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f2ebff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280cf910 0x7f4f280d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f2ebff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f280b5ec0 con 0x7f4f280d0a60 2023-06-23T19:02:04.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f2ebff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f280d0060 con 0x7f4f280b5a70 2023-06-23T19:02:04.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f2ebff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280cd9d0 con 0x7f4f280cf910 2023-06-23T19:02:04.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f27fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4f280b5a70 0x7f4f280b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f27fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4f280b5a70 0x7f4f280b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60978/0 (socket says 172.21.15.136:60978) 2023-06-23T19:02:04.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f27fff700 1 -- 172.21.15.136:0/1730802291 learned_addr learned my addr 172.21.15.136:0/1730802291 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:04.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f2c99b700 1 --1- 172.21.15.136:0/1730802291 >> v1:172.21.15.136:6789/0 conn(0x7f4f280d0a60 0x7f4f280d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41944/0 (socket says 172.21.15.136:41944) 2023-06-23T19:02:04.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f2d19c700 1 --2- 172.21.15.136:0/1730802291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280cf910 0x7f4f280d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.816+0000 7f4f27fff700 1 -- 172.21.15.136:0/1730802291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280cf910 msgr2=0x7f4f280d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:04.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.817+0000 7f4f27fff700 1 --2- 172.21.15.136:0/1730802291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280cf910 0x7f4f280d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.817+0000 7f4f27fff700 1 -- 172.21.15.136:0/1730802291 >> v1:172.21.15.136:6789/0 conn(0x7f4f280d0a60 legacy=0x7f4f280d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.817+0000 7f4f27fff700 1 -- 172.21.15.136:0/1730802291 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280cfd90 con 0x7f4f280b5a70 2023-06-23T19:02:04.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.817+0000 7f4f277fe700 1 -- 172.21.15.136:0/1730802291 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839876098 0 0) 0x7f4f280b5ec0 con 0x7f4f280d0a60 2023-06-23T19:02:04.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.817+0000 7f4f2d19c700 1 --2- 172.21.15.136:0/1730802291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280cf910 0x7f4f280d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:04.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.817+0000 7f4f27fff700 1 --2- 172.21.15.136:0/1730802291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280b5a70 0x7f4f280b51d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f140098f0 tx=0x7f4f14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3f8153ff8c1b21 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:04.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.817+0000 7f4f277fe700 1 -- 172.21.15.136:0/1730802291 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400b8a0 con 0x7f4f280b5a70 2023-06-23T19:02:04.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.817+0000 7f4f277fe700 1 -- 172.21.15.136:0/1730802291 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1400ba00 con 0x7f4f280b5a70 2023-06-23T19:02:04.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.817+0000 7f4f277fe700 1 -- 172.21.15.136:0/1730802291 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400bd90 con 0x7f4f280b5a70 2023-06-23T19:02:04.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.818+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1730802291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280b5a70 msgr2=0x7f4f280b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.818+0000 7f4f2ebff700 1 --2- 172.21.15.136:0/1730802291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280b5a70 0x7f4f280b51d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f140098f0 tx=0x7f4f14009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:04.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.818+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1730802291 shutdown_connections 2023-06-23T19:02:04.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.818+0000 7f4f2ebff700 1 --2- 172.21.15.136:0/1730802291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280cf910 0x7f4f280d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.818+0000 7f4f2ebff700 1 --2- 172.21.15.136:0/1730802291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280b5a70 0x7f4f280b51d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.818+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1730802291 >> 172.21.15.136:0/1730802291 conn(0x7f4f28071620 msgr2=0x7f4f280719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:04.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.818+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1730802291 shutdown_connections 2023-06-23T19:02:04.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.818+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1730802291 wait complete. 2023-06-23T19:02:04.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.819+0000 7f4f2ebff700 1 Processor -- start 2023-06-23T19:02:04.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.820+0000 7f4f2ebff700 1 -- start start 2023-06-23T19:02:04.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.820+0000 7f4f2ebff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280b5a70 0x7f4f281f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2ebff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f280cf910 0x7f4f280c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2ebff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280d0a60 0x7f4f281538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2ebff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28159920 con 0x7f4f280d0a60 2023-06-23T19:02:04.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2ebff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280c8940 con 0x7f4f280cf910 2023-06-23T19:02:04.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2ebff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280c8670 con 0x7f4f280b5a70 2023-06-23T19:02:04.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2d19c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280d0a60 0x7f4f281538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2d19c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280d0a60 0x7f4f281538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60980/0 (socket says 172.21.15.136:60980) 2023-06-23T19:02:04.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2d19c700 1 -- 172.21.15.136:0/1984462740 learned_addr learned my addr 172.21.15.136:0/1984462740 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:04.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2c99b700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280b5a70 0x7f4f281f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f27fff700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f280cf910 0x7f4f280c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2d19c700 1 -- 172.21.15.136:0/1984462740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280b5a70 msgr2=0x7f4f281f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2d19c700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280b5a70 0x7f4f281f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2d19c700 1 -- 172.21.15.136:0/1984462740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f280cf910 msgr2=0x7f4f280c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:04.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2d19c700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f280cf910 0x7f4f280c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:04.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f2d19c700 1 -- 172.21.15.136:0/1984462740 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f14009550 con 0x7f4f280d0a60 2023-06-23T19:02:04.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.821+0000 7f4f27fff700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f280cf910 0x7f4f280c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:04.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.822+0000 7f4f2d19c700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280d0a60 0x7f4f281538a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000cef0 tx=0x7f4f2000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:04.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.822+0000 7f4f257fa700 1 -- 172.21.15.136:0/1984462740 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000ae50 con 0x7f4f280d0a60 2023-06-23T19:02:04.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.822+0000 7f4f257fa700 1 -- 172.21.15.136:0/1984462740 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20015440 con 0x7f4f280d0a60 2023-06-23T19:02:04.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.822+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f28156bf0 con 0x7f4f280d0a60 2023-06-23T19:02:04.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.822+0000 7f4f257fa700 1 -- 172.21.15.136:0/1984462740 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200157f0 con 0x7f4f280d0a60 2023-06-23T19:02:04.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.822+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f281571b0 con 0x7f4f280d0a60 2023-06-23T19:02:04.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.823+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2804ea20 con 0x7f4f280d0a60 2023-06-23T19:02:04.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.824+0000 7f4f257fa700 1 -- 172.21.15.136:0/1984462740 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f2000d430 con 0x7f4f280d0a60 2023-06-23T19:02:04.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.826+0000 7f4f257fa700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f0c06ace0 0x7f4f0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:04.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.826+0000 7f4f257fa700 1 -- 172.21.15.136:0/1984462740 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f20089de0 con 0x7f4f280d0a60 2023-06-23T19:02:04.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.826+0000 7f4f2c99b700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f0c06ace0 0x7f4f0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:04.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.827+0000 7f4f2c99b700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f0c06ace0 0x7f4f0c06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c000f60 tx=0x7f4f1c007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:04.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:04.830+0000 7f4f257fa700 1 -- 172.21.15.136:0/1984462740 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f20054b50 con 0x7f4f280d0a60 2023-06-23T19:02:05.029 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.026+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f280d01a0 con 0x7f4f280d0a60 2023-06-23T19:02:05.030 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.026+0000 7f4f257fa700 1 -- 172.21.15.136:0/1984462740 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f2001a0a0 con 0x7f4f280d0a60 2023-06-23T19:02:05.031 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:02:05.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f0c06ace0 msgr2=0x7f4f0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f0c06ace0 0x7f4f0c06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c000f60 tx=0x7f4f1c007c90 comp rx=0 tx=0).stop 2023-06-23T19:02:05.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280d0a60 msgr2=0x7f4f281538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280d0a60 0x7f4f281538a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000cef0 tx=0x7f4f2000a340 comp rx=0 tx=0).stop 2023-06-23T19:02:05.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 shutdown_connections 2023-06-23T19:02:05.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4f0c06ace0 0x7f4f0c06d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f280d0a60 0x7f4f281538a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f280b5a70 0x7f4f281f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 --2- 172.21.15.136:0/1984462740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f280cf910 0x7f4f280c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 >> 172.21.15.136:0/1984462740 conn(0x7f4f28071620 msgr2=0x7f4f280b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:05.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 shutdown_connections 2023-06-23T19:02:05.036 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.029+0000 7f4f2ebff700 1 -- 172.21.15.136:0/1984462740 wait complete. 2023-06-23T19:02:05.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:02:05.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.244+0000 7f3a971ff700 1 Processor -- start 2023-06-23T19:02:05.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.244+0000 7f3a971ff700 1 -- start start 2023-06-23T19:02:05.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a971ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3a900b5a70 0x7f3a900b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a971ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 0x7f3a900d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a971ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900b5ec0 con 0x7f3a900d0a60 2023-06-23T19:02:05.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a971ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a900d0060 con 0x7f3a900b5a70 2023-06-23T19:02:05.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a971ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900cd9d0 con 0x7f3a900cf910 2023-06-23T19:02:05.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a8ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3a900b5a70 0x7f3a900b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a8ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3a900b5a70 0x7f3a900b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40248/0 (socket says 172.21.15.136:40248) 2023-06-23T19:02:05.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a8ffff700 1 -- 172.21.15.136:0/2357195949 learned_addr learned my addr 172.21.15.136:0/2357195949 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:05.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a9579c700 1 --2- 172.21.15.136:0/2357195949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 0x7f3a900d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a8ffff700 1 -- 172.21.15.136:0/2357195949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 msgr2=0x7f3a900d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:05.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a8ffff700 1 --2- 172.21.15.136:0/2357195949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 0x7f3a900d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a8ffff700 1 -- 172.21.15.136:0/2357195949 >> v1:172.21.15.178:6789/0 conn(0x7f3a900d0a60 legacy=0x7f3a900d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.246+0000 7f3a8ffff700 1 -- 172.21.15.136:0/2357195949 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900cfd90 con 0x7f3a900b5a70 2023-06-23T19:02:05.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.247+0000 7f3a8ffff700 1 --2- 172.21.15.136:0/2357195949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900b5a70 0x7f3a900b51d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0098f0 tx=0x7f3a7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650754bdf47d68cc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:05.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.247+0000 7f3a8f7fe700 1 -- 172.21.15.136:0/2357195949 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011830 con 0x7f3a900b5a70 2023-06-23T19:02:05.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.247+0000 7f3a8f7fe700 1 -- 172.21.15.136:0/2357195949 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c011990 con 0x7f3a900b5a70 2023-06-23T19:02:05.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.247+0000 7f3a8f7fe700 1 -- 172.21.15.136:0/2357195949 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011d20 con 0x7f3a900b5a70 2023-06-23T19:02:05.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.247+0000 7f3a971ff700 1 -- 172.21.15.136:0/2357195949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900b5a70 msgr2=0x7f3a900b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.247+0000 7f3a971ff700 1 --2- 172.21.15.136:0/2357195949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900b5a70 0x7f3a900b51d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0098f0 tx=0x7f3a7c009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:05.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.247+0000 7f3a971ff700 1 -- 172.21.15.136:0/2357195949 shutdown_connections 2023-06-23T19:02:05.254 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.247+0000 7f3a971ff700 1 --2- 172.21.15.136:0/2357195949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 0x7f3a900d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.247+0000 7f3a971ff700 1 --2- 172.21.15.136:0/2357195949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900b5a70 0x7f3a900b51d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.248+0000 7f3a971ff700 1 -- 172.21.15.136:0/2357195949 >> 172.21.15.136:0/2357195949 conn(0x7f3a90071620 msgr2=0x7f3a900719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:05.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.248+0000 7f3a971ff700 1 -- 172.21.15.136:0/2357195949 shutdown_connections 2023-06-23T19:02:05.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.248+0000 7f3a971ff700 1 -- 172.21.15.136:0/2357195949 wait complete. 2023-06-23T19:02:05.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.249+0000 7f3a971ff700 1 Processor -- start 2023-06-23T19:02:05.255 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.249+0000 7f3a971ff700 1 -- start start 2023-06-23T19:02:05.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.250+0000 7f3a971ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a900b5a70 0x7f3a90148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.250+0000 7f3a971ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 0x7f3a900c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.250+0000 7f3a971ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900d0a60 0x7f3a90157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.250+0000 7f3a971ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90156c60 con 0x7f3a900d0a60 2023-06-23T19:02:05.257 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.250+0000 7f3a971ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90156f00 con 0x7f3a900b5a70 2023-06-23T19:02:05.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.250+0000 7f3a971ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901571e0 con 0x7f3a900cf910 2023-06-23T19:02:05.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a9579c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900d0a60 0x7f3a90157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a9579c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900d0a60 0x7f3a90157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40258/0 (socket says 172.21.15.136:40258) 2023-06-23T19:02:05.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a9579c700 1 -- 172.21.15.136:0/125661883 learned_addr learned my addr 172.21.15.136:0/125661883 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:05.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a8ffff700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 0x7f3a900c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a94f9b700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a900b5a70 0x7f3a90148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a9579c700 1 -- 172.21.15.136:0/125661883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 msgr2=0x7f3a900c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.258 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a9579c700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 0x7f3a900c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a9579c700 1 -- 172.21.15.136:0/125661883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a900b5a70 msgr2=0x7f3a90148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a9579c700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a900b5a70 0x7f3a90148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a9579c700 1 -- 172.21.15.136:0/125661883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c009550 con 0x7f3a900d0a60 2023-06-23T19:02:05.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.251+0000 7f3a9579c700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900d0a60 0x7f3a90157fa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800efc0 tx=0x7f3a8800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:05.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.252+0000 7f3a8d7fa700 1 -- 172.21.15.136:0/125661883 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88009ea0 con 0x7f3a900d0a60 2023-06-23T19:02:05.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.252+0000 7f3a8d7fa700 1 -- 172.21.15.136:0/125661883 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8800f040 con 0x7f3a900d0a60 2023-06-23T19:02:05.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.252+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a901574c0 con 0x7f3a900d0a60 2023-06-23T19:02:05.259 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.252+0000 7f3a8d7fa700 1 -- 172.21.15.136:0/125661883 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800ced0 con 0x7f3a900d0a60 2023-06-23T19:02:05.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.252+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a90157a80 con 0x7f3a900d0a60 2023-06-23T19:02:05.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.253+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a90157ca0 con 0x7f3a900d0a60 2023-06-23T19:02:05.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.254+0000 7f3a8d7fa700 1 -- 172.21.15.136:0/125661883 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a88014480 con 0x7f3a900d0a60 2023-06-23T19:02:05.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.255+0000 7f3a8d7fa700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3a7406ace0 0x7f3a7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.255+0000 7f3a8d7fa700 1 -- 172.21.15.136:0/125661883 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3a88089ff0 con 0x7f3a900d0a60 2023-06-23T19:02:05.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.255+0000 7f3a94f9b700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3a7406ace0 0x7f3a7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.261 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.256+0000 7f3a94f9b700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3a7406ace0 0x7f3a7406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3a84007fd0 tx=0x7f3a84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.259+0000 7f3a8d7fa700 1 -- 172.21.15.136:0/125661883 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3a88054d30 con 0x7f3a900d0a60 2023-06-23T19:02:05.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.453+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3a9004ea20 con 0x7f3a900d0a60 2023-06-23T19:02:05.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.454+0000 7f3a8d7fa700 1 -- 172.21.15.136:0/125661883 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3a88058350 con 0x7f3a900d0a60 2023-06-23T19:02:05.457 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:05.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3a7406ace0 msgr2=0x7f3a7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3a7406ace0 0x7f3a7406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3a84007fd0 tx=0x7f3a84009040 comp rx=0 tx=0).stop 2023-06-23T19:02:05.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900d0a60 msgr2=0x7f3a90157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900d0a60 0x7f3a90157fa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800efc0 tx=0x7f3a8800c3a0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 shutdown_connections 2023-06-23T19:02:05.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3a7406ace0 0x7f3a7406d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a900b5a70 0x7f3a90148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a900d0a60 0x7f3a90157fa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 --2- 172.21.15.136:0/125661883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a900cf910 0x7f3a900c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 >> 172.21.15.136:0/125661883 conn(0x7f3a90071620 msgr2=0x7f3a900d34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:05.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 shutdown_connections 2023-06-23T19:02:05.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.456+0000 7f3a971ff700 1 -- 172.21.15.136:0/125661883 wait complete. 2023-06-23T19:02:05.478 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.667+0000 7fdf767ff700 1 Processor -- start 2023-06-23T19:02:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.668+0000 7fdf767ff700 1 -- start start 2023-06-23T19:02:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf767ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 0x7fdf700cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf767ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdf7006c060 0x7fdf700702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf767ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf70070c60 con 0x7fdf70070820 2023-06-23T19:02:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf767ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7006c4d0 con 0x7fdf7006c060 2023-06-23T19:02:05.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf767ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700c9510 con 0x7fdf70158ef0 2023-06-23T19:02:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf67fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdf7006c060 0x7fdf700702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf67fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdf7006c060 0x7fdf700702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40266/0 (socket says 172.21.15.136:40266) 2023-06-23T19:02:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf67fff700 1 -- 172.21.15.136:0/1597048652 learned_addr learned my addr 172.21.15.136:0/1597048652 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf6ffff700 1 --2- 172.21.15.136:0/1597048652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 0x7fdf700cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf67fff700 1 -- 172.21.15.136:0/1597048652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 msgr2=0x7fdf700cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:05.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf67fff700 1 --2- 172.21.15.136:0/1597048652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 0x7fdf700cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf67fff700 1 -- 172.21.15.136:0/1597048652 >> v1:172.21.15.178:6789/0 conn(0x7fdf70070820 legacy=0x7fdf700ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.669+0000 7fdf67fff700 1 -- 172.21.15.136:0/1597048652 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf700cd6a0 con 0x7fdf7006c060 2023-06-23T19:02:05.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.670+0000 7fdf67fff700 1 --2- 172.21.15.136:0/1597048652 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 0x7fdf700702e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800bb90 tx=0x7fdf5800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2c7cddb2c31858 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:05.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.670+0000 7fdf6f7fe700 1 -- 172.21.15.136:0/1597048652 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800dd30 con 0x7fdf7006c060 2023-06-23T19:02:05.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.670+0000 7fdf6f7fe700 1 -- 172.21.15.136:0/1597048652 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5800de90 con 0x7fdf7006c060 2023-06-23T19:02:05.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.670+0000 7fdf6f7fe700 1 -- 172.21.15.136:0/1597048652 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58010690 con 0x7fdf7006c060 2023-06-23T19:02:05.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.670+0000 7fdf767ff700 1 -- 172.21.15.136:0/1597048652 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 msgr2=0x7fdf700702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.670+0000 7fdf767ff700 1 --2- 172.21.15.136:0/1597048652 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 0x7fdf700702e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800bb90 tx=0x7fdf5800bea0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.671+0000 7fdf767ff700 1 -- 172.21.15.136:0/1597048652 shutdown_connections 2023-06-23T19:02:05.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.671+0000 7fdf767ff700 1 --2- 172.21.15.136:0/1597048652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 0x7fdf700cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.671+0000 7fdf767ff700 1 --2- 172.21.15.136:0/1597048652 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 0x7fdf700702e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.671+0000 7fdf767ff700 1 -- 172.21.15.136:0/1597048652 >> 172.21.15.136:0/1597048652 conn(0x7fdf700b0ef0 msgr2=0x7fdf700ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:05.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.671+0000 7fdf767ff700 1 -- 172.21.15.136:0/1597048652 shutdown_connections 2023-06-23T19:02:05.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.671+0000 7fdf767ff700 1 -- 172.21.15.136:0/1597048652 wait complete. 2023-06-23T19:02:05.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.672+0000 7fdf767ff700 1 Processor -- start 2023-06-23T19:02:05.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.673+0000 7fdf767ff700 1 -- start start 2023-06-23T19:02:05.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf767ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 0x7fdf700c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf767ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70070820 0x7fdf7014aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf767ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 0x7fdf701592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf767ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700c5050 con 0x7fdf7006c060 2023-06-23T19:02:05.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf767ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7014afa0 con 0x7fdf70070820 2023-06-23T19:02:05.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf767ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700ac240 con 0x7fdf70158ef0 2023-06-23T19:02:05.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf6ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 0x7fdf700c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf6ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 0x7fdf700c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40280/0 (socket says 172.21.15.136:40280) 2023-06-23T19:02:05.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf6ffff700 1 -- 172.21.15.136:0/3315636770 learned_addr learned my addr 172.21.15.136:0/3315636770 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:05.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf74d9c700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 0x7fdf701592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf67fff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70070820 0x7fdf7014aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf6ffff700 1 -- 172.21.15.136:0/3315636770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 msgr2=0x7fdf701592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf6ffff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 0x7fdf701592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf6ffff700 1 -- 172.21.15.136:0/3315636770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70070820 msgr2=0x7fdf7014aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf6ffff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70070820 0x7fdf7014aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf6ffff700 1 -- 172.21.15.136:0/3315636770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5800b7f0 con 0x7fdf7006c060 2023-06-23T19:02:05.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.674+0000 7fdf6ffff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 0x7fdf700c4b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000e870 tx=0x7fdf6000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:05.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.675+0000 7fdf6d7fa700 1 -- 172.21.15.136:0/3315636770 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60009590 con 0x7fdf7006c060 2023-06-23T19:02:05.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.675+0000 7fdf6d7fa700 1 -- 172.21.15.136:0/3315636770 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6000ee70 con 0x7fdf7006c060 2023-06-23T19:02:05.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.675+0000 7fdf6d7fa700 1 -- 172.21.15.136:0/3315636770 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000ca50 con 0x7fdf7006c060 2023-06-23T19:02:05.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.675+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf700ac520 con 0x7fdf7006c060 2023-06-23T19:02:05.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.675+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf700acae0 con 0x7fdf7006c060 2023-06-23T19:02:05.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.676+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf700b0050 con 0x7fdf7006c060 2023-06-23T19:02:05.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.677+0000 7fdf6d7fa700 1 -- 172.21.15.136:0/3315636770 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf6000cbb0 con 0x7fdf7006c060 2023-06-23T19:02:05.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.678+0000 7fdf6d7fa700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdf5006ace0 0x7fdf5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:05.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.678+0000 7fdf6d7fa700 1 -- 172.21.15.136:0/3315636770 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdf600898b0 con 0x7fdf7006c060 2023-06-23T19:02:05.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.678+0000 7fdf67fff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdf5006ace0 0x7fdf5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:05.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.678+0000 7fdf67fff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdf5006ace0 0x7fdf5006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800bee0 tx=0x7fdf58013000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:05.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.682+0000 7fdf6d7fa700 1 -- 172.21.15.136:0/3315636770 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf60057f90 con 0x7fdf7006c060 2023-06-23T19:02:05.885 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.882+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf70073910 con 0x7fdf7006c060 2023-06-23T19:02:05.887 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.883+0000 7fdf6d7fa700 1 -- 172.21.15.136:0/3315636770 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7fdf60021090 con 0x7fdf7006c060 2023-06-23T19:02:05.887 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:05.888 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:05.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdf5006ace0 msgr2=0x7fdf5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdf5006ace0 0x7fdf5006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800bee0 tx=0x7fdf58013000 comp rx=0 tx=0).stop 2023-06-23T19:02:05.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 msgr2=0x7fdf700c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:05.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 0x7fdf700c4b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000e870 tx=0x7fdf6000ec30 comp rx=0 tx=0).stop 2023-06-23T19:02:05.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 shutdown_connections 2023-06-23T19:02:05.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdf5006ace0 0x7fdf5006d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70158ef0 0x7fdf701592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf7006c060 0x7fdf700c4b10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 --2- 172.21.15.136:0/3315636770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70070820 0x7fdf7014aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:05.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 >> 172.21.15.136:0/3315636770 conn(0x7fdf700b0ef0 msgr2=0x7fdf700af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:05.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 shutdown_connections 2023-06-23T19:02:05.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:05.886+0000 7fdf767ff700 1 -- 172.21.15.136:0/3315636770 wait complete. 2023-06-23T19:02:05.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:02:05.909 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:02:06.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.102+0000 7fa29c1ff700 1 Processor -- start 2023-06-23T19:02:06.106 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.102+0000 7fa29c1ff700 1 -- start start 2023-06-23T19:02:06.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.104+0000 7fa29c1ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa2940d0a60 0x7fa2940b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.104+0000 7fa29c1ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa2940cf910 0x7fa2940d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.104+0000 7fa29c1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2940cd9d0 con 0x7fa2940b51d0 2023-06-23T19:02:06.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.104+0000 7fa29c1ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2940d0060 con 0x7fa2940cf910 2023-06-23T19:02:06.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.104+0000 7fa29c1ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2940b5620 con 0x7fa2940d0a60 2023-06-23T19:02:06.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.104+0000 7fa29a79c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa2940cf910 0x7fa2940d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.104+0000 7fa29a79c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa2940cf910 0x7fa2940d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40290/0 (socket says 172.21.15.136:40290) 2023-06-23T19:02:06.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.104+0000 7fa29a79c700 1 -- 172.21.15.136:0/1490603795 learned_addr learned my addr 172.21.15.136:0/1490603795 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:06.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.104+0000 7fa299f9b700 1 --2- 172.21.15.136:0/1490603795 >> v2:172.21.15.178:3300/0 conn(0x7fa2940d0a60 0x7fa2940b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.105+0000 7fa29a79c700 1 -- 172.21.15.136:0/1490603795 >> v2:172.21.15.178:3300/0 conn(0x7fa2940d0a60 msgr2=0x7fa2940b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:06.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.105+0000 7fa29a79c700 1 --2- 172.21.15.136:0/1490603795 >> v2:172.21.15.178:3300/0 conn(0x7fa2940d0a60 0x7fa2940b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.105+0000 7fa29a79c700 1 -- 172.21.15.136:0/1490603795 >> v1:172.21.15.178:6789/0 conn(0x7fa2940b51d0 legacy=0x7fa2940d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.105+0000 7fa29a79c700 1 -- 172.21.15.136:0/1490603795 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940cd410 con 0x7fa2940cf910 2023-06-23T19:02:06.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.105+0000 7fa29a79c700 1 --2- 172.21.15.136:0/1490603795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940cf910 0x7fa2940d2e00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa29406c6e0 tx=0x7fa28c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8dc38a560b27f9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:06.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.105+0000 7fa298f99700 1 -- 172.21.15.136:0/1490603795 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00e070 con 0x7fa2940cf910 2023-06-23T19:02:06.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.105+0000 7fa298f99700 1 -- 172.21.15.136:0/1490603795 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00b910 con 0x7fa2940cf910 2023-06-23T19:02:06.112 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.105+0000 7fa298f99700 1 -- 172.21.15.136:0/1490603795 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00bcc0 con 0x7fa2940cf910 2023-06-23T19:02:06.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.106+0000 7fa29c1ff700 1 -- 172.21.15.136:0/1490603795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940cf910 msgr2=0x7fa2940d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.106+0000 7fa29c1ff700 1 --2- 172.21.15.136:0/1490603795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940cf910 0x7fa2940d2e00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa29406c6e0 tx=0x7fa28c00b330 comp rx=0 tx=0).stop 2023-06-23T19:02:06.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.106+0000 7fa29c1ff700 1 -- 172.21.15.136:0/1490603795 shutdown_connections 2023-06-23T19:02:06.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.106+0000 7fa29c1ff700 1 --2- 172.21.15.136:0/1490603795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940cf910 0x7fa2940d2e00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.106+0000 7fa29c1ff700 1 --2- 172.21.15.136:0/1490603795 >> v2:172.21.15.178:3300/0 conn(0x7fa2940d0a60 0x7fa2940b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.106+0000 7fa29c1ff700 1 -- 172.21.15.136:0/1490603795 >> 172.21.15.136:0/1490603795 conn(0x7fa294071620 msgr2=0x7fa2940719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.106+0000 7fa29c1ff700 1 -- 172.21.15.136:0/1490603795 shutdown_connections 2023-06-23T19:02:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.106+0000 7fa29c1ff700 1 -- 172.21.15.136:0/1490603795 wait complete. 2023-06-23T19:02:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.108+0000 7fa29c1ff700 1 Processor -- start 2023-06-23T19:02:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.108+0000 7fa29c1ff700 1 -- start start 2023-06-23T19:02:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29c1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2940b51d0 0x7fa294156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29c1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2940cf910 0x7fa294155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29c1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940d0a60 0x7fa294159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29c1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa294157210 con 0x7fa2940d0a60 2023-06-23T19:02:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29c1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940c67b0 con 0x7fa2940cf910 2023-06-23T19:02:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29c1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940c6a90 con 0x7fa2940b51d0 2023-06-23T19:02:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29a79c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940d0a60 0x7fa294159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29a79c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940d0a60 0x7fa294159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40294/0 (socket says 172.21.15.136:40294) 2023-06-23T19:02:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29a79c700 1 -- 172.21.15.136:0/4021616140 learned_addr learned my addr 172.21.15.136:0/4021616140 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa299f9b700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2940b51d0 0x7fa294156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.109+0000 7fa29979a700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2940cf910 0x7fa294155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa29a79c700 1 -- 172.21.15.136:0/4021616140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2940b51d0 msgr2=0x7fa294156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa29a79c700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2940b51d0 0x7fa294156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa29a79c700 1 -- 172.21.15.136:0/4021616140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2940cf910 msgr2=0x7fa294155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa29a79c700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2940cf910 0x7fa294155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa29a79c700 1 -- 172.21.15.136:0/4021616140 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c009b30 con 0x7fa2940d0a60 2023-06-23T19:02:06.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa29a79c700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940d0a60 0x7fa294159510 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa2940d3d20 tx=0x7fa28c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:06.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa28a7fc700 1 -- 172.21.15.136:0/4021616140 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c004880 con 0x7fa2940d0a60 2023-06-23T19:02:06.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa28a7fc700 1 -- 172.21.15.136:0/4021616140 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c0092e0 con 0x7fa2940d0a60 2023-06-23T19:02:06.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2940c6d70 con 0x7fa2940d0a60 2023-06-23T19:02:06.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa28a7fc700 1 -- 172.21.15.136:0/4021616140 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c01c660 con 0x7fa2940d0a60 2023-06-23T19:02:06.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.110+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2940c7330 con 0x7fa2940d0a60 2023-06-23T19:02:06.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.111+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2940c7550 con 0x7fa2940d0a60 2023-06-23T19:02:06.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.112+0000 7fa28a7fc700 1 -- 172.21.15.136:0/4021616140 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa28c01c7c0 con 0x7fa2940d0a60 2023-06-23T19:02:06.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.113+0000 7fa28a7fc700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa27806ace0 0x7fa27806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.113+0000 7fa28a7fc700 1 -- 172.21.15.136:0/4021616140 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa28c08b0d0 con 0x7fa2940d0a60 2023-06-23T19:02:06.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.113+0000 7fa299f9b700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa27806ace0 0x7fa27806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.114+0000 7fa299f9b700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa27806ace0 0x7fa27806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa290009b40 tx=0x7fa290009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:06.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.117+0000 7fa28a7fc700 1 -- 172.21.15.136:0/4021616140 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa28c055e40 con 0x7fa2940d0a60 2023-06-23T19:02:06.318 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.314+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2940cde20 con 0x7fa2940d0a60 2023-06-23T19:02:06.318 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.315+0000 7fa28a7fc700 1 -- 172.21.15.136:0/4021616140 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa28c059460 con 0x7fa2940d0a60 2023-06-23T19:02:06.319 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:02:06.321 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.317+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa27806ace0 msgr2=0x7fa27806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.321 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.317+0000 7fa29c1ff700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa27806ace0 0x7fa27806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa290009b40 tx=0x7fa290009210 comp rx=0 tx=0).stop 2023-06-23T19:02:06.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.317+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940d0a60 msgr2=0x7fa294159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.317+0000 7fa29c1ff700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940d0a60 0x7fa294159510 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa2940d3d20 tx=0x7fa28c004ad0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.318+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 shutdown_connections 2023-06-23T19:02:06.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.318+0000 7fa29c1ff700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa27806ace0 0x7fa27806d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.318+0000 7fa29c1ff700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2940d0a60 0x7fa294159510 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.318+0000 7fa29c1ff700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2940b51d0 0x7fa294156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.318+0000 7fa29c1ff700 1 --2- 172.21.15.136:0/4021616140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2940cf910 0x7fa294155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.318+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 >> 172.21.15.136:0/4021616140 conn(0x7fa294071620 msgr2=0x7fa2940b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:06.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.318+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 shutdown_connections 2023-06-23T19:02:06.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.318+0000 7fa29c1ff700 1 -- 172.21.15.136:0/4021616140 wait complete. 2023-06-23T19:02:06.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:02:06.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.532+0000 7f54c3fff700 1 Processor -- start 2023-06-23T19:02:06.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.532+0000 7f54c3fff700 1 -- start start 2023-06-23T19:02:06.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.533+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc159590 0x7f54bc0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.533+0000 7f54c3fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f54bc0b1510 0x7f54bc0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.533+0000 7f54c3fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0caee0 con 0x7f54bc159960 2023-06-23T19:02:06.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.533+0000 7f54c3fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc0b1ec0 con 0x7f54bc0b1510 2023-06-23T19:02:06.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.533+0000 7f54c3fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0c8f30 con 0x7f54bc159590 2023-06-23T19:02:06.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.533+0000 7f54c159a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f54bc0b1510 0x7f54bc0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.544 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.533+0000 7f54c159a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f54bc0b1510 0x7f54bc0b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40306/0 (socket says 172.21.15.136:40306) 2023-06-23T19:02:06.544 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.533+0000 7f54c159a700 1 -- 172.21.15.136:0/3083761449 learned_addr learned my addr 172.21.15.136:0/3083761449 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:06.544 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.534+0000 7f54c1d9b700 1 --2- 172.21.15.136:0/3083761449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc159590 0x7f54bc0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.544 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.534+0000 7f54c159a700 1 -- 172.21.15.136:0/3083761449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc159590 msgr2=0x7f54bc0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:06.545 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.534+0000 7f54c159a700 1 --2- 172.21.15.136:0/3083761449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc159590 0x7f54bc0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.545 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.534+0000 7f54c159a700 1 -- 172.21.15.136:0/3083761449 >> v1:172.21.15.178:6789/0 conn(0x7f54bc159960 legacy=0x7f54bc159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.545 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.534+0000 7f54c159a700 1 -- 172.21.15.136:0/3083761449 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc15a4d0 con 0x7f54bc0b1510 2023-06-23T19:02:06.545 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.534+0000 7f54c159a700 1 --2- 172.21.15.136:0/3083761449 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc0b1510 0x7f54bc0b1980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0098f0 tx=0x7f54ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fe9c1a257cd2ea server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:06.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.534+0000 7f54c0d99700 1 -- 172.21.15.136:0/3083761449 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00f8a0 con 0x7f54bc0b1510 2023-06-23T19:02:06.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.534+0000 7f54c0d99700 1 -- 172.21.15.136:0/3083761449 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac00fa00 con 0x7f54bc0b1510 2023-06-23T19:02:06.546 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.534+0000 7f54c0d99700 1 -- 172.21.15.136:0/3083761449 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00fd90 con 0x7f54bc0b1510 2023-06-23T19:02:06.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.535+0000 7f54c3fff700 1 -- 172.21.15.136:0/3083761449 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc0b1510 msgr2=0x7f54bc0b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.535+0000 7f54c3fff700 1 --2- 172.21.15.136:0/3083761449 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc0b1510 0x7f54bc0b1980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0098f0 tx=0x7f54ac009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:06.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.535+0000 7f54c3fff700 1 -- 172.21.15.136:0/3083761449 shutdown_connections 2023-06-23T19:02:06.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.535+0000 7f54c3fff700 1 --2- 172.21.15.136:0/3083761449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc159590 0x7f54bc0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.535+0000 7f54c3fff700 1 --2- 172.21.15.136:0/3083761449 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc0b1510 0x7f54bc0b1980 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.535+0000 7f54c3fff700 1 -- 172.21.15.136:0/3083761449 >> 172.21.15.136:0/3083761449 conn(0x7f54bc06ab80 msgr2=0x7f54bc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:06.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.535+0000 7f54c3fff700 1 -- 172.21.15.136:0/3083761449 shutdown_connections 2023-06-23T19:02:06.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.535+0000 7f54c3fff700 1 -- 172.21.15.136:0/3083761449 wait complete. 2023-06-23T19:02:06.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.537+0000 7f54c3fff700 1 Processor -- start 2023-06-23T19:02:06.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.537+0000 7f54c3fff700 1 -- start start 2023-06-23T19:02:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc0b1510 0x7f54bc157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc159590 0x7f54bc0c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.554 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc159960 0x7f54bc14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.554 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c3fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0c38f0 con 0x7f54bc159960 2023-06-23T19:02:06.554 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c3fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0c3100 con 0x7f54bc159590 2023-06-23T19:02:06.554 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c3fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc150240 con 0x7f54bc0b1510 2023-06-23T19:02:06.555 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc159960 0x7f54bc14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.555 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc159960 0x7f54bc14fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40322/0 (socket says 172.21.15.136:40322) 2023-06-23T19:02:06.555 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c259c700 1 -- 172.21.15.136:0/3216076179 learned_addr learned my addr 172.21.15.136:0/3216076179 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:06.555 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c159a700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc159590 0x7f54bc0c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.556 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.538+0000 7f54c1d9b700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc0b1510 0x7f54bc157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.556 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54c259c700 1 -- 172.21.15.136:0/3216076179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc0b1510 msgr2=0x7f54bc157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.556 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54c259c700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc0b1510 0x7f54bc157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.557 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54c259c700 1 -- 172.21.15.136:0/3216076179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc159590 msgr2=0x7f54bc0c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.557 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54c259c700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc159590 0x7f54bc0c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.558 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54c259c700 1 -- 172.21.15.136:0/3216076179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac009550 con 0x7f54bc159960 2023-06-23T19:02:06.558 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54c259c700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc159960 0x7f54bc14fd00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f54b400cc50 tx=0x7f54b400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:06.559 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54b27fc700 1 -- 172.21.15.136:0/3216076179 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4003c00 con 0x7f54bc159960 2023-06-23T19:02:06.559 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54b27fc700 1 -- 172.21.15.136:0/3216076179 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b4003d60 con 0x7f54bc159960 2023-06-23T19:02:06.560 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54b27fc700 1 -- 172.21.15.136:0/3216076179 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b400aab0 con 0x7f54bc159960 2023-06-23T19:02:06.560 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc0c3330 con 0x7f54bc159960 2023-06-23T19:02:06.560 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.539+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc0c6980 con 0x7f54bc159960 2023-06-23T19:02:06.561 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.540+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc071620 con 0x7f54bc159960 2023-06-23T19:02:06.561 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.541+0000 7f54b27fc700 1 -- 172.21.15.136:0/3216076179 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54b400ac10 con 0x7f54bc159960 2023-06-23T19:02:06.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.543+0000 7f54b27fc700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54a006ace0 0x7f54a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.543+0000 7f54b27fc700 1 -- 172.21.15.136:0/3216076179 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f54b40897e0 con 0x7f54bc159960 2023-06-23T19:02:06.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.543+0000 7f54c1d9b700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54a006ace0 0x7f54a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.563 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.544+0000 7f54c1d9b700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54a006ace0 0x7f54a006d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54b8006b20 tx=0x7f54b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:06.564 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.547+0000 7f54b27fc700 1 -- 172.21.15.136:0/3216076179 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54b40544c0 con 0x7f54bc159960 2023-06-23T19:02:06.745 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.742+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54bc0c67e0 con 0x7f54bc159960 2023-06-23T19:02:06.746 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.742+0000 7f54b27fc700 1 -- 172.21.15.136:0/3216076179 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54bc0c67e0 con 0x7f54bc159960 2023-06-23T19:02:06.746 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:02:06.749 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54a006ace0 msgr2=0x7f54a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.749 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54a006ace0 0x7f54a006d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54b8006b20 tx=0x7f54b8008040 comp rx=0 tx=0).stop 2023-06-23T19:02:06.749 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc159960 msgr2=0x7f54bc14fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.750 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc159960 0x7f54bc14fd00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f54b400cc50 tx=0x7f54b400cf60 comp rx=0 tx=0).stop 2023-06-23T19:02:06.750 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 shutdown_connections 2023-06-23T19:02:06.750 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f54a006ace0 0x7f54a006d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54bc159960 0x7f54bc14fd00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54bc0b1510 0x7f54bc157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 --2- 172.21.15.136:0/3216076179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc159590 0x7f54bc0c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 >> 172.21.15.136:0/3216076179 conn(0x7f54bc06ab80 msgr2=0x7f54bc0701e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:06.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 shutdown_connections 2023-06-23T19:02:06.752 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.745+0000 7f54c3fff700 1 -- 172.21.15.136:0/3216076179 wait complete. 2023-06-23T19:02:06.766 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:02:06.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.959+0000 7f33c77ff700 1 Processor -- start 2023-06-23T19:02:06.963 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.959+0000 7f33c77ff700 1 -- start start 2023-06-23T19:02:06.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.960+0000 7f33c77ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f33c00d0a60 0x7f33c00b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.964 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.960+0000 7f33c77ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c00cd9d0 con 0x7f33c00cf910 2023-06-23T19:02:06.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.960+0000 7f33c77ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c00b5620 con 0x7f33c00b51d0 2023-06-23T19:02:06.965 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.960+0000 7f33c77ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c00d0060 con 0x7f33c00d0a60 2023-06-23T19:02:06.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33c5d9c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f33c00cf910 0x7f33c00d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38004/0 (socket says 172.21.15.136:38004) 2023-06-23T19:02:06.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33c5d9c700 1 -- 172.21.15.136:0/1604870989 learned_addr learned my addr 172.21.15.136:0/1604870989 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:06.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33c559b700 1 --2- 172.21.15.136:0/1604870989 >> v2:172.21.15.178:3300/0 conn(0x7f33c00d0a60 0x7f33c00b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017752480 0 0) 0x7f33c00cd9d0 con 0x7f33c00cf910 2023-06-23T19:02:06.967 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33ac0035b0 con 0x7f33c00cf910 2023-06-23T19:02:06.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811767869 0 0) 0x7f33c00b5620 con 0x7f33c00b51d0 2023-06-23T19:02:06.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c00cd9d0 con 0x7f33c00b51d0 2023-06-23T19:02:06.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2373247679 0 0) 0x7f33ac0035b0 con 0x7f33c00cf910 2023-06-23T19:02:06.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 >> v2:172.21.15.178:3300/0 conn(0x7f33c00d0a60 msgr2=0x7f33c00b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:06.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 --2- 172.21.15.136:0/1604870989 >> v2:172.21.15.178:3300/0 conn(0x7f33c00d0a60 0x7f33c00b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 >> v1:172.21.15.178:6789/0 conn(0x7f33c00b51d0 legacy=0x7f33c00d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c00cd410 con 0x7f33c00cf910 2023-06-23T19:02:06.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7f33b80019f0 con 0x7f33c00cf910 2023-06-23T19:02:06.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33c559b700 1 --2- 172.21.15.136:0/1604870989 >> v2:172.21.15.178:3300/0 conn(0x7f33c00d0a60 0x7f33c00b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:06.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 >> v1:172.21.15.136:6789/0 conn(0x7f33c00cf910 legacy=0x7f33c00d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.979 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33ac003b90 0x7f33ac003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.979 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.961+0000 7f33b7fff700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac004850 0x7f33ac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.979 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33b7fff700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33ac005200 0x7f33ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00d0060 con 0x7f33ac003b90 2023-06-23T19:02:06.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac00c060 con 0x7f33ac005200 2023-06-23T19:02:06.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac00c220 con 0x7f33ac004850 2023-06-23T19:02:06.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c559b700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33ac003b90 0x7f33ac003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c5d9c700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33ac005200 0x7f33ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c4d9a700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac004850 0x7f33ac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c559b700 1 -- 172.21.15.136:0/1604870989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac004850 msgr2=0x7f33ac004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:06.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c559b700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac004850 0x7f33ac004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c559b700 1 -- 172.21.15.136:0/1604870989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33ac005200 msgr2=0x7f33ac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:06.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c559b700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33ac005200 0x7f33ac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c559b700 1 -- 172.21.15.136:0/1604870989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0035b0 con 0x7f33ac003b90 2023-06-23T19:02:06.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c5d9c700 1 -- 172.21.15.136:0/1604870989 reap_dead start 2023-06-23T19:02:06.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.962+0000 7f33c559b700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33ac003b90 0x7f33ac003f80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009d30 tx=0x7f33ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea55bbff9c02696 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:06.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc009e80 con 0x7f33ac003b90 2023-06-23T19:02:06.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc00e9a0 con 0x7f33ac003b90 2023-06-23T19:02:06.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33b7fff700 1 -- 172.21.15.136:0/1604870989 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc00ed10 con 0x7f33ac003b90 2023-06-23T19:02:06.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33c77ff700 1 -- 172.21.15.136:0/1604870989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33ac003b90 msgr2=0x7f33ac003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33c77ff700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33ac003b90 0x7f33ac003f80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009d30 tx=0x7f33ac005880 comp rx=0 tx=0).stop 2023-06-23T19:02:06.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33c77ff700 1 -- 172.21.15.136:0/1604870989 shutdown_connections 2023-06-23T19:02:06.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33c77ff700 1 --2- 172.21.15.136:0/1604870989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33ac003b90 0x7f33ac003f80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33c77ff700 1 -- 172.21.15.136:0/1604870989 >> 172.21.15.136:0/1604870989 conn(0x7f33c0071620 msgr2=0x7f33c00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:06.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33c77ff700 1 -- 172.21.15.136:0/1604870989 shutdown_connections 2023-06-23T19:02:06.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.963+0000 7f33c77ff700 1 -- 172.21.15.136:0/1604870989 wait complete. 2023-06-23T19:02:06.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.966+0000 7f33c77ff700 1 Processor -- start 2023-06-23T19:02:06.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.966+0000 7f33c77ff700 1 -- start start 2023-06-23T19:02:06.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.967+0000 7f33c77ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac003b90 0x7f33c0148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.967+0000 7f33c77ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c015c950 0x7f33c00b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.967+0000 7f33c77ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c015cdc0 0x7f33c00b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.967+0000 7f33c77ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c01494c0 con 0x7f33c015cdc0 2023-06-23T19:02:06.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.967+0000 7f33c77ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c015ef80 con 0x7f33c015c950 2023-06-23T19:02:06.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.967+0000 7f33c77ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c0152d20 con 0x7f33ac003b90 2023-06-23T19:02:06.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.967+0000 7f33c5d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c015cdc0 0x7f33c00b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.967+0000 7f33c5d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c015cdc0 0x7f33c00b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40330/0 (socket says 172.21.15.136:40330) 2023-06-23T19:02:06.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.967+0000 7f33c5d9c700 1 -- 172.21.15.136:0/3607125241 learned_addr learned my addr 172.21.15.136:0/3607125241 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:06.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c4d9a700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c015c950 0x7f33c00b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c559b700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac003b90 0x7f33c0148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c5d9c700 1 -- 172.21.15.136:0/3607125241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac003b90 msgr2=0x7f33c0148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c5d9c700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac003b90 0x7f33c0148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c5d9c700 1 -- 172.21.15.136:0/3607125241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c015c950 msgr2=0x7f33c00b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:06.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c5d9c700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c015c950 0x7f33c00b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:06.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c5d9c700 1 -- 172.21.15.136:0/3607125241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c015f1d0 con 0x7f33c015cdc0 2023-06-23T19:02:06.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c5d9c700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c015cdc0 0x7f33c00b4440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f33c00d3cc0 tx=0x7f33b8007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:06.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33b5ffb700 1 -- 172.21.15.136:0/3607125241 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b800eb70 con 0x7f33c015cdc0 2023-06-23T19:02:06.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33b5ffb700 1 -- 172.21.15.136:0/3607125241 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b800ecd0 con 0x7f33c015cdc0 2023-06-23T19:02:06.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c015f4b0 con 0x7f33c015cdc0 2023-06-23T19:02:06.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33b5ffb700 1 -- 172.21.15.136:0/3607125241 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8013420 con 0x7f33c015cdc0 2023-06-23T19:02:06.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.968+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c015f790 con 0x7f33c015cdc0 2023-06-23T19:02:06.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.970+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c0153200 con 0x7f33c015cdc0 2023-06-23T19:02:06.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.970+0000 7f33b5ffb700 1 -- 172.21.15.136:0/3607125241 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33b8013580 con 0x7f33c015cdc0 2023-06-23T19:02:06.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.971+0000 7f33b5ffb700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f33a406ad10 0x7f33a406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:06.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.971+0000 7f33b5ffb700 1 -- 172.21.15.136:0/3607125241 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f33b8089d50 con 0x7f33c015cdc0 2023-06-23T19:02:06.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.971+0000 7f33c559b700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f33a406ad10 0x7f33a406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:06.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.972+0000 7f33c559b700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f33a406ad10 0x7f33a406d1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0090b0 tx=0x7f33bc01e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:06.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:06.975+0000 7f33b5ffb700 1 -- 172.21.15.136:0/3607125241 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33c0153200 con 0x7f33c015cdc0 2023-06-23T19:02:07.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.177+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33c0153200 con 0x7f33c015cdc0 2023-06-23T19:02:07.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.178+0000 7f33b5ffb700 1 -- 172.21.15.136:0/3607125241 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33c0153200 con 0x7f33c015cdc0 2023-06-23T19:02:07.182 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:07.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f33a406ad10 msgr2=0x7f33a406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.189 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f33a406ad10 0x7f33a406d1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0090b0 tx=0x7f33bc01e040 comp rx=0 tx=0).stop 2023-06-23T19:02:07.189 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c015cdc0 msgr2=0x7f33c00b4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.189 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c015cdc0 0x7f33c00b4440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f33c00d3cc0 tx=0x7f33b8007c90 comp rx=0 tx=0).stop 2023-06-23T19:02:07.189 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 shutdown_connections 2023-06-23T19:02:07.189 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f33a406ad10 0x7f33a406d1c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.189 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c015cdc0 0x7f33c00b4440 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.189 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac003b90 0x7f33c0148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 --2- 172.21.15.136:0/3607125241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c015c950 0x7f33c00b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.180+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 >> 172.21.15.136:0/3607125241 conn(0x7f33c0071620 msgr2=0x7f33c015c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:07.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.181+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 shutdown_connections 2023-06-23T19:02:07.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.181+0000 7f33c77ff700 1 -- 172.21.15.136:0/3607125241 wait complete. 2023-06-23T19:02:07.203 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:02:07.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.395+0000 7fd2519ff700 1 Processor -- start 2023-06-23T19:02:07.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.395+0000 7fd2519ff700 1 -- start start 2023-06-23T19:02:07.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.396+0000 7fd2519ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd24c0b5a70 0x7fd24c0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.396+0000 7fd2519ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0b5ec0 con 0x7fd24c0d0a60 2023-06-23T19:02:07.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.396+0000 7fd2519ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0cd9d0 con 0x7fd24c0cf910 2023-06-23T19:02:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.396+0000 7fd2519ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c0d0060 con 0x7fd24c0b5a70 2023-06-23T19:02:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd24affd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd24c0d0a60 0x7fd24c0d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38014/0 (socket says 172.21.15.136:38014) 2023-06-23T19:02:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd24affd700 1 -- 172.21.15.136:0/2799895731 learned_addr learned my addr 172.21.15.136:0/2799895731 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd24a7fc700 1 --2- 172.21.15.136:0/2799895731 >> v2:172.21.15.178:3300/0 conn(0x7fd24c0b5a70 0x7fd24c0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111374831 0 0) 0x7fd24c0b5ec0 con 0x7fd24c0d0a60 2023-06-23T19:02:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2340035b0 con 0x7fd24c0d0a60 2023-06-23T19:02:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 558728846 0 0) 0x7fd2340035b0 con 0x7fd24c0d0a60 2023-06-23T19:02:07.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 >> v2:172.21.15.178:3300/0 conn(0x7fd24c0b5a70 msgr2=0x7fd24c0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:07.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd249ffb700 1 --2- 172.21.15.136:0/2799895731 >> v2:172.21.15.178:3300/0 conn(0x7fd24c0b5a70 0x7fd24c0b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 >> v1:172.21.15.178:6789/0 conn(0x7fd24c0cf910 legacy=0x7fd24c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0cd410 con 0x7fd24c0d0a60 2023-06-23T19:02:07.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fd23c001670 con 0x7fd24c0d0a60 2023-06-23T19:02:07.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.397+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 >> v1:172.21.15.136:6789/0 conn(0x7fd24c0d0a60 legacy=0x7fd24c0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd249ffb700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd234003a00 0x7fd234003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd249ffb700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2340043f0 0x7fd2340048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd249ffb700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2340050b0 0x7fd23400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0d0060 con 0x7fd234003a00 2023-06-23T19:02:07.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23400c000 con 0x7fd2340043f0 2023-06-23T19:02:07.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23400c1c0 con 0x7fd2340050b0 2023-06-23T19:02:07.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24affd700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd234003a00 0x7fd234003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24a7fc700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2340043f0 0x7fd2340048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24b7fe700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2340050b0 0x7fd23400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24affd700 1 -- 172.21.15.136:0/2799895731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2340050b0 msgr2=0x7fd23400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:07.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24affd700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2340050b0 0x7fd23400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24affd700 1 -- 172.21.15.136:0/2799895731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2340043f0 msgr2=0x7fd2340048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:07.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24affd700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2340043f0 0x7fd2340048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24affd700 1 -- 172.21.15.136:0/2799895731 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340035b0 con 0x7fd234003a00 2023-06-23T19:02:07.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24b7fe700 1 -- 172.21.15.136:0/2799895731 reap_dead start 2023-06-23T19:02:07.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.398+0000 7fd24affd700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd234003a00 0x7fd234003dd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c210 tx=0x7fd234005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bdce187356e538 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:07.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00cd50 con 0x7fd234003a00 2023-06-23T19:02:07.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c005960 con 0x7fd234003a00 2023-06-23T19:02:07.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd249ffb700 1 -- 172.21.15.136:0/2799895731 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c005d10 con 0x7fd234003a00 2023-06-23T19:02:07.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd2519ff700 1 -- 172.21.15.136:0/2799895731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd234003a00 msgr2=0x7fd234003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd2519ff700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd234003a00 0x7fd234003dd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c210 tx=0x7fd234005880 comp rx=0 tx=0).stop 2023-06-23T19:02:07.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd2519ff700 1 -- 172.21.15.136:0/2799895731 shutdown_connections 2023-06-23T19:02:07.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd2519ff700 1 --2- 172.21.15.136:0/2799895731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd234003a00 0x7fd234003dd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd2519ff700 1 -- 172.21.15.136:0/2799895731 >> 172.21.15.136:0/2799895731 conn(0x7fd24c071620 msgr2=0x7fd24c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:07.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd2519ff700 1 -- 172.21.15.136:0/2799895731 shutdown_connections 2023-06-23T19:02:07.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.399+0000 7fd2519ff700 1 -- 172.21.15.136:0/2799895731 wait complete. 2023-06-23T19:02:07.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.401+0000 7fd2519ff700 1 Processor -- start 2023-06-23T19:02:07.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.401+0000 7fd2519ff700 1 -- start start 2023-06-23T19:02:07.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd2519ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd234003a00 0x7fd24c159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd2519ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd24c0b7cc0 0x7fd24c0b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd2519ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c0b6f00 0x7fd24c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd2519ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b8350 con 0x7fd24c0b6f00 2023-06-23T19:02:07.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd2519ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b8130 con 0x7fd234003a00 2023-06-23T19:02:07.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd2519ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b7370 con 0x7fd24c0b7cc0 2023-06-23T19:02:07.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd24b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c0b6f00 0x7fd24c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd24a7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd24c0b7cc0 0x7fd24c0b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd24affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd234003a00 0x7fd24c159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd24a7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd24c0b7cc0 0x7fd24c0b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:52968/0 (socket says 172.21.15.136:52968) 2023-06-23T19:02:07.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd24b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c0b6f00 0x7fd24c15c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40340/0 (socket says 172.21.15.136:40340) 2023-06-23T19:02:07.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.402+0000 7fd24a7fc700 1 -- 172.21.15.136:0/1970585611 learned_addr learned my addr 172.21.15.136:0/1970585611 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:07.413 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd24b7fe700 1 -- 172.21.15.136:0/1970585611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd24c0b7cc0 msgr2=0x7fd24c0b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.413 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd24b7fe700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd24c0b7cc0 0x7fd24c0b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.413 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd24b7fe700 1 -- 172.21.15.136:0/1970585611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd234003a00 msgr2=0x7fd24c159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.413 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd24b7fe700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd234003a00 0x7fd24c159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.413 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd24b7fe700 1 -- 172.21.15.136:0/1970585611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c156700 con 0x7fd24c0b6f00 2023-06-23T19:02:07.413 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd24b7fe700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c0b6f00 0x7fd24c15c920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0d3c90 tx=0x7fd24400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:07.413 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd233fff700 1 -- 172.21.15.136:0/1970585611 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244003c10 con 0x7fd24c0b6f00 2023-06-23T19:02:07.414 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd233fff700 1 -- 172.21.15.136:0/1970585611 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244003d70 con 0x7fd24c0b6f00 2023-06-23T19:02:07.414 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c0c88e0 con 0x7fd24c0b6f00 2023-06-23T19:02:07.414 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.403+0000 7fd233fff700 1 -- 172.21.15.136:0/1970585611 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2440052f0 con 0x7fd24c0b6f00 2023-06-23T19:02:07.414 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.404+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c0c8e20 con 0x7fd24c0b6f00 2023-06-23T19:02:07.414 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.405+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c0cfd10 con 0x7fd24c0b6f00 2023-06-23T19:02:07.414 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.405+0000 7fd233fff700 1 -- 172.21.15.136:0/1970585611 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd244005450 con 0x7fd24c0b6f00 2023-06-23T19:02:07.415 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.406+0000 7fd233fff700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd23806ace0 0x7fd23806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.415 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.406+0000 7fd233fff700 1 -- 172.21.15.136:0/1970585611 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd2440897a0 con 0x7fd24c0b6f00 2023-06-23T19:02:07.415 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.407+0000 7fd24affd700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd23806ace0 0x7fd23806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.416 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.407+0000 7fd24affd700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd23806ace0 0x7fd23806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd23c000c00 tx=0x7fd23c00a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:07.416 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.410+0000 7fd233fff700 1 -- 172.21.15.136:0/1970585611 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd244054480 con 0x7fd24c0b6f00 2023-06-23T19:02:07.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.606+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd24c04ea20 con 0x7fd24c0b6f00 2023-06-23T19:02:07.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.607+0000 7fd233fff700 1 -- 172.21.15.136:0/1970585611 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd244057aa0 con 0x7fd24c0b6f00 2023-06-23T19:02:07.611 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:02:07.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd23806ace0 msgr2=0x7fd23806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd23806ace0 0x7fd23806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd23c000c00 tx=0x7fd23c00a000 comp rx=0 tx=0).stop 2023-06-23T19:02:07.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c0b6f00 msgr2=0x7fd24c15c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c0b6f00 0x7fd24c15c920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0d3c90 tx=0x7fd24400ee90 comp rx=0 tx=0).stop 2023-06-23T19:02:07.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 shutdown_connections 2023-06-23T19:02:07.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd23806ace0 0x7fd23806d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd234003a00 0x7fd24c159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c0b6f00 0x7fd24c15c920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 --2- 172.21.15.136:0/1970585611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd24c0b7cc0 0x7fd24c0b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 >> 172.21.15.136:0/1970585611 conn(0x7fd24c071620 msgr2=0x7fd24c0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 shutdown_connections 2023-06-23T19:02:07.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.609+0000 7fd2519ff700 1 -- 172.21.15.136:0/1970585611 wait complete. 2023-06-23T19:02:07.631 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:02:07.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.825+0000 7f99c17ff700 1 Processor -- start 2023-06-23T19:02:07.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.825+0000 7f99c17ff700 1 -- start start 2023-06-23T19:02:07.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.827+0000 7f99c17ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0d0a60 0x7f99bc0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.827+0000 7f99c17ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0cd9d0 con 0x7f99bc0cf910 2023-06-23T19:02:07.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.827+0000 7f99c17ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0b5640 con 0x7f99bc0b51d0 2023-06-23T19:02:07.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.827+0000 7f99c17ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0d0060 con 0x7f99bc0d0a60 2023-06-23T19:02:07.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.827+0000 7f99bb7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f99bc0cf910 0x7f99bc0d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38030/0 (socket says 172.21.15.136:38030) 2023-06-23T19:02:07.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.827+0000 7f99bb7fe700 1 -- 172.21.15.136:0/3007683914 learned_addr learned my addr 172.21.15.136:0/3007683914 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:07.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.828+0000 7f99baffd700 1 --2- 172.21.15.136:0/3007683914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0d0a60 0x7f99bc0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.828+0000 7f99ba7fc700 1 -- 172.21.15.136:0/3007683914 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246841947 0 0) 0x7f99bc0cd9d0 con 0x7f99bc0cf910 2023-06-23T19:02:07.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.828+0000 7f99ba7fc700 1 -- 172.21.15.136:0/3007683914 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a80035b0 con 0x7f99bc0cf910 2023-06-23T19:02:07.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.828+0000 7f99ba7fc700 1 -- 172.21.15.136:0/3007683914 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623597167 0 0) 0x7f99bc0b5640 con 0x7f99bc0b51d0 2023-06-23T19:02:07.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.828+0000 7f99ba7fc700 1 -- 172.21.15.136:0/3007683914 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99bc0cd9d0 con 0x7f99bc0b51d0 2023-06-23T19:02:07.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.828+0000 7f99baffd700 1 -- 172.21.15.136:0/3007683914 >> v1:172.21.15.178:6789/0 conn(0x7f99bc0b51d0 legacy=0x7f99bc0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.828+0000 7f99baffd700 1 -- 172.21.15.136:0/3007683914 >> v1:172.21.15.136:6789/0 conn(0x7f99bc0cf910 legacy=0x7f99bc0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.828+0000 7f99baffd700 1 -- 172.21.15.136:0/3007683914 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0cfd90 con 0x7f99bc0d0a60 2023-06-23T19:02:07.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.828+0000 7f99baffd700 1 --2- 172.21.15.136:0/3007683914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0d0a60 0x7f99bc0b5a70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009870 tx=0x7f99ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ad11fdc23c21cef server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:07.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99ba7fc700 1 -- 172.21.15.136:0/3007683914 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac011830 con 0x7f99bc0d0a60 2023-06-23T19:02:07.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99ba7fc700 1 -- 172.21.15.136:0/3007683914 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac011990 con 0x7f99bc0d0a60 2023-06-23T19:02:07.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99ba7fc700 1 -- 172.21.15.136:0/3007683914 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac011d20 con 0x7f99bc0d0a60 2023-06-23T19:02:07.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99c17ff700 1 -- 172.21.15.136:0/3007683914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0d0a60 msgr2=0x7f99bc0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99c17ff700 1 --2- 172.21.15.136:0/3007683914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0d0a60 0x7f99bc0b5a70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009870 tx=0x7f99ac009b80 comp rx=0 tx=0).stop 2023-06-23T19:02:07.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99c17ff700 1 -- 172.21.15.136:0/3007683914 shutdown_connections 2023-06-23T19:02:07.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99c17ff700 1 --2- 172.21.15.136:0/3007683914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0d0a60 0x7f99bc0b5a70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99c17ff700 1 -- 172.21.15.136:0/3007683914 >> 172.21.15.136:0/3007683914 conn(0x7f99bc071620 msgr2=0x7f99bc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:07.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99c17ff700 1 -- 172.21.15.136:0/3007683914 shutdown_connections 2023-06-23T19:02:07.836 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.829+0000 7f99c17ff700 1 -- 172.21.15.136:0/3007683914 wait complete. 2023-06-23T19:02:07.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.831+0000 7f99c17ff700 1 Processor -- start 2023-06-23T19:02:07.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.831+0000 7f99c17ff700 1 -- start start 2023-06-23T19:02:07.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.832+0000 7f99c17ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99bc0b51d0 0x7f99bc15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.840 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.832+0000 7f99c17ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0cf910 0x7f99bc0ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.832+0000 7f99c17ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0d0a60 0x7f99bc0ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.832+0000 7f99c17ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0a95f0 con 0x7f99bc0b51d0 2023-06-23T19:02:07.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.832+0000 7f99c17ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1f2550 con 0x7f99bc0d0a60 2023-06-23T19:02:07.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.832+0000 7f99c17ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1f2830 con 0x7f99bc0cf910 2023-06-23T19:02:07.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.832+0000 7f99baffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99bc0b51d0 0x7f99bc15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.832+0000 7f99baffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99bc0b51d0 0x7f99bc15e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40344/0 (socket says 172.21.15.136:40344) 2023-06-23T19:02:07.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.832+0000 7f99baffd700 1 -- 172.21.15.136:0/3408335868 learned_addr learned my addr 172.21.15.136:0/3408335868 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:07.841 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99b3fff700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0cf910 0x7f99bc0ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99bb7fe700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0d0a60 0x7f99bc0ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99baffd700 1 -- 172.21.15.136:0/3408335868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0cf910 msgr2=0x7f99bc0ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99baffd700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0cf910 0x7f99bc0ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99baffd700 1 -- 172.21.15.136:0/3408335868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0d0a60 msgr2=0x7f99bc0ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:07.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99baffd700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0d0a60 0x7f99bc0ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:07.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99baffd700 1 -- 172.21.15.136:0/3408335868 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0094a0 con 0x7f99bc0b51d0 2023-06-23T19:02:07.842 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99baffd700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99bc0b51d0 0x7f99bc15e6d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f99ac014040 tx=0x7f99ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:07.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99b37fe700 1 -- 172.21.15.136:0/3408335868 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac01a860 con 0x7f99bc0b51d0 2023-06-23T19:02:07.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99b37fe700 1 -- 172.21.15.136:0/3408335868 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac01a9c0 con 0x7f99bc0b51d0 2023-06-23T19:02:07.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc1f2b10 con 0x7f99bc0b51d0 2023-06-23T19:02:07.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99b37fe700 1 -- 172.21.15.136:0/3408335868 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac01ad30 con 0x7f99bc0b51d0 2023-06-23T19:02:07.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.833+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc15ec10 con 0x7f99bc0b51d0 2023-06-23T19:02:07.843 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.835+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc04ea20 con 0x7f99bc0b51d0 2023-06-23T19:02:07.844 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.836+0000 7f99b37fe700 1 -- 172.21.15.136:0/3408335868 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99ac022070 con 0x7f99bc0b51d0 2023-06-23T19:02:07.844 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.836+0000 7f99b37fe700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f999c06ace0 0x7f999c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:07.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.837+0000 7f99b37fe700 1 -- 172.21.15.136:0/3408335868 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f99ac08a920 con 0x7f99bc0b51d0 2023-06-23T19:02:07.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.837+0000 7f99b3fff700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f999c06ace0 0x7f999c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:07.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.837+0000 7f99b3fff700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f999c06ace0 0x7f999c06d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0b8690 tx=0x7f99a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:07.845 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:07.841+0000 7f99b37fe700 1 -- 172.21.15.136:0/3408335868 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99ac055690 con 0x7f99bc0b51d0 2023-06-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.042+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f99bc0b4110 con 0x7f99bc0b51d0 2023-06-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.042+0000 7f99b37fe700 1 -- 172.21.15.136:0/3408335868 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f99ac029020 con 0x7f99bc0b51d0 2023-06-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f999c06ace0 msgr2=0x7f999c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f999c06ace0 0x7f999c06d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0b8690 tx=0x7f99a4009040 comp rx=0 tx=0).stop 2023-06-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99bc0b51d0 msgr2=0x7f99bc15e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99bc0b51d0 0x7f99bc15e6d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f99ac014040 tx=0x7f99ac004750 comp rx=0 tx=0).stop 2023-06-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 shutdown_connections 2023-06-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f999c06ace0 0x7f999c06d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0d0a60 0x7f99bc0ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99bc0b51d0 0x7f99bc15e6d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 --2- 172.21.15.136:0/3408335868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc0cf910 0x7f99bc0ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 >> 172.21.15.136:0/3408335868 conn(0x7f99bc071620 msgr2=0x7f99bc15f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 shutdown_connections 2023-06-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.045+0000 7f99c17ff700 1 -- 172.21.15.136:0/3408335868 wait complete. 2023-06-23T19:02:08.076 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-23T19:02:08.077 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-23T19:02:08.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.268+0000 7f88bbbff700 1 Processor -- start 2023-06-23T19:02:08.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.268+0000 7f88bbbff700 1 -- start start 2023-06-23T19:02:08.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.269+0000 7f88bbbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b41674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:08.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.269+0000 7f88bbbff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b41610a0 con 0x7f88b40cd830 2023-06-23T19:02:08.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.269+0000 7f88bbbff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b415da90 con 0x7f88b415c570 2023-06-23T19:02:08.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.269+0000 7f88bbbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b415d670 con 0x7f88b4160a50 2023-06-23T19:02:08.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.269+0000 7f88b919a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f88b40cd830 0x7f88b4160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38038/0 (socket says 172.21.15.136:38038) 2023-06-23T19:02:08.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88b919a700 1 -- 172.21.15.136:0/732893920 learned_addr learned my addr 172.21.15.136:0/732893920 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:08.275 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88ba19c700 1 --2- 172.21.15.136:0/732893920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b41674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:08.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88b8999700 1 -- 172.21.15.136:0/732893920 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246264983 0 0) 0x7f88b41610a0 con 0x7f88b40cd830 2023-06-23T19:02:08.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88b8999700 1 -- 172.21.15.136:0/732893920 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a00035b0 con 0x7f88b40cd830 2023-06-23T19:02:08.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88b8999700 1 -- 172.21.15.136:0/732893920 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927287637 0 0) 0x7f88b415da90 con 0x7f88b415c570 2023-06-23T19:02:08.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88b8999700 1 -- 172.21.15.136:0/732893920 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b41610a0 con 0x7f88b415c570 2023-06-23T19:02:08.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88ba19c700 1 -- 172.21.15.136:0/732893920 >> v1:172.21.15.178:6789/0 conn(0x7f88b415c570 legacy=0x7f88b40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:08.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88b8999700 1 -- 172.21.15.136:0/732893920 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4256156099 0 0) 0x7f88a00035b0 con 0x7f88b40cd830 2023-06-23T19:02:08.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88ba19c700 1 -- 172.21.15.136:0/732893920 >> v1:172.21.15.136:6789/0 conn(0x7f88b40cd830 legacy=0x7f88b4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:08.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.270+0000 7f88ba19c700 1 -- 172.21.15.136:0/732893920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b415ccd0 con 0x7f88b4160a50 2023-06-23T19:02:08.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.271+0000 7f88ba19c700 1 --2- 172.21.15.136:0/732893920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b41674d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009dc0 tx=0x7f88ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e01bdbb70992150 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:08.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.271+0000 7f88b8999700 1 -- 172.21.15.136:0/732893920 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac00e070 con 0x7f88b4160a50 2023-06-23T19:02:08.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.271+0000 7f88b8999700 1 -- 172.21.15.136:0/732893920 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac003a20 con 0x7f88b4160a50 2023-06-23T19:02:08.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.271+0000 7f88b8999700 1 -- 172.21.15.136:0/732893920 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4001670 con 0x7f88b4160a50 2023-06-23T19:02:08.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.271+0000 7f88bbbff700 1 -- 172.21.15.136:0/732893920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 msgr2=0x7f88b41674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:08.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.271+0000 7f88bbbff700 1 --2- 172.21.15.136:0/732893920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b41674d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009dc0 tx=0x7f88ac00b330 comp rx=0 tx=0).stop 2023-06-23T19:02:08.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.272+0000 7f88bbbff700 1 -- 172.21.15.136:0/732893920 shutdown_connections 2023-06-23T19:02:08.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.272+0000 7f88bbbff700 1 --2- 172.21.15.136:0/732893920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b41674d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:08.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.272+0000 7f88bbbff700 1 -- 172.21.15.136:0/732893920 >> 172.21.15.136:0/732893920 conn(0x7f88b4071620 msgr2=0x7f88b40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:08.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.272+0000 7f88bbbff700 1 -- 172.21.15.136:0/732893920 shutdown_connections 2023-06-23T19:02:08.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.272+0000 7f88bbbff700 1 -- 172.21.15.136:0/732893920 wait complete. 2023-06-23T19:02:08.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.273+0000 7f88bbbff700 1 Processor -- start 2023-06-23T19:02:08.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.273+0000 7f88bbbff700 1 -- start start 2023-06-23T19:02:08.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.274+0000 7f88bbbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88b40cd830 0x7f88b40c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:08.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.274+0000 7f88bbbff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b415c570 0x7f88b4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:08.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.274+0000 7f88bbbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b40b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:08.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.274+0000 7f88bbbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b41508c0 con 0x7f88b40cd830 2023-06-23T19:02:08.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.274+0000 7f88bbbff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b40c79e0 con 0x7f88b415c570 2023-06-23T19:02:08.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.274+0000 7f88bbbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b40c6be0 con 0x7f88b4160a50 2023-06-23T19:02:08.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b999b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88b40cd830 0x7f88b40c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:08.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b999b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88b40cd830 0x7f88b40c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40346/0 (socket says 172.21.15.136:40346) 2023-06-23T19:02:08.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b999b700 1 -- 172.21.15.136:0/3818986784 learned_addr learned my addr 172.21.15.136:0/3818986784 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:08.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88ba19c700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b40b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:08.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b919a700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b415c570 0x7f88b4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:08.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b999b700 1 -- 172.21.15.136:0/3818986784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 msgr2=0x7f88b40b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:08.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b999b700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b40b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:08.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b999b700 1 -- 172.21.15.136:0/3818986784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b415c570 msgr2=0x7f88b4150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:08.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b999b700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b415c570 0x7f88b4150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:08.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b999b700 1 -- 172.21.15.136:0/3818986784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac009a70 con 0x7f88b40cd830 2023-06-23T19:02:08.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88ba19c700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b40b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:08.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.275+0000 7f88b999b700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88b40cd830 0x7f88b40c6600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88b000c500 tx=0x7f88b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:08.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.276+0000 7f88aa7fc700 1 -- 172.21.15.136:0/3818986784 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b00052d0 con 0x7f88b40cd830 2023-06-23T19:02:08.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.276+0000 7f88aa7fc700 1 -- 172.21.15.136:0/3818986784 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b0005430 con 0x7f88b40cd830 2023-06-23T19:02:08.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.276+0000 7f88aa7fc700 1 -- 172.21.15.136:0/3818986784 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b00038c0 con 0x7f88b40cd830 2023-06-23T19:02:08.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.276+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b40c6ec0 con 0x7f88b40cd830 2023-06-23T19:02:08.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.276+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b40c7480 con 0x7f88b40cd830 2023-06-23T19:02:08.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.277+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b40c7610 con 0x7f88b40cd830 2023-06-23T19:02:08.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.278+0000 7f88aa7fc700 1 -- 172.21.15.136:0/3818986784 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88b0003a20 con 0x7f88b40cd830 2023-06-23T19:02:08.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.279+0000 7f88aa7fc700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f889806ace0 0x7f889806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:08.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.279+0000 7f88aa7fc700 1 -- 172.21.15.136:0/3818986784 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f88b0088de0 con 0x7f88b40cd830 2023-06-23T19:02:08.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.279+0000 7f88b919a700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f889806ace0 0x7f889806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:08.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.280+0000 7f88b919a700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f889806ace0 0x7f889806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88a4007fd0 tx=0x7f88a4007a60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:08.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.283+0000 7f88aa7fc700 1 -- 172.21.15.136:0/3818986784 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f88b0053ac0 con 0x7f88b40cd830 2023-06-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:08.563+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f88b4073910 con 0x7f88b40cd830 2023-06-23T19:02:09.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.054+0000 7f88aa7fc700 1 -- 172.21.15.136:0/3818986784 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v78) v1 ==== 147+0+0 (secure 0 0 0) 0x7f88b00570e0 con 0x7f88b40cd830 2023-06-23T19:02:09.062 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f889806ace0 msgr2=0x7f889806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:09.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f889806ace0 0x7f889806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88a4007fd0 tx=0x7f88a4007a60 comp rx=0 tx=0).stop 2023-06-23T19:02:09.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88b40cd830 msgr2=0x7f88b40c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:09.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88b40cd830 0x7f88b40c6600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88b000c500 tx=0x7f88b000c8c0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.064 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 shutdown_connections 2023-06-23T19:02:09.064 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f889806ace0 0x7f889806d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.064 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b4160a50 0x7f88b40b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.064 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88b40cd830 0x7f88b40c6600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 --2- 172.21.15.136:0/3818986784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b415c570 0x7f88b4150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 >> 172.21.15.136:0/3818986784 conn(0x7f88b4071620 msgr2=0x7f88b40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:09.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 shutdown_connections 2023-06-23T19:02:09.066 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.057+0000 7f88bbbff700 1 -- 172.21.15.136:0/3818986784 wait complete. 2023-06-23T19:02:09.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-23T19:02:09.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.277+0000 7f9032fff700 1 Processor -- start 2023-06-23T19:02:09.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.277+0000 7f9032fff700 1 -- start start 2023-06-23T19:02:09.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.279+0000 7f9032fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f902c0d0a60 0x7f902c0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:09.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.279+0000 7f9032fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f902c0b51d0 0x7f902c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:09.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.279+0000 7f9032fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902c0cd9d0 con 0x7f902c0d0e30 2023-06-23T19:02:09.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.279+0000 7f9032fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c0d0060 con 0x7f902c0d0a60 2023-06-23T19:02:09.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.279+0000 7f9032fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c0cfe50 con 0x7f902c0b51d0 2023-06-23T19:02:09.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.279+0000 7f9030d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f902c0d0a60 0x7f902c0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:09.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.279+0000 7f903159c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f902c0d0e30 0x7f902c0d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38052/0 (socket says 172.21.15.136:38052) 2023-06-23T19:02:09.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.279+0000 7f903159c700 1 -- 172.21.15.136:0/293803403 learned_addr learned my addr 172.21.15.136:0/293803403 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:09.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f902bfff700 1 --2- 172.21.15.136:0/293803403 >> v2:172.21.15.178:3300/0 conn(0x7f902c0b51d0 0x7f902c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:09.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f902b7fe700 1 -- 172.21.15.136:0/293803403 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296574433 0 0) 0x7f902c0cd9d0 con 0x7f902c0d0e30 2023-06-23T19:02:09.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f902b7fe700 1 -- 172.21.15.136:0/293803403 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f901c0035b0 con 0x7f902c0d0e30 2023-06-23T19:02:09.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f9030d9b700 1 -- 172.21.15.136:0/293803403 >> v2:172.21.15.178:3300/0 conn(0x7f902c0b51d0 msgr2=0x7f902c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:09.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f9030d9b700 1 --2- 172.21.15.136:0/293803403 >> v2:172.21.15.178:3300/0 conn(0x7f902c0b51d0 0x7f902c0cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f9030d9b700 1 -- 172.21.15.136:0/293803403 >> v1:172.21.15.136:6789/0 conn(0x7f902c0d0e30 legacy=0x7f902c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:09.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f9030d9b700 1 -- 172.21.15.136:0/293803403 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c0b5620 con 0x7f902c0d0a60 2023-06-23T19:02:09.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f9030d9b700 1 --2- 172.21.15.136:0/293803403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 0x7f902c0b5a70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f902c0d07a0 tx=0x7f9020009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0ae2b543297ae4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:09.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f902b7fe700 1 -- 172.21.15.136:0/293803403 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020011830 con 0x7f902c0d0a60 2023-06-23T19:02:09.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f902b7fe700 1 -- 172.21.15.136:0/293803403 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020011990 con 0x7f902c0d0a60 2023-06-23T19:02:09.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.280+0000 7f902b7fe700 1 -- 172.21.15.136:0/293803403 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020011d20 con 0x7f902c0d0a60 2023-06-23T19:02:09.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.281+0000 7f9032fff700 1 -- 172.21.15.136:0/293803403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 msgr2=0x7f902c0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:09.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.281+0000 7f9032fff700 1 --2- 172.21.15.136:0/293803403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 0x7f902c0b5a70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f902c0d07a0 tx=0x7f9020009b20 comp rx=0 tx=0).stop 2023-06-23T19:02:09.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.281+0000 7f9032fff700 1 -- 172.21.15.136:0/293803403 shutdown_connections 2023-06-23T19:02:09.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.281+0000 7f9032fff700 1 --2- 172.21.15.136:0/293803403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 0x7f902c0b5a70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.281+0000 7f9032fff700 1 --2- 172.21.15.136:0/293803403 >> v2:172.21.15.178:3300/0 conn(0x7f902c0b51d0 0x7f902c0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.281+0000 7f9032fff700 1 -- 172.21.15.136:0/293803403 >> 172.21.15.136:0/293803403 conn(0x7f902c071620 msgr2=0x7f902c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:09.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.281+0000 7f9032fff700 1 -- 172.21.15.136:0/293803403 shutdown_connections 2023-06-23T19:02:09.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.281+0000 7f9032fff700 1 -- 172.21.15.136:0/293803403 wait complete. 2023-06-23T19:02:09.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.283+0000 7f9032fff700 1 Processor -- start 2023-06-23T19:02:09.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.283+0000 7f9032fff700 1 -- start start 2023-06-23T19:02:09.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f9032fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f902c0b51d0 0x7f902c1f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:09.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f9032fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 0x7f902c0b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:09.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f9032fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f902c0d0e30 0x7f902c15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:09.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f9032fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0b83b0 con 0x7f902c0d0a60 2023-06-23T19:02:09.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f9032fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0c6710 con 0x7f902c0d0e30 2023-06-23T19:02:09.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f9032fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0c69f0 con 0x7f902c0b51d0 2023-06-23T19:02:09.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f902bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 0x7f902c0b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:09.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f902bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 0x7f902c0b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40362/0 (socket says 172.21.15.136:40362) 2023-06-23T19:02:09.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f902bfff700 1 -- 172.21.15.136:0/446216151 learned_addr learned my addr 172.21.15.136:0/446216151 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:09.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f9030d9b700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f902c0b51d0 0x7f902c1f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:09.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.284+0000 7f903159c700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f902c0d0e30 0x7f902c15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:09.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f902bfff700 1 -- 172.21.15.136:0/446216151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f902c0b51d0 msgr2=0x7f902c1f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:09.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f902bfff700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f902c0b51d0 0x7f902c1f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f902bfff700 1 -- 172.21.15.136:0/446216151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f902c0d0e30 msgr2=0x7f902c15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:09.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f902bfff700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f902c0d0e30 0x7f902c15a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f902bfff700 1 -- 172.21.15.136:0/446216151 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90200094a0 con 0x7f902c0d0a60 2023-06-23T19:02:09.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f902bfff700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 0x7f902c0b7b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f901800e9b0 tx=0x7f901800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:09.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f90297fa700 1 -- 172.21.15.136:0/446216151 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018009710 con 0x7f902c0d0a60 2023-06-23T19:02:09.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f90297fa700 1 -- 172.21.15.136:0/446216151 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901800c850 con 0x7f902c0d0a60 2023-06-23T19:02:09.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c0c6cd0 con 0x7f902c0d0a60 2023-06-23T19:02:09.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f90297fa700 1 -- 172.21.15.136:0/446216151 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901800cbc0 con 0x7f902c0d0a60 2023-06-23T19:02:09.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.285+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c0b8070 con 0x7f902c0d0a60 2023-06-23T19:02:09.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.286+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c04ea20 con 0x7f902c0d0a60 2023-06-23T19:02:09.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.287+0000 7f90297fa700 1 -- 172.21.15.136:0/446216151 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f901800cd20 con 0x7f902c0d0a60 2023-06-23T19:02:09.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.288+0000 7f90297fa700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f901006ace0 0x7f901006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:09.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.288+0000 7f90297fa700 1 -- 172.21.15.136:0/446216151 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9018089850 con 0x7f902c0d0a60 2023-06-23T19:02:09.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.289+0000 7f9030d9b700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f901006ace0 0x7f901006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:09.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.289+0000 7f9030d9b700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f901006ace0 0x7f901006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f90200090b0 tx=0x7f9020008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:09.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.293+0000 7f90297fa700 1 -- 172.21.15.136:0/446216151 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f90180545c0 con 0x7f902c0d0a60 2023-06-23T19:02:09.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.490+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f902c0d01a0 con 0x7f902c0d0a60 2023-06-23T19:02:09.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.495+0000 7f90297fa700 1 -- 172.21.15.136:0/446216151 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9018057be0 con 0x7f902c0d0a60 2023-06-23T19:02:09.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f901006ace0 msgr2=0x7f901006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:09.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f901006ace0 0x7f901006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f90200090b0 tx=0x7f9020008030 comp rx=0 tx=0).stop 2023-06-23T19:02:09.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 msgr2=0x7f902c0b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:09.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 0x7f902c0b7b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f901800e9b0 tx=0x7f901800ecc0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 shutdown_connections 2023-06-23T19:02:09.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f901006ace0 0x7f901006d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f902c0d0e30 0x7f902c15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f902c0b51d0 0x7f902c1f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 --2- 172.21.15.136:0/446216151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f902c0d0a60 0x7f902c0b7b30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:09.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 >> 172.21.15.136:0/446216151 conn(0x7f902c071620 msgr2=0x7f902c0d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:09.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 shutdown_connections 2023-06-23T19:02:09.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:09.498+0000 7f9032fff700 1 -- 172.21.15.136:0/446216151 wait complete. 2023-06-23T19:02:09.520 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-23T19:02:09.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-23T19:02:09.615 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-23T19:02:09.726 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-23T19:02:09.727 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:02:09.728 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:09.772 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:02:09.772 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:09.855 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:02:09.855 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:09.938 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:10.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.169+0000 7f7eee3ff700 1 Processor -- start 2023-06-23T19:02:10.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.169+0000 7f7eee3ff700 1 -- start start 2023-06-23T19:02:10.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.170+0000 7f7eee3ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7ee815c570 0x7f7ee80cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.170+0000 7f7eee3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee8160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.170+0000 7f7eee3ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee80cdab0 con 0x7f7ee8160880 2023-06-23T19:02:10.174 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.170+0000 7f7eee3ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee815d670 con 0x7f7ee815c570 2023-06-23T19:02:10.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.170+0000 7f7eee3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee81610a0 con 0x7f7ee80cd660 2023-06-23T19:02:10.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee7fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7ee815c570 0x7f7ee80cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7eec99c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f7ee8160880 0x7f7ee806b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38056/0 (socket says 172.21.15.136:38056) 2023-06-23T19:02:10.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7eec99c700 1 -- 172.21.15.136:0/925490583 learned_addr learned my addr 172.21.15.136:0/925490583 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:10.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee77fe700 1 --2- 172.21.15.136:0/925490583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee8160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee6ffd700 1 -- 172.21.15.136:0/925490583 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541049189 0 0) 0x7f7ee0001490 con 0x7f7ee8160880 2023-06-23T19:02:10.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee6ffd700 1 -- 172.21.15.136:0/925490583 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed00035b0 con 0x7f7ee8160880 2023-06-23T19:02:10.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee7fff700 1 -- 172.21.15.136:0/925490583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 msgr2=0x7f7ee8160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:10.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee7fff700 1 --2- 172.21.15.136:0/925490583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee8160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee7fff700 1 -- 172.21.15.136:0/925490583 >> v1:172.21.15.136:6789/0 conn(0x7f7ee8160880 legacy=0x7f7ee806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee7fff700 1 -- 172.21.15.136:0/925490583 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee815da90 con 0x7f7ee815c570 2023-06-23T19:02:10.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee77fe700 1 --2- 172.21.15.136:0/925490583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee8160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:10.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.171+0000 7f7ee7fff700 1 --2- 172.21.15.136:0/925490583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 0x7f7ee80cd120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009840 tx=0x7f7ed8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee3a9e0adbe01d9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:10.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7ee6ffd700 1 -- 172.21.15.136:0/925490583 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8011830 con 0x7f7ee815c570 2023-06-23T19:02:10.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7ee6ffd700 1 -- 172.21.15.136:0/925490583 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8011990 con 0x7f7ee815c570 2023-06-23T19:02:10.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7ee6ffd700 1 -- 172.21.15.136:0/925490583 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8011d20 con 0x7f7ee815c570 2023-06-23T19:02:10.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7eee3ff700 1 -- 172.21.15.136:0/925490583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 msgr2=0x7f7ee80cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7eee3ff700 1 --2- 172.21.15.136:0/925490583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 0x7f7ee80cd120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009840 tx=0x7f7ed8009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:10.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7eee3ff700 1 -- 172.21.15.136:0/925490583 shutdown_connections 2023-06-23T19:02:10.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7eee3ff700 1 --2- 172.21.15.136:0/925490583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 0x7f7ee80cd120 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7eee3ff700 1 --2- 172.21.15.136:0/925490583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee8160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7eee3ff700 1 -- 172.21.15.136:0/925490583 >> 172.21.15.136:0/925490583 conn(0x7f7ee8071620 msgr2=0x7f7ee80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:10.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7eee3ff700 1 -- 172.21.15.136:0/925490583 shutdown_connections 2023-06-23T19:02:10.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.172+0000 7f7eee3ff700 1 -- 172.21.15.136:0/925490583 wait complete. 2023-06-23T19:02:10.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.174+0000 7f7eee3ff700 1 Processor -- start 2023-06-23T19:02:10.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.174+0000 7f7eee3ff700 1 -- start start 2023-06-23T19:02:10.183 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.175+0000 7f7eee3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee80ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.183 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.175+0000 7f7eee3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 0x7f7ee80ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.183 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.175+0000 7f7eee3ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee8160880 0x7f7ee8152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.183 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.175+0000 7f7eee3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80c6b00 con 0x7f7ee815c570 2023-06-23T19:02:10.183 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.175+0000 7f7eee3ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80c6de0 con 0x7f7ee8160880 2023-06-23T19:02:10.183 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.175+0000 7f7eee3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80c70c0 con 0x7f7ee80cd660 2023-06-23T19:02:10.183 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.175+0000 7f7ee77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 0x7f7ee80ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.183 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.175+0000 7f7ee77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 0x7f7ee80ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40376/0 (socket says 172.21.15.136:40376) 2023-06-23T19:02:10.184 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.175+0000 7f7ee77fe700 1 -- 172.21.15.136:0/3497674035 learned_addr learned my addr 172.21.15.136:0/3497674035 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:10.184 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee7fff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee80ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.184 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7eec99c700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee8160880 0x7f7ee8152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.184 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee77fe700 1 -- 172.21.15.136:0/3497674035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 msgr2=0x7f7ee80ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.184 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee77fe700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee80ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.184 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee77fe700 1 -- 172.21.15.136:0/3497674035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee8160880 msgr2=0x7f7ee8152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee77fe700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee8160880 0x7f7ee8152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee77fe700 1 -- 172.21.15.136:0/3497674035 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80094a0 con 0x7f7ee815c570 2023-06-23T19:02:10.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee7fff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee80ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:10.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee77fe700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 0x7f7ee80ca060 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00e810 tx=0x7f7edc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:10.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee4ff9700 1 -- 172.21.15.136:0/3497674035 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00c020 con 0x7f7ee815c570 2023-06-23T19:02:10.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee4ff9700 1 -- 172.21.15.136:0/3497674035 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc004250 con 0x7f7ee815c570 2023-06-23T19:02:10.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee80c73a0 con 0x7f7ee815c570 2023-06-23T19:02:10.185 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7ee4ff9700 1 -- 172.21.15.136:0/3497674035 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0036a0 con 0x7f7ee815c570 2023-06-23T19:02:10.186 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.176+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee8153a70 con 0x7f7ee815c570 2023-06-23T19:02:10.186 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.177+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee80c78c0 con 0x7f7ee815c570 2023-06-23T19:02:10.186 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.178+0000 7f7ee4ff9700 1 -- 172.21.15.136:0/3497674035 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7edc003800 con 0x7f7ee815c570 2023-06-23T19:02:10.186 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.179+0000 7f7ee4ff9700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7ed406ace0 0x7f7ed406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.187 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.179+0000 7f7ee4ff9700 1 -- 172.21.15.136:0/3497674035 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7edc089380 con 0x7f7ee815c570 2023-06-23T19:02:10.187 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.179+0000 7f7ee7fff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7ed406ace0 0x7f7ed406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.187 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.180+0000 7f7ee7fff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7ed406ace0 0x7f7ed406d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8000c00 tx=0x7f7ed8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:10.187 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.183+0000 7f7ee4ff9700 1 -- 172.21.15.136:0/3497674035 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ee80c78c0 con 0x7f7ee815c570 2023-06-23T19:02:10.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.380+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ee80c78c0 con 0x7f7ee815c570 2023-06-23T19:02:10.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.382+0000 7f7ee4ff9700 1 -- 172.21.15.136:0/3497674035 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f7ee80c78c0 con 0x7f7ee815c570 2023-06-23T19:02:10.386 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:10.386 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:10.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7ed406ace0 msgr2=0x7f7ed406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7ed406ace0 0x7f7ed406d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8000c00 tx=0x7f7ed8008030 comp rx=0 tx=0).stop 2023-06-23T19:02:10.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 msgr2=0x7f7ee80ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 0x7f7ee80ca060 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00e810 tx=0x7f7edc00ebd0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 shutdown_connections 2023-06-23T19:02:10.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7ed406ace0 0x7f7ed406d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee8160880 0x7f7ee8152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80cd660 0x7f7ee80ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 --2- 172.21.15.136:0/3497674035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ee815c570 0x7f7ee80ca060 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 >> 172.21.15.136:0/3497674035 conn(0x7f7ee8071620 msgr2=0x7f7ee80d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:10.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.384+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 shutdown_connections 2023-06-23T19:02:10.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.385+0000 7f7eee3ff700 1 -- 172.21.15.136:0/3497674035 wait complete. 2023-06-23T19:02:10.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:02:10.408 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:02:10.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.601+0000 7f3b5fdff700 1 Processor -- start 2023-06-23T19:02:10.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.601+0000 7f3b5fdff700 1 -- start start 2023-06-23T19:02:10.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.602+0000 7f3b5fdff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3b580b5a70 0x7f3b580b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5fdff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580b5ec0 con 0x7f3b580cf910 2023-06-23T19:02:10.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5fdff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580cd9d0 con 0x7f3b580d0a60 2023-06-23T19:02:10.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5fdff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580d0060 con 0x7f3b580b5a70 2023-06-23T19:02:10.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5d39a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3b580b5a70 0x7f3b580b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5d39a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3b580b5a70 0x7f3b580b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40384/0 (socket says 172.21.15.136:40384) 2023-06-23T19:02:10.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5d39a700 1 -- 172.21.15.136:0/2515113673 learned_addr learned my addr 172.21.15.136:0/2515113673 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:10.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5e39c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3b580cf910 0x7f3b580d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38060/0 (socket says 172.21.15.136:38060) 2023-06-23T19:02:10.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5d39a700 1 -- 172.21.15.136:0/2515113673 >> v1:172.21.15.178:6789/0 conn(0x7f3b580d0a60 legacy=0x7f3b580d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:10.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5d39a700 1 -- 172.21.15.136:0/2515113673 >> v1:172.21.15.136:6789/0 conn(0x7f3b580cf910 legacy=0x7f3b580d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5d39a700 1 -- 172.21.15.136:0/2515113673 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580cd410 con 0x7f3b580b5a70 2023-06-23T19:02:10.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.603+0000 7f3b5cb99700 1 -- 172.21.15.136:0/2515113673 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524551971 0 0) 0x7f3b580b5ec0 con 0x7f3b580cf910 2023-06-23T19:02:10.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5d39a700 1 --2- 172.21.15.136:0/2515113673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 0x7f3b580b51d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3b480098f0 tx=0x7f3b48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09a85eddf36e743 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:10.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5cb99700 1 -- 172.21.15.136:0/2515113673 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48004230 con 0x7f3b580b5a70 2023-06-23T19:02:10.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5cb99700 1 -- 172.21.15.136:0/2515113673 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b48004390 con 0x7f3b580b5a70 2023-06-23T19:02:10.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5cb99700 1 -- 172.21.15.136:0/2515113673 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480036a0 con 0x7f3b580b5a70 2023-06-23T19:02:10.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2515113673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 msgr2=0x7f3b580b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5fdff700 1 --2- 172.21.15.136:0/2515113673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 0x7f3b580b51d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3b480098f0 tx=0x7f3b48009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:10.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2515113673 shutdown_connections 2023-06-23T19:02:10.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5fdff700 1 --2- 172.21.15.136:0/2515113673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 0x7f3b580b51d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2515113673 >> 172.21.15.136:0/2515113673 conn(0x7f3b58071620 msgr2=0x7f3b580719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:10.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.604+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2515113673 shutdown_connections 2023-06-23T19:02:10.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.605+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2515113673 wait complete. 2023-06-23T19:02:10.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.606+0000 7f3b5fdff700 1 Processor -- start 2023-06-23T19:02:10.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.606+0000 7f3b5fdff700 1 -- start start 2023-06-23T19:02:10.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.607+0000 7f3b5fdff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 0x7f3b5814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.607+0000 7f3b5fdff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b580cf910 0x7f3b580c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.607+0000 7f3b5fdff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b580d0a60 0x7f3b580c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.607+0000 7f3b5fdff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5814d610 con 0x7f3b580b5a70 2023-06-23T19:02:10.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.607+0000 7f3b5fdff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5815d940 con 0x7f3b580cf910 2023-06-23T19:02:10.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.607+0000 7f3b5fdff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5815dc00 con 0x7f3b580d0a60 2023-06-23T19:02:10.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.607+0000 7f3b5db9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 0x7f3b5814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5db9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 0x7f3b5814d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40398/0 (socket says 172.21.15.136:40398) 2023-06-23T19:02:10.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5db9b700 1 -- 172.21.15.136:0/2575811865 learned_addr learned my addr 172.21.15.136:0/2575811865 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:10.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5d39a700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b580cf910 0x7f3b580c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5e39c700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b580d0a60 0x7f3b580c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5db9b700 1 -- 172.21.15.136:0/2575811865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b580d0a60 msgr2=0x7f3b580c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5db9b700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b580d0a60 0x7f3b580c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5db9b700 1 -- 172.21.15.136:0/2575811865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b580cf910 msgr2=0x7f3b580c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5db9b700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b580cf910 0x7f3b580c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5db9b700 1 -- 172.21.15.136:0/2575811865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48009550 con 0x7f3b580b5a70 2023-06-23T19:02:10.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5e39c700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b580d0a60 0x7f3b580c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:10.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b5db9b700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 0x7f3b5814d0d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400b4a0 tx=0x7f3b5400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:10.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b4e7fc700 1 -- 172.21.15.136:0/2575811865 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54011830 con 0x7f3b580b5a70 2023-06-23T19:02:10.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b4e7fc700 1 -- 172.21.15.136:0/2575811865 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b54011990 con 0x7f3b580b5a70 2023-06-23T19:02:10.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.608+0000 7f3b4e7fc700 1 -- 172.21.15.136:0/2575811865 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54011d40 con 0x7f3b580b5a70 2023-06-23T19:02:10.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.609+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5815dee0 con 0x7f3b580b5a70 2023-06-23T19:02:10.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.609+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5815e4a0 con 0x7f3b580b5a70 2023-06-23T19:02:10.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.610+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5815e690 con 0x7f3b580b5a70 2023-06-23T19:02:10.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.611+0000 7f3b4e7fc700 1 -- 172.21.15.136:0/2575811865 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b5401a400 con 0x7f3b580b5a70 2023-06-23T19:02:10.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.612+0000 7f3b4e7fc700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3b3c06ace0 0x7f3b3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:10.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.612+0000 7f3b4e7fc700 1 -- 172.21.15.136:0/2575811865 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3b540894b0 con 0x7f3b580b5a70 2023-06-23T19:02:10.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.612+0000 7f3b5d39a700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3b3c06ace0 0x7f3b3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:10.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.613+0000 7f3b5d39a700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3b3c06ace0 0x7f3b3c06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009130 tx=0x7f3b48008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:10.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.617+0000 7f3b4e7fc700 1 -- 172.21.15.136:0/2575811865 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3b54054190 con 0x7f3b580b5a70 2023-06-23T19:02:10.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.814+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b5804ea20 con 0x7f3b580b5a70 2023-06-23T19:02:10.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.814+0000 7f3b4e7fc700 1 -- 172.21.15.136:0/2575811865 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b540577b0 con 0x7f3b580b5a70 2023-06-23T19:02:10.819 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:02:10.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3b3c06ace0 msgr2=0x7f3b3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3b3c06ace0 0x7f3b3c06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009130 tx=0x7f3b48008030 comp rx=0 tx=0).stop 2023-06-23T19:02:10.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 msgr2=0x7f3b5814d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:10.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 0x7f3b5814d0d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400b4a0 tx=0x7f3b5400b7b0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 shutdown_connections 2023-06-23T19:02:10.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3b3c06ace0 0x7f3b3c06d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b580d0a60 0x7f3b580c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b580b5a70 0x7f3b5814d0d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 --2- 172.21.15.136:0/2575811865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b580cf910 0x7f3b580c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:10.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 >> 172.21.15.136:0/2575811865 conn(0x7f3b58071620 msgr2=0x7f3b580d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:10.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 shutdown_connections 2023-06-23T19:02:10.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:10.817+0000 7f3b5fdff700 1 -- 172.21.15.136:0/2575811865 wait complete. 2023-06-23T19:02:10.839 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:02:11.037 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.033+0000 7fbd09fff700 1 Processor -- start 2023-06-23T19:02:11.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.033+0000 7fbd09fff700 1 -- start start 2023-06-23T19:02:11.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.034+0000 7fbd09fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159590 0x7fbd040c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.034+0000 7fbd09fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbd040b1510 0x7fbd040b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.034+0000 7fbd09fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd040caee0 con 0x7fbd04159960 2023-06-23T19:02:11.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.034+0000 7fbd09fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd040b1ec0 con 0x7fbd040b1510 2023-06-23T19:02:11.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.034+0000 7fbd09fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040c8f30 con 0x7fbd04159590 2023-06-23T19:02:11.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.034+0000 7fbd02ffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbd040b1510 0x7fbd040b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd02ffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbd040b1510 0x7fbd040b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40412/0 (socket says 172.21.15.136:40412) 2023-06-23T19:02:11.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd02ffd700 1 -- 172.21.15.136:0/1492501066 learned_addr learned my addr 172.21.15.136:0/1492501066 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:11.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd037fe700 1 --2- 172.21.15.136:0/1492501066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159590 0x7fbd040c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd02ffd700 1 -- 172.21.15.136:0/1492501066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159590 msgr2=0x7fbd040c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:11.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd02ffd700 1 --2- 172.21.15.136:0/1492501066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159590 0x7fbd040c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd02ffd700 1 -- 172.21.15.136:0/1492501066 >> v1:172.21.15.178:6789/0 conn(0x7fbd04159960 legacy=0x7fbd04159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd02ffd700 1 -- 172.21.15.136:0/1492501066 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0415a4d0 con 0x7fbd040b1510 2023-06-23T19:02:11.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd02ffd700 1 --2- 172.21.15.136:0/1492501066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd040b1510 0x7fbd040b1980 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80098f0 tx=0x7fbcf8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463d8ee8cded975a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:11.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd027fc700 1 -- 172.21.15.136:0/1492501066 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8011830 con 0x7fbd040b1510 2023-06-23T19:02:11.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd027fc700 1 -- 172.21.15.136:0/1492501066 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8011990 con 0x7fbd040b1510 2023-06-23T19:02:11.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.035+0000 7fbd027fc700 1 -- 172.21.15.136:0/1492501066 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8011d20 con 0x7fbd040b1510 2023-06-23T19:02:11.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.036+0000 7fbd09fff700 1 -- 172.21.15.136:0/1492501066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd040b1510 msgr2=0x7fbd040b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.036+0000 7fbd09fff700 1 --2- 172.21.15.136:0/1492501066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd040b1510 0x7fbd040b1980 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80098f0 tx=0x7fbcf8009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:11.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.036+0000 7fbd09fff700 1 -- 172.21.15.136:0/1492501066 shutdown_connections 2023-06-23T19:02:11.059 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.036+0000 7fbd09fff700 1 --2- 172.21.15.136:0/1492501066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159590 0x7fbd040c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.059 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.036+0000 7fbd09fff700 1 --2- 172.21.15.136:0/1492501066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd040b1510 0x7fbd040b1980 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.060 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.036+0000 7fbd09fff700 1 -- 172.21.15.136:0/1492501066 >> 172.21.15.136:0/1492501066 conn(0x7fbd0406ab80 msgr2=0x7fbd040ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:11.060 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.036+0000 7fbd09fff700 1 -- 172.21.15.136:0/1492501066 shutdown_connections 2023-06-23T19:02:11.060 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.036+0000 7fbd09fff700 1 -- 172.21.15.136:0/1492501066 wait complete. 2023-06-23T19:02:11.061 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.038+0000 7fbd09fff700 1 Processor -- start 2023-06-23T19:02:11.061 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.038+0000 7fbd09fff700 1 -- start start 2023-06-23T19:02:11.061 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd09fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd040b1510 0x7fbd0414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.061 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd09fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd04159590 0x7fbd040c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.061 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd09fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159960 0x7fbd04150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.061 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd09fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0414e710 con 0x7fbd04159590 2023-06-23T19:02:11.062 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd09fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040cc410 con 0x7fbd040b1510 2023-06-23T19:02:11.062 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd09fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040c26f0 con 0x7fbd04159960 2023-06-23T19:02:11.062 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd02ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd04159590 0x7fbd040c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.062 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd02ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd04159590 0x7fbd040c21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40424/0 (socket says 172.21.15.136:40424) 2023-06-23T19:02:11.062 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd02ffd700 1 -- 172.21.15.136:0/586018324 learned_addr learned my addr 172.21.15.136:0/586018324 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:11.062 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd03fff700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159960 0x7fbd04150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.062 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.039+0000 7fbd037fe700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd040b1510 0x7fbd0414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbd02ffd700 1 -- 172.21.15.136:0/586018324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159960 msgr2=0x7fbd04150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbd02ffd700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159960 0x7fbd04150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbd02ffd700 1 -- 172.21.15.136:0/586018324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd040b1510 msgr2=0x7fbd0414d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbd02ffd700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd040b1510 0x7fbd0414d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbd02ffd700 1 -- 172.21.15.136:0/586018324 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf8009550 con 0x7fbd04159590 2023-06-23T19:02:11.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbd037fe700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd040b1510 0x7fbd0414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:11.063 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbd02ffd700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd04159590 0x7fbd040c21b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbd0406df60 tx=0x7fbcf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:11.064 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbcebfff700 1 -- 172.21.15.136:0/586018324 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf80036a0 con 0x7fbd04159590 2023-06-23T19:02:11.064 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbcebfff700 1 -- 172.21.15.136:0/586018324 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf801e070 con 0x7fbd04159590 2023-06-23T19:02:11.064 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbcebfff700 1 -- 172.21.15.136:0/586018324 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8003a40 con 0x7fbd04159590 2023-06-23T19:02:11.064 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0414de70 con 0x7fbd04159590 2023-06-23T19:02:11.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.040+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0414e430 con 0x7fbd04159590 2023-06-23T19:02:11.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.041+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd04071620 con 0x7fbd04159590 2023-06-23T19:02:11.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.042+0000 7fbcebfff700 1 -- 172.21.15.136:0/586018324 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbcf8003ba0 con 0x7fbd04159590 2023-06-23T19:02:11.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.043+0000 7fbcebfff700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.043+0000 7fbcebfff700 1 -- 172.21.15.136:0/586018324 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbcf808a710 con 0x7fbd04159590 2023-06-23T19:02:11.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.043+0000 7fbd037fe700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.066 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.044+0000 7fbd037fe700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009b90 tx=0x7fbcf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:11.066 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.048+0000 7fbcebfff700 1 -- 172.21.15.136:0/586018324 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbcf8055520 con 0x7fbd04159590 2023-06-23T19:02:11.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.243+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbd0404ea20 con 0x7fbd04159590 2023-06-23T19:02:11.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.244+0000 7fbcebfff700 1 -- 172.21.15.136:0/586018324 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbcf8058b40 con 0x7fbd04159590 2023-06-23T19:02:11.249 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:02:11.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 msgr2=0x7fbcf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009b90 tx=0x7fbcf4008040 comp rx=0 tx=0).stop 2023-06-23T19:02:11.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd04159590 msgr2=0x7fbd040c21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd04159590 0x7fbd040c21b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbd0406df60 tx=0x7fbcf8004750 comp rx=0 tx=0).stop 2023-06-23T19:02:11.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 shutdown_connections 2023-06-23T19:02:11.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd040b1510 0x7fbd0414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd04159960 0x7fbd04150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 --2- 172.21.15.136:0/586018324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd04159590 0x7fbd040c21b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 >> 172.21.15.136:0/586018324 conn(0x7fbd0406ab80 msgr2=0x7fbd0415bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:11.252 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.246+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 shutdown_connections 2023-06-23T19:02:11.253 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.247+0000 7fbd09fff700 1 -- 172.21.15.136:0/586018324 wait complete. 2023-06-23T19:02:11.270 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:02:11.466 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.461+0000 7ff40fdff700 1 Processor -- start 2023-06-23T19:02:11.466 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.461+0000 7ff40fdff700 1 -- start start 2023-06-23T19:02:11.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40fdff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080b5a70 0x7ff4080b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40fdff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff4080cf910 0x7ff4080d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40fdff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080b5ec0 con 0x7ff4080d0a60 2023-06-23T19:02:11.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40fdff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080d0060 con 0x7ff4080cf910 2023-06-23T19:02:11.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40fdff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080cd9d0 con 0x7ff4080b5a70 2023-06-23T19:02:11.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40db9b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff4080d0a60 0x7ff4080d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38064/0 (socket says 172.21.15.136:38064) 2023-06-23T19:02:11.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40db9b700 1 -- 172.21.15.136:0/3267369492 learned_addr learned my addr 172.21.15.136:0/3267369492 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:11.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40e39c700 1 --2- 172.21.15.136:0/3267369492 >> v2:172.21.15.136:3300/0 conn(0x7ff4080cf910 0x7ff4080d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40d39a700 1 --2- 172.21.15.136:0/3267369492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080b5a70 0x7ff4080b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.470 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.463+0000 7ff40cb99700 1 -- 172.21.15.136:0/3267369492 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678210598 0 0) 0x7ff4080b5ec0 con 0x7ff4080d0a60 2023-06-23T19:02:11.471 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.464+0000 7ff40cb99700 1 -- 172.21.15.136:0/3267369492 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f40035b0 con 0x7ff4080d0a60 2023-06-23T19:02:11.471 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.464+0000 7ff40e39c700 1 -- 172.21.15.136:0/3267369492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080b5a70 msgr2=0x7ff4080b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:11.471 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.464+0000 7ff40e39c700 1 --2- 172.21.15.136:0/3267369492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080b5a70 0x7ff4080b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.464+0000 7ff40e39c700 1 -- 172.21.15.136:0/3267369492 >> v1:172.21.15.136:6789/0 conn(0x7ff4080d0a60 legacy=0x7ff4080d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.464+0000 7ff40e39c700 1 -- 172.21.15.136:0/3267369492 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080cfd90 con 0x7ff4080cf910 2023-06-23T19:02:11.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.464+0000 7ff40e39c700 1 --2- 172.21.15.136:0/3267369492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080cf910 0x7ff4080d2e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff400009d90 tx=0x7ff40000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6990eb1aac3439b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:11.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.464+0000 7ff40cb99700 1 -- 172.21.15.136:0/3267369492 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000e070 con 0x7ff4080cf910 2023-06-23T19:02:11.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.464+0000 7ff40cb99700 1 -- 172.21.15.136:0/3267369492 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000bb20 con 0x7ff4080cf910 2023-06-23T19:02:11.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.464+0000 7ff40cb99700 1 -- 172.21.15.136:0/3267369492 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400012430 con 0x7ff4080cf910 2023-06-23T19:02:11.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.465+0000 7ff40fdff700 1 -- 172.21.15.136:0/3267369492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080cf910 msgr2=0x7ff4080d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.465+0000 7ff40fdff700 1 --2- 172.21.15.136:0/3267369492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080cf910 0x7ff4080d2e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff400009d90 tx=0x7ff40000b330 comp rx=0 tx=0).stop 2023-06-23T19:02:11.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.465+0000 7ff40fdff700 1 -- 172.21.15.136:0/3267369492 shutdown_connections 2023-06-23T19:02:11.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.465+0000 7ff40fdff700 1 --2- 172.21.15.136:0/3267369492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080cf910 0x7ff4080d2e00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.465+0000 7ff40fdff700 1 --2- 172.21.15.136:0/3267369492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080b5a70 0x7ff4080b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.465+0000 7ff40fdff700 1 -- 172.21.15.136:0/3267369492 >> 172.21.15.136:0/3267369492 conn(0x7ff408071620 msgr2=0x7ff4080719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:11.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.465+0000 7ff40fdff700 1 -- 172.21.15.136:0/3267369492 shutdown_connections 2023-06-23T19:02:11.474 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.465+0000 7ff40fdff700 1 -- 172.21.15.136:0/3267369492 wait complete. 2023-06-23T19:02:11.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.467+0000 7ff40fdff700 1 Processor -- start 2023-06-23T19:02:11.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.467+0000 7ff40fdff700 1 -- start start 2023-06-23T19:02:11.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40fdff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080b5a70 0x7ff40815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40fdff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080cf910 0x7ff4081f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40fdff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4080d0a60 0x7ff40815c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40fdff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081f5110 con 0x7ff4080b5a70 2023-06-23T19:02:11.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40fdff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080b16d0 con 0x7ff4080d0a60 2023-06-23T19:02:11.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40fdff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081f4dc0 con 0x7ff4080cf910 2023-06-23T19:02:11.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40db9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080b5a70 0x7ff40815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40db9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080b5a70 0x7ff40815e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40442/0 (socket says 172.21.15.136:40442) 2023-06-23T19:02:11.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40db9b700 1 -- 172.21.15.136:0/3003904873 learned_addr learned my addr 172.21.15.136:0/3003904873 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:11.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40e39c700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4080d0a60 0x7ff40815c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40d39a700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080cf910 0x7ff4081f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40db9b700 1 -- 172.21.15.136:0/3003904873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080cf910 msgr2=0x7ff4081f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40db9b700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080cf910 0x7ff4081f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40db9b700 1 -- 172.21.15.136:0/3003904873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4080d0a60 msgr2=0x7ff40815c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40db9b700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4080d0a60 0x7ff40815c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40db9b700 1 -- 172.21.15.136:0/3003904873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009a70 con 0x7ff4080b5a70 2023-06-23T19:02:11.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.468+0000 7ff40db9b700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080b5a70 0x7ff40815e2b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff404001eb0 tx=0x7ff40400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:11.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.469+0000 7ff3fe7fc700 1 -- 172.21.15.136:0/3003904873 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404005d70 con 0x7ff4080b5a70 2023-06-23T19:02:11.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.469+0000 7ff3fe7fc700 1 -- 172.21.15.136:0/3003904873 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4040070d0 con 0x7ff4080b5a70 2023-06-23T19:02:11.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.469+0000 7ff3fe7fc700 1 -- 172.21.15.136:0/3003904873 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404007460 con 0x7ff4080b5a70 2023-06-23T19:02:11.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.469+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40815ede0 con 0x7ff4080b5a70 2023-06-23T19:02:11.479 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.469+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40815e7f0 con 0x7ff4080b5a70 2023-06-23T19:02:11.479 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.470+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40815eb60 con 0x7ff4080b5a70 2023-06-23T19:02:11.479 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.471+0000 7ff3fe7fc700 1 -- 172.21.15.136:0/3003904873 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4040075c0 con 0x7ff4080b5a70 2023-06-23T19:02:11.480 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.472+0000 7ff3fe7fc700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff3ec06ace0 0x7ff3ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.480 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.472+0000 7ff3fe7fc700 1 -- 172.21.15.136:0/3003904873 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff404088d30 con 0x7ff4080b5a70 2023-06-23T19:02:11.480 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.472+0000 7ff40d39a700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff3ec06ace0 0x7ff3ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.472+0000 7ff40d39a700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff3ec06ace0 0x7ff3ec06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff40815af60 tx=0x7ff3f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:11.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.476+0000 7ff3fe7fc700 1 -- 172.21.15.136:0/3003904873 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff404053aa0 con 0x7ff4080b5a70 2023-06-23T19:02:11.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.671+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff40804ea20 con 0x7ff4080b5a70 2023-06-23T19:02:11.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.672+0000 7ff3fe7fc700 1 -- 172.21.15.136:0/3003904873 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4040570c0 con 0x7ff4080b5a70 2023-06-23T19:02:11.677 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:11.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff3ec06ace0 msgr2=0x7ff3ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff3ec06ace0 0x7ff3ec06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff40815af60 tx=0x7ff3f8008040 comp rx=0 tx=0).stop 2023-06-23T19:02:11.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080b5a70 msgr2=0x7ff40815e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080b5a70 0x7ff40815e2b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff404001eb0 tx=0x7ff40400c860 comp rx=0 tx=0).stop 2023-06-23T19:02:11.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 shutdown_connections 2023-06-23T19:02:11.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff3ec06ace0 0x7ff3ec06d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4080d0a60 0x7ff40815c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4080b5a70 0x7ff40815e2b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 --2- 172.21.15.136:0/3003904873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080cf910 0x7ff4081f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 >> 172.21.15.136:0/3003904873 conn(0x7ff408071620 msgr2=0x7ff4080b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:11.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 shutdown_connections 2023-06-23T19:02:11.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.675+0000 7ff40fdff700 1 -- 172.21.15.136:0/3003904873 wait complete. 2023-06-23T19:02:11.697 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:02:11.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.890+0000 7f61851ff700 1 Processor -- start 2023-06-23T19:02:11.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.890+0000 7f61851ff700 1 -- start start 2023-06-23T19:02:11.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.890+0000 7f61851ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f61800d0a60 0x7f61800b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.890+0000 7f61851ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f61800cf910 0x7f61800d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.890+0000 7f61851ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61800cd9d0 con 0x7f61800b51d0 2023-06-23T19:02:11.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.890+0000 7f61851ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800d0060 con 0x7f61800d0a60 2023-06-23T19:02:11.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.890+0000 7f61851ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800b5620 con 0x7f61800cf910 2023-06-23T19:02:11.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.890+0000 7f617ed9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f61800d0a60 0x7f61800b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.891+0000 7f617ed9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f61800d0a60 0x7f61800b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40456/0 (socket says 172.21.15.136:40456) 2023-06-23T19:02:11.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.891+0000 7f617ed9d700 1 -- 172.21.15.136:0/1006956883 learned_addr learned my addr 172.21.15.136:0/1006956883 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:11.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.891+0000 7f617f59e700 1 --2- 172.21.15.136:0/1006956883 >> v2:172.21.15.178:3300/0 conn(0x7f61800cf910 0x7f61800d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.891+0000 7f617ed9d700 1 -- 172.21.15.136:0/1006956883 >> v2:172.21.15.178:3300/0 conn(0x7f61800cf910 msgr2=0x7f61800d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:11.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.891+0000 7f617ed9d700 1 --2- 172.21.15.136:0/1006956883 >> v2:172.21.15.178:3300/0 conn(0x7f61800cf910 0x7f61800d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.891+0000 7f617ed9d700 1 -- 172.21.15.136:0/1006956883 >> v1:172.21.15.178:6789/0 conn(0x7f61800b51d0 legacy=0x7f61800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.891+0000 7f617ed9d700 1 -- 172.21.15.136:0/1006956883 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61800cd410 con 0x7f61800d0a60 2023-06-23T19:02:11.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.891+0000 7f617ed9d700 1 --2- 172.21.15.136:0/1006956883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 0x7f61800b5a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f61800b2610 tx=0x7f6170009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1596a0a051e87ff server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:11.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f617dd9b700 1 -- 172.21.15.136:0/1006956883 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000b870 con 0x7f61800d0a60 2023-06-23T19:02:11.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f617dd9b700 1 -- 172.21.15.136:0/1006956883 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000b9d0 con 0x7f61800d0a60 2023-06-23T19:02:11.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f617dd9b700 1 -- 172.21.15.136:0/1006956883 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000bd60 con 0x7f61800d0a60 2023-06-23T19:02:11.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f61851ff700 1 -- 172.21.15.136:0/1006956883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 msgr2=0x7f61800b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f61851ff700 1 --2- 172.21.15.136:0/1006956883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 0x7f61800b5a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f61800b2610 tx=0x7f6170009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f61851ff700 1 -- 172.21.15.136:0/1006956883 shutdown_connections 2023-06-23T19:02:11.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f61851ff700 1 --2- 172.21.15.136:0/1006956883 >> v2:172.21.15.178:3300/0 conn(0x7f61800cf910 0x7f61800d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f61851ff700 1 --2- 172.21.15.136:0/1006956883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 0x7f61800b5a70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f61851ff700 1 -- 172.21.15.136:0/1006956883 >> 172.21.15.136:0/1006956883 conn(0x7f6180071620 msgr2=0x7f61800719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:11.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f61851ff700 1 -- 172.21.15.136:0/1006956883 shutdown_connections 2023-06-23T19:02:11.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.892+0000 7f61851ff700 1 -- 172.21.15.136:0/1006956883 wait complete. 2023-06-23T19:02:11.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.894+0000 7f61851ff700 1 Processor -- start 2023-06-23T19:02:11.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.894+0000 7f61851ff700 1 -- start start 2023-06-23T19:02:11.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.895+0000 7f61851ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61800b51d0 0x7f61801f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.895+0000 7f61851ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800cf910 0x7f61800b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.895+0000 7f61851ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 0x7f618015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.895+0000 7f61851ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618015ec90 con 0x7f61800d0a60 2023-06-23T19:02:11.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.895+0000 7f61851ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618015ddc0 con 0x7f61800b51d0 2023-06-23T19:02:11.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.895+0000 7f61851ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618015e010 con 0x7f61800cf910 2023-06-23T19:02:11.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.895+0000 7f617f59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 0x7f618015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.895+0000 7f617f59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 0x7f618015f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40460/0 (socket says 172.21.15.136:40460) 2023-06-23T19:02:11.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.895+0000 7f617f59e700 1 -- 172.21.15.136:0/1666356896 learned_addr learned my addr 172.21.15.136:0/1666356896 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:11.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f617ed9d700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61800b51d0 0x7f61801f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f617e59c700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800cf910 0x7f61800b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f617f59e700 1 -- 172.21.15.136:0/1666356896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800cf910 msgr2=0x7f61800b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f617f59e700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800cf910 0x7f61800b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f617f59e700 1 -- 172.21.15.136:0/1666356896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61800b51d0 msgr2=0x7f61801f1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:11.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f617f59e700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61800b51d0 0x7f61801f1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:11.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f617f59e700 1 -- 172.21.15.136:0/1666356896 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170009550 con 0x7f61800d0a60 2023-06-23T19:02:11.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f617f59e700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 0x7f618015f0b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6178007e40 tx=0x7f617800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:11.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f61677fe700 1 -- 172.21.15.136:0/1666356896 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800eea0 con 0x7f61800d0a60 2023-06-23T19:02:11.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f61677fe700 1 -- 172.21.15.136:0/1666356896 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6178014420 con 0x7f61800d0a60 2023-06-23T19:02:11.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618015e2f0 con 0x7f61800d0a60 2023-06-23T19:02:11.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f61677fe700 1 -- 172.21.15.136:0/1666356896 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780147b0 con 0x7f61800d0a60 2023-06-23T19:02:11.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.896+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618015e8b0 con 0x7f61800d0a60 2023-06-23T19:02:11.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.897+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618015edd0 con 0x7f61800d0a60 2023-06-23T19:02:11.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.898+0000 7f61677fe700 1 -- 172.21.15.136:0/1666356896 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6178014910 con 0x7f61800d0a60 2023-06-23T19:02:11.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.899+0000 7f61677fe700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f616c06ace0 0x7f616c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:11.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.899+0000 7f61677fe700 1 -- 172.21.15.136:0/1666356896 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f617808a090 con 0x7f61800d0a60 2023-06-23T19:02:11.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.899+0000 7f617ed9d700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f616c06ace0 0x7f616c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:11.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.900+0000 7f617ed9d700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f616c06ace0 0x7f616c06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6170014040 tx=0x7f6170008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:11.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:11.903+0000 7f61677fe700 1 -- 172.21.15.136:0/1666356896 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f618015edd0 con 0x7f61800d0a60 2023-06-23T19:02:12.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.098+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f618015edd0 con 0x7f61800d0a60 2023-06-23T19:02:12.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.099+0000 7f61677fe700 1 -- 172.21.15.136:0/1666356896 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f618015edd0 con 0x7f61800d0a60 2023-06-23T19:02:12.104 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:02:12.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f616c06ace0 msgr2=0x7f616c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f616c06ace0 0x7f616c06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6170014040 tx=0x7f6170008030 comp rx=0 tx=0).stop 2023-06-23T19:02:12.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 msgr2=0x7f618015f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 0x7f618015f0b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6178007e40 tx=0x7f617800e3c0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 shutdown_connections 2023-06-23T19:02:12.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f616c06ace0 0x7f616c06d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61800b51d0 0x7f61801f1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61800d0a60 0x7f618015f0b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 --2- 172.21.15.136:0/1666356896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800cf910 0x7f61800b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 >> 172.21.15.136:0/1666356896 conn(0x7f6180071620 msgr2=0x7f61800d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:12.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 shutdown_connections 2023-06-23T19:02:12.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.101+0000 7f61851ff700 1 -- 172.21.15.136:0/1666356896 wait complete. 2023-06-23T19:02:12.124 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.315+0000 7fdda75ff700 1 Processor -- start 2023-06-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.315+0000 7fdda75ff700 1 -- start start 2023-06-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.316+0000 7fdda75ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdda00b5a70 0x7fdda00b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.316+0000 7fdda75ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdda00cf910 0x7fdda00d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.316+0000 7fdda75ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda00b5ec0 con 0x7fdda00d0a60 2023-06-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.316+0000 7fdda75ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda00d0060 con 0x7fdda00b5a70 2023-06-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.316+0000 7fdda75ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda00cd9d0 con 0x7fdda00cf910 2023-06-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.317+0000 7fdda4b9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdda00b5a70 0x7fdda00b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.317+0000 7fdda4b9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdda00b5a70 0x7fdda00b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40476/0 (socket says 172.21.15.136:40476) 2023-06-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.317+0000 7fdda4b9a700 1 -- 172.21.15.136:0/2245593708 learned_addr learned my addr 172.21.15.136:0/2245593708 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.317+0000 7fdda5b9c700 1 --2- 172.21.15.136:0/2245593708 >> v2:172.21.15.178:3300/0 conn(0x7fdda00cf910 0x7fdda00d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.317+0000 7fdda4b9a700 1 -- 172.21.15.136:0/2245593708 >> v2:172.21.15.178:3300/0 conn(0x7fdda00cf910 msgr2=0x7fdda00d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.317+0000 7fdda4b9a700 1 --2- 172.21.15.136:0/2245593708 >> v2:172.21.15.178:3300/0 conn(0x7fdda00cf910 0x7fdda00d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.317+0000 7fdda4b9a700 1 -- 172.21.15.136:0/2245593708 >> v1:172.21.15.178:6789/0 conn(0x7fdda00d0a60 legacy=0x7fdda00d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.317+0000 7fdda4b9a700 1 -- 172.21.15.136:0/2245593708 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00cd410 con 0x7fdda00b5a70 2023-06-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.317+0000 7fdda4b9a700 1 --2- 172.21.15.136:0/2245593708 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00b5a70 0x7fdda00b51d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdda00b2610 tx=0x7fdd90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a07d1b90694a6d4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdd97fff700 1 -- 172.21.15.136:0/2245593708 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90004230 con 0x7fdda00b5a70 2023-06-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdd97fff700 1 -- 172.21.15.136:0/2245593708 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd90004390 con 0x7fdda00b5a70 2023-06-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdd97fff700 1 -- 172.21.15.136:0/2245593708 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900036a0 con 0x7fdda00b5a70 2023-06-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdda75ff700 1 -- 172.21.15.136:0/2245593708 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00b5a70 msgr2=0x7fdda00b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdda75ff700 1 --2- 172.21.15.136:0/2245593708 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00b5a70 0x7fdda00b51d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdda00b2610 tx=0x7fdd90009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdda75ff700 1 -- 172.21.15.136:0/2245593708 shutdown_connections 2023-06-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdda75ff700 1 --2- 172.21.15.136:0/2245593708 >> v2:172.21.15.178:3300/0 conn(0x7fdda00cf910 0x7fdda00d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdda75ff700 1 --2- 172.21.15.136:0/2245593708 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00b5a70 0x7fdda00b51d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdda75ff700 1 -- 172.21.15.136:0/2245593708 >> 172.21.15.136:0/2245593708 conn(0x7fdda0071620 msgr2=0x7fdda00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdda75ff700 1 -- 172.21.15.136:0/2245593708 shutdown_connections 2023-06-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.318+0000 7fdda75ff700 1 -- 172.21.15.136:0/2245593708 wait complete. 2023-06-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.321+0000 7fdda75ff700 1 Processor -- start 2023-06-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.321+0000 7fdda75ff700 1 -- start start 2023-06-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda75ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda00b5a70 0x7fdda015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda75ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00cf910 0x7fdda00cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda75ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda00d0a60 0x7fdda00cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda75ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda015b810 con 0x7fdda00cf910 2023-06-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda75ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c7760 con 0x7fdda00b5a70 2023-06-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda75ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c7a00 con 0x7fdda00d0a60 2023-06-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda4b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00cf910 0x7fdda00cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda4b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00cf910 0x7fdda00cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40484/0 (socket says 172.21.15.136:40484) 2023-06-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda4b9a700 1 -- 172.21.15.136:0/2793596610 learned_addr learned my addr 172.21.15.136:0/2793596610 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.322+0000 7fdda539b700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda00b5a70 0x7fdda015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdda5b9c700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda00d0a60 0x7fdda00cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdda4b9a700 1 -- 172.21.15.136:0/2793596610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda00d0a60 msgr2=0x7fdda00cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdda4b9a700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda00d0a60 0x7fdda00cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdda4b9a700 1 -- 172.21.15.136:0/2793596610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda00b5a70 msgr2=0x7fdda015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdda4b9a700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda00b5a70 0x7fdda015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdda4b9a700 1 -- 172.21.15.136:0/2793596610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd90009550 con 0x7fdda00cf910 2023-06-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdda4b9a700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00cf910 0x7fdda00cc180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009130 tx=0x7fdd90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdd95ffb700 1 -- 172.21.15.136:0/2793596610 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90003dc0 con 0x7fdda00cf910 2023-06-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdd95ffb700 1 -- 172.21.15.136:0/2793596610 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9001f070 con 0x7fdda00cf910 2023-06-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda00c7ce0 con 0x7fdda00cf910 2023-06-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdd95ffb700 1 -- 172.21.15.136:0/2793596610 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90011870 con 0x7fdda00cf910 2023-06-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.323+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda00c82a0 con 0x7fdda00cf910 2023-06-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.324+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda00c84c0 con 0x7fdda00cf910 2023-06-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.325+0000 7fdd95ffb700 1 -- 172.21.15.136:0/2793596610 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd90021030 con 0x7fdda00cf910 2023-06-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.327+0000 7fdd95ffb700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdd8406ace0 0x7fdd8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.327+0000 7fdd95ffb700 1 -- 172.21.15.136:0/2793596610 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdd9008ad60 con 0x7fdda00cf910 2023-06-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.327+0000 7fdda539b700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdd8406ace0 0x7fdd8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.328+0000 7fdda539b700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdd8406ace0 0x7fdd8406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdda00b2080 tx=0x7fdd9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.332+0000 7fdd95ffb700 1 -- 172.21.15.136:0/2793596610 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd90055b70 con 0x7fdda00cf910 2023-06-23T19:02:12.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.533+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdda004ea20 con 0x7fdda00cf910 2023-06-23T19:02:12.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.534+0000 7fdd95ffb700 1 -- 172.21.15.136:0/2793596610 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdd90059190 con 0x7fdda00cf910 2023-06-23T19:02:12.539 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:12.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdd8406ace0 msgr2=0x7fdd8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdd8406ace0 0x7fdd8406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdda00b2080 tx=0x7fdd9c008040 comp rx=0 tx=0).stop 2023-06-23T19:02:12.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00cf910 msgr2=0x7fdda00cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00cf910 0x7fdda00cc180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009130 tx=0x7fdd90004750 comp rx=0 tx=0).stop 2023-06-23T19:02:12.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 shutdown_connections 2023-06-23T19:02:12.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdd8406ace0 0x7fdd8406d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda00b5a70 0x7fdda015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda00d0a60 0x7fdda00cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 --2- 172.21.15.136:0/2793596610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdda00cf910 0x7fdda00cc180 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 >> 172.21.15.136:0/2793596610 conn(0x7fdda0071620 msgr2=0x7fdda00d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:12.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 shutdown_connections 2023-06-23T19:02:12.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.536+0000 7fdda75ff700 1 -- 172.21.15.136:0/2793596610 wait complete. 2023-06-23T19:02:12.559 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T19:02:12.752 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.748+0000 7f389c9ff700 1 Processor -- start 2023-06-23T19:02:12.752 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.748+0000 7f389c9ff700 1 -- start start 2023-06-23T19:02:12.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.749+0000 7f389c9ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f38980cd830 0x7f3898160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.749+0000 7f389c9ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3898160880 0x7f38980d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.749+0000 7f389c9ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38981610a0 con 0x7f389815c570 2023-06-23T19:02:12.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.749+0000 7f389c9ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389815d670 con 0x7f38980cd830 2023-06-23T19:02:12.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.749+0000 7f389c9ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389815da90 con 0x7f3898160880 2023-06-23T19:02:12.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.749+0000 7f388ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f38980cd830 0x7f3898160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.749+0000 7f389659c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f389815c570 0x7f38980cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38072/0 (socket says 172.21.15.136:38072) 2023-06-23T19:02:12.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.749+0000 7f389659c700 1 -- 172.21.15.136:0/776410826 learned_addr learned my addr 172.21.15.136:0/776410826 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:12.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f3896d9d700 1 --2- 172.21.15.136:0/776410826 >> v2:172.21.15.178:3300/0 conn(0x7f3898160880 0x7f38980d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f388ffff700 1 -- 172.21.15.136:0/776410826 >> v2:172.21.15.178:3300/0 conn(0x7f3898160880 msgr2=0x7f38980d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:12.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f388ffff700 1 --2- 172.21.15.136:0/776410826 >> v2:172.21.15.178:3300/0 conn(0x7f3898160880 0x7f38980d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f388ffff700 1 -- 172.21.15.136:0/776410826 >> v1:172.21.15.136:6789/0 conn(0x7f389815c570 legacy=0x7f38980cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f388ffff700 1 -- 172.21.15.136:0/776410826 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389815ccd0 con 0x7f38980cd830 2023-06-23T19:02:12.758 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f3896d9d700 1 --2- 172.21.15.136:0/776410826 >> v2:172.21.15.178:3300/0 conn(0x7f3898160880 0x7f38980d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f3895d9b700 1 -- 172.21.15.136:0/776410826 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043255304 0 0) 0x7f38981610a0 con 0x7f389815c570 2023-06-23T19:02:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f388ffff700 1 --2- 172.21.15.136:0/776410826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 0x7f3898160340 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f38980cdc00 tx=0x7f3880009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b401714ec568f3ab server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f3895d9b700 1 -- 172.21.15.136:0/776410826 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880011830 con 0x7f38980cd830 2023-06-23T19:02:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f3895d9b700 1 -- 172.21.15.136:0/776410826 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880011990 con 0x7f38980cd830 2023-06-23T19:02:12.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.750+0000 7f3895d9b700 1 -- 172.21.15.136:0/776410826 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880011d20 con 0x7f38980cd830 2023-06-23T19:02:12.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.751+0000 7f389c9ff700 1 -- 172.21.15.136:0/776410826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 msgr2=0x7f3898160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.751+0000 7f389c9ff700 1 --2- 172.21.15.136:0/776410826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 0x7f3898160340 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f38980cdc00 tx=0x7f3880009b20 comp rx=0 tx=0).stop 2023-06-23T19:02:12.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.751+0000 7f389c9ff700 1 -- 172.21.15.136:0/776410826 shutdown_connections 2023-06-23T19:02:12.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.751+0000 7f389c9ff700 1 --2- 172.21.15.136:0/776410826 >> v2:172.21.15.178:3300/0 conn(0x7f3898160880 0x7f38980d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.751+0000 7f389c9ff700 1 --2- 172.21.15.136:0/776410826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 0x7f3898160340 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.751+0000 7f389c9ff700 1 -- 172.21.15.136:0/776410826 >> 172.21.15.136:0/776410826 conn(0x7f3898071620 msgr2=0x7f38980719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:12.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.751+0000 7f389c9ff700 1 -- 172.21.15.136:0/776410826 shutdown_connections 2023-06-23T19:02:12.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.751+0000 7f389c9ff700 1 -- 172.21.15.136:0/776410826 wait complete. 2023-06-23T19:02:12.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.753+0000 7f389c9ff700 1 Processor -- start 2023-06-23T19:02:12.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.754+0000 7f389c9ff700 1 -- start start 2023-06-23T19:02:12.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389c9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 0x7f3898150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389c9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f389815c570 0x7f3898151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389c9ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3898160880 0x7f38980c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389c9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980ca540 con 0x7f38980cd830 2023-06-23T19:02:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389c9ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3898151a40 con 0x7f3898160880 2023-06-23T19:02:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389c9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980c7840 con 0x7f389815c570 2023-06-23T19:02:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 0x7f3898150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 0x7f3898150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40510/0 (socket says 172.21.15.136:40510) 2023-06-23T19:02:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389659c700 1 -- 172.21.15.136:0/3392673191 learned_addr learned my addr 172.21.15.136:0/3392673191 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f3896d9d700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3898160880 0x7f38980c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f388ffff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f389815c570 0x7f3898151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389659c700 1 -- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f389815c570 msgr2=0x7f3898151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389659c700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f389815c570 0x7f3898151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389659c700 1 -- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3898160880 msgr2=0x7f38980c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389659c700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3898160880 0x7f38980c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.755+0000 7f389659c700 1 -- 172.21.15.136:0/3392673191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800094a0 con 0x7f38980cd830 2023-06-23T19:02:12.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.756+0000 7f388ffff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f389815c570 0x7f3898151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.756+0000 7f3896d9d700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3898160880 0x7f38980c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.756+0000 7f389659c700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 0x7f3898150040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f38880011e0 tx=0x7f388800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.756+0000 7f388effd700 1 -- 172.21.15.136:0/3392673191 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888004c80 con 0x7f38980cd830 2023-06-23T19:02:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.756+0000 7f388effd700 1 -- 172.21.15.136:0/3392673191 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3888004e00 con 0x7f38980cd830 2023-06-23T19:02:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.756+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38980c9ba0 con 0x7f38980cd830 2023-06-23T19:02:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.756+0000 7f388effd700 1 -- 172.21.15.136:0/3392673191 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888007310 con 0x7f38980cd830 2023-06-23T19:02:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.756+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38980ca160 con 0x7f38980cd830 2023-06-23T19:02:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.757+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3898073910 con 0x7f38980cd830 2023-06-23T19:02:12.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.758+0000 7f388effd700 1 -- 172.21.15.136:0/3392673191 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3888007470 con 0x7f38980cd830 2023-06-23T19:02:12.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.759+0000 7f388effd700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f387806ace0 0x7f387806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:12.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.759+0000 7f388effd700 1 -- 172.21.15.136:0/3392673191 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f38880895e0 con 0x7f38980cd830 2023-06-23T19:02:12.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.759+0000 7f388ffff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f387806ace0 0x7f387806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:12.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.760+0000 7f388ffff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f387806ace0 0x7f387806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f38800090b0 tx=0x7f3880008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:12.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.763+0000 7f388effd700 1 -- 172.21.15.136:0/3392673191 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3888054360 con 0x7f38980cd830 2023-06-23T19:02:12.979 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.976+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f38980ce370 con 0x7f38980cd830 2023-06-23T19:02:12.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.976+0000 7f388effd700 1 -- 172.21.15.136:0/3392673191 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3888057980 con 0x7f38980cd830 2023-06-23T19:02:12.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f387806ace0 msgr2=0x7f387806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f387806ace0 0x7f387806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f38800090b0 tx=0x7f3880008030 comp rx=0 tx=0).stop 2023-06-23T19:02:12.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 msgr2=0x7f3898150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:12.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 0x7f3898150040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f38880011e0 tx=0x7f388800cae0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 shutdown_connections 2023-06-23T19:02:12.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f387806ace0 0x7f387806d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3898160880 0x7f38980c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38980cd830 0x7f3898150040 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 --2- 172.21.15.136:0/3392673191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f389815c570 0x7f3898151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:12.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 >> 172.21.15.136:0/3392673191 conn(0x7f3898071620 msgr2=0x7f38980cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:12.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 shutdown_connections 2023-06-23T19:02:12.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:12.979+0000 7f389c9ff700 1 -- 172.21.15.136:0/3392673191 wait complete. 2023-06-23T19:02:12.986 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2023-06-23T19:02:13.001 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-23T19:02:13.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:13.002 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-23T19:02:13.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2023-06-23T19:02:13.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:13.100 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-23T19:02:13.143 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:02:13.143 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:13.191 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:02:13.192 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:13.281 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:02:13.281 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:13.365 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.555+0000 7f3c9bfff700 1 Processor -- start 2023-06-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.556+0000 7f3c9bfff700 1 -- start start 2023-06-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c9415c570 0x7f3c940cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9bfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3c940cd660 0x7f3c94160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9bfff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c941610a0 con 0x7f3c94160880 2023-06-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9bfff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9415d670 con 0x7f3c940cd660 2023-06-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9bfff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940cdad0 con 0x7f3c9415c570 2023-06-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9959a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3c940cd660 0x7f3c94160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9959a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3c940cd660 0x7f3c94160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40516/0 (socket says 172.21.15.136:40516) 2023-06-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9959a700 1 -- 172.21.15.136:0/259621944 learned_addr learned my addr 172.21.15.136:0/259621944 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c99d9b700 1 --2- 172.21.15.136:0/259621944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c9415c570 0x7f3c940cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9959a700 1 -- 172.21.15.136:0/259621944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c9415c570 msgr2=0x7f3c940cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9959a700 1 --2- 172.21.15.136:0/259621944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c9415c570 0x7f3c940cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9959a700 1 -- 172.21.15.136:0/259621944 >> v1:172.21.15.136:6789/0 conn(0x7f3c94160880 legacy=0x7f3c9406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.557+0000 7f3c9959a700 1 -- 172.21.15.136:0/259621944 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9415da90 con 0x7f3c940cd660 2023-06-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.558+0000 7f3c9959a700 1 --2- 172.21.15.136:0/259621944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c940cd660 0x7f3c94160340 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009920 tx=0x7f3c84009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99009136047b0418 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.558+0000 7f3c98d99700 1 -- 172.21.15.136:0/259621944 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84011830 con 0x7f3c940cd660 2023-06-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.558+0000 7f3c98d99700 1 -- 172.21.15.136:0/259621944 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c84011990 con 0x7f3c940cd660 2023-06-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.558+0000 7f3c98d99700 1 -- 172.21.15.136:0/259621944 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84011d20 con 0x7f3c940cd660 2023-06-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.558+0000 7f3c9bfff700 1 -- 172.21.15.136:0/259621944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c940cd660 msgr2=0x7f3c94160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.558+0000 7f3c9bfff700 1 --2- 172.21.15.136:0/259621944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c940cd660 0x7f3c94160340 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009920 tx=0x7f3c84009c30 comp rx=0 tx=0).stop 2023-06-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.559+0000 7f3c9bfff700 1 -- 172.21.15.136:0/259621944 shutdown_connections 2023-06-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.559+0000 7f3c9bfff700 1 --2- 172.21.15.136:0/259621944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c9415c570 0x7f3c940cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.559+0000 7f3c9bfff700 1 --2- 172.21.15.136:0/259621944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c940cd660 0x7f3c94160340 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.559+0000 7f3c9bfff700 1 -- 172.21.15.136:0/259621944 >> 172.21.15.136:0/259621944 conn(0x7f3c94071620 msgr2=0x7f3c940719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.559+0000 7f3c9bfff700 1 -- 172.21.15.136:0/259621944 shutdown_connections 2023-06-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.559+0000 7f3c9bfff700 1 -- 172.21.15.136:0/259621944 wait complete. 2023-06-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.561+0000 7f3c9bfff700 1 Processor -- start 2023-06-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.561+0000 7f3c9bfff700 1 -- start start 2023-06-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.562+0000 7f3c9bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c940cd660 0x7f3c9414fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.562+0000 7f3c9bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c9415c570 0x7f3c940cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.562+0000 7f3c9bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c94160880 0x7f3c940cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.562+0000 7f3c9bfff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c9c40 con 0x7f3c9415c570 2023-06-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.562+0000 7f3c9bfff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c9f20 con 0x7f3c94160880 2023-06-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.562+0000 7f3c9bfff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940ca200 con 0x7f3c940cd660 2023-06-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9959a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c9415c570 0x7f3c940cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9959a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c9415c570 0x7f3c940cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40520/0 (socket says 172.21.15.136:40520) 2023-06-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9959a700 1 -- 172.21.15.136:0/4009339659 learned_addr learned my addr 172.21.15.136:0/4009339659 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c99d9b700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c940cd660 0x7f3c9414fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9a59c700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c94160880 0x7f3c940cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9959a700 1 -- 172.21.15.136:0/4009339659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c940cd660 msgr2=0x7f3c9414fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9959a700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c940cd660 0x7f3c9414fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9959a700 1 -- 172.21.15.136:0/4009339659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c94160880 msgr2=0x7f3c940cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9959a700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c94160880 0x7f3c940cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9959a700 1 -- 172.21.15.136:0/4009339659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c84009550 con 0x7f3c9415c570 2023-06-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.563+0000 7f3c9959a700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c9415c570 0x7f3c940cc3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009130 tx=0x7f3c84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.564+0000 7f3c8a7fc700 1 -- 172.21.15.136:0/4009339659 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84004590 con 0x7f3c9415c570 2023-06-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.564+0000 7f3c8a7fc700 1 -- 172.21.15.136:0/4009339659 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8401e070 con 0x7f3c9415c570 2023-06-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.564+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c940ca4e0 con 0x7f3c9415c570 2023-06-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.564+0000 7f3c8a7fc700 1 -- 172.21.15.136:0/4009339659 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c840038e0 con 0x7f3c9415c570 2023-06-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.564+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c940cc900 con 0x7f3c9415c570 2023-06-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.565+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c940caa00 con 0x7f3c9415c570 2023-06-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.566+0000 7f3c8a7fc700 1 -- 172.21.15.136:0/4009339659 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c84003a40 con 0x7f3c9415c570 2023-06-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.567+0000 7f3c8a7fc700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3c7806ace0 0x7f3c7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.567+0000 7f3c8a7fc700 1 -- 172.21.15.136:0/4009339659 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3c8408a720 con 0x7f3c9415c570 2023-06-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.567+0000 7f3c99d9b700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3c7806ace0 0x7f3c7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.567+0000 7f3c99d9b700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3c7806ace0 0x7f3c7806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c941f59c0 tx=0x7f3c90009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.571+0000 7f3c8a7fc700 1 -- 172.21.15.136:0/4009339659 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c940caa00 con 0x7f3c9415c570 2023-06-23T19:02:13.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.768+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c940ca340 con 0x7f3c9415c570 2023-06-23T19:02:13.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.769+0000 7f3c8a7fc700 1 -- 172.21.15.136:0/4009339659 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f3c940ca340 con 0x7f3c9415c570 2023-06-23T19:02:13.774 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:13.774 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:13.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3c7806ace0 msgr2=0x7f3c7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:13.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3c7806ace0 0x7f3c7806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c941f59c0 tx=0x7f3c90009210 comp rx=0 tx=0).stop 2023-06-23T19:02:13.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c9415c570 msgr2=0x7f3c940cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:13.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c9415c570 0x7f3c940cc3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009130 tx=0x7f3c84004750 comp rx=0 tx=0).stop 2023-06-23T19:02:13.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 shutdown_connections 2023-06-23T19:02:13.782 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3c7806ace0 0x7f3c7806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:13.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c94160880 0x7f3c940cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:13.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c940cd660 0x7f3c9414fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:13.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 --2- 172.21.15.136:0/4009339659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c9415c570 0x7f3c940cc3c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:13.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 >> 172.21.15.136:0/4009339659 conn(0x7f3c94071620 msgr2=0x7f3c940d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:13.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 shutdown_connections 2023-06-23T19:02:13.783 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.772+0000 7f3c9bfff700 1 -- 172.21.15.136:0/4009339659 wait complete. 2023-06-23T19:02:13.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:02:13.797 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:02:13.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.992+0000 7f79b37ff700 1 Processor -- start 2023-06-23T19:02:13.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.993+0000 7f79b37ff700 1 -- start start 2023-06-23T19:02:14.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.994+0000 7f79b37ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0b5a70 0x7f79ac0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.994+0000 7f79b37ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac0b5ec0 con 0x7f79ac0cf910 2023-06-23T19:02:14.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.994+0000 7f79b37ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac0cd9d0 con 0x7f79ac0d0a60 2023-06-23T19:02:14.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.994+0000 7f79b37ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0d0060 con 0x7f79ac0b5a70 2023-06-23T19:02:14.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.994+0000 7f79b1d9c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f79ac0cf910 0x7f79ac0d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38090/0 (socket says 172.21.15.136:38090) 2023-06-23T19:02:14.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.994+0000 7f79b1d9c700 1 -- 172.21.15.136:0/2899825381 learned_addr learned my addr 172.21.15.136:0/2899825381 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:14.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.994+0000 7f79b0d9a700 1 --2- 172.21.15.136:0/2899825381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0b5a70 0x7f79ac0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.994+0000 7f79a3fff700 1 -- 172.21.15.136:0/2899825381 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683847163 0 0) 0x7f79ac0b5ec0 con 0x7f79ac0cf910 2023-06-23T19:02:14.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.995+0000 7f79a3fff700 1 -- 172.21.15.136:0/2899825381 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79980035b0 con 0x7f79ac0cf910 2023-06-23T19:02:14.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.995+0000 7f79b0d9a700 1 -- 172.21.15.136:0/2899825381 >> v1:172.21.15.178:6789/0 conn(0x7f79ac0d0a60 legacy=0x7f79ac0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.995+0000 7f79a3fff700 1 -- 172.21.15.136:0/2899825381 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594856531 0 0) 0x7f79ac0cd9d0 con 0x7f79ac0d0a60 2023-06-23T19:02:14.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.995+0000 7f79b0d9a700 1 -- 172.21.15.136:0/2899825381 >> v1:172.21.15.136:6789/0 conn(0x7f79ac0cf910 legacy=0x7f79ac0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.995+0000 7f79b0d9a700 1 -- 172.21.15.136:0/2899825381 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0cfd90 con 0x7f79ac0b5a70 2023-06-23T19:02:14.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.995+0000 7f79b0d9a700 1 --2- 172.21.15.136:0/2899825381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0b5a70 0x7f79ac0b51d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f799c009870 tx=0x7f799c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28515232c49246c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:14.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.995+0000 7f79a3fff700 1 -- 172.21.15.136:0/2899825381 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c011830 con 0x7f79ac0b5a70 2023-06-23T19:02:14.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.995+0000 7f79a3fff700 1 -- 172.21.15.136:0/2899825381 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c011990 con 0x7f79ac0b5a70 2023-06-23T19:02:14.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.995+0000 7f79a3fff700 1 -- 172.21.15.136:0/2899825381 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c011d20 con 0x7f79ac0b5a70 2023-06-23T19:02:14.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.996+0000 7f79b37ff700 1 -- 172.21.15.136:0/2899825381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0b5a70 msgr2=0x7f79ac0b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.996+0000 7f79b37ff700 1 --2- 172.21.15.136:0/2899825381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0b5a70 0x7f79ac0b51d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f799c009870 tx=0x7f799c009b80 comp rx=0 tx=0).stop 2023-06-23T19:02:14.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.996+0000 7f79b37ff700 1 -- 172.21.15.136:0/2899825381 shutdown_connections 2023-06-23T19:02:14.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.996+0000 7f79b37ff700 1 --2- 172.21.15.136:0/2899825381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0b5a70 0x7f79ac0b51d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.996+0000 7f79b37ff700 1 -- 172.21.15.136:0/2899825381 >> 172.21.15.136:0/2899825381 conn(0x7f79ac071620 msgr2=0x7f79ac0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:14.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.996+0000 7f79b37ff700 1 -- 172.21.15.136:0/2899825381 shutdown_connections 2023-06-23T19:02:14.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.996+0000 7f79b37ff700 1 -- 172.21.15.136:0/2899825381 wait complete. 2023-06-23T19:02:14.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.998+0000 7f79b37ff700 1 Processor -- start 2023-06-23T19:02:14.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.998+0000 7f79b37ff700 1 -- start start 2023-06-23T19:02:14.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b37ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79ac0b5a70 0x7f79ac14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b37ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79ac0cf910 0x7f79ac14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b37ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0d0a60 0x7f79ac14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b37ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac14d070 con 0x7f79ac0b5a70 2023-06-23T19:02:14.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b37ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac14e720 con 0x7f79ac0cf910 2023-06-23T19:02:14.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b37ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac14c3f0 con 0x7f79ac0d0a60 2023-06-23T19:02:14.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b159b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79ac0b5a70 0x7f79ac14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b159b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79ac0b5a70 0x7f79ac14af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40522/0 (socket says 172.21.15.136:40522) 2023-06-23T19:02:14.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b159b700 1 -- 172.21.15.136:0/1688368947 learned_addr learned my addr 172.21.15.136:0/1688368947 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:14.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b159b700 1 -- 172.21.15.136:0/1688368947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0d0a60 msgr2=0x7f79ac14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b159b700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0d0a60 0x7f79ac14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b159b700 1 -- 172.21.15.136:0/1688368947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79ac0cf910 msgr2=0x7f79ac14b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b159b700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79ac0cf910 0x7f79ac14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:13.999+0000 7f79b159b700 1 -- 172.21.15.136:0/1688368947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c0094a0 con 0x7f79ac0b5a70 2023-06-23T19:02:14.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.000+0000 7f79b159b700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79ac0b5a70 0x7f79ac14af10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c550 tx=0x7f79a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:14.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.000+0000 7f79a1ffb700 1 -- 172.21.15.136:0/1688368947 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a80054e0 con 0x7f79ac0b5a70 2023-06-23T19:02:14.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.000+0000 7f79a1ffb700 1 -- 172.21.15.136:0/1688368947 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8003680 con 0x7f79ac0b5a70 2023-06-23T19:02:14.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.000+0000 7f79a1ffb700 1 -- 172.21.15.136:0/1688368947 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8003a30 con 0x7f79ac0b5a70 2023-06-23T19:02:14.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.000+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac14c6d0 con 0x7f79ac0b5a70 2023-06-23T19:02:14.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.000+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac14cc90 con 0x7f79ac0b5a70 2023-06-23T19:02:14.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.001+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac04ea20 con 0x7f79ac0b5a70 2023-06-23T19:02:14.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.002+0000 7f79a1ffb700 1 -- 172.21.15.136:0/1688368947 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79a8003b90 con 0x7f79ac0b5a70 2023-06-23T19:02:14.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.003+0000 7f79a1ffb700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f799006ace0 0x7f799006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.003+0000 7f79a1ffb700 1 -- 172.21.15.136:0/1688368947 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f79a8088d20 con 0x7f79ac0b5a70 2023-06-23T19:02:14.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.003+0000 7f79b0d9a700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f799006ace0 0x7f799006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.003+0000 7f79b0d9a700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f799006ace0 0x7f799006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0b17b0 tx=0x7f799c010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:14.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.007+0000 7f79a1ffb700 1 -- 172.21.15.136:0/1688368947 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f79a8053a00 con 0x7f79ac0b5a70 2023-06-23T19:02:14.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.203+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79ac0b1a30 con 0x7f79ac0b5a70 2023-06-23T19:02:14.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.204+0000 7f79a1ffb700 1 -- 172.21.15.136:0/1688368947 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79a8017020 con 0x7f79ac0b5a70 2023-06-23T19:02:14.209 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:02:14.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f799006ace0 msgr2=0x7f799006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f799006ace0 0x7f799006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0b17b0 tx=0x7f799c010000 comp rx=0 tx=0).stop 2023-06-23T19:02:14.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79ac0b5a70 msgr2=0x7f79ac14af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79ac0b5a70 0x7f79ac14af10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c550 tx=0x7f79a800c910 comp rx=0 tx=0).stop 2023-06-23T19:02:14.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 shutdown_connections 2023-06-23T19:02:14.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f799006ace0 0x7f799006d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79ac0d0a60 0x7f79ac14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79ac0b5a70 0x7f79ac14af10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 --2- 172.21.15.136:0/1688368947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79ac0cf910 0x7f79ac14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.206+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 >> 172.21.15.136:0/1688368947 conn(0x7f79ac071620 msgr2=0x7f79ac0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:14.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.207+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 shutdown_connections 2023-06-23T19:02:14.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.207+0000 7f79b37ff700 1 -- 172.21.15.136:0/1688368947 wait complete. 2023-06-23T19:02:14.228 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:02:14.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.421+0000 7f4e353ff700 1 Processor -- start 2023-06-23T19:02:14.426 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.422+0000 7f4e353ff700 1 -- start start 2023-06-23T19:02:14.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.423+0000 7f4e353ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300d0a60 0x7f4e300b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.430 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.423+0000 7f4e353ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4e300b51d0 0x7f4e300cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.430 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.423+0000 7f4e353ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e300cd9d0 con 0x7f4e300d0e30 2023-06-23T19:02:14.430 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.423+0000 7f4e353ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e300d0060 con 0x7f4e300b51d0 2023-06-23T19:02:14.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.423+0000 7f4e353ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e300cfe50 con 0x7f4e300d0a60 2023-06-23T19:02:14.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.423+0000 7f4e2effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300d0a60 0x7f4e300b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.423+0000 7f4e2effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300d0a60 0x7f4e300b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:53162/0 (socket says 172.21.15.136:53162) 2023-06-23T19:02:14.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.423+0000 7f4e2effd700 1 -- 172.21.15.136:0/708955932 learned_addr learned my addr 172.21.15.136:0/708955932 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:14.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.423+0000 7f4e27fff700 1 --2- 172.21.15.136:0/708955932 >> v2:172.21.15.178:3300/0 conn(0x7f4e300b51d0 0x7f4e300cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.424+0000 7f4e2effd700 1 -- 172.21.15.136:0/708955932 >> v2:172.21.15.178:3300/0 conn(0x7f4e300b51d0 msgr2=0x7f4e300cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:14.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.424+0000 7f4e2effd700 1 --2- 172.21.15.136:0/708955932 >> v2:172.21.15.178:3300/0 conn(0x7f4e300b51d0 0x7f4e300cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.424+0000 7f4e2effd700 1 -- 172.21.15.136:0/708955932 >> v1:172.21.15.178:6789/0 conn(0x7f4e300d0e30 legacy=0x7f4e300d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.424+0000 7f4e2effd700 1 -- 172.21.15.136:0/708955932 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e300b5640 con 0x7f4e300d0a60 2023-06-23T19:02:14.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.424+0000 7f4e2effd700 1 --2- 172.21.15.136:0/708955932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300d0a60 0x7f4e300b5a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e200098f0 tx=0x7f4e20009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d977ac7b1a94d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:14.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.424+0000 7f4e2e7fc700 1 -- 172.21.15.136:0/708955932 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20011830 con 0x7f4e300d0a60 2023-06-23T19:02:14.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.424+0000 7f4e2e7fc700 1 -- 172.21.15.136:0/708955932 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e20011990 con 0x7f4e300d0a60 2023-06-23T19:02:14.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.424+0000 7f4e2e7fc700 1 -- 172.21.15.136:0/708955932 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20011d20 con 0x7f4e300d0a60 2023-06-23T19:02:14.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.425+0000 7f4e353ff700 1 -- 172.21.15.136:0/708955932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300d0a60 msgr2=0x7f4e300b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.425+0000 7f4e353ff700 1 --2- 172.21.15.136:0/708955932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300d0a60 0x7f4e300b5a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e200098f0 tx=0x7f4e20009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:14.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.425+0000 7f4e353ff700 1 -- 172.21.15.136:0/708955932 shutdown_connections 2023-06-23T19:02:14.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.425+0000 7f4e353ff700 1 --2- 172.21.15.136:0/708955932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300d0a60 0x7f4e300b5a70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.425+0000 7f4e353ff700 1 --2- 172.21.15.136:0/708955932 >> v2:172.21.15.178:3300/0 conn(0x7f4e300b51d0 0x7f4e300cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.425+0000 7f4e353ff700 1 -- 172.21.15.136:0/708955932 >> 172.21.15.136:0/708955932 conn(0x7f4e30071620 msgr2=0x7f4e300719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:14.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.425+0000 7f4e353ff700 1 -- 172.21.15.136:0/708955932 shutdown_connections 2023-06-23T19:02:14.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.425+0000 7f4e353ff700 1 -- 172.21.15.136:0/708955932 wait complete. 2023-06-23T19:02:14.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.427+0000 7f4e353ff700 1 Processor -- start 2023-06-23T19:02:14.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.427+0000 7f4e353ff700 1 -- start start 2023-06-23T19:02:14.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e353ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300b51d0 0x7f4e301562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e353ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e300d0a60 0x7f4e300b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e353ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e300d0e30 0x7f4e300cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e353ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e300b8b70 con 0x7f4e300d0a60 2023-06-23T19:02:14.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e353ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e300b86e0 con 0x7f4e300d0e30 2023-06-23T19:02:14.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e353ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e300b7ad0 con 0x7f4e300b51d0 2023-06-23T19:02:14.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e300d0a60 0x7f4e300b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e300d0a60 0x7f4e300b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40538/0 (socket says 172.21.15.136:40538) 2023-06-23T19:02:14.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e27fff700 1 -- 172.21.15.136:0/3431831090 learned_addr learned my addr 172.21.15.136:0/3431831090 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:14.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e2effd700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300b51d0 0x7f4e301562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.428+0000 7f4e2f7fe700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e300d0e30 0x7f4e300cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e27fff700 1 -- 172.21.15.136:0/3431831090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300b51d0 msgr2=0x7f4e301562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e27fff700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300b51d0 0x7f4e301562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e27fff700 1 -- 172.21.15.136:0/3431831090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e300d0e30 msgr2=0x7f4e300cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e27fff700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e300d0e30 0x7f4e300cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e27fff700 1 -- 172.21.15.136:0/3431831090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20009550 con 0x7f4e300d0a60 2023-06-23T19:02:14.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e2effd700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300b51d0 0x7f4e301562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:14.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e27fff700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e300d0a60 0x7f4e300b70f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800e9b0 tx=0x7f4e1800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:14.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e277fe700 1 -- 172.21.15.136:0/3431831090 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18009710 con 0x7f4e300d0a60 2023-06-23T19:02:14.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e277fe700 1 -- 172.21.15.136:0/3431831090 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800c850 con 0x7f4e300d0a60 2023-06-23T19:02:14.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e300b7db0 con 0x7f4e300d0a60 2023-06-23T19:02:14.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e277fe700 1 -- 172.21.15.136:0/3431831090 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800cbc0 con 0x7f4e300d0a60 2023-06-23T19:02:14.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.429+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e300b8370 con 0x7f4e300d0a60 2023-06-23T19:02:14.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.430+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e300b8890 con 0x7f4e300d0a60 2023-06-23T19:02:14.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.431+0000 7f4e277fe700 1 -- 172.21.15.136:0/3431831090 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e1800cd20 con 0x7f4e300d0a60 2023-06-23T19:02:14.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.432+0000 7f4e277fe700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e1006ad10 0x7f4e1006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.432+0000 7f4e277fe700 1 -- 172.21.15.136:0/3431831090 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4e18089910 con 0x7f4e300d0a60 2023-06-23T19:02:14.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.432+0000 7f4e2effd700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e1006ad10 0x7f4e1006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.433+0000 7f4e2effd700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e1006ad10 0x7f4e1006d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009c40 tx=0x7f4e20008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:14.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.436+0000 7f4e277fe700 1 -- 172.21.15.136:0/3431831090 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4e300b8890 con 0x7f4e300d0a60 2023-06-23T19:02:14.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.630+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4e300b8850 con 0x7f4e300d0a60 2023-06-23T19:02:14.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.630+0000 7f4e277fe700 1 -- 172.21.15.136:0/3431831090 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4e180210a0 con 0x7f4e300d0a60 2023-06-23T19:02:14.636 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:02:14.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e1006ad10 msgr2=0x7f4e1006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e1006ad10 0x7f4e1006d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009c40 tx=0x7f4e20008030 comp rx=0 tx=0).stop 2023-06-23T19:02:14.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e300d0a60 msgr2=0x7f4e300b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e300d0a60 0x7f4e300b70f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800e9b0 tx=0x7f4e1800ed70 comp rx=0 tx=0).stop 2023-06-23T19:02:14.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 shutdown_connections 2023-06-23T19:02:14.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e1006ad10 0x7f4e1006d1c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e300d0e30 0x7f4e300cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e300b51d0 0x7f4e301562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 --2- 172.21.15.136:0/3431831090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e300d0a60 0x7f4e300b70f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 >> 172.21.15.136:0/3431831090 conn(0x7f4e30071620 msgr2=0x7f4e300ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.632+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 shutdown_connections 2023-06-23T19:02:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.633+0000 7f4e353ff700 1 -- 172.21.15.136:0/3431831090 wait complete. 2023-06-23T19:02:14.654 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:02:14.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.847+0000 7f24e5fff700 1 Processor -- start 2023-06-23T19:02:14.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.847+0000 7f24e5fff700 1 -- start start 2023-06-23T19:02:14.852 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.848+0000 7f24e5fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f24e006b000 0x7f24e006b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24e5fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 0x7f24e00ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24e5fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e00b1670 con 0x7f24e00b0af0 2023-06-23T19:02:14.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24e5fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e006b910 con 0x7f24e006b000 2023-06-23T19:02:14.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24e5fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e00b1900 con 0x7f24e00adbb0 2023-06-23T19:02:14.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24df7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f24e006b000 0x7f24e006b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24dffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 0x7f24e00ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24d7fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f24e00b0af0 0x7f24e00b0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:48822/0 (socket says 172.21.15.136:48822) 2023-06-23T19:02:14.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24d7fff700 1 -- 172.21.15.136:0/528074341 learned_addr learned my addr 172.21.15.136:0/528074341 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:14.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24dffff700 1 -- 172.21.15.136:0/528074341 >> v2:172.21.15.178:3300/0 conn(0x7f24e006b000 msgr2=0x7f24e006b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:14.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24dffff700 1 --2- 172.21.15.136:0/528074341 >> v2:172.21.15.178:3300/0 conn(0x7f24e006b000 0x7f24e006b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.850+0000 7f24dffff700 1 -- 172.21.15.136:0/528074341 >> v1:172.21.15.178:6789/0 conn(0x7f24e00b0af0 legacy=0x7f24e00b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.849+0000 7f24deffd700 1 -- 172.21.15.136:0/528074341 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226298826 0 0) 0x7f24e00b1670 con 0x7f24e00b0af0 2023-06-23T19:02:14.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.850+0000 7f24dffff700 1 -- 172.21.15.136:0/528074341 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e00b1be0 con 0x7f24e00adbb0 2023-06-23T19:02:14.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.850+0000 7f24dffff700 1 --2- 172.21.15.136:0/528074341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 0x7f24e00ae030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009d90 tx=0x7f24d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=270d80f932e75e55 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:14.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.850+0000 7f24deffd700 1 -- 172.21.15.136:0/528074341 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800e070 con 0x7f24e00adbb0 2023-06-23T19:02:14.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.850+0000 7f24deffd700 1 -- 172.21.15.136:0/528074341 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d800bb20 con 0x7f24e00adbb0 2023-06-23T19:02:14.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.850+0000 7f24deffd700 1 -- 172.21.15.136:0/528074341 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8012430 con 0x7f24e00adbb0 2023-06-23T19:02:14.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.851+0000 7f24e5fff700 1 -- 172.21.15.136:0/528074341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 msgr2=0x7f24e00ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.851+0000 7f24e5fff700 1 --2- 172.21.15.136:0/528074341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 0x7f24e00ae030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009d90 tx=0x7f24d800b330 comp rx=0 tx=0).stop 2023-06-23T19:02:14.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.851+0000 7f24e5fff700 1 -- 172.21.15.136:0/528074341 shutdown_connections 2023-06-23T19:02:14.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.851+0000 7f24e5fff700 1 --2- 172.21.15.136:0/528074341 >> v2:172.21.15.178:3300/0 conn(0x7f24e006b000 0x7f24e006b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.851+0000 7f24e5fff700 1 --2- 172.21.15.136:0/528074341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 0x7f24e00ae030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.851+0000 7f24e5fff700 1 -- 172.21.15.136:0/528074341 >> 172.21.15.136:0/528074341 conn(0x7f24e0099d30 msgr2=0x7f24e00d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:14.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.851+0000 7f24e5fff700 1 -- 172.21.15.136:0/528074341 shutdown_connections 2023-06-23T19:02:14.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.851+0000 7f24e5fff700 1 -- 172.21.15.136:0/528074341 wait complete. 2023-06-23T19:02:14.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.852+0000 7f24e5fff700 1 Processor -- start 2023-06-23T19:02:14.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.852+0000 7f24e5fff700 1 -- start start 2023-06-23T19:02:14.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.853+0000 7f24e5fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24e006b000 0x7f24e00c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.853+0000 7f24e5fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 0x7f24e00cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.853+0000 7f24e5fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24e00b0af0 0x7f24e015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.853+0000 7f24e5fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e00b3f00 con 0x7f24e00b0af0 2023-06-23T19:02:14.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.853+0000 7f24e5fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e00c5500 con 0x7f24e006b000 2023-06-23T19:02:14.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.853+0000 7f24e5fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e00c57e0 con 0x7f24e00adbb0 2023-06-23T19:02:14.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24dffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24e00b0af0 0x7f24e015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24dffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24e00b0af0 0x7f24e015a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59196/0 (socket says 172.21.15.136:59196) 2023-06-23T19:02:14.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24dffff700 1 -- 172.21.15.136:0/1709844164 learned_addr learned my addr 172.21.15.136:0/1709844164 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:14.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24df7fe700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24e006b000 0x7f24e00c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24d7fff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 0x7f24e00cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24dffff700 1 -- 172.21.15.136:0/1709844164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 msgr2=0x7f24e00cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24dffff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 0x7f24e00cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24dffff700 1 -- 172.21.15.136:0/1709844164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24e006b000 msgr2=0x7f24e00c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24dffff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24e006b000 0x7f24e00c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24dffff700 1 -- 172.21.15.136:0/1709844164 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d8009a70 con 0x7f24e00b0af0 2023-06-23T19:02:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.854+0000 7f24dffff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24e00b0af0 0x7f24e015a8a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f24d8014040 tx=0x7f24d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.855+0000 7f24dcff9700 1 -- 172.21.15.136:0/1709844164 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8012430 con 0x7f24e00b0af0 2023-06-23T19:02:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.855+0000 7f24dcff9700 1 -- 172.21.15.136:0/1709844164 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d8020070 con 0x7f24e00b0af0 2023-06-23T19:02:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.855+0000 7f24dcff9700 1 -- 172.21.15.136:0/1709844164 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8004280 con 0x7f24e00b0af0 2023-06-23T19:02:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.855+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e00b38b0 con 0x7f24e00b0af0 2023-06-23T19:02:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.855+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e015ade0 con 0x7f24e00b0af0 2023-06-23T19:02:14.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.856+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e004ea20 con 0x7f24e00b0af0 2023-06-23T19:02:14.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.857+0000 7f24dcff9700 1 -- 172.21.15.136:0/1709844164 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24d80043e0 con 0x7f24e00b0af0 2023-06-23T19:02:14.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.858+0000 7f24dcff9700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f24c006ace0 0x7f24c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:14.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.858+0000 7f24dcff9700 1 -- 172.21.15.136:0/1709844164 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f24d8022070 con 0x7f24e00b0af0 2023-06-23T19:02:14.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.858+0000 7f24df7fe700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f24c006ace0 0x7f24c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:14.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.858+0000 7f24df7fe700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f24c006ace0 0x7f24c006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009b70 tx=0x7f24d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:14.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:14.862+0000 7f24dcff9700 1 -- 172.21.15.136:0/1709844164 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f24d8056270 con 0x7f24e00b0af0 2023-06-23T19:02:15.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.070+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24e00b0580 con 0x7f24e00b0af0 2023-06-23T19:02:15.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.071+0000 7f24dcff9700 1 -- 172.21.15.136:0/1709844164 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24d8059890 con 0x7f24e00b0af0 2023-06-23T19:02:15.075 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:15.077 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f24c006ace0 msgr2=0x7f24c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f24c006ace0 0x7f24c006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009b70 tx=0x7f24d0008040 comp rx=0 tx=0).stop 2023-06-23T19:02:15.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24e00b0af0 msgr2=0x7f24e015a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24e00b0af0 0x7f24e015a8a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f24d8014040 tx=0x7f24d8004ad0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 shutdown_connections 2023-06-23T19:02:15.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f24c006ace0 0x7f24c006d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24e006b000 0x7f24e00c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24e00b0af0 0x7f24e015a8a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 --2- 172.21.15.136:0/1709844164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24e00adbb0 0x7f24e00cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 >> 172.21.15.136:0/1709844164 conn(0x7f24e0099d30 msgr2=0x7f24e00ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:15.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 shutdown_connections 2023-06-23T19:02:15.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.074+0000 7f24e5fff700 1 -- 172.21.15.136:0/1709844164 wait complete. 2023-06-23T19:02:15.096 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:02:15.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.288+0000 7fe9fcbff700 1 Processor -- start 2023-06-23T19:02:15.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.288+0000 7fe9fcbff700 1 -- start start 2023-06-23T19:02:15.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.289+0000 7fe9fcbff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe9f80d0a60 0x7fe9f80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.289+0000 7fe9fcbff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f80cd9d0 con 0x7fe9f80cf910 2023-06-23T19:02:15.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.289+0000 7fe9fcbff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f80b5620 con 0x7fe9f80b51d0 2023-06-23T19:02:15.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.289+0000 7fe9fcbff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80d0060 con 0x7fe9f80d0a60 2023-06-23T19:02:15.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.290+0000 7fe9f659c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe9f80d0a60 0x7fe9f80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.290+0000 7fe9f659c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe9f80d0a60 0x7fe9f80b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59206/0 (socket says 172.21.15.136:59206) 2023-06-23T19:02:15.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.290+0000 7fe9f659c700 1 -- 172.21.15.136:0/3377124684 learned_addr learned my addr 172.21.15.136:0/3377124684 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:15.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.290+0000 7fe9f659c700 1 -- 172.21.15.136:0/3377124684 >> v1:172.21.15.178:6789/0 conn(0x7fe9f80b51d0 legacy=0x7fe9f80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:15.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.290+0000 7fe9f659c700 1 -- 172.21.15.136:0/3377124684 >> v1:172.21.15.136:6789/0 conn(0x7fe9f80cf910 legacy=0x7fe9f80d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.290+0000 7fe9f659c700 1 -- 172.21.15.136:0/3377124684 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f80cd410 con 0x7fe9f80d0a60 2023-06-23T19:02:15.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9f659c700 1 --2- 172.21.15.136:0/3377124684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80d0a60 0x7fe9f80b5a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80098f0 tx=0x7fe9e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2127a2135d6537cc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:15.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9f5d9b700 1 -- 172.21.15.136:0/3377124684 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e800b8a0 con 0x7fe9f80d0a60 2023-06-23T19:02:15.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9f5d9b700 1 -- 172.21.15.136:0/3377124684 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e800ba00 con 0x7fe9f80d0a60 2023-06-23T19:02:15.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9f5d9b700 1 -- 172.21.15.136:0/3377124684 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e800bd90 con 0x7fe9f80d0a60 2023-06-23T19:02:15.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9fcbff700 1 -- 172.21.15.136:0/3377124684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80d0a60 msgr2=0x7fe9f80b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9fcbff700 1 --2- 172.21.15.136:0/3377124684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80d0a60 0x7fe9f80b5a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80098f0 tx=0x7fe9e8009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:15.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9fcbff700 1 -- 172.21.15.136:0/3377124684 shutdown_connections 2023-06-23T19:02:15.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9fcbff700 1 --2- 172.21.15.136:0/3377124684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80d0a60 0x7fe9f80b5a70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9fcbff700 1 -- 172.21.15.136:0/3377124684 >> 172.21.15.136:0/3377124684 conn(0x7fe9f8071620 msgr2=0x7fe9f80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:15.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9fcbff700 1 -- 172.21.15.136:0/3377124684 shutdown_connections 2023-06-23T19:02:15.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.291+0000 7fe9fcbff700 1 -- 172.21.15.136:0/3377124684 wait complete. 2023-06-23T19:02:15.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.293+0000 7fe9fcbff700 1 Processor -- start 2023-06-23T19:02:15.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.293+0000 7fe9fcbff700 1 -- start start 2023-06-23T19:02:15.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.294+0000 7fe9fcbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80b51d0 0x7fe9f8156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.294+0000 7fe9fcbff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9f80cf910 0x7fe9f80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.294+0000 7fe9fcbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9f80d0a60 0x7fe9f80c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.294+0000 7fe9fcbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c8190 con 0x7fe9f80b51d0 2023-06-23T19:02:15.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.294+0000 7fe9fcbff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c8420 con 0x7fe9f80cf910 2023-06-23T19:02:15.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.294+0000 7fe9fcbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c8700 con 0x7fe9f80d0a60 2023-06-23T19:02:15.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.294+0000 7fe9f659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80b51d0 0x7fe9f8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.294+0000 7fe9f659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80b51d0 0x7fe9f8156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59218/0 (socket says 172.21.15.136:59218) 2023-06-23T19:02:15.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.294+0000 7fe9f659c700 1 -- 172.21.15.136:0/935033986 learned_addr learned my addr 172.21.15.136:0/935033986 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:15.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9f659c700 1 -- 172.21.15.136:0/935033986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9f80d0a60 msgr2=0x7fe9f80c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9f659c700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9f80d0a60 0x7fe9f80c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9f659c700 1 -- 172.21.15.136:0/935033986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9f80cf910 msgr2=0x7fe9f80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9effff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9f80cf910 0x7fe9f80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9f659c700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9f80cf910 0x7fe9f80c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9f659c700 1 -- 172.21.15.136:0/935033986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8009550 con 0x7fe9f80b51d0 2023-06-23T19:02:15.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9effff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9f80cf910 0x7fe9f80c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:15.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9f659c700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80b51d0 0x7fe9f8156460 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009130 tx=0x7fe9e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:15.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9eeffd700 1 -- 172.21.15.136:0/935033986 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80036a0 con 0x7fe9f80b51d0 2023-06-23T19:02:15.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9eeffd700 1 -- 172.21.15.136:0/935033986 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e801e070 con 0x7fe9f80b51d0 2023-06-23T19:02:15.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9eeffd700 1 -- 172.21.15.136:0/935033986 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8003a60 con 0x7fe9f80b51d0 2023-06-23T19:02:15.303 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f80c89e0 con 0x7fe9f80b51d0 2023-06-23T19:02:15.303 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.295+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f80c8fa0 con 0x7fe9f80b51d0 2023-06-23T19:02:15.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.296+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f804ea20 con 0x7fe9f80b51d0 2023-06-23T19:02:15.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.297+0000 7fe9eeffd700 1 -- 172.21.15.136:0/935033986 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9e8003bc0 con 0x7fe9f80b51d0 2023-06-23T19:02:15.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.298+0000 7fe9eeffd700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe9d806ace0 0x7fe9d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.298+0000 7fe9eeffd700 1 -- 172.21.15.136:0/935033986 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe9e8020070 con 0x7fe9f80b51d0 2023-06-23T19:02:15.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.298+0000 7fe9effff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe9d806ace0 0x7fe9d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.299+0000 7fe9effff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe9d806ace0 0x7fe9d806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000f60 tx=0x7fe9e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:15.306 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.303+0000 7fe9eeffd700 1 -- 172.21.15.136:0/935033986 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe9e8055bd0 con 0x7fe9f80b51d0 2023-06-23T19:02:15.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.495+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe9f80d1dc0 con 0x7fe9f80b51d0 2023-06-23T19:02:15.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.496+0000 7fe9eeffd700 1 -- 172.21.15.136:0/935033986 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe9e8015020 con 0x7fe9f80b51d0 2023-06-23T19:02:15.500 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:02:15.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe9d806ace0 msgr2=0x7fe9d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe9d806ace0 0x7fe9d806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000f60 tx=0x7fe9e0009040 comp rx=0 tx=0).stop 2023-06-23T19:02:15.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80b51d0 msgr2=0x7fe9f8156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80b51d0 0x7fe9f8156460 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009130 tx=0x7fe9e8004750 comp rx=0 tx=0).stop 2023-06-23T19:02:15.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 shutdown_connections 2023-06-23T19:02:15.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe9d806ace0 0x7fe9d806d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9f80d0a60 0x7fe9f80c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9f80b51d0 0x7fe9f8156460 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 --2- 172.21.15.136:0/935033986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9f80cf910 0x7fe9f80c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 >> 172.21.15.136:0/935033986 conn(0x7fe9f8071620 msgr2=0x7fe9f80b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:15.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 shutdown_connections 2023-06-23T19:02:15.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.498+0000 7fe9fcbff700 1 -- 172.21.15.136:0/935033986 wait complete. 2023-06-23T19:02:15.520 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:02:15.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.711+0000 7f738b1ff700 1 Processor -- start 2023-06-23T19:02:15.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.712+0000 7f738b1ff700 1 -- start start 2023-06-23T19:02:15.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.713+0000 7f738b1ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f73840b5a70 0x7f73840b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.713+0000 7f738b1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840cf910 0x7f73840d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.713+0000 7f738b1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73840b5ec0 con 0x7f73840d0a60 2023-06-23T19:02:15.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.713+0000 7f738b1ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73840d0060 con 0x7f73840b5a70 2023-06-23T19:02:15.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.713+0000 7f738b1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73840cd9d0 con 0x7f73840cf910 2023-06-23T19:02:15.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.713+0000 7f7383fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f73840b5a70 0x7f73840b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.713+0000 7f7383fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f73840b5a70 0x7f73840b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59232/0 (socket says 172.21.15.136:59232) 2023-06-23T19:02:15.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.713+0000 7f7383fff700 1 -- 172.21.15.136:0/2554477355 learned_addr learned my addr 172.21.15.136:0/2554477355 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:15.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.713+0000 7f738979c700 1 --2- 172.21.15.136:0/2554477355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840cf910 0x7f73840d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.714+0000 7f7383fff700 1 -- 172.21.15.136:0/2554477355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840cf910 msgr2=0x7f73840d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:15.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.714+0000 7f7383fff700 1 --2- 172.21.15.136:0/2554477355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840cf910 0x7f73840d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.714+0000 7f7383fff700 1 -- 172.21.15.136:0/2554477355 >> v1:172.21.15.178:6789/0 conn(0x7f73840d0a60 legacy=0x7f73840d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.714+0000 7f73837fe700 1 -- 172.21.15.136:0/2554477355 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408057285 0 0) 0x7f73840b5ec0 con 0x7f73840d0a60 2023-06-23T19:02:15.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.714+0000 7f7383fff700 1 -- 172.21.15.136:0/2554477355 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73840cfd90 con 0x7f73840b5a70 2023-06-23T19:02:15.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.714+0000 7f7383fff700 1 --2- 172.21.15.136:0/2554477355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840b5a70 0x7f73840b51d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f73700098f0 tx=0x7f7370009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7261850977460ed1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:15.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.714+0000 7f73837fe700 1 -- 172.21.15.136:0/2554477355 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370011830 con 0x7f73840b5a70 2023-06-23T19:02:15.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.714+0000 7f73837fe700 1 -- 172.21.15.136:0/2554477355 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7370011990 con 0x7f73840b5a70 2023-06-23T19:02:15.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.714+0000 7f73837fe700 1 -- 172.21.15.136:0/2554477355 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370011d20 con 0x7f73840b5a70 2023-06-23T19:02:15.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.715+0000 7f738b1ff700 1 -- 172.21.15.136:0/2554477355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840b5a70 msgr2=0x7f73840b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.715+0000 7f738b1ff700 1 --2- 172.21.15.136:0/2554477355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840b5a70 0x7f73840b51d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f73700098f0 tx=0x7f7370009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:15.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.715+0000 7f738b1ff700 1 -- 172.21.15.136:0/2554477355 shutdown_connections 2023-06-23T19:02:15.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.715+0000 7f738b1ff700 1 --2- 172.21.15.136:0/2554477355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840cf910 0x7f73840d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.715+0000 7f738b1ff700 1 --2- 172.21.15.136:0/2554477355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840b5a70 0x7f73840b51d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.715+0000 7f738b1ff700 1 -- 172.21.15.136:0/2554477355 >> 172.21.15.136:0/2554477355 conn(0x7f7384071620 msgr2=0x7f73840719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:15.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.715+0000 7f738b1ff700 1 -- 172.21.15.136:0/2554477355 shutdown_connections 2023-06-23T19:02:15.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.715+0000 7f738b1ff700 1 -- 172.21.15.136:0/2554477355 wait complete. 2023-06-23T19:02:15.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.716+0000 7f738b1ff700 1 Processor -- start 2023-06-23T19:02:15.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.717+0000 7f738b1ff700 1 -- start start 2023-06-23T19:02:15.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.717+0000 7f738b1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840b5a70 0x7f73840c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.717+0000 7f738b1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840cf910 0x7f738415b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.717+0000 7f738b1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73840d0a60 0x7f738415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.717+0000 7f738b1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738415f8d0 con 0x7f73840cf910 2023-06-23T19:02:15.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.717+0000 7f738b1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73840c7b10 con 0x7f73840d0a60 2023-06-23T19:02:15.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.717+0000 7f738b1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73840c8610 con 0x7f73840b5a70 2023-06-23T19:02:15.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7383fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840cf910 0x7f738415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7383fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840cf910 0x7f738415b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59234/0 (socket says 172.21.15.136:59234) 2023-06-23T19:02:15.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7383fff700 1 -- 172.21.15.136:0/1187628753 learned_addr learned my addr 172.21.15.136:0/1187628753 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:15.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7388f9b700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840b5a70 0x7f73840c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f738979c700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73840d0a60 0x7f738415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7383fff700 1 -- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840b5a70 msgr2=0x7f73840c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7383fff700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840b5a70 0x7f73840c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7383fff700 1 -- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73840d0a60 msgr2=0x7f738415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7383fff700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73840d0a60 0x7f738415eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7383fff700 1 -- 172.21.15.136:0/1187628753 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7370009550 con 0x7f73840cf910 2023-06-23T19:02:15.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7388f9b700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840b5a70 0x7f73840c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:15.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f738979c700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73840d0a60 0x7f738415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:15.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.718+0000 7f7383fff700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840cf910 0x7f738415b120 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7370009c40 tx=0x7f7370004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:15.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.719+0000 7f73817fa700 1 -- 172.21.15.136:0/1187628753 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370004480 con 0x7f73840cf910 2023-06-23T19:02:15.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.719+0000 7f73817fa700 1 -- 172.21.15.136:0/1187628753 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737001f070 con 0x7f73840cf910 2023-06-23T19:02:15.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.719+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73840c7d70 con 0x7f73840cf910 2023-06-23T19:02:15.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.719+0000 7f73817fa700 1 -- 172.21.15.136:0/1187628753 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73700038c0 con 0x7f73840cf910 2023-06-23T19:02:15.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.719+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73840c8330 con 0x7f73840cf910 2023-06-23T19:02:15.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.720+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738404ea20 con 0x7f73840cf910 2023-06-23T19:02:15.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.721+0000 7f73817fa700 1 -- 172.21.15.136:0/1187628753 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7370021030 con 0x7f73840cf910 2023-06-23T19:02:15.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.722+0000 7f73817fa700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f736806ace0 0x7f736806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:15.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.722+0000 7f73817fa700 1 -- 172.21.15.136:0/1187628753 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f737008acd0 con 0x7f73840cf910 2023-06-23T19:02:15.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.722+0000 7f7388f9b700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f736806ace0 0x7f736806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:15.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.723+0000 7f7388f9b700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f736806ace0 0x7f736806d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7378000f60 tx=0x7f7378009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:15.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.726+0000 7f73817fa700 1 -- 172.21.15.136:0/1187628753 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7370055a40 con 0x7f73840cf910 2023-06-23T19:02:15.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.924+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f73840d01a0 con 0x7f73840cf910 2023-06-23T19:02:15.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.924+0000 7f73817fa700 1 -- 172.21.15.136:0/1187628753 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f73700150a0 con 0x7f73840cf910 2023-06-23T19:02:15.929 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:15.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f736806ace0 msgr2=0x7f736806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f736806ace0 0x7f736806d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7378000f60 tx=0x7f7378009040 comp rx=0 tx=0).stop 2023-06-23T19:02:15.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840cf910 msgr2=0x7f738415b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:15.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840cf910 0x7f738415b120 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7370009c40 tx=0x7f7370004750 comp rx=0 tx=0).stop 2023-06-23T19:02:15.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 shutdown_connections 2023-06-23T19:02:15.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f736806ace0 0x7f736806d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73840d0a60 0x7f738415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73840b5a70 0x7f73840c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 --2- 172.21.15.136:0/1187628753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73840cf910 0x7f738415b120 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:15.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 >> 172.21.15.136:0/1187628753 conn(0x7f7384071620 msgr2=0x7f73840b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:15.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 shutdown_connections 2023-06-23T19:02:15.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:15.927+0000 7f738b1ff700 1 -- 172.21.15.136:0/1187628753 wait complete. 2023-06-23T19:02:15.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T19:02:16.144 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.140+0000 7f2d3dbff700 1 Processor -- start 2023-06-23T19:02:16.144 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.140+0000 7f2d3dbff700 1 -- start start 2023-06-23T19:02:16.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.141+0000 7f2d3dbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.141+0000 7f2d3dbff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d38160a50 0x7f2d380d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.141+0000 7f2d3dbff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d381610a0 con 0x7f2d380cd660 2023-06-23T19:02:16.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.141+0000 7f2d3dbff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3815d670 con 0x7f2d38160a50 2023-06-23T19:02:16.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d3dbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38160eb0 con 0x7f2d3815c570 2023-06-23T19:02:16.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d37fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d38160a50 0x7f2d380d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:53252/0 (socket says 172.21.15.136:53252) 2023-06-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d37fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d38160a50 0x7f2d380d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:60122/0 (socket says 172.21.15.136:60122) 2023-06-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d377fe700 1 -- 172.21.15.136:0/2297804890 learned_addr learned my addr 172.21.15.136:0/2297804890 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d37fff700 1 -- 172.21.15.136:0/2297804890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 msgr2=0x7f2d380cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d37fff700 1 --2- 172.21.15.136:0/2297804890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d37fff700 1 -- 172.21.15.136:0/2297804890 >> v1:172.21.15.178:6789/0 conn(0x7f2d380cd660 legacy=0x7f2d38160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d37fff700 1 -- 172.21.15.136:0/2297804890 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3815da90 con 0x7f2d38160a50 2023-06-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d377fe700 1 --2- 172.21.15.136:0/2297804890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.142+0000 7f2d367fc700 1 -- 172.21.15.136:0/2297804890 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189032289 0 0) 0x7f2d381610a0 con 0x7f2d380cd660 2023-06-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.143+0000 7f2d37fff700 1 --2- 172.21.15.136:0/2297804890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d38160a50 0x7f2d380d0bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009dc0 tx=0x7f2d3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cc520d4f0c93e34 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.143+0000 7f2d367fc700 1 -- 172.21.15.136:0/2297804890 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000e070 con 0x7f2d38160a50 2023-06-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.143+0000 7f2d367fc700 1 -- 172.21.15.136:0/2297804890 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3000bae0 con 0x7f2d38160a50 2023-06-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.143+0000 7f2d367fc700 1 -- 172.21.15.136:0/2297804890 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000be90 con 0x7f2d38160a50 2023-06-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.144+0000 7f2d3dbff700 1 -- 172.21.15.136:0/2297804890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d38160a50 msgr2=0x7f2d380d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.144+0000 7f2d3dbff700 1 --2- 172.21.15.136:0/2297804890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d38160a50 0x7f2d380d0bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009dc0 tx=0x7f2d3000b330 comp rx=0 tx=0).stop 2023-06-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.144+0000 7f2d3dbff700 1 -- 172.21.15.136:0/2297804890 shutdown_connections 2023-06-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.144+0000 7f2d3dbff700 1 --2- 172.21.15.136:0/2297804890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d38160a50 0x7f2d380d0bb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.144+0000 7f2d3dbff700 1 --2- 172.21.15.136:0/2297804890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.144+0000 7f2d3dbff700 1 -- 172.21.15.136:0/2297804890 >> 172.21.15.136:0/2297804890 conn(0x7f2d38071620 msgr2=0x7f2d380719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.144+0000 7f2d3dbff700 1 -- 172.21.15.136:0/2297804890 shutdown_connections 2023-06-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.144+0000 7f2d3dbff700 1 -- 172.21.15.136:0/2297804890 wait complete. 2023-06-23T19:02:16.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.145+0000 7f2d3dbff700 1 Processor -- start 2023-06-23T19:02:16.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.146+0000 7f2d3dbff700 1 -- start start 2023-06-23T19:02:16.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.146+0000 7f2d3dbff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d380cd660 0x7f2d380c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d3dbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d3dbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d38160a50 0x7f2d380b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d3dbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c6b40 con 0x7f2d38160a50 2023-06-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d3dbff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380ca0e0 con 0x7f2d380cd660 2023-06-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d3dbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c6d70 con 0x7f2d3815c570 2023-06-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d37fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d38160a50 0x7f2d380b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d37fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d38160a50 0x7f2d380b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59244/0 (socket says 172.21.15.136:59244) 2023-06-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d37fff700 1 -- 172.21.15.136:0/3685384638 learned_addr learned my addr 172.21.15.136:0/3685384638 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d377fe700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d380cd660 0x7f2d380c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d36ffd700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d37fff700 1 -- 172.21.15.136:0/3685384638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 msgr2=0x7f2d380c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d37fff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d37fff700 1 -- 172.21.15.136:0/3685384638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d380cd660 msgr2=0x7f2d380c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d37fff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d380cd660 0x7f2d380c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.147+0000 7f2d37fff700 1 -- 172.21.15.136:0/3685384638 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28009550 con 0x7f2d38160a50 2023-06-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.148+0000 7f2d37fff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d38160a50 0x7f2d380b3610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2d30014040 tx=0x7f2d30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.148+0000 7f2d1ffff700 1 -- 172.21.15.136:0/3685384638 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30004610 con 0x7f2d38160a50 2023-06-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.148+0000 7f2d1ffff700 1 -- 172.21.15.136:0/3685384638 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30020070 con 0x7f2d38160a50 2023-06-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.148+0000 7f2d1ffff700 1 -- 172.21.15.136:0/3685384638 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30027480 con 0x7f2d38160a50 2023-06-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.148+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d30009a70 con 0x7f2d38160a50 2023-06-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.148+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d380c7330 con 0x7f2d38160a50 2023-06-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.149+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d380ca290 con 0x7f2d38160a50 2023-06-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.150+0000 7f2d1ffff700 1 -- 172.21.15.136:0/3685384638 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d30012430 con 0x7f2d38160a50 2023-06-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.151+0000 7f2d1ffff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d2406ace0 0x7f2d2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.151+0000 7f2d1ffff700 1 -- 172.21.15.136:0/3685384638 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2d30022070 con 0x7f2d38160a50 2023-06-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.151+0000 7f2d377fe700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d2406ace0 0x7f2d2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.152+0000 7f2d377fe700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d2406ace0 0x7f2d2406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d380b7c10 tx=0x7f2d28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:16.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.155+0000 7f2d1ffff700 1 -- 172.21.15.136:0/3685384638 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d380ca290 con 0x7f2d38160a50 2023-06-23T19:02:16.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.365+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2d380c7540 con 0x7f2d38160a50 2023-06-23T19:02:16.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.366+0000 7f2d1ffff700 1 -- 172.21.15.136:0/3685384638 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2d30059d60 con 0x7f2d38160a50 2023-06-23T19:02:16.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d2406ace0 msgr2=0x7f2d2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:16.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d2406ace0 0x7f2d2406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d380b7c10 tx=0x7f2d28008040 comp rx=0 tx=0).stop 2023-06-23T19:02:16.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d38160a50 msgr2=0x7f2d380b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:16.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d38160a50 0x7f2d380b3610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2d30014040 tx=0x7f2d30004ad0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 shutdown_connections 2023-06-23T19:02:16.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d2406ace0 0x7f2d2406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d380cd660 0x7f2d380c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d38160a50 0x7f2d380b3610 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 --2- 172.21.15.136:0/3685384638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d3815c570 0x7f2d380c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 >> 172.21.15.136:0/3685384638 conn(0x7f2d38071620 msgr2=0x7f2d380d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:16.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 shutdown_connections 2023-06-23T19:02:16.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.368+0000 7f2d3dbff700 1 -- 172.21.15.136:0/3685384638 wait complete. 2023-06-23T19:02:16.374 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2023-06-23T19:02:16.391 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-06-23T19:02:16.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:16.392 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-06-23T19:02:16.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2023-06-23T19:02:16.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:16.482 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-23T19:02:16.548 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:02:16.549 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:16.592 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:02:16.593 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:16.674 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:02:16.675 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:16.756 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:16.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.985+0000 7f2a36dff700 1 Processor -- start 2023-06-23T19:02:16.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.985+0000 7f2a36dff700 1 -- start start 2023-06-23T19:02:16.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.986+0000 7f2a36dff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2a3015c570 0x7f2a300cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.986+0000 7f2a36dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a30160e70 con 0x7f2a300cd660 2023-06-23T19:02:16.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.986+0000 7f2a36dff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a301610a0 con 0x7f2a30160a50 2023-06-23T19:02:16.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.986+0000 7f2a36dff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3015d670 con 0x7f2a3015c570 2023-06-23T19:02:16.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2ffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2a300cd660 0x7f2a30160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46804/0 (socket says 172.21.15.136:46804) 2023-06-23T19:02:16.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2ffff700 1 -- 172.21.15.136:0/619097060 learned_addr learned my addr 172.21.15.136:0/619097060 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:16.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a34b9b700 1 --2- 172.21.15.136:0/619097060 >> v2:172.21.15.178:3300/0 conn(0x7f2a3015c570 0x7f2a300cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857091653 0 0) 0x7f2a30160e70 con 0x7f2a300cd660 2023-06-23T19:02:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a200035b0 con 0x7f2a300cd660 2023-06-23T19:02:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1161557721 0 0) 0x7f2a200035b0 con 0x7f2a300cd660 2023-06-23T19:02:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 >> v2:172.21.15.178:3300/0 conn(0x7f2a3015c570 msgr2=0x7f2a300cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2f7fe700 1 --2- 172.21.15.136:0/619097060 >> v2:172.21.15.178:3300/0 conn(0x7f2a3015c570 0x7f2a300cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 >> v1:172.21.15.178:6789/0 conn(0x7f2a30160a50 legacy=0x7f2a300d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3015da90 con 0x7f2a300cd660 2023-06-23T19:02:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.987+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7f2a1c001670 con 0x7f2a300cd660 2023-06-23T19:02:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 >> v1:172.21.15.136:6789/0 conn(0x7f2a300cd660 legacy=0x7f2a30160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2f7fe700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a20003a50 0x7f2a20003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2f7fe700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a20004850 0x7f2a20004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2f7fe700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a20005200 0x7f2a2000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3015d670 con 0x7f2a20004850 2023-06-23T19:02:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2000c0e0 con 0x7f2a20003a50 2023-06-23T19:02:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2000c2a0 con 0x7f2a20005200 2023-06-23T19:02:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2ffff700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a20004850 0x7f2a20004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a34b9b700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a20003a50 0x7f2a20003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a3539c700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a20005200 0x7f2a2000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2ffff700 1 -- 172.21.15.136:0/619097060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a20005200 msgr2=0x7f2a2000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2ffff700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a20005200 0x7f2a2000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2ffff700 1 -- 172.21.15.136:0/619097060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a20003a50 msgr2=0x7f2a20003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2ffff700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a20003a50 0x7f2a20003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2ffff700 1 -- 172.21.15.136:0/619097060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200035b0 con 0x7f2a20004850 2023-06-23T19:02:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a3539c700 1 -- 172.21.15.136:0/619097060 reap_dead start 2023-06-23T19:02:17.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.988+0000 7f2a2ffff700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a20004850 0x7f2a20004cc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c001eb0 tx=0x7f2a20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bae1c5fd8ffc6a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:17.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c007b70 con 0x7f2a20004850 2023-06-23T19:02:17.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00ccb0 con 0x7f2a20004850 2023-06-23T19:02:17.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a2f7fe700 1 -- 172.21.15.136:0/619097060 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c005ba0 con 0x7f2a20004850 2023-06-23T19:02:17.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a36dff700 1 -- 172.21.15.136:0/619097060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a20004850 msgr2=0x7f2a20004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a36dff700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a20004850 0x7f2a20004cc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c001eb0 tx=0x7f2a20005880 comp rx=0 tx=0).stop 2023-06-23T19:02:17.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a36dff700 1 -- 172.21.15.136:0/619097060 shutdown_connections 2023-06-23T19:02:17.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a36dff700 1 --2- 172.21.15.136:0/619097060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a20004850 0x7f2a20004cc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a36dff700 1 -- 172.21.15.136:0/619097060 >> 172.21.15.136:0/619097060 conn(0x7f2a30071620 msgr2=0x7f2a300719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:17.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a36dff700 1 -- 172.21.15.136:0/619097060 shutdown_connections 2023-06-23T19:02:17.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.989+0000 7f2a36dff700 1 -- 172.21.15.136:0/619097060 wait complete. 2023-06-23T19:02:17.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.991+0000 7f2a36dff700 1 Processor -- start 2023-06-23T19:02:17.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.991+0000 7f2a36dff700 1 -- start start 2023-06-23T19:02:17.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.992+0000 7f2a36dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a20004850 0x7f2a300b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.992+0000 7f2a36dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a300cb2d0 0x7f2a300cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.992+0000 7f2a36dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a301f2010 0x7f2a301f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.992+0000 7f2a36dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300cca80 con 0x7f2a300cb2d0 2023-06-23T19:02:17.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.992+0000 7f2a36dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300caa00 con 0x7f2a301f2010 2023-06-23T19:02:17.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.992+0000 7f2a36dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300c9ba0 con 0x7f2a20004850 2023-06-23T19:02:17.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a300cb2d0 0x7f2a300cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a300cb2d0 0x7f2a300cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59264/0 (socket says 172.21.15.136:59264) 2023-06-23T19:02:17.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2ffff700 1 -- 172.21.15.136:0/1960273126 learned_addr learned my addr 172.21.15.136:0/1960273126 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:17.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a3539c700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a301f2010 0x7f2a301f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a34b9b700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a20004850 0x7f2a300b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2ffff700 1 -- 172.21.15.136:0/1960273126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a20004850 msgr2=0x7f2a300b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2ffff700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a20004850 0x7f2a300b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2ffff700 1 -- 172.21.15.136:0/1960273126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a301f2010 msgr2=0x7f2a301f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2ffff700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a301f2010 0x7f2a301f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2ffff700 1 -- 172.21.15.136:0/1960273126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a300c9e80 con 0x7f2a300cb2d0 2023-06-23T19:02:17.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2ffff700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a300cb2d0 0x7f2a300cb740 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c720 tx=0x7f2a1c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:17.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2d7fa700 1 -- 172.21.15.136:0/1960273126 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c007b70 con 0x7f2a300cb2d0 2023-06-23T19:02:17.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2d7fa700 1 -- 172.21.15.136:0/1960273126 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c004ca0 con 0x7f2a300cb2d0 2023-06-23T19:02:17.009 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a2d7fa700 1 -- 172.21.15.136:0/1960273126 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c007310 con 0x7f2a300cb2d0 2023-06-23T19:02:17.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.993+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a300ca160 con 0x7f2a300cb2d0 2023-06-23T19:02:17.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.994+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a300ca720 con 0x7f2a300cb2d0 2023-06-23T19:02:17.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.995+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a30073910 con 0x7f2a300cb2d0 2023-06-23T19:02:17.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.995+0000 7f2a2d7fa700 1 -- 172.21.15.136:0/1960273126 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a1c007470 con 0x7f2a300cb2d0 2023-06-23T19:02:17.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.997+0000 7f2a2d7fa700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2a1406ad10 0x7f2a1406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.997+0000 7f2a2d7fa700 1 -- 172.21.15.136:0/1960273126 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2a1c08a390 con 0x7f2a300cb2d0 2023-06-23T19:02:17.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.997+0000 7f2a34b9b700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2a1406ad10 0x7f2a1406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:16.998+0000 7f2a34b9b700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2a1406ad10 0x7f2a1406d1c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a3004fa50 tx=0x7f2a24009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:17.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.001+0000 7f2a2d7fa700 1 -- 172.21.15.136:0/1960273126 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a1c055100 con 0x7f2a300cb2d0 2023-06-23T19:02:17.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.201+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a300b5360 con 0x7f2a300cb2d0 2023-06-23T19:02:17.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.202+0000 7f2a2d7fa700 1 -- 172.21.15.136:0/1960273126 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f2a1c058720 con 0x7f2a300cb2d0 2023-06-23T19:02:17.206 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:17.206 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:17.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.204+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2a1406ad10 msgr2=0x7f2a1406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.204+0000 7f2a36dff700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2a1406ad10 0x7f2a1406d1c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a3004fa50 tx=0x7f2a24009210 comp rx=0 tx=0).stop 2023-06-23T19:02:17.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.204+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a300cb2d0 msgr2=0x7f2a300cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.204+0000 7f2a36dff700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a300cb2d0 0x7f2a300cb740 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c720 tx=0x7f2a1c001930 comp rx=0 tx=0).stop 2023-06-23T19:02:17.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.205+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 shutdown_connections 2023-06-23T19:02:17.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.205+0000 7f2a36dff700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2a1406ad10 0x7f2a1406d1c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.205+0000 7f2a36dff700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a301f2010 0x7f2a301f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.205+0000 7f2a36dff700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a20004850 0x7f2a300b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.205+0000 7f2a36dff700 1 --2- 172.21.15.136:0/1960273126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a300cb2d0 0x7f2a300cb740 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.205+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 >> 172.21.15.136:0/1960273126 conn(0x7f2a30071620 msgr2=0x7f2a3015dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:17.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.205+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 shutdown_connections 2023-06-23T19:02:17.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.205+0000 7f2a36dff700 1 -- 172.21.15.136:0/1960273126 wait complete. 2023-06-23T19:02:17.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:02:17.229 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.421+0000 7f023a5ff700 1 Processor -- start 2023-06-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.421+0000 7f023a5ff700 1 -- start start 2023-06-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.423+0000 7f023a5ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f02340b51d0 0x7f02340cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.423+0000 7f023a5ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02340b5ec0 con 0x7f02340d0a60 2023-06-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.423+0000 7f023a5ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02340cd9d0 con 0x7f02340b5a70 2023-06-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.423+0000 7f023a5ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02340d0060 con 0x7f02340b51d0 2023-06-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.423+0000 7f0233fff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f02340d0a60 0x7f02340d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46816/0 (socket says 172.21.15.136:46816) 2023-06-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.423+0000 7f0233fff700 1 -- 172.21.15.136:0/3429713962 learned_addr learned my addr 172.21.15.136:0/3429713962 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.423+0000 7f0238b9c700 1 --2- 172.21.15.136:0/3429713962 >> v2:172.21.15.136:3300/0 conn(0x7f02340b51d0 0x7f02340cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.424+0000 7f0238b9c700 1 -- 172.21.15.136:0/3429713962 >> v1:172.21.15.178:6789/0 conn(0x7f02340b5a70 legacy=0x7f02340d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.424+0000 7f0238b9c700 1 -- 172.21.15.136:0/3429713962 >> v1:172.21.15.136:6789/0 conn(0x7f02340d0a60 legacy=0x7f02340d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.424+0000 7f0232ffd700 1 -- 172.21.15.136:0/3429713962 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489385060 0 0) 0x7f02340b5ec0 con 0x7f02340d0a60 2023-06-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.424+0000 7f0238b9c700 1 -- 172.21.15.136:0/3429713962 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340b5610 con 0x7f02340b51d0 2023-06-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.424+0000 7f0238b9c700 1 --2- 172.21.15.136:0/3429713962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b51d0 0x7f02340cf910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f022c009d90 tx=0x7f022c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469e6335768e5d00 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.424+0000 7f0232ffd700 1 -- 172.21.15.136:0/3429713962 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c00e070 con 0x7f02340b51d0 2023-06-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.424+0000 7f0232ffd700 1 -- 172.21.15.136:0/3429713962 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c00bbd0 con 0x7f02340b51d0 2023-06-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.424+0000 7f0232ffd700 1 -- 172.21.15.136:0/3429713962 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c012430 con 0x7f02340b51d0 2023-06-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.425+0000 7f023a5ff700 1 -- 172.21.15.136:0/3429713962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b51d0 msgr2=0x7f02340cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.425+0000 7f023a5ff700 1 --2- 172.21.15.136:0/3429713962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b51d0 0x7f02340cf910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f022c009d90 tx=0x7f022c00b330 comp rx=0 tx=0).stop 2023-06-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.425+0000 7f023a5ff700 1 -- 172.21.15.136:0/3429713962 shutdown_connections 2023-06-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.425+0000 7f023a5ff700 1 --2- 172.21.15.136:0/3429713962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b51d0 0x7f02340cf910 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.425+0000 7f023a5ff700 1 -- 172.21.15.136:0/3429713962 >> 172.21.15.136:0/3429713962 conn(0x7f0234071620 msgr2=0x7f02340719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.425+0000 7f023a5ff700 1 -- 172.21.15.136:0/3429713962 shutdown_connections 2023-06-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.425+0000 7f023a5ff700 1 -- 172.21.15.136:0/3429713962 wait complete. 2023-06-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.427+0000 7f023a5ff700 1 Processor -- start 2023-06-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.427+0000 7f023a5ff700 1 -- start start 2023-06-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f023a5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02340b51d0 0x7f023415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f023a5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b5a70 0x7f023415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f023a5ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02340d0a60 0x7f02340cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f023a5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02340ccb80 con 0x7f02340b5a70 2023-06-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f023a5ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023415ac40 con 0x7f02340d0a60 2023-06-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f023a5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023415a960 con 0x7f02340b51d0 2023-06-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f02337fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b5a70 0x7f023415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f02337fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b5a70 0x7f023415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59284/0 (socket says 172.21.15.136:59284) 2023-06-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f02337fe700 1 -- 172.21.15.136:0/2205461374 learned_addr learned my addr 172.21.15.136:0/2205461374 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f0233fff700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02340b51d0 0x7f023415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f0238b9c700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02340d0a60 0x7f02340cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f02337fe700 1 -- 172.21.15.136:0/2205461374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02340b51d0 msgr2=0x7f023415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f02337fe700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02340b51d0 0x7f023415d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f02337fe700 1 -- 172.21.15.136:0/2205461374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02340d0a60 msgr2=0x7f02340cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f02337fe700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02340d0a60 0x7f02340cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.429+0000 7f02337fe700 1 -- 172.21.15.136:0/2205461374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c009a70 con 0x7f02340b5a70 2023-06-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.430+0000 7f02337fe700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b5a70 0x7f023415a2a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f022800c4e0 tx=0x7f022800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.430+0000 7f0230ff9700 1 -- 172.21.15.136:0/2205461374 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280052d0 con 0x7f02340b5a70 2023-06-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.430+0000 7f0230ff9700 1 -- 172.21.15.136:0/2205461374 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0228005430 con 0x7f02340b5a70 2023-06-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.430+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02340c9e20 con 0x7f02340b5a70 2023-06-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.430+0000 7f0230ff9700 1 -- 172.21.15.136:0/2205461374 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280038c0 con 0x7f02340b5a70 2023-06-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.430+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02340ca3e0 con 0x7f02340b5a70 2023-06-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.431+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023404ea20 con 0x7f02340b5a70 2023-06-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.432+0000 7f0230ff9700 1 -- 172.21.15.136:0/2205461374 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0228003a20 con 0x7f02340b5a70 2023-06-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.433+0000 7f0230ff9700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f022006ace0 0x7f022006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.433+0000 7f0230ff9700 1 -- 172.21.15.136:0/2205461374 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0228088b60 con 0x7f02340b5a70 2023-06-23T19:02:17.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.433+0000 7f0233fff700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f022006ace0 0x7f022006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.440 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.434+0000 7f0233fff700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f022006ace0 0x7f022006d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0224000f60 tx=0x7f0224004a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:17.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.437+0000 7f0230ff9700 1 -- 172.21.15.136:0/2205461374 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f02280538d0 con 0x7f02340b5a70 2023-06-23T19:02:17.634 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.631+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02340b69a0 con 0x7f02340b5a70 2023-06-23T19:02:17.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.631+0000 7f0230ff9700 1 -- 172.21.15.136:0/2205461374 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0228056ef0 con 0x7f02340b5a70 2023-06-23T19:02:17.635 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:02:17.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f022006ace0 msgr2=0x7f022006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f022006ace0 0x7f022006d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0224000f60 tx=0x7f0224004a50 comp rx=0 tx=0).stop 2023-06-23T19:02:17.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b5a70 msgr2=0x7f023415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b5a70 0x7f023415a2a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f022800c4e0 tx=0x7f022800c7f0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 shutdown_connections 2023-06-23T19:02:17.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f022006ace0 0x7f022006d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02340d0a60 0x7f02340cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02340b51d0 0x7f023415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 --2- 172.21.15.136:0/2205461374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02340b5a70 0x7f023415a2a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.633+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 >> 172.21.15.136:0/2205461374 conn(0x7f0234071620 msgr2=0x7f02340b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:17.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.634+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 shutdown_connections 2023-06-23T19:02:17.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.634+0000 7f023a5ff700 1 -- 172.21.15.136:0/2205461374 wait complete. 2023-06-23T19:02:17.657 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.849+0000 7f5eb6dff700 1 Processor -- start 2023-06-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.850+0000 7f5eb6dff700 1 -- start start 2023-06-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb6dff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5eb00d0a60 0x7f5eb00b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb6dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb00cd9d0 con 0x7f5eb00cf910 2023-06-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb6dff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb00b5620 con 0x7f5eb00b51d0 2023-06-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb6dff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb00d0060 con 0x7f5eb00d0a60 2023-06-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb4b9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5eb00d0a60 0x7f5eb00b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb4b9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5eb00d0a60 0x7f5eb00b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59290/0 (socket says 172.21.15.136:59290) 2023-06-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb4b9b700 1 -- 172.21.15.136:0/2837461254 learned_addr learned my addr 172.21.15.136:0/2837461254 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb539c700 1 --1- 172.21.15.136:0/2837461254 >> v1:172.21.15.136:6789/0 conn(0x7f5eb00cf910 0x7f5eb00d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46818/0 (socket says 172.21.15.136:46818) 2023-06-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb4b9b700 1 -- 172.21.15.136:0/2837461254 >> v1:172.21.15.178:6789/0 conn(0x7f5eb00b51d0 legacy=0x7f5eb00d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb4b9b700 1 -- 172.21.15.136:0/2837461254 >> v1:172.21.15.136:6789/0 conn(0x7f5eb00cf910 legacy=0x7f5eb00d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eb4b9b700 1 -- 172.21.15.136:0/2837461254 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00cd410 con 0x7f5eb00d0a60 2023-06-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.851+0000 7f5eaf7fe700 1 -- 172.21.15.136:0/2837461254 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035246023 0 0) 0x7f5eb00cd9d0 con 0x7f5eb00cf910 2023-06-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.852+0000 7f5eb4b9b700 1 --2- 172.21.15.136:0/2837461254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00d0a60 0x7f5eb00b5a70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40098f0 tx=0x7f5ea4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41101d600de73e0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.852+0000 7f5eaf7fe700 1 -- 172.21.15.136:0/2837461254 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400b8a0 con 0x7f5eb00d0a60 2023-06-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.852+0000 7f5eaf7fe700 1 -- 172.21.15.136:0/2837461254 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea400ba00 con 0x7f5eb00d0a60 2023-06-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.852+0000 7f5eaf7fe700 1 -- 172.21.15.136:0/2837461254 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400bd90 con 0x7f5eb00d0a60 2023-06-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.852+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2837461254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00d0a60 msgr2=0x7f5eb00b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.852+0000 7f5eb6dff700 1 --2- 172.21.15.136:0/2837461254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00d0a60 0x7f5eb00b5a70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40098f0 tx=0x7f5ea4009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.852+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2837461254 shutdown_connections 2023-06-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.852+0000 7f5eb6dff700 1 --2- 172.21.15.136:0/2837461254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00d0a60 0x7f5eb00b5a70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.852+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2837461254 >> 172.21.15.136:0/2837461254 conn(0x7f5eb0071620 msgr2=0x7f5eb00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.853+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2837461254 shutdown_connections 2023-06-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.853+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2837461254 wait complete. 2023-06-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.854+0000 7f5eb6dff700 1 Processor -- start 2023-06-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.854+0000 7f5eb6dff700 1 -- start start 2023-06-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.855+0000 7f5eb6dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00b51d0 0x7f5eb00b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.855+0000 7f5eb6dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5eb00cf910 0x7f5eb015e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.855+0000 7f5eb6dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5eb00d0a60 0x7f5eb0152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.855+0000 7f5eb6dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb015d770 con 0x7f5eb00b51d0 2023-06-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.855+0000 7f5eb6dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb015c950 con 0x7f5eb00cf910 2023-06-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.855+0000 7f5eb6dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0157020 con 0x7f5eb00d0a60 2023-06-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb4b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00b51d0 0x7f5eb00b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb4b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00b51d0 0x7f5eb00b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59296/0 (socket says 172.21.15.136:59296) 2023-06-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb4b9b700 1 -- 172.21.15.136:0/2060183463 learned_addr learned my addr 172.21.15.136:0/2060183463 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eaffff700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5eb00cf910 0x7f5eb015e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb539c700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5eb00d0a60 0x7f5eb0152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb4b9b700 1 -- 172.21.15.136:0/2060183463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5eb00d0a60 msgr2=0x7f5eb0152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb4b9b700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5eb00d0a60 0x7f5eb0152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb4b9b700 1 -- 172.21.15.136:0/2060183463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5eb00cf910 msgr2=0x7f5eb015e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb4b9b700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5eb00cf910 0x7f5eb015e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb4b9b700 1 -- 172.21.15.136:0/2060183463 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4009550 con 0x7f5eb00b51d0 2023-06-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5eb4b9b700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00b51d0 0x7f5eb00b7480 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4014040 tx=0x7f5ea4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.856+0000 7f5ead7fa700 1 -- 172.21.15.136:0/2060183463 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40038a0 con 0x7f5eb00b51d0 2023-06-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.857+0000 7f5ead7fa700 1 -- 172.21.15.136:0/2060183463 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea401e070 con 0x7f5eb00b51d0 2023-06-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.857+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb015cbf0 con 0x7f5eb00b51d0 2023-06-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.857+0000 7f5ead7fa700 1 -- 172.21.15.136:0/2060183463 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4003c20 con 0x7f5eb00b51d0 2023-06-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.857+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb015d1b0 con 0x7f5eb00b51d0 2023-06-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.858+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb004ea20 con 0x7f5eb00b51d0 2023-06-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.859+0000 7f5ead7fa700 1 -- 172.21.15.136:0/2060183463 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ea4011420 con 0x7f5eb00b51d0 2023-06-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.860+0000 7f5ead7fa700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e9406ace0 0x7f5e9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.860+0000 7f5ead7fa700 1 -- 172.21.15.136:0/2060183463 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ea4020070 con 0x7f5eb00b51d0 2023-06-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.860+0000 7f5eaffff700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e9406ace0 0x7f5e9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.861+0000 7f5eaffff700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e9406ace0 0x7f5e9406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00b88c0 tx=0x7f5e9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:17.864+0000 7f5ead7fa700 1 -- 172.21.15.136:0/2060183463 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5ea4055ba0 con 0x7f5eb00b51d0 2023-06-23T19:02:18.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.059+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5eb00b19e0 con 0x7f5eb00b51d0 2023-06-23T19:02:18.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.060+0000 7f5ead7fa700 1 -- 172.21.15.136:0/2060183463 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ea40591c0 con 0x7f5eb00b51d0 2023-06-23T19:02:18.066 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:02:18.066 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e9406ace0 msgr2=0x7f5e9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.066 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e9406ace0 0x7f5e9406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00b88c0 tx=0x7f5e9c009040 comp rx=0 tx=0).stop 2023-06-23T19:02:18.067 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00b51d0 msgr2=0x7f5eb00b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.067 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00b51d0 0x7f5eb00b7480 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4014040 tx=0x7f5ea4004750 comp rx=0 tx=0).stop 2023-06-23T19:02:18.067 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 shutdown_connections 2023-06-23T19:02:18.067 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e9406ace0 0x7f5e9406d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5eb00d0a60 0x7f5eb0152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5eb00b51d0 0x7f5eb00b7480 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 --2- 172.21.15.136:0/2060183463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5eb00cf910 0x7f5eb015e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 >> 172.21.15.136:0/2060183463 conn(0x7f5eb0071620 msgr2=0x7f5eb00b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:18.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 shutdown_connections 2023-06-23T19:02:18.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.062+0000 7f5eb6dff700 1 -- 172.21.15.136:0/2060183463 wait complete. 2023-06-23T19:02:18.086 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:02:18.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.278+0000 7fb49f1ff700 1 Processor -- start 2023-06-23T19:02:18.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.278+0000 7fb49f1ff700 1 -- start start 2023-06-23T19:02:18.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49f1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb49815a5a0 0x7fb4980b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49f1ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb4980709f0 0x7fb49806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49f1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49806d130 con 0x7fb4980b2b40 2023-06-23T19:02:18.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49f1ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980cf6a0 con 0x7fb4980709f0 2023-06-23T19:02:18.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49f1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49806c520 con 0x7fb49815a5a0 2023-06-23T19:02:18.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49d79c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb4980709f0 0x7fb49806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49d79c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb4980709f0 0x7fb49806d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59308/0 (socket says 172.21.15.136:59308) 2023-06-23T19:02:18.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49d79c700 1 -- 172.21.15.136:0/460728019 learned_addr learned my addr 172.21.15.136:0/460728019 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:18.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49cf9b700 1 --2- 172.21.15.136:0/460728019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb49815a5a0 0x7fb4980b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49d79c700 1 -- 172.21.15.136:0/460728019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb49815a5a0 msgr2=0x7fb4980b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:18.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49d79c700 1 --2- 172.21.15.136:0/460728019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb49815a5a0 0x7fb4980b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49d79c700 1 -- 172.21.15.136:0/460728019 >> v1:172.21.15.178:6789/0 conn(0x7fb4980b2b40 legacy=0x7fb4980702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:18.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49d79c700 1 -- 172.21.15.136:0/460728019 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49806c800 con 0x7fb4980709f0 2023-06-23T19:02:18.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.280+0000 7fb49cf9b700 1 --2- 172.21.15.136:0/460728019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb49815a5a0 0x7fb4980b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:18.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb49d79c700 1 --2- 172.21.15.136:0/460728019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980709f0 0x7fb49806d5c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb490009e50 tx=0x7fb49000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ebd90934401073 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:18.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb4977fe700 1 -- 172.21.15.136:0/460728019 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000e070 con 0x7fb4980709f0 2023-06-23T19:02:18.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb4977fe700 1 -- 172.21.15.136:0/460728019 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490003a20 con 0x7fb4980709f0 2023-06-23T19:02:18.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb4977fe700 1 -- 172.21.15.136:0/460728019 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490003dd0 con 0x7fb4980709f0 2023-06-23T19:02:18.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb49f1ff700 1 -- 172.21.15.136:0/460728019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980709f0 msgr2=0x7fb49806d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb49f1ff700 1 --2- 172.21.15.136:0/460728019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980709f0 0x7fb49806d5c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb490009e50 tx=0x7fb49000b330 comp rx=0 tx=0).stop 2023-06-23T19:02:18.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb49f1ff700 1 -- 172.21.15.136:0/460728019 shutdown_connections 2023-06-23T19:02:18.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb49f1ff700 1 --2- 172.21.15.136:0/460728019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980709f0 0x7fb49806d5c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb49f1ff700 1 --2- 172.21.15.136:0/460728019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb49815a5a0 0x7fb4980b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb49f1ff700 1 -- 172.21.15.136:0/460728019 >> 172.21.15.136:0/460728019 conn(0x7fb49806ab80 msgr2=0x7fb4980ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:18.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.281+0000 7fb49f1ff700 1 -- 172.21.15.136:0/460728019 shutdown_connections 2023-06-23T19:02:18.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.282+0000 7fb49f1ff700 1 -- 172.21.15.136:0/460728019 wait complete. 2023-06-23T19:02:18.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.284+0000 7fb49f1ff700 1 Processor -- start 2023-06-23T19:02:18.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.284+0000 7fb49f1ff700 1 -- start start 2023-06-23T19:02:18.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.285+0000 7fb49f1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4980709f0 0x7fb49814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.285+0000 7fb49f1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980b2b40 0x7fb4980ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.285+0000 7fb49f1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb49815a5a0 0x7fb4980c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.285+0000 7fb49f1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980ca870 con 0x7fb4980b2b40 2023-06-23T19:02:18.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.285+0000 7fb49f1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49815b9c0 con 0x7fb49815a5a0 2023-06-23T19:02:18.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.285+0000 7fb49f1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49815bca0 con 0x7fb4980709f0 2023-06-23T19:02:18.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.285+0000 7fb497fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980b2b40 0x7fb4980ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb497fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980b2b40 0x7fb4980ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59322/0 (socket says 172.21.15.136:59322) 2023-06-23T19:02:18.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb497fff700 1 -- 172.21.15.136:0/3714209867 learned_addr learned my addr 172.21.15.136:0/3714209867 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:18.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb49cf9b700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4980709f0 0x7fb49814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb49d79c700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb49815a5a0 0x7fb4980c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb497fff700 1 -- 172.21.15.136:0/3714209867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4980709f0 msgr2=0x7fb49814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb497fff700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4980709f0 0x7fb49814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb497fff700 1 -- 172.21.15.136:0/3714209867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb49815a5a0 msgr2=0x7fb4980c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb497fff700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb49815a5a0 0x7fb4980c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb497fff700 1 -- 172.21.15.136:0/3714209867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490009b30 con 0x7fb4980b2b40 2023-06-23T19:02:18.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb497fff700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980b2b40 0x7fb4980ca020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c4d0 tx=0x7fb48400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:18.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb4957fa700 1 -- 172.21.15.136:0/3714209867 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484011790 con 0x7fb4980b2b40 2023-06-23T19:02:18.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb4957fa700 1 -- 172.21.15.136:0/3714209867 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4840118f0 con 0x7fb4980b2b40 2023-06-23T19:02:18.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49815bf80 con 0x7fb4980b2b40 2023-06-23T19:02:18.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.286+0000 7fb4957fa700 1 -- 172.21.15.136:0/3714209867 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484011ca0 con 0x7fb4980b2b40 2023-06-23T19:02:18.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.287+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4980ca560 con 0x7fb4980b2b40 2023-06-23T19:02:18.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.288+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49804ea20 con 0x7fb4980b2b40 2023-06-23T19:02:18.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.288+0000 7fb4957fa700 1 -- 172.21.15.136:0/3714209867 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb48401c460 con 0x7fb4980b2b40 2023-06-23T19:02:18.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.289+0000 7fb4957fa700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb47c06ace0 0x7fb47c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.290+0000 7fb4957fa700 1 -- 172.21.15.136:0/3714209867 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb4840895c0 con 0x7fb4980b2b40 2023-06-23T19:02:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.290+0000 7fb49cf9b700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb47c06ace0 0x7fb47c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.290+0000 7fb49cf9b700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb47c06ace0 0x7fb47c06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb48c006fd0 tx=0x7fb48c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.293+0000 7fb4957fa700 1 -- 172.21.15.136:0/3714209867 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb484054210 con 0x7fb4980b2b40 2023-06-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.487+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4980c5530 con 0x7fb4980b2b40 2023-06-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.487+0000 7fb4957fa700 1 -- 172.21.15.136:0/3714209867 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb484057830 con 0x7fb4980b2b40 2023-06-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb47c06ace0 msgr2=0x7fb47c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb47c06ace0 0x7fb47c06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb48c006fd0 tx=0x7fb48c008040 comp rx=0 tx=0).stop 2023-06-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980b2b40 msgr2=0x7fb4980ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980b2b40 0x7fb4980ca020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c4d0 tx=0x7fb48400c7e0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 shutdown_connections 2023-06-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb47c06ace0 0x7fb47c06d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb49815a5a0 0x7fb4980c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4980709f0 0x7fb49814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 --2- 172.21.15.136:0/3714209867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4980b2b40 0x7fb4980ca020 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 >> 172.21.15.136:0/3714209867 conn(0x7fb49806ab80 msgr2=0x7fb498159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 shutdown_connections 2023-06-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.490+0000 7fb49f1ff700 1 -- 172.21.15.136:0/3714209867 wait complete. 2023-06-23T19:02:18.513 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:02:18.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.704+0000 7faee57ff700 1 Processor -- start 2023-06-23T19:02:18.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.704+0000 7faee57ff700 1 -- start start 2023-06-23T19:02:18.709 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faee57ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faee00b51d0 0x7faee00cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.709 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faee57ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00b5ec0 con 0x7faee00d0a60 2023-06-23T19:02:18.709 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faee57ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00cd9d0 con 0x7faee00b5a70 2023-06-23T19:02:18.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faee57ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee00d0060 con 0x7faee00b51d0 2023-06-23T19:02:18.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faedeffd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7faee00d0a60 0x7faee00d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46824/0 (socket says 172.21.15.136:46824) 2023-06-23T19:02:18.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faedeffd700 1 -- 172.21.15.136:0/154699476 learned_addr learned my addr 172.21.15.136:0/154699476 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:18.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287219692 0 0) 0x7faee00b5ec0 con 0x7faee00d0a60 2023-06-23T19:02:18.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faedf7fe700 1 --2- 172.21.15.136:0/154699476 >> v2:172.21.15.178:3300/0 conn(0x7faee00b51d0 0x7faee00cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faecc0035b0 con 0x7faee00d0a60 2023-06-23T19:02:18.712 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.706+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 953048492 0 0) 0x7faecc0035b0 con 0x7faee00d0a60 2023-06-23T19:02:18.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 >> v2:172.21.15.178:3300/0 conn(0x7faee00b51d0 msgr2=0x7faee00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:18.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 --2- 172.21.15.136:0/154699476 >> v2:172.21.15.178:3300/0 conn(0x7faee00b51d0 0x7faee00cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 >> v1:172.21.15.178:6789/0 conn(0x7faee00b5a70 legacy=0x7faee00d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00b5610 con 0x7faee00d0a60 2023-06-23T19:02:18.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7faed0001670 con 0x7faee00d0a60 2023-06-23T19:02:18.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 >> v1:172.21.15.136:6789/0 conn(0x7faee00d0a60 legacy=0x7faee00d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faecc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc004850 0x7faecc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc005200 0x7faecc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00d0060 con 0x7faecc003a00 2023-06-23T19:02:18.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00c080 con 0x7faecc004850 2023-06-23T19:02:18.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00c240 con 0x7faecc005200 2023-06-23T19:02:18.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faedeffd700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faecc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faed7fff700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc004850 0x7faecc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faedf7fe700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc005200 0x7faecc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faedeffd700 1 -- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc005200 msgr2=0x7faecc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:18.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faedeffd700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc005200 0x7faecc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faedeffd700 1 -- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc004850 msgr2=0x7faecc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:18.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faedeffd700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc004850 0x7faecc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faedeffd700 1 -- 172.21.15.136:0/154699476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0035b0 con 0x7faecc003a00 2023-06-23T19:02:18.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faed7fff700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc004850 0x7faecc004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:18.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faedf7fe700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc005200 0x7faecc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:18.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.707+0000 7faedf7fe700 1 -- 172.21.15.136:0/154699476 reap_dead start 2023-06-23T19:02:18.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.708+0000 7faedeffd700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faecc003e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faed000c2a0 tx=0x7faecc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade478fbadf66ac2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:18.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.708+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0007c10 con 0x7faecc003a00 2023-06-23T19:02:18.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.708+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000cde0 con 0x7faecc003a00 2023-06-23T19:02:18.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.708+0000 7faede7fc700 1 -- 172.21.15.136:0/154699476 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0005ba0 con 0x7faecc003a00 2023-06-23T19:02:18.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.708+0000 7faee57ff700 1 -- 172.21.15.136:0/154699476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 msgr2=0x7faecc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.708+0000 7faee57ff700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faecc003e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faed000c2a0 tx=0x7faecc005880 comp rx=0 tx=0).stop 2023-06-23T19:02:18.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.708+0000 7faee57ff700 1 -- 172.21.15.136:0/154699476 shutdown_connections 2023-06-23T19:02:18.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.708+0000 7faee57ff700 1 --2- 172.21.15.136:0/154699476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faecc003e10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.708+0000 7faee57ff700 1 -- 172.21.15.136:0/154699476 >> 172.21.15.136:0/154699476 conn(0x7faee0071620 msgr2=0x7faee00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:18.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.709+0000 7faee57ff700 1 -- 172.21.15.136:0/154699476 shutdown_connections 2023-06-23T19:02:18.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.709+0000 7faee57ff700 1 -- 172.21.15.136:0/154699476 wait complete. 2023-06-23T19:02:18.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.710+0000 7faee57ff700 1 Processor -- start 2023-06-23T19:02:18.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.710+0000 7faee57ff700 1 -- start start 2023-06-23T19:02:18.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.711+0000 7faee57ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faee01f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.711+0000 7faee57ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faee00c8f20 0x7faee01f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.711+0000 7faee57ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faee01f55f0 0x7faee00b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.711+0000 7faee57ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0150b70 con 0x7faecc003a00 2023-06-23T19:02:18.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.711+0000 7faee57ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00c8740 con 0x7faee01f55f0 2023-06-23T19:02:18.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.711+0000 7faee57ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee01f5b00 con 0x7faee00c8f20 2023-06-23T19:02:18.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedeffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faee01f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedeffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faee01f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59346/0 (socket says 172.21.15.136:59346) 2023-06-23T19:02:18.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedeffd700 1 -- 172.21.15.136:0/3400569615 learned_addr learned my addr 172.21.15.136:0/3400569615 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:18.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faed7fff700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faee00c8f20 0x7faee01f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedf7fe700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faee01f55f0 0x7faee00b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedeffd700 1 -- 172.21.15.136:0/3400569615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faee00c8f20 msgr2=0x7faee01f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedeffd700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faee00c8f20 0x7faee01f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedeffd700 1 -- 172.21.15.136:0/3400569615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faee01f55f0 msgr2=0x7faee00b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedeffd700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faee01f55f0 0x7faee00b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedeffd700 1 -- 172.21.15.136:0/3400569615 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee01f5de0 con 0x7faecc003a00 2023-06-23T19:02:18.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faedeffd700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faee01f1520 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faed0000c00 tx=0x7faee00cdb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:18.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.712+0000 7faed77fe700 1 -- 172.21.15.136:0/3400569615 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0004c80 con 0x7faecc003a00 2023-06-23T19:02:18.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.713+0000 7faed77fe700 1 -- 172.21.15.136:0/3400569615 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0004de0 con 0x7faecc003a00 2023-06-23T19:02:18.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.713+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee00c8a00 con 0x7faecc003a00 2023-06-23T19:02:18.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.713+0000 7faed77fe700 1 -- 172.21.15.136:0/3400569615 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00072d0 con 0x7faecc003a00 2023-06-23T19:02:18.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.713+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee00c9390 con 0x7faecc003a00 2023-06-23T19:02:18.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.714+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee004ea20 con 0x7faecc003a00 2023-06-23T19:02:18.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.715+0000 7faed77fe700 1 -- 172.21.15.136:0/3400569615 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faed0007430 con 0x7faecc003a00 2023-06-23T19:02:18.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.715+0000 7faed77fe700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7faec006ace0 0x7faec006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:18.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.715+0000 7faed77fe700 1 -- 172.21.15.136:0/3400569615 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faed0089ee0 con 0x7faecc003a00 2023-06-23T19:02:18.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.716+0000 7faed7fff700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7faec006ace0 0x7faec006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:18.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.716+0000 7faed7fff700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7faec006ace0 0x7faec006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faee015b020 tx=0x7faec8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:18.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.720+0000 7faed77fe700 1 -- 172.21.15.136:0/3400569615 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faed0054e10 con 0x7faecc003a00 2023-06-23T19:02:18.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.915+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faee00d2100 con 0x7faecc003a00 2023-06-23T19:02:18.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.915+0000 7faed77fe700 1 -- 172.21.15.136:0/3400569615 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7faed0007d70 con 0x7faecc003a00 2023-06-23T19:02:18.919 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:02:18.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7faec006ace0 msgr2=0x7faec006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7faec006ace0 0x7faec006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faee015b020 tx=0x7faec8009040 comp rx=0 tx=0).stop 2023-06-23T19:02:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 msgr2=0x7faee01f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faee01f1520 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faed0000c00 tx=0x7faee00cdb60 comp rx=0 tx=0).stop 2023-06-23T19:02:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 shutdown_connections 2023-06-23T19:02:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7faec006ace0 0x7faec006d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faee01f55f0 0x7faee00b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faecc003a00 0x7faee01f1520 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 --2- 172.21.15.136:0/3400569615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faee00c8f20 0x7faee01f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:18.923 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 >> 172.21.15.136:0/3400569615 conn(0x7faee0071620 msgr2=0x7faee00b8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:18.923 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 shutdown_connections 2023-06-23T19:02:18.923 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:18.918+0000 7faee57ff700 1 -- 172.21.15.136:0/3400569615 wait complete. 2023-06-23T19:02:18.940 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:02:19.138 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.134+0000 7f2186fff700 1 Processor -- start 2023-06-23T19:02:19.139 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.134+0000 7f2186fff700 1 -- start start 2023-06-23T19:02:19.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f2186fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800b51d0 0x7f21800cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f2186fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21800b5ec0 con 0x7f21800b5a70 2023-06-23T19:02:19.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f2186fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21800b5650 con 0x7f21800d0a60 2023-06-23T19:02:19.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f2186fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21800d0060 con 0x7f21800b51d0 2023-06-23T19:02:19.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f217ffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f21800b5a70 0x7f21800d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46832/0 (socket says 172.21.15.136:46832) 2023-06-23T19:02:19.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f217ffff700 1 -- 172.21.15.136:0/244415550 learned_addr learned my addr 172.21.15.136:0/244415550 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:19.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f218559c700 1 --2- 172.21.15.136:0/244415550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800b51d0 0x7f21800cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f217f7fe700 1 -- 172.21.15.136:0/244415550 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345318867 0 0) 0x7f21800b5ec0 con 0x7f21800b5a70 2023-06-23T19:02:19.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f217f7fe700 1 -- 172.21.15.136:0/244415550 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21700035b0 con 0x7f21800b5a70 2023-06-23T19:02:19.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f217f7fe700 1 -- 172.21.15.136:0/244415550 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365048295 0 0) 0x7f21800b5650 con 0x7f21800d0a60 2023-06-23T19:02:19.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.136+0000 7f217f7fe700 1 -- 172.21.15.136:0/244415550 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21800b5ec0 con 0x7f21800d0a60 2023-06-23T19:02:19.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.137+0000 7f217f7fe700 1 -- 172.21.15.136:0/244415550 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1479717636 0 0) 0x7f21700035b0 con 0x7f21800b5a70 2023-06-23T19:02:19.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.137+0000 7f218559c700 1 -- 172.21.15.136:0/244415550 >> v1:172.21.15.178:6789/0 conn(0x7f21800d0a60 legacy=0x7f21800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.137+0000 7f218559c700 1 -- 172.21.15.136:0/244415550 >> v1:172.21.15.136:6789/0 conn(0x7f21800b5a70 legacy=0x7f21800d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.137+0000 7f218559c700 1 -- 172.21.15.136:0/244415550 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21800cd9d0 con 0x7f21800b51d0 2023-06-23T19:02:19.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.137+0000 7f218559c700 1 --2- 172.21.15.136:0/244415550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800b51d0 0x7f21800cf910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2178009dc0 tx=0x7f217800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83c2595289e662b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:19.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.137+0000 7f217f7fe700 1 -- 172.21.15.136:0/244415550 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800e070 con 0x7f21800b51d0 2023-06-23T19:02:19.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.137+0000 7f217f7fe700 1 -- 172.21.15.136:0/244415550 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2178003a20 con 0x7f21800b51d0 2023-06-23T19:02:19.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.137+0000 7f217f7fe700 1 -- 172.21.15.136:0/244415550 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c001670 con 0x7f21800b51d0 2023-06-23T19:02:19.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.138+0000 7f2186fff700 1 -- 172.21.15.136:0/244415550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800b51d0 msgr2=0x7f21800cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.138+0000 7f2186fff700 1 --2- 172.21.15.136:0/244415550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800b51d0 0x7f21800cf910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2178009dc0 tx=0x7f217800b330 comp rx=0 tx=0).stop 2023-06-23T19:02:19.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.138+0000 7f2186fff700 1 -- 172.21.15.136:0/244415550 shutdown_connections 2023-06-23T19:02:19.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.138+0000 7f2186fff700 1 --2- 172.21.15.136:0/244415550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800b51d0 0x7f21800cf910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.138+0000 7f2186fff700 1 -- 172.21.15.136:0/244415550 >> 172.21.15.136:0/244415550 conn(0x7f2180071620 msgr2=0x7f21800719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:19.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.138+0000 7f2186fff700 1 -- 172.21.15.136:0/244415550 shutdown_connections 2023-06-23T19:02:19.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.138+0000 7f2186fff700 1 -- 172.21.15.136:0/244415550 wait complete. 2023-06-23T19:02:19.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.140+0000 7f2186fff700 1 Processor -- start 2023-06-23T19:02:19.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.140+0000 7f2186fff700 1 -- start start 2023-06-23T19:02:19.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f2186fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800b51d0 0x7f21800b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f2186fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21800b5a70 0x7f2180148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f2186fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800d0a60 0x7f2180149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f2186fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800c7390 con 0x7f21800b5a70 2023-06-23T19:02:19.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f2186fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800ca5b0 con 0x7f21800b51d0 2023-06-23T19:02:19.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f2186fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21800ca890 con 0x7f21800d0a60 2023-06-23T19:02:19.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f217ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21800b5a70 0x7f2180148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f217ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21800b5a70 0x7f2180148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59350/0 (socket says 172.21.15.136:59350) 2023-06-23T19:02:19.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f217ffff700 1 -- 172.21.15.136:0/2204184829 learned_addr learned my addr 172.21.15.136:0/2204184829 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:19.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f218559c700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800d0a60 0x7f2180149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f2184d9b700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800b51d0 0x7f21800b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f217ffff700 1 -- 172.21.15.136:0/2204184829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800d0a60 msgr2=0x7f2180149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f217ffff700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800d0a60 0x7f2180149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f217ffff700 1 -- 172.21.15.136:0/2204184829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800b51d0 msgr2=0x7f21800b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f217ffff700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800b51d0 0x7f21800b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f217ffff700 1 -- 172.21.15.136:0/2204184829 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2178009a70 con 0x7f21800b5a70 2023-06-23T19:02:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.141+0000 7f2184d9b700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800b51d0 0x7f21800b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.142+0000 7f217ffff700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21800b5a70 0x7f2180148de0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c750 tx=0x7f216c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.142+0000 7f217d7fa700 1 -- 172.21.15.136:0/2204184829 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c007560 con 0x7f21800b5a70 2023-06-23T19:02:19.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.142+0000 7f217d7fa700 1 -- 172.21.15.136:0/2204184829 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c0076c0 con 0x7f21800b5a70 2023-06-23T19:02:19.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.142+0000 7f217d7fa700 1 -- 172.21.15.136:0/2204184829 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c004ab0 con 0x7f21800b5a70 2023-06-23T19:02:19.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.142+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21800cab70 con 0x7f21800b5a70 2023-06-23T19:02:19.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.142+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21800b84c0 con 0x7f21800b5a70 2023-06-23T19:02:19.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.143+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21800cb090 con 0x7f21800b5a70 2023-06-23T19:02:19.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.144+0000 7f217d7fa700 1 -- 172.21.15.136:0/2204184829 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f216c004c10 con 0x7f21800b5a70 2023-06-23T19:02:19.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.146+0000 7f217d7fa700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f216406ace0 0x7f216406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.146+0000 7f217d7fa700 1 -- 172.21.15.136:0/2204184829 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f216c0888b0 con 0x7f21800b5a70 2023-06-23T19:02:19.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.146+0000 7f2184d9b700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f216406ace0 0x7f216406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.147+0000 7f2184d9b700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f216406ace0 0x7f216406d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f21740011e0 tx=0x7f2174009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:19.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.150+0000 7f217d7fa700 1 -- 172.21.15.136:0/2204184829 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f21800cb090 con 0x7f21800b5a70 2023-06-23T19:02:19.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.347+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f21800cb090 con 0x7f21800b5a70 2023-06-23T19:02:19.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.348+0000 7f217d7fa700 1 -- 172.21.15.136:0/2204184829 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f216c018020 con 0x7f21800b5a70 2023-06-23T19:02:19.352 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:19.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f216406ace0 msgr2=0x7f216406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f216406ace0 0x7f216406d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f21740011e0 tx=0x7f2174009040 comp rx=0 tx=0).stop 2023-06-23T19:02:19.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21800b5a70 msgr2=0x7f2180148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21800b5a70 0x7f2180148de0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c750 tx=0x7f216c00cb10 comp rx=0 tx=0).stop 2023-06-23T19:02:19.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 shutdown_connections 2023-06-23T19:02:19.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f216406ace0 0x7f216406d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800b51d0 0x7f21800b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800d0a60 0x7f2180149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 --2- 172.21.15.136:0/2204184829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21800b5a70 0x7f2180148de0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 >> 172.21.15.136:0/2204184829 conn(0x7f2180071620 msgr2=0x7f21800b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:19.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.350+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 shutdown_connections 2023-06-23T19:02:19.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.351+0000 7f2186fff700 1 -- 172.21.15.136:0/2204184829 wait complete. 2023-06-23T19:02:19.373 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T19:02:19.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.564+0000 7fbd14bff700 1 Processor -- start 2023-06-23T19:02:19.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.564+0000 7fbd14bff700 1 -- start start 2023-06-23T19:02:19.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.565+0000 7fbd14bff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbd1015c570 0x7fbd100cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.565+0000 7fbd14bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd10160e70 con 0x7fbd100cd660 2023-06-23T19:02:19.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.565+0000 7fbd14bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd101610a0 con 0x7fbd10160a50 2023-06-23T19:02:19.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.565+0000 7fbd14bff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1015d670 con 0x7fbd1015c570 2023-06-23T19:02:19.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.566+0000 7fbd0dd9b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fbd100cd660 0x7fbd10160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46834/0 (socket says 172.21.15.136:46834) 2023-06-23T19:02:19.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.566+0000 7fbd0dd9b700 1 -- 172.21.15.136:0/3025010224 learned_addr learned my addr 172.21.15.136:0/3025010224 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:19.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.566+0000 7fbd0e59c700 1 --2- 172.21.15.136:0/3025010224 >> v2:172.21.15.178:3300/0 conn(0x7fbd1015c570 0x7fbd100cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.566+0000 7fbd0d59a700 1 -- 172.21.15.136:0/3025010224 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284292878 0 0) 0x7fbd10160e70 con 0x7fbd100cd660 2023-06-23T19:02:19.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.566+0000 7fbd0d59a700 1 -- 172.21.15.136:0/3025010224 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf80035b0 con 0x7fbd100cd660 2023-06-23T19:02:19.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.566+0000 7fbd0e59c700 1 -- 172.21.15.136:0/3025010224 >> v1:172.21.15.178:6789/0 conn(0x7fbd10160a50 legacy=0x7fbd100d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.566+0000 7fbd0e59c700 1 -- 172.21.15.136:0/3025010224 >> v1:172.21.15.136:6789/0 conn(0x7fbd100cd660 legacy=0x7fbd10160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.566+0000 7fbd0d59a700 1 -- 172.21.15.136:0/3025010224 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077138400 0 0) 0x7fbcf80035b0 con 0x7fbd100cd660 2023-06-23T19:02:19.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.566+0000 7fbd0e59c700 1 -- 172.21.15.136:0/3025010224 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1015da90 con 0x7fbd1015c570 2023-06-23T19:02:19.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.567+0000 7fbd0e59c700 1 --2- 172.21.15.136:0/3025010224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1015c570 0x7fbd100cd120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009840 tx=0x7fbd00009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e075f1a4bcc2bf6d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:19.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.567+0000 7fbd0d59a700 1 -- 172.21.15.136:0/3025010224 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04001670 con 0x7fbd1015c570 2023-06-23T19:02:19.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.567+0000 7fbd0d59a700 1 -- 172.21.15.136:0/3025010224 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00004030 con 0x7fbd1015c570 2023-06-23T19:02:19.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.567+0000 7fbd0d59a700 1 -- 172.21.15.136:0/3025010224 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000043c0 con 0x7fbd1015c570 2023-06-23T19:02:19.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.567+0000 7fbd14bff700 1 -- 172.21.15.136:0/3025010224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1015c570 msgr2=0x7fbd100cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.567+0000 7fbd14bff700 1 --2- 172.21.15.136:0/3025010224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1015c570 0x7fbd100cd120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009840 tx=0x7fbd00009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:19.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.567+0000 7fbd14bff700 1 -- 172.21.15.136:0/3025010224 shutdown_connections 2023-06-23T19:02:19.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.567+0000 7fbd14bff700 1 --2- 172.21.15.136:0/3025010224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd1015c570 0x7fbd100cd120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.567+0000 7fbd14bff700 1 -- 172.21.15.136:0/3025010224 >> 172.21.15.136:0/3025010224 conn(0x7fbd10071620 msgr2=0x7fbd100719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:19.574 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.568+0000 7fbd14bff700 1 -- 172.21.15.136:0/3025010224 shutdown_connections 2023-06-23T19:02:19.575 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.568+0000 7fbd14bff700 1 -- 172.21.15.136:0/3025010224 wait complete. 2023-06-23T19:02:19.576 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.569+0000 7fbd14bff700 1 Processor -- start 2023-06-23T19:02:19.577 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.569+0000 7fbd14bff700 1 -- start start 2023-06-23T19:02:19.577 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.570+0000 7fbd14bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd100cd660 0x7fbd100c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.570+0000 7fbd14bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1015c570 0x7fbd101e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.570+0000 7fbd14bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd10160a50 0x7fbd1015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.570+0000 7fbd14bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd101e7180 con 0x7fbd1015c570 2023-06-23T19:02:19.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.570+0000 7fbd14bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd101e7b50 con 0x7fbd10160a50 2023-06-23T19:02:19.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.570+0000 7fbd14bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd101e8c10 con 0x7fbd100cd660 2023-06-23T19:02:19.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1015c570 0x7fbd101e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1015c570 0x7fbd101e7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59360/0 (socket says 172.21.15.136:59360) 2023-06-23T19:02:19.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0dd9b700 1 -- 172.21.15.136:0/1368228610 learned_addr learned my addr 172.21.15.136:0/1368228610 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:19.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0e59c700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd100cd660 0x7fbd100c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0ed9d700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd10160a50 0x7fbd1015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0dd9b700 1 -- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd100cd660 msgr2=0x7fbd100c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0dd9b700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd100cd660 0x7fbd100c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0dd9b700 1 -- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd10160a50 msgr2=0x7fbd1015a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0dd9b700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd10160a50 0x7fbd1015a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0dd9b700 1 -- 172.21.15.136:0/1368228610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd000094a0 con 0x7fbd1015c570 2023-06-23T19:02:19.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0ed9d700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd10160a50 0x7fbd1015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:19.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0e59c700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd100cd660 0x7fbd100c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:19.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbd0dd9b700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1015c570 0x7fbd101e7610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400c520 tx=0x7fbd0400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:19.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.571+0000 7fbcfeffd700 1 -- 172.21.15.136:0/1368228610 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04004c80 con 0x7fbd1015c570 2023-06-23T19:02:19.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.572+0000 7fbcfeffd700 1 -- 172.21.15.136:0/1368228610 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd04004e20 con 0x7fbd1015c570 2023-06-23T19:02:19.581 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.572+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd101e6b30 con 0x7fbd1015c570 2023-06-23T19:02:19.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.572+0000 7fbcfeffd700 1 -- 172.21.15.136:0/1368228610 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04007310 con 0x7fbd1015c570 2023-06-23T19:02:19.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.572+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1015a9b0 con 0x7fbd1015c570 2023-06-23T19:02:19.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.573+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd101e6990 con 0x7fbd1015c570 2023-06-23T19:02:19.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.574+0000 7fbcfeffd700 1 -- 172.21.15.136:0/1368228610 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd04007470 con 0x7fbd1015c570 2023-06-23T19:02:19.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.574+0000 7fbcfeffd700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:19.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.575+0000 7fbcfeffd700 1 -- 172.21.15.136:0/1368228610 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbd040895f0 con 0x7fbd1015c570 2023-06-23T19:02:19.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.575+0000 7fbd0e59c700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:19.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.575+0000 7fbd0e59c700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd000090b0 tx=0x7fbd00008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:19.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.579+0000 7fbcfeffd700 1 -- 172.21.15.136:0/1368228610 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd101e6990 con 0x7fbd1015c570 2023-06-23T19:02:19.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.786+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd101e6990 con 0x7fbd1015c570 2023-06-23T19:02:19.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.786+0000 7fbcfeffd700 1 -- 172.21.15.136:0/1368228610 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbd101e6990 con 0x7fbd1015c570 2023-06-23T19:02:19.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 msgr2=0x7fbcf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd000090b0 tx=0x7fbd00008030 comp rx=0 tx=0).stop 2023-06-23T19:02:19.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1015c570 msgr2=0x7fbd101e7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:19.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1015c570 0x7fbd101e7610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400c520 tx=0x7fbd0400c8e0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 shutdown_connections 2023-06-23T19:02:19.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fbcf006ace0 0x7fbcf006d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd10160a50 0x7fbd1015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd100cd660 0x7fbd100c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 --2- 172.21.15.136:0/1368228610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd1015c570 0x7fbd101e7610 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:19.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 >> 172.21.15.136:0/1368228610 conn(0x7fbd10071620 msgr2=0x7fbd100d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:19.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 shutdown_connections 2023-06-23T19:02:19.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:19.789+0000 7fbd14bff700 1 -- 172.21.15.136:0/1368228610 wait complete. 2023-06-23T19:02:19.794 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2023-06-23T19:02:19.810 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-06-23T19:02:19.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:19.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-06-23T19:02:19.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2023-06-23T19:02:19.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:19.895 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-23T19:02:19.938 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:02:19.938 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:19.985 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:02:19.986 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:20.071 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-23T19:02:20.071 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:20.155 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:20.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.344+0000 7fc3665ff700 1 Processor -- start 2023-06-23T19:02:20.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.344+0000 7fc3665ff700 1 -- start start 2023-06-23T19:02:20.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.345+0000 7fc3665ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc3600cd830 0x7fc360160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.345+0000 7fc3665ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc360160880 0x7fc3600d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.345+0000 7fc3665ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3601610a0 con 0x7fc36015c570 2023-06-23T19:02:20.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.345+0000 7fc3665ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36015d670 con 0x7fc3600cd830 2023-06-23T19:02:20.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.345+0000 7fc3665ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36015da90 con 0x7fc360160880 2023-06-23T19:02:20.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc364b9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc360160880 0x7fc3600d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc35f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc3600cd830 0x7fc360160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc364b9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc360160880 0x7fc3600d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:53340/0 (socket says 172.21.15.136:53340) 2023-06-23T19:02:20.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc364b9c700 1 -- 172.21.15.136:0/419940001 learned_addr learned my addr 172.21.15.136:0/419940001 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc35f7fe700 1 -- 172.21.15.136:0/419940001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc360160880 msgr2=0x7fc3600d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc35f7fe700 1 --2- 172.21.15.136:0/419940001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc360160880 0x7fc3600d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc35f7fe700 1 -- 172.21.15.136:0/419940001 >> v1:172.21.15.178:6789/0 conn(0x7fc36015c570 legacy=0x7fc3600cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc35f7fe700 1 -- 172.21.15.136:0/419940001 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36015ccd0 con 0x7fc3600cd830 2023-06-23T19:02:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc35effd700 1 -- 172.21.15.136:0/419940001 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076549577 0 0) 0x7fc3601610a0 con 0x7fc36015c570 2023-06-23T19:02:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.346+0000 7fc364b9c700 1 --2- 172.21.15.136:0/419940001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc360160880 0x7fc3600d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.347+0000 7fc35f7fe700 1 --2- 172.21.15.136:0/419940001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3600cd830 0x7fc360160340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc354009840 tx=0x7fc354009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2578e7d9b397fb1b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.347+0000 7fc35effd700 1 -- 172.21.15.136:0/419940001 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354011830 con 0x7fc3600cd830 2023-06-23T19:02:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.347+0000 7fc35effd700 1 -- 172.21.15.136:0/419940001 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354011990 con 0x7fc3600cd830 2023-06-23T19:02:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.347+0000 7fc35effd700 1 -- 172.21.15.136:0/419940001 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354011d20 con 0x7fc3600cd830 2023-06-23T19:02:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.347+0000 7fc3665ff700 1 -- 172.21.15.136:0/419940001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3600cd830 msgr2=0x7fc360160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.347+0000 7fc3665ff700 1 --2- 172.21.15.136:0/419940001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3600cd830 0x7fc360160340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc354009840 tx=0x7fc354009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.348+0000 7fc3665ff700 1 -- 172.21.15.136:0/419940001 shutdown_connections 2023-06-23T19:02:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.348+0000 7fc3665ff700 1 --2- 172.21.15.136:0/419940001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc360160880 0x7fc3600d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.348+0000 7fc3665ff700 1 --2- 172.21.15.136:0/419940001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3600cd830 0x7fc360160340 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.348+0000 7fc3665ff700 1 -- 172.21.15.136:0/419940001 >> 172.21.15.136:0/419940001 conn(0x7fc360071620 msgr2=0x7fc3600719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:20.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.348+0000 7fc3665ff700 1 -- 172.21.15.136:0/419940001 shutdown_connections 2023-06-23T19:02:20.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.348+0000 7fc3665ff700 1 -- 172.21.15.136:0/419940001 wait complete. 2023-06-23T19:02:20.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.349+0000 7fc3665ff700 1 Processor -- start 2023-06-23T19:02:20.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.349+0000 7fc3665ff700 1 -- start start 2023-06-23T19:02:20.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.350+0000 7fc3665ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3600cd830 0x7fc3600b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.350+0000 7fc3665ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc36015c570 0x7fc3600c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.350+0000 7fc3665ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc360160880 0x7fc3600b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.350+0000 7fc3665ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3601f3030 con 0x7fc3600cd830 2023-06-23T19:02:20.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.350+0000 7fc3665ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3601f3310 con 0x7fc360160880 2023-06-23T19:02:20.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.350+0000 7fc3665ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600b75d0 con 0x7fc36015c570 2023-06-23T19:02:20.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3600cd830 0x7fc3600b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3600cd830 0x7fc3600b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59374/0 (socket says 172.21.15.136:59374) 2023-06-23T19:02:20.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35ffff700 1 -- 172.21.15.136:0/4204213954 learned_addr learned my addr 172.21.15.136:0/4204213954 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:20.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35f7fe700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc36015c570 0x7fc3600c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc364b9c700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc360160880 0x7fc3600b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35ffff700 1 -- 172.21.15.136:0/4204213954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc36015c570 msgr2=0x7fc3600c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35ffff700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc36015c570 0x7fc3600c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35ffff700 1 -- 172.21.15.136:0/4204213954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc360160880 msgr2=0x7fc3600b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35ffff700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc360160880 0x7fc3600b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35ffff700 1 -- 172.21.15.136:0/4204213954 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358009b30 con 0x7fc3600cd830 2023-06-23T19:02:20.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.351+0000 7fc35ffff700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3600cd830 0x7fc3600b59b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc3500011e0 tx=0x7fc35000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:20.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.352+0000 7fc35cff9700 1 -- 172.21.15.136:0/4204213954 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500054e0 con 0x7fc3600cd830 2023-06-23T19:02:20.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.352+0000 7fc35cff9700 1 -- 172.21.15.136:0/4204213954 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350003680 con 0x7fc3600cd830 2023-06-23T19:02:20.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.352+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3540094a0 con 0x7fc3600cd830 2023-06-23T19:02:20.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.352+0000 7fc35cff9700 1 -- 172.21.15.136:0/4204213954 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350003a30 con 0x7fc3600cd830 2023-06-23T19:02:20.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.352+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3600b6390 con 0x7fc3600cd830 2023-06-23T19:02:20.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.353+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc360073910 con 0x7fc3600cd830 2023-06-23T19:02:20.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.354+0000 7fc35cff9700 1 -- 172.21.15.136:0/4204213954 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc350003b90 con 0x7fc3600cd830 2023-06-23T19:02:20.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.355+0000 7fc35cff9700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc34c06ace0 0x7fc34c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.355+0000 7fc35cff9700 1 -- 172.21.15.136:0/4204213954 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc350088ca0 con 0x7fc3600cd830 2023-06-23T19:02:20.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.355+0000 7fc35f7fe700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc34c06ace0 0x7fc34c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.355+0000 7fc35f7fe700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc34c06ace0 0x7fc34c06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc354000c00 tx=0x7fc354008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:20.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.359+0000 7fc35cff9700 1 -- 172.21.15.136:0/4204213954 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc350053990 con 0x7fc3600cd830 2023-06-23T19:02:20.566 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.563+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3600c9630 con 0x7fc3600cd830 2023-06-23T19:02:20.568 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.564+0000 7fc35cff9700 1 -- 172.21.15.136:0/4204213954 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7fc350056fb0 con 0x7fc3600cd830 2023-06-23T19:02:20.568 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:20.569 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:20.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc34c06ace0 msgr2=0x7fc34c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc34c06ace0 0x7fc34c06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc354000c00 tx=0x7fc354008030 comp rx=0 tx=0).stop 2023-06-23T19:02:20.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3600cd830 msgr2=0x7fc3600b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3600cd830 0x7fc3600b59b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc3500011e0 tx=0x7fc35000ca30 comp rx=0 tx=0).stop 2023-06-23T19:02:20.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 shutdown_connections 2023-06-23T19:02:20.571 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc34c06ace0 0x7fc34c06d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc360160880 0x7fc3600b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3600cd830 0x7fc3600b59b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 --2- 172.21.15.136:0/4204213954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc36015c570 0x7fc3600c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 >> 172.21.15.136:0/4204213954 conn(0x7fc360071620 msgr2=0x7fc3600cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:20.572 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 shutdown_connections 2023-06-23T19:02:20.573 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.567+0000 7fc3665ff700 1 -- 172.21.15.136:0/4204213954 wait complete. 2023-06-23T19:02:20.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:02:20.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:02:20.787 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.783+0000 7fdff23ff700 1 Processor -- start 2023-06-23T19:02:20.787 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.783+0000 7fdff23ff700 1 -- start start 2023-06-23T19:02:20.791 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.785+0000 7fdff23ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdfec0b51d0 0x7fdfec0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.791 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.785+0000 7fdff23ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec0b5ec0 con 0x7fdfec0b5a70 2023-06-23T19:02:20.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.785+0000 7fdff23ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec0cd9d0 con 0x7fdfec0d0a60 2023-06-23T19:02:20.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.785+0000 7fdff23ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfec0d0060 con 0x7fdfec0b51d0 2023-06-23T19:02:20.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.785+0000 7fdfeb7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fdfec0b5a70 0x7fdfec0d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46846/0 (socket says 172.21.15.136:46846) 2023-06-23T19:02:20.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.785+0000 7fdfeb7fe700 1 -- 172.21.15.136:0/3130848988 learned_addr learned my addr 172.21.15.136:0/3130848988 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:20.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.786+0000 7fdff099c700 1 --2- 172.21.15.136:0/3130848988 >> v2:172.21.15.136:3300/0 conn(0x7fdfec0b51d0 0x7fdfec0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.786+0000 7fdfeaffd700 1 -- 172.21.15.136:0/3130848988 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753300741 0 0) 0x7fdfec0b5ec0 con 0x7fdfec0b5a70 2023-06-23T19:02:20.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.786+0000 7fdfeaffd700 1 -- 172.21.15.136:0/3130848988 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd80035b0 con 0x7fdfec0b5a70 2023-06-23T19:02:20.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.786+0000 7fdfeaffd700 1 -- 172.21.15.136:0/3130848988 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382541145 0 0) 0x7fdfec0cd9d0 con 0x7fdfec0d0a60 2023-06-23T19:02:20.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.786+0000 7fdff099c700 1 -- 172.21.15.136:0/3130848988 >> v1:172.21.15.178:6789/0 conn(0x7fdfec0d0a60 legacy=0x7fdfec0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.786+0000 7fdff099c700 1 -- 172.21.15.136:0/3130848988 >> v1:172.21.15.136:6789/0 conn(0x7fdfec0b5a70 legacy=0x7fdfec0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.786+0000 7fdff099c700 1 -- 172.21.15.136:0/3130848988 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec0b5610 con 0x7fdfec0b51d0 2023-06-23T19:02:20.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.786+0000 7fdff099c700 1 --2- 172.21.15.136:0/3130848988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b51d0 0x7fdfec0cf910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009840 tx=0x7fdfe4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70285e7214015e3e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:20.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.786+0000 7fdfeaffd700 1 -- 172.21.15.136:0/3130848988 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4011830 con 0x7fdfec0b51d0 2023-06-23T19:02:20.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.787+0000 7fdfeaffd700 1 -- 172.21.15.136:0/3130848988 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4011990 con 0x7fdfec0b51d0 2023-06-23T19:02:20.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.787+0000 7fdfeaffd700 1 -- 172.21.15.136:0/3130848988 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4011d20 con 0x7fdfec0b51d0 2023-06-23T19:02:20.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.787+0000 7fdff23ff700 1 -- 172.21.15.136:0/3130848988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b51d0 msgr2=0x7fdfec0cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.787+0000 7fdff23ff700 1 --2- 172.21.15.136:0/3130848988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b51d0 0x7fdfec0cf910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009840 tx=0x7fdfe4009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:20.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.787+0000 7fdff23ff700 1 -- 172.21.15.136:0/3130848988 shutdown_connections 2023-06-23T19:02:20.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.787+0000 7fdff23ff700 1 --2- 172.21.15.136:0/3130848988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b51d0 0x7fdfec0cf910 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.787+0000 7fdff23ff700 1 -- 172.21.15.136:0/3130848988 >> 172.21.15.136:0/3130848988 conn(0x7fdfec071620 msgr2=0x7fdfec0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:20.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.787+0000 7fdff23ff700 1 -- 172.21.15.136:0/3130848988 shutdown_connections 2023-06-23T19:02:20.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.787+0000 7fdff23ff700 1 -- 172.21.15.136:0/3130848988 wait complete. 2023-06-23T19:02:20.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.789+0000 7fdff23ff700 1 Processor -- start 2023-06-23T19:02:20.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.789+0000 7fdff23ff700 1 -- start start 2023-06-23T19:02:20.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdff23ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfec0b51d0 0x7fdfec0c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdff23ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b5a70 0x7fdfec15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdff23ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfec0d0a60 0x7fdfec14fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdff23ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0cb610 con 0x7fdfec0b5a70 2023-06-23T19:02:20.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdff23ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0cad40 con 0x7fdfec0b51d0 2023-06-23T19:02:20.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdff23ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec1f2950 con 0x7fdfec0d0a60 2023-06-23T19:02:20.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdfeb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b5a70 0x7fdfec15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.802 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdfebfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfec0b51d0 0x7fdfec0c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdfeb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b5a70 0x7fdfec15efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59380/0 (socket says 172.21.15.136:59380) 2023-06-23T19:02:20.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.790+0000 7fdfeb7fe700 1 -- 172.21.15.136:0/4268454222 learned_addr learned my addr 172.21.15.136:0/4268454222 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:20.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdff099c700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfec0d0a60 0x7fdfec14fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdfeb7fe700 1 -- 172.21.15.136:0/4268454222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfec0d0a60 msgr2=0x7fdfec14fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdfeb7fe700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfec0d0a60 0x7fdfec14fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdfeb7fe700 1 -- 172.21.15.136:0/4268454222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfec0b51d0 msgr2=0x7fdfec0c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:20.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdfeb7fe700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfec0b51d0 0x7fdfec0c7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:20.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdfeb7fe700 1 -- 172.21.15.136:0/4268454222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe40094a0 con 0x7fdfec0b5a70 2023-06-23T19:02:20.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdfeb7fe700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b5a70 0x7fdfec15efc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c4d0 tx=0x7fdfd400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:20.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdfe8ff9700 1 -- 172.21.15.136:0/4268454222 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4005d70 con 0x7fdfec0b5a70 2023-06-23T19:02:20.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdfe8ff9700 1 -- 172.21.15.136:0/4268454222 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd40070d0 con 0x7fdfec0b5a70 2023-06-23T19:02:20.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfec0caf50 con 0x7fdfec0b5a70 2023-06-23T19:02:20.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdfe8ff9700 1 -- 172.21.15.136:0/4268454222 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4007440 con 0x7fdfec0b5a70 2023-06-23T19:02:20.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.791+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec15f500 con 0x7fdfec0b5a70 2023-06-23T19:02:20.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.792+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfec0cb750 con 0x7fdfec0b5a70 2023-06-23T19:02:20.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.793+0000 7fdfe8ff9700 1 -- 172.21.15.136:0/4268454222 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfd40075a0 con 0x7fdfec0b5a70 2023-06-23T19:02:20.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.794+0000 7fdfe8ff9700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdfcc06ace0 0x7fdfcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:20.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.794+0000 7fdfe8ff9700 1 -- 172.21.15.136:0/4268454222 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdfd4088ab0 con 0x7fdfec0b5a70 2023-06-23T19:02:20.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.795+0000 7fdfebfff700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdfcc06ace0 0x7fdfcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:20.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.795+0000 7fdfebfff700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdfcc06ace0 0x7fdfcc06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0012e0 tx=0x7fdfdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:20.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.799+0000 7fdfe8ff9700 1 -- 172.21.15.136:0/4268454222 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdfec0cb750 con 0x7fdfec0b5a70 2023-06-23T19:02:21.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.998+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfec0cb750 con 0x7fdfec0b5a70 2023-06-23T19:02:21.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:20.998+0000 7fdfe8ff9700 1 -- 172.21.15.136:0/4268454222 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfd4017020 con 0x7fdfec0b5a70 2023-06-23T19:02:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:02:21.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdfcc06ace0 msgr2=0x7fdfcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdfcc06ace0 0x7fdfcc06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0012e0 tx=0x7fdfdc009040 comp rx=0 tx=0).stop 2023-06-23T19:02:21.005 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b5a70 msgr2=0x7fdfec15efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b5a70 0x7fdfec15efc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c4d0 tx=0x7fdfd400c7e0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 shutdown_connections 2023-06-23T19:02:21.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdfcc06ace0 0x7fdfcc06d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfec0b51d0 0x7fdfec0c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfec0d0a60 0x7fdfec14fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 --2- 172.21.15.136:0/4268454222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfec0b5a70 0x7fdfec15efc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 >> 172.21.15.136:0/4268454222 conn(0x7fdfec071620 msgr2=0x7fdfec0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:21.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 shutdown_connections 2023-06-23T19:02:21.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.001+0000 7fdff23ff700 1 -- 172.21.15.136:0/4268454222 wait complete. 2023-06-23T19:02:21.023 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:02:21.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.216+0000 7fe2ea3ff700 1 Processor -- start 2023-06-23T19:02:21.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.217+0000 7fe2ea3ff700 1 -- start start 2023-06-23T19:02:21.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2ea3ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe2e40b5a70 0x7fe2e40b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2ea3ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe2e40cf910 0x7fe2e40d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2ea3ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e40b5ec0 con 0x7fe2e40d0a60 2023-06-23T19:02:21.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2ea3ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e40d0060 con 0x7fe2e40b5a70 2023-06-23T19:02:21.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2ea3ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e40cd9d0 con 0x7fe2e40cf910 2023-06-23T19:02:21.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2dbfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe2e40b5a70 0x7fe2e40b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2dbfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe2e40b5a70 0x7fe2e40b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59392/0 (socket says 172.21.15.136:59392) 2023-06-23T19:02:21.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2dbfff700 1 -- 172.21.15.136:0/737413817 learned_addr learned my addr 172.21.15.136:0/737413817 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:21.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2dbfff700 1 -- 172.21.15.136:0/737413817 >> v2:172.21.15.178:3300/0 conn(0x7fe2e40cf910 msgr2=0x7fe2e40d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:21.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2dbfff700 1 --2- 172.21.15.136:0/737413817 >> v2:172.21.15.178:3300/0 conn(0x7fe2e40cf910 0x7fe2e40d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2dbfff700 1 -- 172.21.15.136:0/737413817 >> v1:172.21.15.136:6789/0 conn(0x7fe2e40d0a60 legacy=0x7fe2e40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.218+0000 7fe2dbfff700 1 -- 172.21.15.136:0/737413817 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e40cd410 con 0x7fe2e40b5a70 2023-06-23T19:02:21.224 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.219+0000 7fe2dbfff700 1 --2- 172.21.15.136:0/737413817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40b5a70 0x7fe2e40b51d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40b2610 tx=0x7fe2cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30b3f2b22969bfc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:21.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.219+0000 7fe2e37fe700 1 -- 172.21.15.136:0/737413817 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00b870 con 0x7fe2e40b5a70 2023-06-23T19:02:21.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.219+0000 7fe2e37fe700 1 -- 172.21.15.136:0/737413817 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc00b9d0 con 0x7fe2e40b5a70 2023-06-23T19:02:21.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.219+0000 7fe2e37fe700 1 -- 172.21.15.136:0/737413817 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00bd60 con 0x7fe2e40b5a70 2023-06-23T19:02:21.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.219+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/737413817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40b5a70 msgr2=0x7fe2e40b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.219+0000 7fe2ea3ff700 1 --2- 172.21.15.136:0/737413817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40b5a70 0x7fe2e40b51d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40b2610 tx=0x7fe2cc009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.219+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/737413817 shutdown_connections 2023-06-23T19:02:21.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.220+0000 7fe2ea3ff700 1 --2- 172.21.15.136:0/737413817 >> v2:172.21.15.178:3300/0 conn(0x7fe2e40cf910 0x7fe2e40d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.220+0000 7fe2ea3ff700 1 --2- 172.21.15.136:0/737413817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40b5a70 0x7fe2e40b51d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.220+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/737413817 >> 172.21.15.136:0/737413817 conn(0x7fe2e4071620 msgr2=0x7fe2e40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:21.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.220+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/737413817 shutdown_connections 2023-06-23T19:02:21.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.220+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/737413817 wait complete. 2023-06-23T19:02:21.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.221+0000 7fe2ea3ff700 1 Processor -- start 2023-06-23T19:02:21.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.221+0000 7fe2ea3ff700 1 -- start start 2023-06-23T19:02:21.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.222+0000 7fe2ea3ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2e40b5a70 0x7fe2e41532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.222+0000 7fe2ea3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e40cf910 0x7fe2e40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.222+0000 7fe2ea3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40d0a60 0x7fe2e40b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.228 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.222+0000 7fe2ea3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40c89c0 con 0x7fe2e40d0a60 2023-06-23T19:02:21.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.222+0000 7fe2ea3ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e41585a0 con 0x7fe2e40b5a70 2023-06-23T19:02:21.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.222+0000 7fe2ea3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e4158880 con 0x7fe2e40cf910 2023-06-23T19:02:21.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e899c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40d0a60 0x7fe2e40b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e899c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40d0a60 0x7fe2e40b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59408/0 (socket says 172.21.15.136:59408) 2023-06-23T19:02:21.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e899c700 1 -- 172.21.15.136:0/588718968 learned_addr learned my addr 172.21.15.136:0/588718968 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:21.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e3fff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2e40b5a70 0x7fe2e41532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2dbfff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e40cf910 0x7fe2e40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.229 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e899c700 1 -- 172.21.15.136:0/588718968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e40cf910 msgr2=0x7fe2e40b7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e899c700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e40cf910 0x7fe2e40b7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e899c700 1 -- 172.21.15.136:0/588718968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2e40b5a70 msgr2=0x7fe2e41532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e899c700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2e40b5a70 0x7fe2e41532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.230 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e899c700 1 -- 172.21.15.136:0/588718968 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc009550 con 0x7fe2e40d0a60 2023-06-23T19:02:21.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.223+0000 7fe2e899c700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40d0a60 0x7fe2e40b7e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00b970 tx=0x7fe2dc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:21.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.224+0000 7fe2e17fa700 1 -- 172.21.15.136:0/588718968 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00d860 con 0x7fe2e40d0a60 2023-06-23T19:02:21.233 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.224+0000 7fe2e17fa700 1 -- 172.21.15.136:0/588718968 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc00d9e0 con 0x7fe2e40d0a60 2023-06-23T19:02:21.233 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.224+0000 7fe2e17fa700 1 -- 172.21.15.136:0/588718968 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00dd90 con 0x7fe2e40d0a60 2023-06-23T19:02:21.233 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.224+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e4158b60 con 0x7fe2e40d0a60 2023-06-23T19:02:21.233 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.224+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e4153a00 con 0x7fe2e40d0a60 2023-06-23T19:02:21.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.225+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e40d01a0 con 0x7fe2e40d0a60 2023-06-23T19:02:21.234 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.226+0000 7fe2e17fa700 1 -- 172.21.15.136:0/588718968 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe2dc00e430 con 0x7fe2e40d0a60 2023-06-23T19:02:21.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.227+0000 7fe2e17fa700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe2c406ace0 0x7fe2c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.227+0000 7fe2e17fa700 1 -- 172.21.15.136:0/588718968 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe2dc006e40 con 0x7fe2e40d0a60 2023-06-23T19:02:21.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.227+0000 7fe2e3fff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe2c406ace0 0x7fe2c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.227+0000 7fe2e3fff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe2c406ace0 0x7fe2c406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40b84a0 tx=0x7fe2d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:21.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.231+0000 7fe2e17fa700 1 -- 172.21.15.136:0/588718968 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe2dc054640 con 0x7fe2e40d0a60 2023-06-23T19:02:21.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.427+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe2e404ea20 con 0x7fe2e40d0a60 2023-06-23T19:02:21.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.428+0000 7fe2e17fa700 1 -- 172.21.15.136:0/588718968 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe2dc057c60 con 0x7fe2e40d0a60 2023-06-23T19:02:21.432 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:02:21.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe2c406ace0 msgr2=0x7fe2c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe2c406ace0 0x7fe2c406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40b84a0 tx=0x7fe2d4009040 comp rx=0 tx=0).stop 2023-06-23T19:02:21.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40d0a60 msgr2=0x7fe2e40b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40d0a60 0x7fe2e40b7e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00b970 tx=0x7fe2dc00bc80 comp rx=0 tx=0).stop 2023-06-23T19:02:21.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 shutdown_connections 2023-06-23T19:02:21.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe2c406ace0 0x7fe2c406d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2e40b5a70 0x7fe2e41532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2e40d0a60 0x7fe2e40b7e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 --2- 172.21.15.136:0/588718968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e40cf910 0x7fe2e40b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 >> 172.21.15.136:0/588718968 conn(0x7fe2e4071620 msgr2=0x7fe2e40b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:21.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 shutdown_connections 2023-06-23T19:02:21.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.430+0000 7fe2ea3ff700 1 -- 172.21.15.136:0/588718968 wait complete. 2023-06-23T19:02:21.454 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.646+0000 7f63b29ff700 1 Processor -- start 2023-06-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.647+0000 7f63b29ff700 1 -- start start 2023-06-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63b29ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 0x7f63ac0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63b29ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f63ac0cf910 0x7f63ac0d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63b29ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ac0b5ec0 con 0x7f63ac0d0a60 2023-06-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63b29ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ac0d0060 con 0x7f63ac0cf910 2023-06-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63b29ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac0cd9d0 con 0x7f63ac0b5a70 2023-06-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63b0f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f63ac0cf910 0x7f63ac0d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63b0f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f63ac0cf910 0x7f63ac0d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59412/0 (socket says 172.21.15.136:59412) 2023-06-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63b0f9c700 1 -- 172.21.15.136:0/130546970 learned_addr learned my addr 172.21.15.136:0/130546970 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63abfff700 1 --1- 172.21.15.136:0/130546970 >> v1:172.21.15.136:6789/0 conn(0x7f63ac0d0a60 0x7f63ac0d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46870/0 (socket says 172.21.15.136:46870) 2023-06-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.648+0000 7f63a3fff700 1 --2- 172.21.15.136:0/130546970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 0x7f63ac0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.649+0000 7f63b0f9c700 1 -- 172.21.15.136:0/130546970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 msgr2=0x7f63ac0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.649+0000 7f63b0f9c700 1 --2- 172.21.15.136:0/130546970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 0x7f63ac0b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.649+0000 7f63b0f9c700 1 -- 172.21.15.136:0/130546970 >> v1:172.21.15.136:6789/0 conn(0x7f63ac0d0a60 legacy=0x7f63ac0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.649+0000 7f63b0f9c700 1 -- 172.21.15.136:0/130546970 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0cfd90 con 0x7f63ac0cf910 2023-06-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.649+0000 7f63b0f9c700 1 --2- 172.21.15.136:0/130546970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 0x7f63ac0d2e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009e50 tx=0x7f63a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21badfaee07b99d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.649+0000 7f63ab7fe700 1 -- 172.21.15.136:0/130546970 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a400e070 con 0x7f63ac0cf910 2023-06-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.649+0000 7f63ab7fe700 1 -- 172.21.15.136:0/130546970 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a400b9c0 con 0x7f63ac0cf910 2023-06-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.649+0000 7f63ab7fe700 1 -- 172.21.15.136:0/130546970 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a400bd70 con 0x7f63ac0cf910 2023-06-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.650+0000 7f63b29ff700 1 -- 172.21.15.136:0/130546970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 msgr2=0x7f63ac0d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.650+0000 7f63b29ff700 1 --2- 172.21.15.136:0/130546970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 0x7f63ac0d2e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009e50 tx=0x7f63a400b330 comp rx=0 tx=0).stop 2023-06-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.650+0000 7f63b29ff700 1 -- 172.21.15.136:0/130546970 shutdown_connections 2023-06-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.650+0000 7f63b29ff700 1 --2- 172.21.15.136:0/130546970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 0x7f63ac0d2e00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.650+0000 7f63b29ff700 1 --2- 172.21.15.136:0/130546970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 0x7f63ac0b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.650+0000 7f63b29ff700 1 -- 172.21.15.136:0/130546970 >> 172.21.15.136:0/130546970 conn(0x7f63ac071620 msgr2=0x7f63ac0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.650+0000 7f63b29ff700 1 -- 172.21.15.136:0/130546970 shutdown_connections 2023-06-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.650+0000 7f63b29ff700 1 -- 172.21.15.136:0/130546970 wait complete. 2023-06-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.651+0000 7f63b29ff700 1 Processor -- start 2023-06-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.652+0000 7f63b29ff700 1 -- start start 2023-06-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.652+0000 7f63b29ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 0x7f63ac15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63b29ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 0x7f63ac15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63b29ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac0d0a60 0x7f63ac0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63b29ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac15d010 con 0x7f63ac0cf910 2023-06-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63b29ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac15c0d0 con 0x7f63ac0d0a60 2023-06-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63b29ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac15d970 con 0x7f63ac0b5a70 2023-06-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 0x7f63ac15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 0x7f63ac15ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59418/0 (socket says 172.21.15.136:59418) 2023-06-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63a3fff700 1 -- 172.21.15.136:0/1658677976 learned_addr learned my addr 172.21.15.136:0/1658677976 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63b0f9c700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac0d0a60 0x7f63ac0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63abfff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 0x7f63ac15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63a3fff700 1 -- 172.21.15.136:0/1658677976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 msgr2=0x7f63ac15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63a3fff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 0x7f63ac15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63a3fff700 1 -- 172.21.15.136:0/1658677976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac0d0a60 msgr2=0x7f63ac0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63a3fff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac0d0a60 0x7f63ac0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.653+0000 7f63a3fff700 1 -- 172.21.15.136:0/1658677976 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a4009b30 con 0x7f63ac0cf910 2023-06-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.654+0000 7f63a3fff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 0x7f63ac15ece0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f639400e810 tx=0x7f639400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.654+0000 7f63a97fa700 1 -- 172.21.15.136:0/1658677976 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639400c070 con 0x7f63ac0cf910 2023-06-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.654+0000 7f63a97fa700 1 -- 172.21.15.136:0/1658677976 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6394013610 con 0x7f63ac0cf910 2023-06-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.654+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac15c390 con 0x7f63ac0cf910 2023-06-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.654+0000 7f63a97fa700 1 -- 172.21.15.136:0/1658677976 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63940139c0 con 0x7f63ac0cf910 2023-06-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.654+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ac15c950 con 0x7f63ac0cf910 2023-06-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.655+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ac15d150 con 0x7f63ac0cf910 2023-06-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.656+0000 7f63a97fa700 1 -- 172.21.15.136:0/1658677976 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6394013b20 con 0x7f63ac0cf910 2023-06-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.657+0000 7f63a97fa700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f638c06ace0 0x7f638c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.657+0000 7f63a97fa700 1 -- 172.21.15.136:0/1658677976 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6394089590 con 0x7f63ac0cf910 2023-06-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.657+0000 7f63abfff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f638c06ace0 0x7f638c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.658+0000 7f63abfff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f638c06ace0 0x7f638c06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f639c000f60 tx=0x7f639c007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.661+0000 7f63a97fa700 1 -- 172.21.15.136:0/1658677976 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63ac15d150 con 0x7f63ac0cf910 2023-06-23T19:02:21.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.857+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63ac15d150 con 0x7f63ac0cf910 2023-06-23T19:02:21.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.858+0000 7f63a97fa700 1 -- 172.21.15.136:0/1658677976 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63ac15d150 con 0x7f63ac0cf910 2023-06-23T19:02:21.862 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:21.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.860+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f638c06ace0 msgr2=0x7f638c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.860+0000 7f63b29ff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f638c06ace0 0x7f638c06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f639c000f60 tx=0x7f639c007ed0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.860+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 msgr2=0x7f63ac15ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:21.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.860+0000 7f63b29ff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 0x7f63ac15ece0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f639400e810 tx=0x7f639400eb20 comp rx=0 tx=0).stop 2023-06-23T19:02:21.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.861+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 shutdown_connections 2023-06-23T19:02:21.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.861+0000 7f63b29ff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f638c06ace0 0x7f638c06d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.861+0000 7f63b29ff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac0d0a60 0x7f63ac0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.861+0000 7f63b29ff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ac0b5a70 0x7f63ac15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.861+0000 7f63b29ff700 1 --2- 172.21.15.136:0/1658677976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0cf910 0x7f63ac15ece0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:21.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.861+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 >> 172.21.15.136:0/1658677976 conn(0x7f63ac071620 msgr2=0x7f63ac0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:21.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.861+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 shutdown_connections 2023-06-23T19:02:21.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:21.861+0000 7f63b29ff700 1 -- 172.21.15.136:0/1658677976 wait complete. 2023-06-23T19:02:21.882 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:02:22.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.074+0000 7f84749ff700 1 Processor -- start 2023-06-23T19:02:22.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.075+0000 7f84749ff700 1 -- start start 2023-06-23T19:02:22.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f84749ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f84700d0a60 0x7f84700b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f84749ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f84700b51d0 0x7f84700cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f84749ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700cd9d0 con 0x7f84700d0e30 2023-06-23T19:02:22.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f84749ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84700d0060 con 0x7f84700b51d0 2023-06-23T19:02:22.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f84749ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84700cfe50 con 0x7f84700d0a60 2023-06-23T19:02:22.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f8467fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f84700b51d0 0x7f84700cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f8467fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f84700b51d0 0x7f84700cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59434/0 (socket says 172.21.15.136:59434) 2023-06-23T19:02:22.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f8467fff700 1 -- 172.21.15.136:0/3831273273 learned_addr learned my addr 172.21.15.136:0/3831273273 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:22.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f846e59c700 1 --2- 172.21.15.136:0/3831273273 >> v2:172.21.15.178:3300/0 conn(0x7f84700d0a60 0x7f84700b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f8467fff700 1 -- 172.21.15.136:0/3831273273 >> v2:172.21.15.178:3300/0 conn(0x7f84700d0a60 msgr2=0x7f84700b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:22.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f8467fff700 1 --2- 172.21.15.136:0/3831273273 >> v2:172.21.15.178:3300/0 conn(0x7f84700d0a60 0x7f84700b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f8467fff700 1 -- 172.21.15.136:0/3831273273 >> v1:172.21.15.178:6789/0 conn(0x7f84700d0e30 legacy=0x7f84700d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:22.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f8467fff700 1 -- 172.21.15.136:0/3831273273 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84700b5620 con 0x7f84700b51d0 2023-06-23T19:02:22.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.076+0000 7f846e59c700 1 --2- 172.21.15.136:0/3831273273 >> v2:172.21.15.178:3300/0 conn(0x7f84700d0a60 0x7f84700b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:22.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f8467fff700 1 --2- 172.21.15.136:0/3831273273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700b51d0 0x7f84700cf910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f847006c6e0 tx=0x7f8458009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec031265cb510610 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:22.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f846dd9b700 1 -- 172.21.15.136:0/3831273273 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458004230 con 0x7f84700b51d0 2023-06-23T19:02:22.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f846dd9b700 1 -- 172.21.15.136:0/3831273273 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8458004390 con 0x7f84700b51d0 2023-06-23T19:02:22.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f846dd9b700 1 -- 172.21.15.136:0/3831273273 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84580036a0 con 0x7f84700b51d0 2023-06-23T19:02:22.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f84749ff700 1 -- 172.21.15.136:0/3831273273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700b51d0 msgr2=0x7f84700cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f84749ff700 1 --2- 172.21.15.136:0/3831273273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700b51d0 0x7f84700cf910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f847006c6e0 tx=0x7f8458009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f84749ff700 1 -- 172.21.15.136:0/3831273273 shutdown_connections 2023-06-23T19:02:22.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f84749ff700 1 --2- 172.21.15.136:0/3831273273 >> v2:172.21.15.178:3300/0 conn(0x7f84700d0a60 0x7f84700b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f84749ff700 1 --2- 172.21.15.136:0/3831273273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700b51d0 0x7f84700cf910 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f84749ff700 1 -- 172.21.15.136:0/3831273273 >> 172.21.15.136:0/3831273273 conn(0x7f8470071620 msgr2=0x7f84700719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:22.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.077+0000 7f84749ff700 1 -- 172.21.15.136:0/3831273273 shutdown_connections 2023-06-23T19:02:22.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.078+0000 7f84749ff700 1 -- 172.21.15.136:0/3831273273 wait complete. 2023-06-23T19:02:22.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.079+0000 7f84749ff700 1 Processor -- start 2023-06-23T19:02:22.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.079+0000 7f84749ff700 1 -- start start 2023-06-23T19:02:22.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.080+0000 7f84749ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84700b51d0 0x7f84700b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.080+0000 7f84749ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700d0a60 0x7f84701f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.080+0000 7f84749ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84700d0e30 0x7f84700b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.080+0000 7f84749ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84700d3720 con 0x7f84700d0a60 2023-06-23T19:02:22.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.080+0000 7f84749ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847015c950 con 0x7f84700b51d0 2023-06-23T19:02:22.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.080+0000 7f84749ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847015cba0 con 0x7f84700d0e30 2023-06-23T19:02:22.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.080+0000 7f8467fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700d0a60 0x7f84701f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.080+0000 7f8467fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700d0a60 0x7f84701f13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59446/0 (socket says 172.21.15.136:59446) 2023-06-23T19:02:22.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.080+0000 7f8467fff700 1 -- 172.21.15.136:0/1659359214 learned_addr learned my addr 172.21.15.136:0/1659359214 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:22.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f846e59c700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84700b51d0 0x7f84700b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f8467fff700 1 -- 172.21.15.136:0/1659359214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84700d0e30 msgr2=0x7f84700b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f846ed9d700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84700d0e30 0x7f84700b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f8467fff700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84700d0e30 0x7f84700b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f8467fff700 1 -- 172.21.15.136:0/1659359214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84700b51d0 msgr2=0x7f84700b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f8467fff700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84700b51d0 0x7f84700b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f8467fff700 1 -- 172.21.15.136:0/1659359214 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458009550 con 0x7f84700d0a60 2023-06-23T19:02:22.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f846e59c700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84700b51d0 0x7f84700b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:22.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f8467fff700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700d0a60 0x7f84701f13a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8458009130 tx=0x7f8458004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:22.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f8466ffd700 1 -- 172.21.15.136:0/1659359214 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458003dc0 con 0x7f84700d0a60 2023-06-23T19:02:22.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f8466ffd700 1 -- 172.21.15.136:0/1659359214 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845801f070 con 0x7f84700d0a60 2023-06-23T19:02:22.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847015ce80 con 0x7f84700d0a60 2023-06-23T19:02:22.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.081+0000 7f8466ffd700 1 -- 172.21.15.136:0/1659359214 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458011870 con 0x7f84700d0a60 2023-06-23T19:02:22.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.082+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847015d440 con 0x7f84700d0a60 2023-06-23T19:02:22.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.083+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847004ea20 con 0x7f84700d0a60 2023-06-23T19:02:22.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.083+0000 7f8466ffd700 1 -- 172.21.15.136:0/1659359214 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8458021030 con 0x7f84700d0a60 2023-06-23T19:02:22.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.085+0000 7f8466ffd700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f845006ace0 0x7f845006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.085+0000 7f8466ffd700 1 -- 172.21.15.136:0/1659359214 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f845808ae50 con 0x7f84700d0a60 2023-06-23T19:02:22.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.085+0000 7f846e59c700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f845006ace0 0x7f845006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.086+0000 7f846e59c700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f845006ace0 0x7f845006d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84600089b0 tx=0x7f8460008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:22.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.089+0000 7f8466ffd700 1 -- 172.21.15.136:0/1659359214 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8458055bc0 con 0x7f84700d0a60 2023-06-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.283+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f847015d600 con 0x7f84700d0a60 2023-06-23T19:02:22.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.284+0000 7f8466ffd700 1 -- 172.21.15.136:0/1659359214 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84580591e0 con 0x7f84700d0a60 2023-06-23T19:02:22.288 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f845006ace0 msgr2=0x7f845006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f845006ace0 0x7f845006d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84600089b0 tx=0x7f8460008040 comp rx=0 tx=0).stop 2023-06-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700d0a60 msgr2=0x7f84701f13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700d0a60 0x7f84701f13a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8458009130 tx=0x7f8458004750 comp rx=0 tx=0).stop 2023-06-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 shutdown_connections 2023-06-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f845006ace0 0x7f845006d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84700b51d0 0x7f84700b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84700d0e30 0x7f84700b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 --2- 172.21.15.136:0/1659359214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84700d0a60 0x7f84701f13a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 >> 172.21.15.136:0/1659359214 conn(0x7f8470071620 msgr2=0x7f847015bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 shutdown_connections 2023-06-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.286+0000 7f84749ff700 1 -- 172.21.15.136:0/1659359214 wait complete. 2023-06-23T19:02:22.308 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:02:22.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.500+0000 7fdb6ffff700 1 Processor -- start 2023-06-23T19:02:22.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.500+0000 7fdb6ffff700 1 -- start start 2023-06-23T19:02:22.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.501+0000 7fdb6ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdb680b51d0 0x7fdb680cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.501+0000 7fdb6ffff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb680b5ec0 con 0x7fdb680d0a60 2023-06-23T19:02:22.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.501+0000 7fdb6ffff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb680cd9d0 con 0x7fdb680b5a70 2023-06-23T19:02:22.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.501+0000 7fdb6ffff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb680d0060 con 0x7fdb680b51d0 2023-06-23T19:02:22.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.501+0000 7fdb6e59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdb680b51d0 0x7fdb680cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6dd9b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fdb680d0a60 0x7fdb680d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46882/0 (socket says 172.21.15.136:46882) 2023-06-23T19:02:22.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6e59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdb680b51d0 0x7fdb680cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59448/0 (socket says 172.21.15.136:59448) 2023-06-23T19:02:22.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6dd9b700 1 -- 172.21.15.136:0/3746727127 learned_addr learned my addr 172.21.15.136:0/3746727127 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:22.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6e59c700 1 -- 172.21.15.136:0/3746727127 >> v1:172.21.15.178:6789/0 conn(0x7fdb680b5a70 legacy=0x7fdb680d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:22.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6e59c700 1 -- 172.21.15.136:0/3746727127 >> v1:172.21.15.136:6789/0 conn(0x7fdb680d0a60 legacy=0x7fdb680d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6e59c700 1 -- 172.21.15.136:0/3746727127 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb680b5610 con 0x7fdb680b51d0 2023-06-23T19:02:22.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6e59c700 1 --2- 172.21.15.136:0/3746727127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 0x7fdb680cf910 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009d90 tx=0x7fdb6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e65a183eb463fa server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:22.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6cd99700 1 -- 172.21.15.136:0/3746727127 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000e070 con 0x7fdb680b51d0 2023-06-23T19:02:22.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6cd99700 1 -- 172.21.15.136:0/3746727127 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6000bb90 con 0x7fdb680b51d0 2023-06-23T19:02:22.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.502+0000 7fdb6cd99700 1 -- 172.21.15.136:0/3746727127 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60003a20 con 0x7fdb680b51d0 2023-06-23T19:02:22.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.503+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3746727127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 msgr2=0x7fdb680cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.503+0000 7fdb6ffff700 1 --2- 172.21.15.136:0/3746727127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 0x7fdb680cf910 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009d90 tx=0x7fdb6000b330 comp rx=0 tx=0).stop 2023-06-23T19:02:22.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.503+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3746727127 shutdown_connections 2023-06-23T19:02:22.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.503+0000 7fdb6ffff700 1 --2- 172.21.15.136:0/3746727127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 0x7fdb680cf910 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.503+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3746727127 >> 172.21.15.136:0/3746727127 conn(0x7fdb68071620 msgr2=0x7fdb680719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:22.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.503+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3746727127 shutdown_connections 2023-06-23T19:02:22.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.503+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3746727127 wait complete. 2023-06-23T19:02:22.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.505+0000 7fdb6ffff700 1 Processor -- start 2023-06-23T19:02:22.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.505+0000 7fdb6ffff700 1 -- start start 2023-06-23T19:02:22.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 0x7fdb681530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb680b5a70 0x7fdb680c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680d0a60 0x7fdb680cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6ffff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68153600 con 0x7fdb680b51d0 2023-06-23T19:02:22.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6ffff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68157380 con 0x7fdb680b5a70 2023-06-23T19:02:22.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6ffff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68157660 con 0x7fdb680d0a60 2023-06-23T19:02:22.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 0x7fdb681530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 0x7fdb681530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59456/0 (socket says 172.21.15.136:59456) 2023-06-23T19:02:22.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6dd9b700 1 -- 172.21.15.136:0/3044386552 learned_addr learned my addr 172.21.15.136:0/3044386552 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:22.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6e59c700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680d0a60 0x7fdb680cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6d59a700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb680b5a70 0x7fdb680c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6dd9b700 1 -- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680d0a60 msgr2=0x7fdb680cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6dd9b700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680d0a60 0x7fdb680cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6dd9b700 1 -- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb680b5a70 msgr2=0x7fdb680c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6dd9b700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb680b5a70 0x7fdb680c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6dd9b700 1 -- 172.21.15.136:0/3044386552 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb60009a70 con 0x7fdb680b51d0 2023-06-23T19:02:22.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6e59c700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680d0a60 0x7fdb680cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:22.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.506+0000 7fdb6d59a700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb680b5a70 0x7fdb680c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.507+0000 7fdb6dd9b700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 0x7fdb681530c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c430 tx=0x7fdb6400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.507+0000 7fdb5e7fc700 1 -- 172.21.15.136:0/3044386552 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64005d70 con 0x7fdb680b51d0 2023-06-23T19:02:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.507+0000 7fdb5e7fc700 1 -- 172.21.15.136:0/3044386552 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb640070d0 con 0x7fdb680b51d0 2023-06-23T19:02:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.507+0000 7fdb5e7fc700 1 -- 172.21.15.136:0/3044386552 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64007460 con 0x7fdb680b51d0 2023-06-23T19:02:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.507+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb68157940 con 0x7fdb680b51d0 2023-06-23T19:02:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.507+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb68157f00 con 0x7fdb680b51d0 2023-06-23T19:02:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.508+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb68158110 con 0x7fdb680b51d0 2023-06-23T19:02:22.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.509+0000 7fdb5e7fc700 1 -- 172.21.15.136:0/3044386552 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb640075c0 con 0x7fdb680b51d0 2023-06-23T19:02:22.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.510+0000 7fdb5e7fc700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb4c06ace0 0x7fdb4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.510+0000 7fdb5e7fc700 1 -- 172.21.15.136:0/3044386552 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdb64088cb0 con 0x7fdb680b51d0 2023-06-23T19:02:22.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.510+0000 7fdb6d59a700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb4c06ace0 0x7fdb4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.511+0000 7fdb6d59a700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb4c06ace0 0x7fdb4c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb6815a390 tx=0x7fdb58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:22.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.514+0000 7fdb5e7fc700 1 -- 172.21.15.136:0/3044386552 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb64053990 con 0x7fdb680b51d0 2023-06-23T19:02:22.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.709+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdb6804ea20 con 0x7fdb680b51d0 2023-06-23T19:02:22.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.710+0000 7fdb5e7fc700 1 -- 172.21.15.136:0/3044386552 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdb640170a0 con 0x7fdb680b51d0 2023-06-23T19:02:22.714 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:22.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb4c06ace0 msgr2=0x7fdb4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb4c06ace0 0x7fdb4c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb6815a390 tx=0x7fdb58009040 comp rx=0 tx=0).stop 2023-06-23T19:02:22.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 msgr2=0x7fdb681530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 0x7fdb681530c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c430 tx=0x7fdb6400c7f0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 shutdown_connections 2023-06-23T19:02:22.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdb4c06ace0 0x7fdb4c06d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680d0a60 0x7fdb680cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb680b51d0 0x7fdb681530c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 --2- 172.21.15.136:0/3044386552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb680b5a70 0x7fdb680c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 >> 172.21.15.136:0/3044386552 conn(0x7fdb68071620 msgr2=0x7fdb6815c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:22.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 shutdown_connections 2023-06-23T19:02:22.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.712+0000 7fdb6ffff700 1 -- 172.21.15.136:0/3044386552 wait complete. 2023-06-23T19:02:22.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.928+0000 7f68ed7ff700 1 Processor -- start 2023-06-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.928+0000 7f68ed7ff700 1 -- start start 2023-06-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.929+0000 7f68ed7ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f68e815c570 0x7f68e80cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.929+0000 7f68ed7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e80cd660 0x7f68e8160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.929+0000 7f68ed7ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e80cdab0 con 0x7f68e8160880 2023-06-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.929+0000 7f68ed7ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e815d670 con 0x7f68e815c570 2023-06-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.929+0000 7f68ed7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e81610a0 con 0x7f68e80cd660 2023-06-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e77fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f68e8160880 0x7f68e806b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46894/0 (socket says 172.21.15.136:46894) 2023-06-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e77fe700 1 -- 172.21.15.136:0/1694171943 learned_addr learned my addr 172.21.15.136:0/1694171943 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e6ffd700 1 --2- 172.21.15.136:0/1694171943 >> v2:172.21.15.178:3300/0 conn(0x7f68e815c570 0x7f68e80cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e67fc700 1 --2- 172.21.15.136:0/1694171943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e80cd660 0x7f68e8160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e5ffb700 1 -- 172.21.15.136:0/1694171943 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422151420 0 0) 0x7f68e0001490 con 0x7f68e8160880 2023-06-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e5ffb700 1 -- 172.21.15.136:0/1694171943 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68d00035b0 con 0x7f68e8160880 2023-06-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e67fc700 1 -- 172.21.15.136:0/1694171943 >> v2:172.21.15.178:3300/0 conn(0x7f68e815c570 msgr2=0x7f68e80cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e67fc700 1 --2- 172.21.15.136:0/1694171943 >> v2:172.21.15.178:3300/0 conn(0x7f68e815c570 0x7f68e80cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e67fc700 1 -- 172.21.15.136:0/1694171943 >> v1:172.21.15.136:6789/0 conn(0x7f68e8160880 legacy=0x7f68e806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e67fc700 1 -- 172.21.15.136:0/1694171943 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e815da90 con 0x7f68e80cd660 2023-06-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.930+0000 7f68e6ffd700 1 --2- 172.21.15.136:0/1694171943 >> v2:172.21.15.178:3300/0 conn(0x7f68e815c570 0x7f68e80cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68e67fc700 1 --2- 172.21.15.136:0/1694171943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e80cd660 0x7f68e8160340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009840 tx=0x7f68dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42df8a0bb87599d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68e5ffb700 1 -- 172.21.15.136:0/1694171943 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc011830 con 0x7f68e80cd660 2023-06-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68e5ffb700 1 -- 172.21.15.136:0/1694171943 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc011990 con 0x7f68e80cd660 2023-06-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68e5ffb700 1 -- 172.21.15.136:0/1694171943 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc011d20 con 0x7f68e80cd660 2023-06-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68ed7ff700 1 -- 172.21.15.136:0/1694171943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e80cd660 msgr2=0x7f68e8160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68ed7ff700 1 --2- 172.21.15.136:0/1694171943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e80cd660 0x7f68e8160340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009840 tx=0x7f68dc009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68ed7ff700 1 -- 172.21.15.136:0/1694171943 shutdown_connections 2023-06-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68ed7ff700 1 --2- 172.21.15.136:0/1694171943 >> v2:172.21.15.178:3300/0 conn(0x7f68e815c570 0x7f68e80cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68ed7ff700 1 --2- 172.21.15.136:0/1694171943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e80cd660 0x7f68e8160340 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68ed7ff700 1 -- 172.21.15.136:0/1694171943 >> 172.21.15.136:0/1694171943 conn(0x7f68e8071620 msgr2=0x7f68e80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.931+0000 7f68ed7ff700 1 -- 172.21.15.136:0/1694171943 shutdown_connections 2023-06-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.932+0000 7f68ed7ff700 1 -- 172.21.15.136:0/1694171943 wait complete. 2023-06-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.933+0000 7f68ed7ff700 1 Processor -- start 2023-06-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.933+0000 7f68ed7ff700 1 -- start start 2023-06-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.934+0000 7f68ed7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68e80cd660 0x7f68e80b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.934+0000 7f68ed7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e815c570 0x7f68e80b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.934+0000 7f68ed7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68e8160880 0x7f68e80b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.934+0000 7f68ed7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80b72a0 con 0x7f68e80cd660 2023-06-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.934+0000 7f68ed7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80b6e10 con 0x7f68e8160880 2023-06-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.934+0000 7f68ed7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80b6200 con 0x7f68e815c570 2023-06-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.934+0000 7f68e6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68e80cd660 0x7f68e80b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.934+0000 7f68e6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68e80cd660 0x7f68e80b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59458/0 (socket says 172.21.15.136:59458) 2023-06-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.934+0000 7f68e6ffd700 1 -- 172.21.15.136:0/619006259 learned_addr learned my addr 172.21.15.136:0/619006259 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68e67fc700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e815c570 0x7f68e80b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68e77fe700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68e8160880 0x7f68e80b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68e6ffd700 1 -- 172.21.15.136:0/619006259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e815c570 msgr2=0x7f68e80b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68e6ffd700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e815c570 0x7f68e80b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68e6ffd700 1 -- 172.21.15.136:0/619006259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68e8160880 msgr2=0x7f68e80b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68e6ffd700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68e8160880 0x7f68e80b8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68e6ffd700 1 -- 172.21.15.136:0/619006259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80094a0 con 0x7f68e80cd660 2023-06-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68e77fe700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68e8160880 0x7f68e80b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68e6ffd700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68e80cd660 0x7f68e80b59b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f68d800ebe0 tx=0x7f68d800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68cf7fe700 1 -- 172.21.15.136:0/619006259 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800c7f0 con 0x7f68e80cd660 2023-06-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68cf7fe700 1 -- 172.21.15.136:0/619006259 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d800c950 con 0x7f68e80cd660 2023-06-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc0094a0 con 0x7f68e80cd660 2023-06-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68cf7fe700 1 -- 172.21.15.136:0/619006259 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800cce0 con 0x7f68e80cd660 2023-06-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.935+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e80b67c0 con 0x7f68e80cd660 2023-06-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.936+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e80b70f0 con 0x7f68e80cd660 2023-06-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.937+0000 7f68cf7fe700 1 -- 172.21.15.136:0/619006259 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68d8013470 con 0x7f68e80cd660 2023-06-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.938+0000 7f68cf7fe700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68d406ace0 0x7f68d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.938+0000 7f68cf7fe700 1 -- 172.21.15.136:0/619006259 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f68d80897e0 con 0x7f68e80cd660 2023-06-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.938+0000 7f68e67fc700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68d406ace0 0x7f68d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.939+0000 7f68e67fc700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68d406ace0 0x7f68d406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000c00 tx=0x7f68dc01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:22.942+0000 7f68cf7fe700 1 -- 172.21.15.136:0/619006259 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68d8054550 con 0x7f68e80cd660 2023-06-23T19:02:23.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.157+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f68e815cf80 con 0x7f68e80cd660 2023-06-23T19:02:23.161 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.157+0000 7f68cf7fe700 1 -- 172.21.15.136:0/619006259 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f68d8057b70 con 0x7f68e80cd660 2023-06-23T19:02:23.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68d406ace0 msgr2=0x7f68d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68d406ace0 0x7f68d406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000c00 tx=0x7f68dc01c040 comp rx=0 tx=0).stop 2023-06-23T19:02:23.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68e80cd660 msgr2=0x7f68e80b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68e80cd660 0x7f68e80b59b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f68d800ebe0 tx=0x7f68d800eef0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 shutdown_connections 2023-06-23T19:02:23.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f68d406ace0 0x7f68d406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68e8160880 0x7f68e80b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68e80cd660 0x7f68e80b59b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 --2- 172.21.15.136:0/619006259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68e815c570 0x7f68e80b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 >> 172.21.15.136:0/619006259 conn(0x7f68e8071620 msgr2=0x7f68e80d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:23.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 shutdown_connections 2023-06-23T19:02:23.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.160+0000 7f68ed7ff700 1 -- 172.21.15.136:0/619006259 wait complete. 2023-06-23T19:02:23.168 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2023-06-23T19:02:23.182 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-06-23T19:02:23.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:23.183 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-06-23T19:02:23.272 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2023-06-23T19:02:23.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:23.274 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-23T19:02:23.320 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-23T19:02:23.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:02:23.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.510+0000 7fb4c75ff700 1 Processor -- start 2023-06-23T19:02:23.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.510+0000 7fb4c75ff700 1 -- start start 2023-06-23T19:02:23.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.511+0000 7fb4c75ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4c015a1c0 0x7fb4c00cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.511+0000 7fb4c75ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb4c006b530 0x7fb4c0070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.511+0000 7fb4c75ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb4c00cad40 0x7fb4c00cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.511+0000 7fb4c75ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c015a590 con 0x7fb4c00cad40 2023-06-23T19:02:23.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c75ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c00715f0 con 0x7fb4c006b530 2023-06-23T19:02:23.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c75ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0071310 con 0x7fb4c015a1c0 2023-06-23T19:02:23.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c5b9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb4c00cad40 0x7fb4c00cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:23.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c5b9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb4c00cad40 0x7fb4c00cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59468/0 (socket says 172.21.15.136:59468) 2023-06-23T19:02:23.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c5b9c700 1 -- 172.21.15.136:0/2440147347 learned_addr learned my addr 172.21.15.136:0/2440147347 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:23.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c5b9c700 1 -- 172.21.15.136:0/2440147347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4c015a1c0 msgr2=0x7fb4c00cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:23.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c5b9c700 1 --2- 172.21.15.136:0/2440147347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4c015a1c0 0x7fb4c00cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c5b9c700 1 -- 172.21.15.136:0/2440147347 >> v2:172.21.15.178:3300/0 conn(0x7fb4c006b530 msgr2=0x7fb4c0070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:23.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c5b9c700 1 --2- 172.21.15.136:0/2440147347 >> v2:172.21.15.178:3300/0 conn(0x7fb4c006b530 0x7fb4c0070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c5b9c700 1 -- 172.21.15.136:0/2440147347 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c00ccc10 con 0x7fb4c00cad40 2023-06-23T19:02:23.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.512+0000 7fb4c5b9c700 1 --2- 172.21.15.136:0/2440147347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 0x7fb4c00cb1c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb4c006fc00 tx=0x7fb4b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88c8952a2e7a36d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:23.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4b7fff700 1 -- 172.21.15.136:0/2440147347 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b800e070 con 0x7fb4c00cad40 2023-06-23T19:02:23.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4b7fff700 1 -- 172.21.15.136:0/2440147347 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b800b9c0 con 0x7fb4c00cad40 2023-06-23T19:02:23.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4b7fff700 1 -- 172.21.15.136:0/2440147347 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b800bd70 con 0x7fb4c00cad40 2023-06-23T19:02:23.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2440147347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 msgr2=0x7fb4c00cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2440147347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 0x7fb4c00cb1c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb4c006fc00 tx=0x7fb4b800b330 comp rx=0 tx=0).stop 2023-06-23T19:02:23.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2440147347 shutdown_connections 2023-06-23T19:02:23.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2440147347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 0x7fb4c00cb1c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2440147347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4c015a1c0 0x7fb4c00cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2440147347 >> v2:172.21.15.178:3300/0 conn(0x7fb4c006b530 0x7fb4c0070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2440147347 >> 172.21.15.136:0/2440147347 conn(0x7fb4c00cba20 msgr2=0x7fb4c00cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:23.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2440147347 shutdown_connections 2023-06-23T19:02:23.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.513+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2440147347 wait complete. 2023-06-23T19:02:23.521 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.515+0000 7fb4c75ff700 1 Processor -- start 2023-06-23T19:02:23.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.515+0000 7fb4c75ff700 1 -- start start 2023-06-23T19:02:23.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.516+0000 7fb4c75ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4c006b530 0x7fb4c014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.516+0000 7fb4c75ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 0x7fb4c00af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.516+0000 7fb4c75ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4c015a1c0 0x7fb4c00c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.516+0000 7fb4c75ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00b08e0 con 0x7fb4c00cad40 2023-06-23T19:02:23.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.516+0000 7fb4c75ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00afc60 con 0x7fb4c015a1c0 2023-06-23T19:02:23.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.516+0000 7fb4c75ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00aff40 con 0x7fb4c006b530 2023-06-23T19:02:23.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.516+0000 7fb4c4b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 0x7fb4c00af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:23.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.516+0000 7fb4c4b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 0x7fb4c00af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59478/0 (socket says 172.21.15.136:59478) 2023-06-23T19:02:23.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.516+0000 7fb4c4b9a700 1 -- 172.21.15.136:0/2880896901 learned_addr learned my addr 172.21.15.136:0/2880896901 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:23.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c539b700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4c006b530 0x7fb4c014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:23.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c5b9c700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4c015a1c0 0x7fb4c00c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:23.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c4b9a700 1 -- 172.21.15.136:0/2880896901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4c006b530 msgr2=0x7fb4c014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c4b9a700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4c006b530 0x7fb4c014a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c4b9a700 1 -- 172.21.15.136:0/2880896901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4c015a1c0 msgr2=0x7fb4c00c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c4b9a700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4c015a1c0 0x7fb4c00c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c4b9a700 1 -- 172.21.15.136:0/2880896901 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8009b30 con 0x7fb4c00cad40 2023-06-23T19:02:23.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c4b9a700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 0x7fb4c00af330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000b4a0 tx=0x7fb4b000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:23.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4b5ffb700 1 -- 172.21.15.136:0/2880896901 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011830 con 0x7fb4c00cad40 2023-06-23T19:02:23.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4b5ffb700 1 -- 172.21.15.136:0/2880896901 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b0011990 con 0x7fb4c00cad40 2023-06-23T19:02:23.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c00b0220 con 0x7fb4c00cad40 2023-06-23T19:02:23.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4b5ffb700 1 -- 172.21.15.136:0/2880896901 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011d40 con 0x7fb4c00cad40 2023-06-23T19:02:23.525 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.517+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c014a8a0 con 0x7fb4c00cad40 2023-06-23T19:02:23.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.519+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c00b0a20 con 0x7fb4c00cad40 2023-06-23T19:02:23.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.519+0000 7fb4b5ffb700 1 -- 172.21.15.136:0/2880896901 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4b001a400 con 0x7fb4c00cad40 2023-06-23T19:02:23.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.520+0000 7fb4b5ffb700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb4a406ace0 0x7fb4a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.520+0000 7fb4b5ffb700 1 -- 172.21.15.136:0/2880896901 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb4b0089790 con 0x7fb4c00cad40 2023-06-23T19:02:23.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.520+0000 7fb4c539b700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb4a406ace0 0x7fb4a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:23.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.521+0000 7fb4c539b700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb4a406ace0 0x7fb4a406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc006fd0 tx=0x7fb4bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:23.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.524+0000 7fb4b5ffb700 1 -- 172.21.15.136:0/2880896901 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb4c00b0a20 con 0x7fb4c00cad40 2023-06-23T19:02:23.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.762+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4c00b0a20 con 0x7fb4c00cad40 2023-06-23T19:02:23.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.763+0000 7fb4b5ffb700 1 -- 172.21.15.136:0/2880896901 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7fb4c00b0a20 con 0x7fb4c00cad40 2023-06-23T19:02:23.767 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:23.767 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:31.031767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T19:02:23.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb4a406ace0 msgr2=0x7fb4a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb4a406ace0 0x7fb4a406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc006fd0 tx=0x7fb4bc008040 comp rx=0 tx=0).stop 2023-06-23T19:02:23.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 msgr2=0x7fb4c00af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 0x7fb4c00af330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000b4a0 tx=0x7fb4b000b860 comp rx=0 tx=0).stop 2023-06-23T19:02:23.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 shutdown_connections 2023-06-23T19:02:23.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb4a406ace0 0x7fb4a406d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4c015a1c0 0x7fb4c00c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4c006b530 0x7fb4c014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 --2- 172.21.15.136:0/2880896901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4c00cad40 0x7fb4c00af330 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 >> 172.21.15.136:0/2880896901 conn(0x7fb4c00cba20 msgr2=0x7fb4c00b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:23.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 shutdown_connections 2023-06-23T19:02:23.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.765+0000 7fb4c75ff700 1 -- 172.21.15.136:0/2880896901 wait complete. 2023-06-23T19:02:23.771 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2023-06-23T19:02:23.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:23.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.978+0000 7f34901ff700 1 Processor -- start 2023-06-23T19:02:23.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.979+0000 7f34901ff700 1 -- start start 2023-06-23T19:02:23.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f34901ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f348815c570 0x7f34880cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f34901ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3488160e70 con 0x7f34880cd660 2023-06-23T19:02:23.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f34901ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34881610a0 con 0x7f3488160a50 2023-06-23T19:02:23.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f34901ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348815d670 con 0x7f348815c570 2023-06-23T19:02:23.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f348df9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f348815c570 0x7f34880cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:23.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f348df9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f348815c570 0x7f34880cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59490/0 (socket says 172.21.15.136:59490) 2023-06-23T19:02:23.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f348d79a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f34880cd660 0x7f3488160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46898/0 (socket says 172.21.15.136:46898) 2023-06-23T19:02:23.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f348df9b700 1 -- 172.21.15.136:0/2191254506 learned_addr learned my addr 172.21.15.136:0/2191254506 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:23.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f348df9b700 1 -- 172.21.15.136:0/2191254506 >> v1:172.21.15.178:6789/0 conn(0x7f3488160a50 legacy=0x7f34880d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f348df9b700 1 -- 172.21.15.136:0/2191254506 >> v1:172.21.15.136:6789/0 conn(0x7f34880cd660 legacy=0x7f3488160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.980+0000 7f348df9b700 1 -- 172.21.15.136:0/2191254506 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348815da90 con 0x7f348815c570 2023-06-23T19:02:23.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.981+0000 7f348df9b700 1 --2- 172.21.15.136:0/2191254506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348815c570 0x7f34880cd120 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f34840098f0 tx=0x7f3484009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74469a9bbd88449c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:23.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.981+0000 7f348cf99700 1 -- 172.21.15.136:0/2191254506 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400b8a0 con 0x7f348815c570 2023-06-23T19:02:23.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.981+0000 7f348cf99700 1 -- 172.21.15.136:0/2191254506 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348400ba00 con 0x7f348815c570 2023-06-23T19:02:23.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.981+0000 7f348cf99700 1 -- 172.21.15.136:0/2191254506 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400bd90 con 0x7f348815c570 2023-06-23T19:02:23.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.981+0000 7f34901ff700 1 -- 172.21.15.136:0/2191254506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348815c570 msgr2=0x7f34880cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.981+0000 7f34901ff700 1 --2- 172.21.15.136:0/2191254506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348815c570 0x7f34880cd120 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f34840098f0 tx=0x7f3484009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:23.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.982+0000 7f34901ff700 1 -- 172.21.15.136:0/2191254506 shutdown_connections 2023-06-23T19:02:23.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.982+0000 7f34901ff700 1 --2- 172.21.15.136:0/2191254506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348815c570 0x7f34880cd120 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.982+0000 7f34901ff700 1 -- 172.21.15.136:0/2191254506 >> 172.21.15.136:0/2191254506 conn(0x7f3488071620 msgr2=0x7f34880719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:23.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.982+0000 7f34901ff700 1 -- 172.21.15.136:0/2191254506 shutdown_connections 2023-06-23T19:02:23.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.982+0000 7f34901ff700 1 -- 172.21.15.136:0/2191254506 wait complete. 2023-06-23T19:02:23.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.983+0000 7f34901ff700 1 Processor -- start 2023-06-23T19:02:23.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.983+0000 7f34901ff700 1 -- start start 2023-06-23T19:02:23.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.984+0000 7f34901ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34880cd660 0x7f348814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.984+0000 7f34901ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f348815c570 0x7f3488147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.984+0000 7f34901ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3488160a50 0x7f34880cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.984+0000 7f34901ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3488147fb0 con 0x7f3488160a50 2023-06-23T19:02:23.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.984+0000 7f34901ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3488148290 con 0x7f348815c570 2023-06-23T19:02:23.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.984+0000 7f34901ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3488148570 con 0x7f34880cd660 2023-06-23T19:02:23.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348e79c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3488160a50 0x7f34880cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:23.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348e79c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3488160a50 0x7f34880cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59498/0 (socket says 172.21.15.136:59498) 2023-06-23T19:02:23.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348e79c700 1 -- 172.21.15.136:0/3615006413 learned_addr learned my addr 172.21.15.136:0/3615006413 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:23.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348d79a700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f348815c570 0x7f3488147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:23.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348e79c700 1 -- 172.21.15.136:0/3615006413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34880cd660 msgr2=0x7f348814a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348e79c700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34880cd660 0x7f348814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348e79c700 1 -- 172.21.15.136:0/3615006413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f348815c570 msgr2=0x7f3488147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:23.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348e79c700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f348815c570 0x7f3488147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:23.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348e79c700 1 -- 172.21.15.136:0/3615006413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009550 con 0x7f3488160a50 2023-06-23T19:02:23.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348d79a700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f348815c570 0x7f3488147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:23.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f348e79c700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3488160a50 0x7f34880cb490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f348000cc50 tx=0x7f348000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:23.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f347e7fc700 1 -- 172.21.15.136:0/3615006413 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000ad80 con 0x7f3488160a50 2023-06-23T19:02:23.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f347e7fc700 1 -- 172.21.15.136:0/3615006413 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348000ce50 con 0x7f3488160a50 2023-06-23T19:02:23.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3488148850 con 0x7f3488160a50 2023-06-23T19:02:23.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.985+0000 7f347e7fc700 1 -- 172.21.15.136:0/3615006413 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480003c40 con 0x7f3488160a50 2023-06-23T19:02:23.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.986+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348814abc0 con 0x7f3488160a50 2023-06-23T19:02:23.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.987+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348815e160 con 0x7f3488160a50 2023-06-23T19:02:23.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.987+0000 7f347e7fc700 1 -- 172.21.15.136:0/3615006413 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34800050d0 con 0x7f3488160a50 2023-06-23T19:02:23.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.989+0000 7f347e7fc700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f346c06ace0 0x7f346c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:23.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.989+0000 7f347e7fc700 1 -- 172.21.15.136:0/3615006413 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3480089960 con 0x7f3488160a50 2023-06-23T19:02:23.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.989+0000 7f348df9b700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f346c06ace0 0x7f346c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:23.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.990+0000 7f348df9b700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f346c06ace0 0x7f346c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f34880b41b0 tx=0x7f3484010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:23.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:23.993+0000 7f347e7fc700 1 -- 172.21.15.136:0/3615006413 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3480054640 con 0x7f3488160a50 2023-06-23T19:02:24.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.194+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3488073910 con 0x7f3488160a50 2023-06-23T19:02:24.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.196+0000 7f347e7fc700 1 -- 172.21.15.136:0/3615006413 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f3480057c60 con 0x7f3488160a50 2023-06-23T19:02:24.200 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:24.200 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:24.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f346c06ace0 msgr2=0x7f346c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f346c06ace0 0x7f346c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f34880b41b0 tx=0x7f3484010000 comp rx=0 tx=0).stop 2023-06-23T19:02:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3488160a50 msgr2=0x7f34880cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3488160a50 0x7f34880cb490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f348000cc50 tx=0x7f348000a340 comp rx=0 tx=0).stop 2023-06-23T19:02:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 shutdown_connections 2023-06-23T19:02:24.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f346c06ace0 0x7f346c06d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3488160a50 0x7f34880cb490 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34880cd660 0x7f348814a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 --2- 172.21.15.136:0/3615006413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f348815c570 0x7f3488147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 >> 172.21.15.136:0/3615006413 conn(0x7f3488071620 msgr2=0x7f34880d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:24.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 shutdown_connections 2023-06-23T19:02:24.208 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.198+0000 7f34901ff700 1 -- 172.21.15.136:0/3615006413 wait complete. 2023-06-23T19:02:24.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:01:02.019612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:01:03.332383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T19:01:06.399217+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T19:02:24.222 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:02:24.430 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.421+0000 7f090f7ff700 1 Processor -- start 2023-06-23T19:02:24.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.422+0000 7f090f7ff700 1 -- start start 2023-06-23T19:02:24.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.423+0000 7f090f7ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f09080b5a70 0x7f09080b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.423+0000 7f090f7ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09080b5ec0 con 0x7f09080cf910 2023-06-23T19:02:24.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.423+0000 7f090f7ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09080cd9d0 con 0x7f09080d0a60 2023-06-23T19:02:24.431 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.423+0000 7f090f7ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09080d0060 con 0x7f09080b5a70 2023-06-23T19:02:24.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.423+0000 7f090cd9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f09080b5a70 0x7f09080b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.423+0000 7f090dd9c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f09080cf910 0x7f09080d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:46910/0 (socket says 172.21.15.136:46910) 2023-06-23T19:02:24.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.423+0000 7f090dd9c700 1 -- 172.21.15.136:0/1923228713 learned_addr learned my addr 172.21.15.136:0/1923228713 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:24.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.423+0000 7f090cd9a700 1 -- 172.21.15.136:0/1923228713 >> v1:172.21.15.178:6789/0 conn(0x7f09080d0a60 legacy=0x7f09080d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.424+0000 7f090cd9a700 1 -- 172.21.15.136:0/1923228713 >> v1:172.21.15.136:6789/0 conn(0x7f09080cf910 legacy=0x7f09080d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.424+0000 7f090cd9a700 1 -- 172.21.15.136:0/1923228713 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080cd410 con 0x7f09080b5a70 2023-06-23T19:02:24.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.424+0000 7f090cd9a700 1 --2- 172.21.15.136:0/1923228713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080b5a70 0x7f09080b51d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009840 tx=0x7f08f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543cab5fe53d06c1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:24.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.424+0000 7f08fffff700 1 -- 172.21.15.136:0/1923228713 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8011830 con 0x7f09080b5a70 2023-06-23T19:02:24.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.424+0000 7f08fffff700 1 -- 172.21.15.136:0/1923228713 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8011990 con 0x7f09080b5a70 2023-06-23T19:02:24.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.424+0000 7f08fffff700 1 -- 172.21.15.136:0/1923228713 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8011d20 con 0x7f09080b5a70 2023-06-23T19:02:24.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.424+0000 7f090f7ff700 1 -- 172.21.15.136:0/1923228713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080b5a70 msgr2=0x7f09080b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.424+0000 7f090f7ff700 1 --2- 172.21.15.136:0/1923228713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080b5a70 0x7f09080b51d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009840 tx=0x7f08f8009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:24.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.425+0000 7f090f7ff700 1 -- 172.21.15.136:0/1923228713 shutdown_connections 2023-06-23T19:02:24.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.425+0000 7f090f7ff700 1 --2- 172.21.15.136:0/1923228713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080b5a70 0x7f09080b51d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.425+0000 7f090f7ff700 1 -- 172.21.15.136:0/1923228713 >> 172.21.15.136:0/1923228713 conn(0x7f0908071620 msgr2=0x7f09080719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:24.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.425+0000 7f090f7ff700 1 -- 172.21.15.136:0/1923228713 shutdown_connections 2023-06-23T19:02:24.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.425+0000 7f090f7ff700 1 -- 172.21.15.136:0/1923228713 wait complete. 2023-06-23T19:02:24.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.427+0000 7f090f7ff700 1 Processor -- start 2023-06-23T19:02:24.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.427+0000 7f090f7ff700 1 -- start start 2023-06-23T19:02:24.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090f7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09080b5a70 0x7f09080c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090f7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09080cf910 0x7f090815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090f7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080d0a60 0x7f09081563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090f7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090815dab0 con 0x7f09080d0a60 2023-06-23T19:02:24.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090f7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080c83e0 con 0x7f09080b5a70 2023-06-23T19:02:24.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090f7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09080c86c0 con 0x7f09080cf910 2023-06-23T19:02:24.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090dd9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080d0a60 0x7f09081563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090dd9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080d0a60 0x7f09081563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59518/0 (socket says 172.21.15.136:59518) 2023-06-23T19:02:24.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090dd9c700 1 -- 172.21.15.136:0/1782182603 learned_addr learned my addr 172.21.15.136:0/1782182603 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:24.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090cd9a700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09080cf910 0x7f090815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090d59b700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09080b5a70 0x7f09080c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090dd9c700 1 -- 172.21.15.136:0/1782182603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09080cf910 msgr2=0x7f090815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090dd9c700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09080cf910 0x7f090815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090dd9c700 1 -- 172.21.15.136:0/1782182603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09080b5a70 msgr2=0x7f09080c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090dd9c700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09080b5a70 0x7f09080c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090dd9c700 1 -- 172.21.15.136:0/1782182603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80094a0 con 0x7f09080d0a60 2023-06-23T19:02:24.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090cd9a700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09080cf910 0x7f090815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:24.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.428+0000 7f090dd9c700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080d0a60 0x7f09081563d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f090000cbc0 tx=0x7f090000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:24.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.429+0000 7f08fdffb700 1 -- 172.21.15.136:0/1782182603 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000ab50 con 0x7f09080d0a60 2023-06-23T19:02:24.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.429+0000 7f08fdffb700 1 -- 172.21.15.136:0/1782182603 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000acb0 con 0x7f09080d0a60 2023-06-23T19:02:24.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.429+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09080c89a0 con 0x7f09080d0a60 2023-06-23T19:02:24.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.429+0000 7f08fdffb700 1 -- 172.21.15.136:0/1782182603 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900012600 con 0x7f09080d0a60 2023-06-23T19:02:24.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.429+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09080c8f60 con 0x7f09080d0a60 2023-06-23T19:02:24.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.430+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09080c9150 con 0x7f09080d0a60 2023-06-23T19:02:24.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.431+0000 7f08fdffb700 1 -- 172.21.15.136:0/1782182603 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f090001b3b0 con 0x7f09080d0a60 2023-06-23T19:02:24.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.432+0000 7f08fdffb700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08ec06ace0 0x7f08ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.432+0000 7f08fdffb700 1 -- 172.21.15.136:0/1782182603 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f09000893b0 con 0x7f09080d0a60 2023-06-23T19:02:24.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.432+0000 7f090d59b700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08ec06ace0 0x7f08ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.433+0000 7f090d59b700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08ec06ace0 0x7f08ec06d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0904000f60 tx=0x7f0904009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:24.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.436+0000 7f08fdffb700 1 -- 172.21.15.136:0/1782182603 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0900054270 con 0x7f09080d0a60 2023-06-23T19:02:24.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.631+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f090804ea20 con 0x7f09080d0a60 2023-06-23T19:02:24.635 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.631+0000 7f08fdffb700 1 -- 172.21.15.136:0/1782182603 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0900057890 con 0x7f09080d0a60 2023-06-23T19:02:24.635 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:02:24.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08ec06ace0 msgr2=0x7f08ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08ec06ace0 0x7f08ec06d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0904000f60 tx=0x7f0904009040 comp rx=0 tx=0).stop 2023-06-23T19:02:24.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080d0a60 msgr2=0x7f09081563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080d0a60 0x7f09081563d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f090000cbc0 tx=0x7f090000cf80 comp rx=0 tx=0).stop 2023-06-23T19:02:24.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 shutdown_connections 2023-06-23T19:02:24.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f08ec06ace0 0x7f08ec06d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.637 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09080b5a70 0x7f09080c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09080d0a60 0x7f09081563d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 --2- 172.21.15.136:0/1782182603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09080cf910 0x7f090815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 >> 172.21.15.136:0/1782182603 conn(0x7f0908071620 msgr2=0x7f09080b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:24.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 shutdown_connections 2023-06-23T19:02:24.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.633+0000 7f090f7ff700 1 -- 172.21.15.136:0/1782182603 wait complete. 2023-06-23T19:02:24.655 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:02:24.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.848+0000 7f3fec5ff700 1 Processor -- start 2023-06-23T19:02:24.851 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.848+0000 7f3fec5ff700 1 -- start start 2023-06-23T19:02:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.849+0000 7f3fec5ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3fe40d0a60 0x7f3fe40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.849+0000 7f3fec5ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40cd9d0 con 0x7f3fe40cf910 2023-06-23T19:02:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.849+0000 7f3fec5ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40b5620 con 0x7f3fe40b51d0 2023-06-23T19:02:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.849+0000 7f3fec5ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40d0060 con 0x7f3fe40d0a60 2023-06-23T19:02:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.849+0000 7f3fea39b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3fe40d0a60 0x7f3fe40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.849+0000 7f3feab9c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3fe40cf910 0x7f3fe40d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36666/0 (socket says 172.21.15.136:36666) 2023-06-23T19:02:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.849+0000 7f3fea39b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3fe40d0a60 0x7f3fe40b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51686/0 (socket says 172.21.15.136:51686) 2023-06-23T19:02:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.849+0000 7f3feab9c700 1 -- 172.21.15.136:0/361907992 learned_addr learned my addr 172.21.15.136:0/361907992 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:24.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.850+0000 7f3fea39b700 1 -- 172.21.15.136:0/361907992 >> v1:172.21.15.178:6789/0 conn(0x7f3fe40b51d0 legacy=0x7f3fe40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:24.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.850+0000 7f3fea39b700 1 -- 172.21.15.136:0/361907992 >> v1:172.21.15.136:6789/0 conn(0x7f3fe40cf910 legacy=0x7f3fe40d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.850+0000 7f3fea39b700 1 -- 172.21.15.136:0/361907992 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe40cd410 con 0x7f3fe40d0a60 2023-06-23T19:02:24.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.850+0000 7f3fea39b700 1 --2- 172.21.15.136:0/361907992 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 0x7f3fe40b5a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009840 tx=0x7f3fe0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66fb9c6e8605771 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:24.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.850+0000 7f3fe9399700 1 -- 172.21.15.136:0/361907992 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0004230 con 0x7f3fe40d0a60 2023-06-23T19:02:24.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.850+0000 7f3fe9399700 1 -- 172.21.15.136:0/361907992 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe0004390 con 0x7f3fe40d0a60 2023-06-23T19:02:24.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.850+0000 7f3fe9399700 1 -- 172.21.15.136:0/361907992 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00036a0 con 0x7f3fe40d0a60 2023-06-23T19:02:24.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.851+0000 7f3fec5ff700 1 -- 172.21.15.136:0/361907992 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 msgr2=0x7f3fe40b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.851+0000 7f3fec5ff700 1 --2- 172.21.15.136:0/361907992 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 0x7f3fe40b5a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009840 tx=0x7f3fe0009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:24.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.851+0000 7f3fec5ff700 1 -- 172.21.15.136:0/361907992 shutdown_connections 2023-06-23T19:02:24.856 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.851+0000 7f3fec5ff700 1 --2- 172.21.15.136:0/361907992 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 0x7f3fe40b5a70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.851+0000 7f3fec5ff700 1 -- 172.21.15.136:0/361907992 >> 172.21.15.136:0/361907992 conn(0x7f3fe4071620 msgr2=0x7f3fe40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:24.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.851+0000 7f3fec5ff700 1 -- 172.21.15.136:0/361907992 shutdown_connections 2023-06-23T19:02:24.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.851+0000 7f3fec5ff700 1 -- 172.21.15.136:0/361907992 wait complete. 2023-06-23T19:02:24.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.852+0000 7f3fec5ff700 1 Processor -- start 2023-06-23T19:02:24.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.853+0000 7f3fec5ff700 1 -- start start 2023-06-23T19:02:24.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.853+0000 7f3fec5ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe40b51d0 0x7f3fe415a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.853+0000 7f3fec5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe40cf910 0x7f3fe41f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3fec5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 0x7f3fe41f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3fec5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41f6020 con 0x7f3fe40d0a60 2023-06-23T19:02:24.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3fec5ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c7af0 con 0x7f3fe40b51d0 2023-06-23T19:02:24.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3fec5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41f6240 con 0x7f3fe40cf910 2023-06-23T19:02:24.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3feab9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 0x7f3fe41f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3feab9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 0x7f3fe41f5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51692/0 (socket says 172.21.15.136:51692) 2023-06-23T19:02:24.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3feab9c700 1 -- 172.21.15.136:0/253723388 learned_addr learned my addr 172.21.15.136:0/253723388 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:24.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3fea39b700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe40b51d0 0x7f3fe415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3fe9b9a700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe40cf910 0x7f3fe41f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3feab9c700 1 -- 172.21.15.136:0/253723388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe40cf910 msgr2=0x7f3fe41f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3feab9c700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe40cf910 0x7f3fe41f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3feab9c700 1 -- 172.21.15.136:0/253723388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe40b51d0 msgr2=0x7f3fe415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:24.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3feab9c700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe40b51d0 0x7f3fe415a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:24.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3feab9c700 1 -- 172.21.15.136:0/253723388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00094a0 con 0x7f3fe40d0a60 2023-06-23T19:02:24.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3fea39b700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe40b51d0 0x7f3fe415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:24.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.854+0000 7f3feab9c700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 0x7f3fe41f5ae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00cbf0 tx=0x7f3fdc0021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:24.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.855+0000 7f3fdaffd700 1 -- 172.21.15.136:0/253723388 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc00ab40 con 0x7f3fe40d0a60 2023-06-23T19:02:24.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.855+0000 7f3fdaffd700 1 -- 172.21.15.136:0/253723388 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc00aca0 con 0x7f3fe40d0a60 2023-06-23T19:02:24.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.855+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40c71c0 con 0x7f3fe40d0a60 2023-06-23T19:02:24.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.855+0000 7f3fdaffd700 1 -- 172.21.15.136:0/253723388 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc012600 con 0x7f3fe40d0a60 2023-06-23T19:02:24.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.855+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe40c7780 con 0x7f3fe40d0a60 2023-06-23T19:02:24.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.856+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe404ea20 con 0x7f3fe40d0a60 2023-06-23T19:02:24.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.857+0000 7f3fdaffd700 1 -- 172.21.15.136:0/253723388 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3fdc01b3b0 con 0x7f3fe40d0a60 2023-06-23T19:02:24.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.858+0000 7f3fdaffd700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc806ace0 0x7f3fc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:24.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.858+0000 7f3fdaffd700 1 -- 172.21.15.136:0/253723388 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3fdc089440 con 0x7f3fe40d0a60 2023-06-23T19:02:24.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.858+0000 7f3fea39b700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc806ace0 0x7f3fc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:24.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.859+0000 7f3fea39b700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc806ace0 0x7f3fc806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00090b0 tx=0x7f3fe0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:24.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:24.862+0000 7f3fdaffd700 1 -- 172.21.15.136:0/253723388 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3fdc0541d0 con 0x7f3fe40d0a60 2023-06-23T19:02:25.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.061+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fe40b68a0 con 0x7f3fe40d0a60 2023-06-23T19:02:25.065 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.061+0000 7f3fdaffd700 1 -- 172.21.15.136:0/253723388 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fdc0577f0 con 0x7f3fe40d0a60 2023-06-23T19:02:25.066 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:02:25.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc806ace0 msgr2=0x7f3fc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc806ace0 0x7f3fc806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00090b0 tx=0x7f3fe0008030 comp rx=0 tx=0).stop 2023-06-23T19:02:25.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 msgr2=0x7f3fe41f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 0x7f3fe41f5ae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00cbf0 tx=0x7f3fdc0021c0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.068 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 shutdown_connections 2023-06-23T19:02:25.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3fc806ace0 0x7f3fc806d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe40b51d0 0x7f3fe415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fe40d0a60 0x7f3fe41f5ae0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 --2- 172.21.15.136:0/253723388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe40cf910 0x7f3fe41f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.069 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 >> 172.21.15.136:0/253723388 conn(0x7f3fe4071620 msgr2=0x7f3fe40b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:25.070 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.063+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 shutdown_connections 2023-06-23T19:02:25.070 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.064+0000 7f3fec5ff700 1 -- 172.21.15.136:0/253723388 wait complete. 2023-06-23T19:02:25.086 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:02:25.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.281+0000 7fd50fbff700 1 Processor -- start 2023-06-23T19:02:25.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.281+0000 7fd50fbff700 1 -- start start 2023-06-23T19:02:25.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.282+0000 7fd50fbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.282+0000 7fd50fbff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd5080cf910 0x7fd5080d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.282+0000 7fd50fbff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5080b5ec0 con 0x7fd5080d0a60 2023-06-23T19:02:25.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.282+0000 7fd50fbff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5080d0060 con 0x7fd5080cf910 2023-06-23T19:02:25.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.282+0000 7fd50fbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080cd9d0 con 0x7fd5080b5a70 2023-06-23T19:02:25.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.282+0000 7fd50d99b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd5080d0a60 0x7fd5080d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36676/0 (socket says 172.21.15.136:36676) 2023-06-23T19:02:25.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50d99b700 1 -- 172.21.15.136:0/538895114 learned_addr learned my addr 172.21.15.136:0/538895114 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:25.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50d19a700 1 --2- 172.21.15.136:0/538895114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50e19c700 1 --2- 172.21.15.136:0/538895114 >> v2:172.21.15.178:3300/0 conn(0x7fd5080cf910 0x7fd5080d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50c999700 1 -- 172.21.15.136:0/538895114 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304359540 0 0) 0x7fd5080b5ec0 con 0x7fd5080d0a60 2023-06-23T19:02:25.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50c999700 1 -- 172.21.15.136:0/538895114 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f40035b0 con 0x7fd5080d0a60 2023-06-23T19:02:25.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50d19a700 1 -- 172.21.15.136:0/538895114 >> v2:172.21.15.178:3300/0 conn(0x7fd5080cf910 msgr2=0x7fd5080d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:25.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50d19a700 1 --2- 172.21.15.136:0/538895114 >> v2:172.21.15.178:3300/0 conn(0x7fd5080cf910 0x7fd5080d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50d19a700 1 -- 172.21.15.136:0/538895114 >> v1:172.21.15.136:6789/0 conn(0x7fd5080d0a60 legacy=0x7fd5080d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50d19a700 1 -- 172.21.15.136:0/538895114 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080cfd90 con 0x7fd5080b5a70 2023-06-23T19:02:25.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.283+0000 7fd50e19c700 1 --2- 172.21.15.136:0/538895114 >> v2:172.21.15.178:3300/0 conn(0x7fd5080cf910 0x7fd5080d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:25.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50d19a700 1 --2- 172.21.15.136:0/538895114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080b51d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009840 tx=0x7fd4f8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1718cef2df128496 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:25.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50c999700 1 -- 172.21.15.136:0/538895114 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8011830 con 0x7fd5080b5a70 2023-06-23T19:02:25.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50c999700 1 -- 172.21.15.136:0/538895114 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8011990 con 0x7fd5080b5a70 2023-06-23T19:02:25.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50c999700 1 -- 172.21.15.136:0/538895114 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8011d20 con 0x7fd5080b5a70 2023-06-23T19:02:25.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50fbff700 1 -- 172.21.15.136:0/538895114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 msgr2=0x7fd5080b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50fbff700 1 --2- 172.21.15.136:0/538895114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080b51d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009840 tx=0x7fd4f8009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:25.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50fbff700 1 -- 172.21.15.136:0/538895114 shutdown_connections 2023-06-23T19:02:25.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50fbff700 1 --2- 172.21.15.136:0/538895114 >> v2:172.21.15.178:3300/0 conn(0x7fd5080cf910 0x7fd5080d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50fbff700 1 --2- 172.21.15.136:0/538895114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080b51d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.293 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.284+0000 7fd50fbff700 1 -- 172.21.15.136:0/538895114 >> 172.21.15.136:0/538895114 conn(0x7fd508071620 msgr2=0x7fd5080719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:25.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.285+0000 7fd50fbff700 1 -- 172.21.15.136:0/538895114 shutdown_connections 2023-06-23T19:02:25.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.285+0000 7fd50fbff700 1 -- 172.21.15.136:0/538895114 wait complete. 2023-06-23T19:02:25.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.286+0000 7fd50fbff700 1 Processor -- start 2023-06-23T19:02:25.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.286+0000 7fd50fbff700 1 -- start start 2023-06-23T19:02:25.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.287+0000 7fd50fbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.296 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.287+0000 7fd50fbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5080cf910 0x7fd50815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.287+0000 7fd50fbff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5080d0a60 0x7fd50815e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.287+0000 7fd50fbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080c8430 con 0x7fd5080cf910 2023-06-23T19:02:25.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.287+0000 7fd50fbff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080c8710 con 0x7fd5080d0a60 2023-06-23T19:02:25.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.287+0000 7fd50fbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080c89f0 con 0x7fd5080b5a70 2023-06-23T19:02:25.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d19a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5080cf910 0x7fd50815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d19a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5080cf910 0x7fd50815dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51700/0 (socket says 172.21.15.136:51700) 2023-06-23T19:02:25.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d19a700 1 -- 172.21.15.136:0/2000683004 learned_addr learned my addr 172.21.15.136:0/2000683004 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:25.297 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d99b700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d19a700 1 -- 172.21.15.136:0/2000683004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 msgr2=0x7fd5080c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d19a700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d19a700 1 -- 172.21.15.136:0/2000683004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5080d0a60 msgr2=0x7fd50815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d19a700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5080d0a60 0x7fd50815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d19a700 1 -- 172.21.15.136:0/2000683004 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd500009a70 con 0x7fd5080cf910 2023-06-23T19:02:25.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d99b700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:25.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd50d19a700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5080cf910 0x7fd50815dde0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80090b0 tx=0x7fd4f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:25.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd4fe7fc700 1 -- 172.21.15.136:0/2000683004 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80036a0 con 0x7fd5080cf910 2023-06-23T19:02:25.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.288+0000 7fd4fe7fc700 1 -- 172.21.15.136:0/2000683004 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f801f070 con 0x7fd5080cf910 2023-06-23T19:02:25.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.289+0000 7fd4fe7fc700 1 -- 172.21.15.136:0/2000683004 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8003a40 con 0x7fd5080cf910 2023-06-23T19:02:25.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.289+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f80094a0 con 0x7fd5080cf910 2023-06-23T19:02:25.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.289+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5080c6ca0 con 0x7fd5080cf910 2023-06-23T19:02:25.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.290+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5080c8f10 con 0x7fd5080cf910 2023-06-23T19:02:25.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.291+0000 7fd4fe7fc700 1 -- 172.21.15.136:0/2000683004 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4f8003ba0 con 0x7fd5080cf910 2023-06-23T19:02:25.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.292+0000 7fd4fe7fc700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd4ec06ace0 0x7fd4ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.292+0000 7fd4fe7fc700 1 -- 172.21.15.136:0/2000683004 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd4f8021070 con 0x7fd5080cf910 2023-06-23T19:02:25.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.292+0000 7fd50d99b700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd4ec06ace0 0x7fd4ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.292+0000 7fd50d99b700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd4ec06ace0 0x7fd4ec06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd5040011e0 tx=0x7fd504009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:25.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.296+0000 7fd4fe7fc700 1 -- 172.21.15.136:0/2000683004 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5080c8f10 con 0x7fd5080cf910 2023-06-23T19:02:25.498 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.495+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5080c8f10 con 0x7fd5080cf910 2023-06-23T19:02:25.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.495+0000 7fd4fe7fc700 1 -- 172.21.15.136:0/2000683004 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4f8015020 con 0x7fd5080cf910 2023-06-23T19:02:25.500 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:25.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd4ec06ace0 msgr2=0x7fd4ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd4ec06ace0 0x7fd4ec06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd5040011e0 tx=0x7fd504009040 comp rx=0 tx=0).stop 2023-06-23T19:02:25.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5080cf910 msgr2=0x7fd50815dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5080cf910 0x7fd50815dde0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80090b0 tx=0x7fd4f8004750 comp rx=0 tx=0).stop 2023-06-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 shutdown_connections 2023-06-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd4ec06ace0 0x7fd4ec06d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5080d0a60 0x7fd50815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5080b5a70 0x7fd5080c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 --2- 172.21.15.136:0/2000683004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5080cf910 0x7fd50815dde0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 >> 172.21.15.136:0/2000683004 conn(0x7fd508071620 msgr2=0x7fd5080b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:25.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 shutdown_connections 2023-06-23T19:02:25.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.498+0000 7fd50fbff700 1 -- 172.21.15.136:0/2000683004 wait complete. 2023-06-23T19:02:25.519 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:02:25.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.712+0000 7f6741bff700 1 Processor -- start 2023-06-23T19:02:25.715 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.712+0000 7f6741bff700 1 -- start start 2023-06-23T19:02:25.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.713+0000 7f6741bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f673c0d0a60 0x7f673c0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.713+0000 7f6741bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0b51d0 0x7f673c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.713+0000 7f6741bff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c0cd9d0 con 0x7f673c0d0e30 2023-06-23T19:02:25.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.713+0000 7f6741bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c0d0060 con 0x7f673c0d0a60 2023-06-23T19:02:25.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.713+0000 7f6741bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0cfe50 con 0x7f673c0b51d0 2023-06-23T19:02:25.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.713+0000 7f673b7fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f673c0d0a60 0x7f673c0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.713+0000 7f673b7fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f673c0d0a60 0x7f673c0b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51716/0 (socket says 172.21.15.136:51716) 2023-06-23T19:02:25.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.713+0000 7f673b7fe700 1 -- 172.21.15.136:0/843874179 learned_addr learned my addr 172.21.15.136:0/843874179 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:25.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f6733fff700 1 --2- 172.21.15.136:0/843874179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0b51d0 0x7f673c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f673b7fe700 1 -- 172.21.15.136:0/843874179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0b51d0 msgr2=0x7f673c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:25.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f673b7fe700 1 --2- 172.21.15.136:0/843874179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0b51d0 0x7f673c0cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f673b7fe700 1 -- 172.21.15.136:0/843874179 >> v1:172.21.15.178:6789/0 conn(0x7f673c0d0e30 legacy=0x7f673c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:25.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f673b7fe700 1 -- 172.21.15.136:0/843874179 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c0b5620 con 0x7f673c0d0a60 2023-06-23T19:02:25.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f6733fff700 1 --2- 172.21.15.136:0/843874179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0b51d0 0x7f673c0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:25.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f673b7fe700 1 --2- 172.21.15.136:0/843874179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0d0a60 0x7f673c0b5a70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f672c0098f0 tx=0x7f672c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4054bf3ff99f3c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:25.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f673affd700 1 -- 172.21.15.136:0/843874179 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c004230 con 0x7f673c0d0a60 2023-06-23T19:02:25.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f673affd700 1 -- 172.21.15.136:0/843874179 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c004390 con 0x7f673c0d0a60 2023-06-23T19:02:25.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.714+0000 7f673affd700 1 -- 172.21.15.136:0/843874179 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0036a0 con 0x7f673c0d0a60 2023-06-23T19:02:25.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.715+0000 7f6741bff700 1 -- 172.21.15.136:0/843874179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0d0a60 msgr2=0x7f673c0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.715+0000 7f6741bff700 1 --2- 172.21.15.136:0/843874179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0d0a60 0x7f673c0b5a70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f672c0098f0 tx=0x7f672c009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:25.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.715+0000 7f6741bff700 1 -- 172.21.15.136:0/843874179 shutdown_connections 2023-06-23T19:02:25.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.715+0000 7f6741bff700 1 --2- 172.21.15.136:0/843874179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0d0a60 0x7f673c0b5a70 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.715+0000 7f6741bff700 1 --2- 172.21.15.136:0/843874179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0b51d0 0x7f673c0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.715+0000 7f6741bff700 1 -- 172.21.15.136:0/843874179 >> 172.21.15.136:0/843874179 conn(0x7f673c071620 msgr2=0x7f673c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:25.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.715+0000 7f6741bff700 1 -- 172.21.15.136:0/843874179 shutdown_connections 2023-06-23T19:02:25.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.715+0000 7f6741bff700 1 -- 172.21.15.136:0/843874179 wait complete. 2023-06-23T19:02:25.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.717+0000 7f6741bff700 1 Processor -- start 2023-06-23T19:02:25.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.717+0000 7f6741bff700 1 -- start start 2023-06-23T19:02:25.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f6741bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0b51d0 0x7f673c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f6741bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0d0a60 0x7f673c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.726 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f6741bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0d0e30 0x7f673c148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f6741bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c149f50 con 0x7f673c0b51d0 2023-06-23T19:02:25.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f6741bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0c6c40 con 0x7f673c0d0e30 2023-06-23T19:02:25.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f6741bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0c9a00 con 0x7f673c0d0a60 2023-06-23T19:02:25.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0b51d0 0x7f673c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0b51d0 0x7f673c0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51724/0 (socket says 172.21.15.136:51724) 2023-06-23T19:02:25.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673b7fe700 1 -- 172.21.15.136:0/771614337 learned_addr learned my addr 172.21.15.136:0/771614337 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:25.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f6733fff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0d0a60 0x7f673c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673bfff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0d0e30 0x7f673c148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673b7fe700 1 -- 172.21.15.136:0/771614337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0d0a60 msgr2=0x7f673c0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673b7fe700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0d0a60 0x7f673c0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673b7fe700 1 -- 172.21.15.136:0/771614337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0d0e30 msgr2=0x7f673c148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673b7fe700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0d0e30 0x7f673c148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673b7fe700 1 -- 172.21.15.136:0/771614337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c009550 con 0x7f673c0b51d0 2023-06-23T19:02:25.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.718+0000 7f673bfff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0d0e30 0x7f673c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:25.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.719+0000 7f673b7fe700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0b51d0 0x7f673c0c94c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f672c009130 tx=0x7f672c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:25.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.719+0000 7f6738ff9700 1 -- 172.21.15.136:0/771614337 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c003e30 con 0x7f673c0b51d0 2023-06-23T19:02:25.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.719+0000 7f6738ff9700 1 -- 172.21.15.136:0/771614337 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c01f070 con 0x7f673c0b51d0 2023-06-23T19:02:25.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.719+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c149990 con 0x7f673c0b51d0 2023-06-23T19:02:25.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.719+0000 7f6738ff9700 1 -- 172.21.15.136:0/771614337 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c00b8a0 con 0x7f673c0b51d0 2023-06-23T19:02:25.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.719+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c0c68d0 con 0x7f673c0b51d0 2023-06-23T19:02:25.730 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.720+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c0c66f0 con 0x7f673c0b51d0 2023-06-23T19:02:25.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.721+0000 7f6738ff9700 1 -- 172.21.15.136:0/771614337 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f672c021030 con 0x7f673c0b51d0 2023-06-23T19:02:25.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.722+0000 7f6738ff9700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:25.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.722+0000 7f6738ff9700 1 -- 172.21.15.136:0/771614337 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f672c08aec0 con 0x7f673c0b51d0 2023-06-23T19:02:25.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.722+0000 7f6733fff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:25.731 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.722+0000 7f6733fff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f673c1f5510 tx=0x7f6724008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:25.732 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.726+0000 7f6738ff9700 1 -- 172.21.15.136:0/771614337 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f672c055c30 con 0x7f673c0b51d0 2023-06-23T19:02:25.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.925+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f673c0c66f0 con 0x7f673c0b51d0 2023-06-23T19:02:25.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.925+0000 7f6738ff9700 1 -- 172.21.15.136:0/771614337 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f672c010380 con 0x7f673c0b51d0 2023-06-23T19:02:25.930 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-23T19:02:25.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 msgr2=0x7f671c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f673c1f5510 tx=0x7f6724008040 comp rx=0 tx=0).stop 2023-06-23T19:02:25.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0b51d0 msgr2=0x7f673c0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:25.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0b51d0 0x7f673c0c94c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f672c009130 tx=0x7f672c004750 comp rx=0 tx=0).stop 2023-06-23T19:02:25.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 shutdown_connections 2023-06-23T19:02:25.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f671c06ace0 0x7f671c06d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673c0d0e30 0x7f673c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f673c0b51d0 0x7f673c0c94c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 --2- 172.21.15.136:0/771614337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f673c0d0a60 0x7f673c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:25.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 >> 172.21.15.136:0/771614337 conn(0x7f673c071620 msgr2=0x7f673c0d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:25.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 shutdown_connections 2023-06-23T19:02:25.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:25.928+0000 7f6741bff700 1 -- 172.21.15.136:0/771614337 wait complete. 2023-06-23T19:02:25.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.145+0000 7f81297ff700 1 Processor -- start 2023-06-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.145+0000 7f81297ff700 1 -- start start 2023-06-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.146+0000 7f81297ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f81240d0a60 0x7f81240b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.146+0000 7f81297ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240b51d0 0x7f81240cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.146+0000 7f81297ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81240cd9d0 con 0x7f81240d0e30 2023-06-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.146+0000 7f81297ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81240d0060 con 0x7f81240d0a60 2023-06-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.146+0000 7f81297ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240cfe50 con 0x7f81240b51d0 2023-06-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.146+0000 7f81237fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f81240d0e30 0x7f81240d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36682/0 (socket says 172.21.15.136:36682) 2023-06-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.146+0000 7f81237fe700 1 -- 172.21.15.136:0/519527757 learned_addr learned my addr 172.21.15.136:0/519527757 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.146+0000 7f8122ffd700 1 --2- 172.21.15.136:0/519527757 >> v2:172.21.15.178:3300/0 conn(0x7f81240d0a60 0x7f81240b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.146+0000 7f811bfff700 1 --2- 172.21.15.136:0/519527757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240b51d0 0x7f81240cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.147+0000 7f81227fc700 1 -- 172.21.15.136:0/519527757 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622313914 0 0) 0x7f81240cd9d0 con 0x7f81240d0e30 2023-06-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.147+0000 7f81227fc700 1 -- 172.21.15.136:0/519527757 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81100035b0 con 0x7f81240d0e30 2023-06-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.147+0000 7f811bfff700 1 -- 172.21.15.136:0/519527757 >> v2:172.21.15.178:3300/0 conn(0x7f81240d0a60 msgr2=0x7f81240b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.147+0000 7f811bfff700 1 --2- 172.21.15.136:0/519527757 >> v2:172.21.15.178:3300/0 conn(0x7f81240d0a60 0x7f81240b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.147+0000 7f811bfff700 1 -- 172.21.15.136:0/519527757 >> v1:172.21.15.136:6789/0 conn(0x7f81240d0e30 legacy=0x7f81240d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.147+0000 7f811bfff700 1 -- 172.21.15.136:0/519527757 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81240b5620 con 0x7f81240b51d0 2023-06-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.147+0000 7f8122ffd700 1 --2- 172.21.15.136:0/519527757 >> v2:172.21.15.178:3300/0 conn(0x7f81240d0a60 0x7f81240b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.147+0000 7f811bfff700 1 --2- 172.21.15.136:0/519527757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240b51d0 0x7f81240cf910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f810c009840 tx=0x7f810c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac00441cdaf14501 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81227fc700 1 -- 172.21.15.136:0/519527757 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c011830 con 0x7f81240b51d0 2023-06-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81227fc700 1 -- 172.21.15.136:0/519527757 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c011990 con 0x7f81240b51d0 2023-06-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81227fc700 1 -- 172.21.15.136:0/519527757 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c011d20 con 0x7f81240b51d0 2023-06-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81297ff700 1 -- 172.21.15.136:0/519527757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240b51d0 msgr2=0x7f81240cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81297ff700 1 --2- 172.21.15.136:0/519527757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240b51d0 0x7f81240cf910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f810c009840 tx=0x7f810c009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81297ff700 1 -- 172.21.15.136:0/519527757 shutdown_connections 2023-06-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81297ff700 1 --2- 172.21.15.136:0/519527757 >> v2:172.21.15.178:3300/0 conn(0x7f81240d0a60 0x7f81240b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81297ff700 1 --2- 172.21.15.136:0/519527757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240b51d0 0x7f81240cf910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81297ff700 1 -- 172.21.15.136:0/519527757 >> 172.21.15.136:0/519527757 conn(0x7f8124071620 msgr2=0x7f81240719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81297ff700 1 -- 172.21.15.136:0/519527757 shutdown_connections 2023-06-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.148+0000 7f81297ff700 1 -- 172.21.15.136:0/519527757 wait complete. 2023-06-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.150+0000 7f81297ff700 1 Processor -- start 2023-06-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.150+0000 7f81297ff700 1 -- start start 2023-06-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f81297ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81240b51d0 0x7f8124158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f81297ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240d0a60 0x7f81241458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f81297ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81240d0e30 0x7f81240c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f81297ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240c7690 con 0x7f81240b51d0 2023-06-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f81297ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8124145410 con 0x7f81240d0e30 2023-06-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f81297ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81241f1d70 con 0x7f81240d0a60 2023-06-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f8122ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81240b51d0 0x7f8124158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f8122ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81240b51d0 0x7f8124158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51736/0 (socket says 172.21.15.136:51736) 2023-06-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f8122ffd700 1 -- 172.21.15.136:0/1419904827 learned_addr learned my addr 172.21.15.136:0/1419904827 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f811bfff700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240d0a60 0x7f81241458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.151+0000 7f81237fe700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81240d0e30 0x7f81240c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f8122ffd700 1 -- 172.21.15.136:0/1419904827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240d0a60 msgr2=0x7f81241458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f8122ffd700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240d0a60 0x7f81241458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f8122ffd700 1 -- 172.21.15.136:0/1419904827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81240d0e30 msgr2=0x7f81240c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f8122ffd700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81240d0e30 0x7f81240c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f8122ffd700 1 -- 172.21.15.136:0/1419904827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140094a0 con 0x7f81240b51d0 2023-06-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f8122ffd700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81240b51d0 0x7f8124158330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f811400ebe0 tx=0x7f8114009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f811b7fe700 1 -- 172.21.15.136:0/1419904827 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400c910 con 0x7f81240b51d0 2023-06-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f811b7fe700 1 -- 172.21.15.136:0/1419904827 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811400ca70 con 0x7f81240b51d0 2023-06-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c0094a0 con 0x7f81240b51d0 2023-06-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f811b7fe700 1 -- 172.21.15.136:0/1419904827 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400cde0 con 0x7f81240b51d0 2023-06-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.152+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81240c73b0 con 0x7f81240b51d0 2023-06-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.153+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81241456f0 con 0x7f81240b51d0 2023-06-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.154+0000 7f811b7fe700 1 -- 172.21.15.136:0/1419904827 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8114013470 con 0x7f81240b51d0 2023-06-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.155+0000 7f811b7fe700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f810406ace0 0x7f810406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.155+0000 7f811b7fe700 1 -- 172.21.15.136:0/1419904827 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f81140899a0 con 0x7f81240b51d0 2023-06-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.155+0000 7f811bfff700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f810406ace0 0x7f810406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.156+0000 7f811bfff700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f810406ace0 0x7f810406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f810c000c00 tx=0x7f810c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.160+0000 7f811b7fe700 1 -- 172.21.15.136:0/1419904827 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8114054710 con 0x7f81240b51d0 2023-06-23T19:02:26.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.355+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f81240ce750 con 0x7f81240b51d0 2023-06-23T19:02:26.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.356+0000 7f811b7fe700 1 -- 172.21.15.136:0/1419904827 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8114057d30 con 0x7f81240b51d0 2023-06-23T19:02:26.362 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-23T19:02:26.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f810406ace0 msgr2=0x7f810406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f810406ace0 0x7f810406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f810c000c00 tx=0x7f810c008030 comp rx=0 tx=0).stop 2023-06-23T19:02:26.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81240b51d0 msgr2=0x7f8124158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81240b51d0 0x7f8124158330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f811400ebe0 tx=0x7f8114009ec0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 shutdown_connections 2023-06-23T19:02:26.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f810406ace0 0x7f810406d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81240d0e30 0x7f81240c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81240b51d0 0x7f8124158330 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 --2- 172.21.15.136:0/1419904827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81240d0a60 0x7f81241458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 >> 172.21.15.136:0/1419904827 conn(0x7f8124071620 msgr2=0x7f81240d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:26.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 shutdown_connections 2023-06-23T19:02:26.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.358+0000 7f81297ff700 1 -- 172.21.15.136:0/1419904827 wait complete. 2023-06-23T19:02:26.381 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:02:26.450 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:02:26.456 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:02:26.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.575+0000 7ff958dff700 1 Processor -- start 2023-06-23T19:02:26.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.575+0000 7ff958dff700 1 -- start start 2023-06-23T19:02:26.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.576+0000 7ff958dff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff9540cd5d0 0x7ff9540c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.576+0000 7ff958dff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff954069ef0 0x7ff95406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.576+0000 7ff958dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95406a830 con 0x7ff95415a0c0 2023-06-23T19:02:26.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.576+0000 7ff958dff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540cd280 con 0x7ff954069ef0 2023-06-23T19:02:26.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.576+0000 7ff958dff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540c9220 con 0x7ff9540cd5d0 2023-06-23T19:02:26.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.576+0000 7ff95259c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff95415a0c0 0x7ff9540ccb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36698/0 (socket says 172.21.15.136:36698) 2023-06-23T19:02:26.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.576+0000 7ff95259c700 1 -- 172.21.15.136:0/3583514809 learned_addr learned my addr 172.21.15.136:0/3583514809 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:26.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.576+0000 7ff952d9d700 1 --2- 172.21.15.136:0/3583514809 >> v2:172.21.15.136:3300/0 conn(0x7ff954069ef0 0x7ff95406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff94bfff700 1 --2- 172.21.15.136:0/3583514809 >> v2:172.21.15.178:3300/0 conn(0x7ff9540cd5d0 0x7ff9540c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff951d9b700 1 -- 172.21.15.136:0/3583514809 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812144558 0 0) 0x7ff95406a830 con 0x7ff95415a0c0 2023-06-23T19:02:26.589 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff951d9b700 1 -- 172.21.15.136:0/3583514809 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9400035b0 con 0x7ff95415a0c0 2023-06-23T19:02:26.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff952d9d700 1 -- 172.21.15.136:0/3583514809 >> v2:172.21.15.178:3300/0 conn(0x7ff9540cd5d0 msgr2=0x7ff9540c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:26.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff952d9d700 1 --2- 172.21.15.136:0/3583514809 >> v2:172.21.15.178:3300/0 conn(0x7ff9540cd5d0 0x7ff9540c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff952d9d700 1 -- 172.21.15.136:0/3583514809 >> v1:172.21.15.136:6789/0 conn(0x7ff95415a0c0 legacy=0x7ff9540ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff952d9d700 1 -- 172.21.15.136:0/3583514809 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540caea0 con 0x7ff954069ef0 2023-06-23T19:02:26.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff94bfff700 1 --2- 172.21.15.136:0/3583514809 >> v2:172.21.15.178:3300/0 conn(0x7ff9540cd5d0 0x7ff9540c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:26.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff952d9d700 1 --2- 172.21.15.136:0/3583514809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff954069ef0 0x7ff95406a2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff9540c1fc0 tx=0x7ff94c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefe746bcb23abe9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:26.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff951d9b700 1 -- 172.21.15.136:0/3583514809 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00e070 con 0x7ff954069ef0 2023-06-23T19:02:26.591 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff951d9b700 1 -- 172.21.15.136:0/3583514809 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c00bae0 con 0x7ff954069ef0 2023-06-23T19:02:26.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.577+0000 7ff951d9b700 1 -- 172.21.15.136:0/3583514809 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00be90 con 0x7ff954069ef0 2023-06-23T19:02:26.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.578+0000 7ff958dff700 1 -- 172.21.15.136:0/3583514809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff954069ef0 msgr2=0x7ff95406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.578+0000 7ff958dff700 1 --2- 172.21.15.136:0/3583514809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff954069ef0 0x7ff95406a2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff9540c1fc0 tx=0x7ff94c00b330 comp rx=0 tx=0).stop 2023-06-23T19:02:26.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.578+0000 7ff958dff700 1 -- 172.21.15.136:0/3583514809 shutdown_connections 2023-06-23T19:02:26.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.578+0000 7ff958dff700 1 --2- 172.21.15.136:0/3583514809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff954069ef0 0x7ff95406a2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.592 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.578+0000 7ff958dff700 1 --2- 172.21.15.136:0/3583514809 >> v2:172.21.15.178:3300/0 conn(0x7ff9540cd5d0 0x7ff9540c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.578+0000 7ff958dff700 1 -- 172.21.15.136:0/3583514809 >> 172.21.15.136:0/3583514809 conn(0x7ff9540b0ef0 msgr2=0x7ff9540ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:26.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.578+0000 7ff958dff700 1 -- 172.21.15.136:0/3583514809 shutdown_connections 2023-06-23T19:02:26.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.578+0000 7ff958dff700 1 -- 172.21.15.136:0/3583514809 wait complete. 2023-06-23T19:02:26.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.580+0000 7ff958dff700 1 Processor -- start 2023-06-23T19:02:26.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.580+0000 7ff958dff700 1 -- start start 2023-06-23T19:02:26.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff958dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff954069ef0 0x7ff954149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff958dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9540cd5d0 0x7ff9541ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.593 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff958dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff95415a0c0 0x7ff9540b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.594 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff958dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540c30b0 con 0x7ff95415a0c0 2023-06-23T19:02:26.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff958dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540c3390 con 0x7ff9540cd5d0 2023-06-23T19:02:26.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff958dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540c3670 con 0x7ff954069ef0 2023-06-23T19:02:26.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff952d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff95415a0c0 0x7ff9540b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff952d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff95415a0c0 0x7ff9540b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51764/0 (socket says 172.21.15.136:51764) 2023-06-23T19:02:26.596 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff952d9d700 1 -- 172.21.15.136:0/3914211297 learned_addr learned my addr 172.21.15.136:0/3914211297 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:26.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff95259c700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff954069ef0 0x7ff954149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff94bfff700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9540cd5d0 0x7ff9541ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff952d9d700 1 -- 172.21.15.136:0/3914211297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff954069ef0 msgr2=0x7ff954149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.581+0000 7ff952d9d700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff954069ef0 0x7ff954149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.582+0000 7ff952d9d700 1 -- 172.21.15.136:0/3914211297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9540cd5d0 msgr2=0x7ff9541ef830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.582+0000 7ff952d9d700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9540cd5d0 0x7ff9541ef830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.582+0000 7ff952d9d700 1 -- 172.21.15.136:0/3914211297 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009a70 con 0x7ff95415a0c0 2023-06-23T19:02:26.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.582+0000 7ff952d9d700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff95415a0c0 0x7ff9540b3e80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009f00 tx=0x7ff94c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:26.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.582+0000 7ff94affd700 1 -- 172.21.15.136:0/3914211297 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c004730 con 0x7ff95415a0c0 2023-06-23T19:02:26.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.582+0000 7ff94affd700 1 -- 172.21.15.136:0/3914211297 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c020070 con 0x7ff95415a0c0 2023-06-23T19:02:26.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.582+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9540c3950 con 0x7ff95415a0c0 2023-06-23T19:02:26.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.582+0000 7ff94affd700 1 -- 172.21.15.136:0/3914211297 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c027480 con 0x7ff95415a0c0 2023-06-23T19:02:26.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.582+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9540c3f10 con 0x7ff95415a0c0 2023-06-23T19:02:26.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.583+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954073910 con 0x7ff95415a0c0 2023-06-23T19:02:26.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.584+0000 7ff94affd700 1 -- 172.21.15.136:0/3914211297 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff94c0275e0 con 0x7ff95415a0c0 2023-06-23T19:02:26.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.585+0000 7ff94affd700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff93406ace0 0x7ff93406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:26.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.585+0000 7ff94affd700 1 -- 172.21.15.136:0/3914211297 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff94c022070 con 0x7ff95415a0c0 2023-06-23T19:02:26.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.585+0000 7ff95259c700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff93406ace0 0x7ff93406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:26.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.586+0000 7ff95259c700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff93406ace0 0x7ff93406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9440011e0 tx=0x7ff944009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:26.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.589+0000 7ff94affd700 1 -- 172.21.15.136:0/3914211297 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff94c05a0d0 con 0x7ff95415a0c0 2023-06-23T19:02:26.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.829+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff95415d4b0 con 0x7ff95415a0c0 2023-06-23T19:02:26.835 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.829+0000 7ff94affd700 1 -- 172.21.15.136:0/3914211297 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7ff94c059c60 con 0x7ff95415a0c0 2023-06-23T19:02:26.836 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:26.836 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:31.031767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T19:02:26.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff93406ace0 msgr2=0x7ff93406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff93406ace0 0x7ff93406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9440011e0 tx=0x7ff944009040 comp rx=0 tx=0).stop 2023-06-23T19:02:26.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff95415a0c0 msgr2=0x7ff9540b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:26.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff95415a0c0 0x7ff9540b3e80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009f00 tx=0x7ff94c004ad0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 shutdown_connections 2023-06-23T19:02:26.837 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff93406ace0 0x7ff93406d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff95415a0c0 0x7ff9540b3e80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff954069ef0 0x7ff954149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 --2- 172.21.15.136:0/3914211297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9540cd5d0 0x7ff9541ef830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:26.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 >> 172.21.15.136:0/3914211297 conn(0x7ff9540b0ef0 msgr2=0x7ff9540c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:26.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 shutdown_connections 2023-06-23T19:02:26.838 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:26.832+0000 7ff958dff700 1 -- 172.21.15.136:0/3914211297 wait complete. 2023-06-23T19:02:26.838 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2023-06-23T19:02:26.854 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:27.088 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.085+0000 7f4e4c1ff700 1 Processor -- start 2023-06-23T19:02:27.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.085+0000 7f4e4c1ff700 1 -- start start 2023-06-23T19:02:27.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.086+0000 7f4e4c1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440cf1e0 0x7f4e4406c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.086+0000 7f4e4c1ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e440cf600 con 0x7f4e44158ef0 2023-06-23T19:02:27.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.086+0000 7f4e4c1ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e440c9510 con 0x7f4e440709f0 2023-06-23T19:02:27.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.086+0000 7f4e4c1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440cd6a0 con 0x7f4e440cf1e0 2023-06-23T19:02:27.090 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.086+0000 7f4e49f9b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f4e44158ef0 0x7f4e440702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36710/0 (socket says 172.21.15.136:36710) 2023-06-23T19:02:27.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.086+0000 7f4e49f9b700 1 -- 172.21.15.136:0/2788355173 learned_addr learned my addr 172.21.15.136:0/2788355173 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:27.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.086+0000 7f4e4a79c700 1 --2- 172.21.15.136:0/2788355173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440cf1e0 0x7f4e4406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.086+0000 7f4e48f99700 1 -- 172.21.15.136:0/2788355173 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901303297 0 0) 0x7f4e440cf600 con 0x7f4e44158ef0 2023-06-23T19:02:27.091 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e48f99700 1 -- 172.21.15.136:0/2788355173 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e300035b0 con 0x7f4e44158ef0 2023-06-23T19:02:27.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e48f99700 1 -- 172.21.15.136:0/2788355173 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018657414 0 0) 0x7f4e440c9510 con 0x7f4e440709f0 2023-06-23T19:02:27.092 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e48f99700 1 -- 172.21.15.136:0/2788355173 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e440cf600 con 0x7f4e440709f0 2023-06-23T19:02:27.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e48f99700 1 -- 172.21.15.136:0/2788355173 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1026889151 0 0) 0x7f4e300035b0 con 0x7f4e44158ef0 2023-06-23T19:02:27.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e4a79c700 1 -- 172.21.15.136:0/2788355173 >> v1:172.21.15.178:6789/0 conn(0x7f4e440709f0 legacy=0x7f4e440ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e4a79c700 1 -- 172.21.15.136:0/2788355173 >> v1:172.21.15.136:6789/0 conn(0x7f4e44158ef0 legacy=0x7f4e440702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e4a79c700 1 -- 172.21.15.136:0/2788355173 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e440cd980 con 0x7f4e440cf1e0 2023-06-23T19:02:27.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e4a79c700 1 --2- 172.21.15.136:0/2788355173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440cf1e0 0x7f4e4406c060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009dc0 tx=0x7f4e3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=920c0cfe6227724 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:27.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e48f99700 1 -- 172.21.15.136:0/2788355173 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00e070 con 0x7f4e440cf1e0 2023-06-23T19:02:27.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.087+0000 7f4e48f99700 1 -- 172.21.15.136:0/2788355173 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c003a20 con 0x7f4e440cf1e0 2023-06-23T19:02:27.093 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.088+0000 7f4e48f99700 1 -- 172.21.15.136:0/2788355173 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40001670 con 0x7f4e440cf1e0 2023-06-23T19:02:27.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.088+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/2788355173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440cf1e0 msgr2=0x7f4e4406c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.088+0000 7f4e4c1ff700 1 --2- 172.21.15.136:0/2788355173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440cf1e0 0x7f4e4406c060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009dc0 tx=0x7f4e3c00b330 comp rx=0 tx=0).stop 2023-06-23T19:02:27.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.088+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/2788355173 shutdown_connections 2023-06-23T19:02:27.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.088+0000 7f4e4c1ff700 1 --2- 172.21.15.136:0/2788355173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440cf1e0 0x7f4e4406c060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.088+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/2788355173 >> 172.21.15.136:0/2788355173 conn(0x7f4e440b0ef0 msgr2=0x7f4e440ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:27.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.088+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/2788355173 shutdown_connections 2023-06-23T19:02:27.094 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.088+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/2788355173 wait complete. 2023-06-23T19:02:27.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.090+0000 7f4e4c1ff700 1 Processor -- start 2023-06-23T19:02:27.095 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.091+0000 7f4e4c1ff700 1 -- start start 2023-06-23T19:02:27.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4c1ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440709f0 0x7f4e441f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4c1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e440cf1e0 0x7f4e440c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4c1ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e44158ef0 0x7f4e4414cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4c1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4414d470 con 0x7f4e440cf1e0 2023-06-23T19:02:27.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4c1ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440c6eb0 con 0x7f4e44158ef0 2023-06-23T19:02:27.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4c1ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441f5c20 con 0x7f4e440709f0 2023-06-23T19:02:27.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4979a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e440cf1e0 0x7f4e440c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4979a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e440cf1e0 0x7f4e440c21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51774/0 (socket says 172.21.15.136:51774) 2023-06-23T19:02:27.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4979a700 1 -- 172.21.15.136:0/666531915 learned_addr learned my addr 172.21.15.136:0/666531915 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:27.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e49f9b700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440709f0 0x7f4e441f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.092+0000 7f4e4a79c700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e44158ef0 0x7f4e4414cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e4979a700 1 -- 172.21.15.136:0/666531915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440709f0 msgr2=0x7f4e441f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e4979a700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440709f0 0x7f4e441f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e4979a700 1 -- 172.21.15.136:0/666531915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e44158ef0 msgr2=0x7f4e4414cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e4979a700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e44158ef0 0x7f4e4414cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e4979a700 1 -- 172.21.15.136:0/666531915 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c009a70 con 0x7f4e440cf1e0 2023-06-23T19:02:27.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e4a79c700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e44158ef0 0x7f4e4414cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:27.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e4979a700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e440cf1e0 0x7f4e440c21c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400c530 tx=0x7f4e3400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:27.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e3a7fc700 1 -- 172.21.15.136:0/666531915 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340052d0 con 0x7f4e440cf1e0 2023-06-23T19:02:27.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e3a7fc700 1 -- 172.21.15.136:0/666531915 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34005430 con 0x7f4e440cf1e0 2023-06-23T19:02:27.099 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e441f5380 con 0x7f4e440cf1e0 2023-06-23T19:02:27.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e3a7fc700 1 -- 172.21.15.136:0/666531915 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340038c0 con 0x7f4e440cf1e0 2023-06-23T19:02:27.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.093+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e441f5940 con 0x7f4e440cf1e0 2023-06-23T19:02:27.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.094+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e440c6cd0 con 0x7f4e440cf1e0 2023-06-23T19:02:27.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.095+0000 7f4e3a7fc700 1 -- 172.21.15.136:0/666531915 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e34003a20 con 0x7f4e440cf1e0 2023-06-23T19:02:27.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.096+0000 7f4e3a7fc700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e2806ace0 0x7f4e2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.096+0000 7f4e3a7fc700 1 -- 172.21.15.136:0/666531915 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4e34088b30 con 0x7f4e440cf1e0 2023-06-23T19:02:27.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.096+0000 7f4e49f9b700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e2806ace0 0x7f4e2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.101 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.097+0000 7f4e49f9b700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e2806ace0 0x7f4e2806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000f60 tx=0x7f4e40001670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:27.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.101+0000 7f4e3a7fc700 1 -- 172.21.15.136:0/666531915 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4e34053a00 con 0x7f4e440cf1e0 2023-06-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.299+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e44073910 con 0x7f4e440cf1e0 2023-06-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.300+0000 7f4e3a7fc700 1 -- 172.21.15.136:0/666531915 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f4e34057020 con 0x7f4e440cf1e0 2023-06-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e2806ace0 msgr2=0x7f4e2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e2806ace0 0x7f4e2806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000f60 tx=0x7f4e40001670 comp rx=0 tx=0).stop 2023-06-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e440cf1e0 msgr2=0x7f4e440c21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e440cf1e0 0x7f4e440c21c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400c530 tx=0x7f4e3400c840 comp rx=0 tx=0).stop 2023-06-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 shutdown_connections 2023-06-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f4e2806ace0 0x7f4e2806d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e44158ef0 0x7f4e4414cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e440709f0 0x7f4e441f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 --2- 172.21.15.136:0/666531915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e440cf1e0 0x7f4e440c21c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 >> 172.21.15.136:0/666531915 conn(0x7f4e440b0ef0 msgr2=0x7f4e440ae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 shutdown_connections 2023-06-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.303+0000 7f4e4c1ff700 1 -- 172.21.15.136:0/666531915 wait complete. 2023-06-23T19:02:27.325 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-23T19:02:27.326 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:02:27.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.515+0000 7f31879ff700 1 Processor -- start 2023-06-23T19:02:27.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.515+0000 7f31879ff700 1 -- start start 2023-06-23T19:02:27.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.516+0000 7f31879ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f31800cd830 0x7f3180160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.516+0000 7f31879ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3180160880 0x7f31800d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.516+0000 7f31879ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31801610a0 con 0x7f318015c570 2023-06-23T19:02:27.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.516+0000 7f31879ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318015d670 con 0x7f3180160880 2023-06-23T19:02:27.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.516+0000 7f31879ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318015da90 con 0x7f31800cd830 2023-06-23T19:02:27.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.517+0000 7f3185f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3180160880 0x7f31800d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.517+0000 7f3185f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3180160880 0x7f31800d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51784/0 (socket says 172.21.15.136:51784) 2023-06-23T19:02:27.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.517+0000 7f3185f9c700 1 -- 172.21.15.136:0/3744524177 learned_addr learned my addr 172.21.15.136:0/3744524177 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:27.525 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.517+0000 7f3184f9a700 1 --2- 172.21.15.136:0/3744524177 >> v2:172.21.15.178:3300/0 conn(0x7f31800cd830 0x7f3180160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.525 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.517+0000 7f3185f9c700 1 -- 172.21.15.136:0/3744524177 >> v2:172.21.15.178:3300/0 conn(0x7f31800cd830 msgr2=0x7f3180160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:27.525 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.517+0000 7f3185f9c700 1 --2- 172.21.15.136:0/3744524177 >> v2:172.21.15.178:3300/0 conn(0x7f31800cd830 0x7f3180160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.517+0000 7f3185f9c700 1 -- 172.21.15.136:0/3744524177 >> v1:172.21.15.178:6789/0 conn(0x7f318015c570 legacy=0x7f31800cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.517+0000 7f3185f9c700 1 -- 172.21.15.136:0/3744524177 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318015ccd0 con 0x7f3180160880 2023-06-23T19:02:27.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.517+0000 7f3185f9c700 1 --2- 172.21.15.136:0/3744524177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3180160880 0x7f31800d0bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f318008bc50 tx=0x7f317800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be551c8e924e3f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:27.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f3177fff700 1 -- 172.21.15.136:0/3744524177 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800e070 con 0x7f3180160880 2023-06-23T19:02:27.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f3177fff700 1 -- 172.21.15.136:0/3744524177 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317800b9c0 con 0x7f3180160880 2023-06-23T19:02:27.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f3177fff700 1 -- 172.21.15.136:0/3744524177 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800bd70 con 0x7f3180160880 2023-06-23T19:02:27.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f31879ff700 1 -- 172.21.15.136:0/3744524177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3180160880 msgr2=0x7f31800d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f31879ff700 1 --2- 172.21.15.136:0/3744524177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3180160880 0x7f31800d0bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f318008bc50 tx=0x7f317800b330 comp rx=0 tx=0).stop 2023-06-23T19:02:27.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f31879ff700 1 -- 172.21.15.136:0/3744524177 shutdown_connections 2023-06-23T19:02:27.529 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f31879ff700 1 --2- 172.21.15.136:0/3744524177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3180160880 0x7f31800d0bb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f31879ff700 1 --2- 172.21.15.136:0/3744524177 >> v2:172.21.15.178:3300/0 conn(0x7f31800cd830 0x7f3180160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f31879ff700 1 -- 172.21.15.136:0/3744524177 >> 172.21.15.136:0/3744524177 conn(0x7f3180071620 msgr2=0x7f31800719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:27.530 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f31879ff700 1 -- 172.21.15.136:0/3744524177 shutdown_connections 2023-06-23T19:02:27.531 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.518+0000 7f31879ff700 1 -- 172.21.15.136:0/3744524177 wait complete. 2023-06-23T19:02:27.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.521+0000 7f31879ff700 1 Processor -- start 2023-06-23T19:02:27.535 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.521+0000 7f31879ff700 1 -- start start 2023-06-23T19:02:27.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f31879ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31800cd830 0x7f318014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f31879ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318015c570 0x7f318014d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f31879ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3180160880 0x7f31800cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.536 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f31879ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31801f5750 con 0x7f318015c570 2023-06-23T19:02:27.537 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f31879ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31800b2b10 con 0x7f31800cd830 2023-06-23T19:02:27.537 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f31879ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31800b2df0 con 0x7f3180160880 2023-06-23T19:02:27.537 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f3184f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318015c570 0x7f318014d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f3184f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318015c570 0x7f318014d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51788/0 (socket says 172.21.15.136:51788) 2023-06-23T19:02:27.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f3184f9a700 1 -- 172.21.15.136:0/4069689393 learned_addr learned my addr 172.21.15.136:0/4069689393 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:27.538 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f318579b700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31800cd830 0x7f318014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.522+0000 7f3185f9c700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3180160880 0x7f31800cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f3184f9a700 1 -- 172.21.15.136:0/4069689393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3180160880 msgr2=0x7f31800cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f3184f9a700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3180160880 0x7f31800cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.540 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f3184f9a700 1 -- 172.21.15.136:0/4069689393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31800cd830 msgr2=0x7f318014d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.540 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f3184f9a700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31800cd830 0x7f318014d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.540 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f3184f9a700 1 -- 172.21.15.136:0/4069689393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178009b30 con 0x7f318015c570 2023-06-23T19:02:27.540 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f3184f9a700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318015c570 0x7f318014d130 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f317000e810 tx=0x7f317000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f3175ffb700 1 -- 172.21.15.136:0/4069689393 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000c070 con 0x7f318015c570 2023-06-23T19:02:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f3175ffb700 1 -- 172.21.15.136:0/4069689393 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170013610 con 0x7f318015c570 2023-06-23T19:02:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31800b30d0 con 0x7f318015c570 2023-06-23T19:02:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f3175ffb700 1 -- 172.21.15.136:0/4069689393 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700139c0 con 0x7f318015c570 2023-06-23T19:02:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.523+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318014d670 con 0x7f318015c570 2023-06-23T19:02:27.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.524+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3180073910 con 0x7f318015c570 2023-06-23T19:02:27.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.525+0000 7f3175ffb700 1 -- 172.21.15.136:0/4069689393 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3170013b20 con 0x7f318015c570 2023-06-23T19:02:27.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.527+0000 7f3175ffb700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f316406ace0 0x7f316406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.527+0000 7f3175ffb700 1 -- 172.21.15.136:0/4069689393 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3170089270 con 0x7f318015c570 2023-06-23T19:02:27.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.527+0000 7f318579b700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f316406ace0 0x7f316406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.528+0000 7f318579b700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f316406ace0 0x7f316406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31800b4be0 tx=0x7f317c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:27.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.531+0000 7f3175ffb700 1 -- 172.21.15.136:0/4069689393 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3170057a80 con 0x7f318015c570 2023-06-23T19:02:27.774 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.771+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31800b5360 con 0x7f318015c570 2023-06-23T19:02:27.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.771+0000 7f3175ffb700 1 -- 172.21.15.136:0/4069689393 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f3170057610 con 0x7f318015c570 2023-06-23T19:02:27.775 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:27.776 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:31.031767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T19:02:27.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f316406ace0 msgr2=0x7f316406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f316406ace0 0x7f316406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31800b4be0 tx=0x7f317c009040 comp rx=0 tx=0).stop 2023-06-23T19:02:27.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318015c570 msgr2=0x7f318014d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318015c570 0x7f318014d130 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f317000e810 tx=0x7f317000eb20 comp rx=0 tx=0).stop 2023-06-23T19:02:27.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 shutdown_connections 2023-06-23T19:02:27.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f316406ace0 0x7f316406d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31800cd830 0x7f318014d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3180160880 0x7f31800cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 --2- 172.21.15.136:0/4069689393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318015c570 0x7f318014d130 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 >> 172.21.15.136:0/4069689393 conn(0x7f3180071620 msgr2=0x7f318015ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:27.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 shutdown_connections 2023-06-23T19:02:27.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.774+0000 7f31879ff700 1 -- 172.21.15.136:0/4069689393 wait complete. 2023-06-23T19:02:27.780 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2023-06-23T19:02:27.796 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.986+0000 7fdcfe7ff700 1 Processor -- start 2023-06-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.986+0000 7fdcfe7ff700 1 -- start start 2023-06-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.987+0000 7fdcfe7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf815c570 0x7fdcf80cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.987+0000 7fdcfe7ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdcf80cd660 0x7fdcf8160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.987+0000 7fdcfe7ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf81610a0 con 0x7fdcf8160880 2023-06-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.987+0000 7fdcfe7ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf815d670 con 0x7fdcf80cd660 2023-06-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.987+0000 7fdcfe7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80cdad0 con 0x7fdcf815c570 2023-06-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.987+0000 7fdcf77fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdcf80cd660 0x7fdcf8160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.987+0000 7fdcf77fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdcf80cd660 0x7fdcf8160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51790/0 (socket says 172.21.15.136:51790) 2023-06-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.987+0000 7fdcf77fe700 1 -- 172.21.15.136:0/1567176482 learned_addr learned my addr 172.21.15.136:0/1567176482 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf7fff700 1 --2- 172.21.15.136:0/1567176482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf815c570 0x7fdcf80cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf77fe700 1 -- 172.21.15.136:0/1567176482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf815c570 msgr2=0x7fdcf80cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf77fe700 1 --2- 172.21.15.136:0/1567176482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf815c570 0x7fdcf80cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf77fe700 1 -- 172.21.15.136:0/1567176482 >> v1:172.21.15.178:6789/0 conn(0x7fdcf8160880 legacy=0x7fdcf806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf77fe700 1 -- 172.21.15.136:0/1567176482 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf815da90 con 0x7fdcf80cd660 2023-06-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf7fff700 1 --2- 172.21.15.136:0/1567176482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf815c570 0x7fdcf80cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf77fe700 1 --2- 172.21.15.136:0/1567176482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf80cd660 0x7fdcf8160340 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009920 tx=0x7fdcec009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336d926c6f9a90ea server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf6ffd700 1 -- 172.21.15.136:0/1567176482 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec004230 con 0x7fdcf80cd660 2023-06-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf6ffd700 1 -- 172.21.15.136:0/1567176482 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec004390 con 0x7fdcf80cd660 2023-06-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.988+0000 7fdcf6ffd700 1 -- 172.21.15.136:0/1567176482 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec009e70 con 0x7fdcf80cd660 2023-06-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.989+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/1567176482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf80cd660 msgr2=0x7fdcf8160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.989+0000 7fdcfe7ff700 1 --2- 172.21.15.136:0/1567176482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf80cd660 0x7fdcf8160340 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009920 tx=0x7fdcec009c30 comp rx=0 tx=0).stop 2023-06-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.989+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/1567176482 shutdown_connections 2023-06-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.989+0000 7fdcfe7ff700 1 --2- 172.21.15.136:0/1567176482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf815c570 0x7fdcf80cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.989+0000 7fdcfe7ff700 1 --2- 172.21.15.136:0/1567176482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf80cd660 0x7fdcf8160340 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.989+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/1567176482 >> 172.21.15.136:0/1567176482 conn(0x7fdcf8071620 msgr2=0x7fdcf80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.989+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/1567176482 shutdown_connections 2023-06-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.989+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/1567176482 wait complete. 2023-06-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.991+0000 7fdcfe7ff700 1 Processor -- start 2023-06-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.991+0000 7fdcfe7ff700 1 -- start start 2023-06-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcfe7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf80cd660 0x7fdcf80c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcfe7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf815c570 0x7fdcf80c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcfe7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcf8160880 0x7fdcf80c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcfe7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf814e600 con 0x7fdcf815c570 2023-06-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcfe7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80b6410 con 0x7fdcf8160880 2023-06-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcfe7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80b8740 con 0x7fdcf80cd660 2023-06-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf815c570 0x7fdcf80c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf815c570 0x7fdcf80c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51798/0 (socket says 172.21.15.136:51798) 2023-06-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf77fe700 1 -- 172.21.15.136:0/133220157 learned_addr learned my addr 172.21.15.136:0/133220157 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf7fff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf80cd660 0x7fdcf80c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcfcd9c700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcf8160880 0x7fdcf80c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf77fe700 1 -- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf80cd660 msgr2=0x7fdcf80c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf77fe700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf80cd660 0x7fdcf80c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf77fe700 1 -- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcf8160880 msgr2=0x7fdcf80c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf77fe700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcf8160880 0x7fdcf80c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf77fe700 1 -- 172.21.15.136:0/133220157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec009550 con 0x7fdcf815c570 2023-06-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcf7fff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf80cd660 0x7fdcf80c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.992+0000 7fdcfcd9c700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcf8160880 0x7fdcf80c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.993+0000 7fdcf77fe700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf815c570 0x7fdcf80c8300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009fd0 tx=0x7fdcec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.993+0000 7fdcf4ff9700 1 -- 172.21.15.136:0/133220157 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec00bdc0 con 0x7fdcf815c570 2023-06-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.993+0000 7fdcf4ff9700 1 -- 172.21.15.136:0/133220157 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec01f070 con 0x7fdcf815c570 2023-06-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.993+0000 7fdcf4ff9700 1 -- 172.21.15.136:0/133220157 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0038c0 con 0x7fdcf815c570 2023-06-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.993+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf80c8ec0 con 0x7fdcf815c570 2023-06-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.993+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf80b5dc0 con 0x7fdcf815c570 2023-06-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.994+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf80b65a0 con 0x7fdcf815c570 2023-06-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.995+0000 7fdcf4ff9700 1 -- 172.21.15.136:0/133220157 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdcec021030 con 0x7fdcf815c570 2023-06-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.996+0000 7fdcf4ff9700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdce406ace0 0x7fdce406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.996+0000 7fdcf4ff9700 1 -- 172.21.15.136:0/133220157 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdcec08afe0 con 0x7fdcf815c570 2023-06-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.996+0000 7fdcf7fff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdce406ace0 0x7fdce406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:27.997+0000 7fdcf7fff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdce406ace0 0x7fdce406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdce80089b0 tx=0x7fdce8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.000+0000 7fdcf4ff9700 1 -- 172.21.15.136:0/133220157 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdcec055e90 con 0x7fdcf815c570 2023-06-23T19:02:28.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.243+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcf815c940 con 0x7fdcf815c570 2023-06-23T19:02:28.247 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.244+0000 7fdcf4ff9700 1 -- 172.21.15.136:0/133220157 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7fdcec0594b0 con 0x7fdcf815c570 2023-06-23T19:02:28.248 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:28.248 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2498486560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2498486560},{"type":"v1","addr":"172.21.15.136:6835","nonce":2498486560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3009978750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3009978750},{"type":"v1","addr":"172.21.15.136:6837","nonce":3009978750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2353638769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2353638769},{"type":"v1","addr":"172.21.15.178:6833","nonce":2353638769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:01:04.348357+0000","modified":"2023-06-23T19:01:31.031767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/329757975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":329757975},{"type":"v1","addr":"172.21.15.178:6835","nonce":329757975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T19:02:28.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdce406ace0 msgr2=0x7fdce406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdce406ace0 0x7fdce406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdce80089b0 tx=0x7fdce8008040 comp rx=0 tx=0).stop 2023-06-23T19:02:28.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf815c570 msgr2=0x7fdcf80c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf815c570 0x7fdcf80c8300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009fd0 tx=0x7fdcec004750 comp rx=0 tx=0).stop 2023-06-23T19:02:28.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 shutdown_connections 2023-06-23T19:02:28.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fdce406ace0 0x7fdce406d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcf8160880 0x7fdcf80c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf80cd660 0x7fdcf80c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 --2- 172.21.15.136:0/133220157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf815c570 0x7fdcf80c8300 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 >> 172.21.15.136:0/133220157 conn(0x7fdcf8071620 msgr2=0x7fdcf815b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:28.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 shutdown_connections 2023-06-23T19:02:28.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.246+0000 7fdcfe7ff700 1 -- 172.21.15.136:0/133220157 wait complete. 2023-06-23T19:02:28.252 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2023-06-23T19:02:28.269 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:28.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.462+0000 7fa7a33ff700 1 Processor -- start 2023-06-23T19:02:28.466 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.462+0000 7fa7a33ff700 1 -- start start 2023-06-23T19:02:28.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.463+0000 7fa7a33ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa79c15c570 0x7fa79c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.463+0000 7fa7a33ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 0x7fa79c0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.463+0000 7fa7a33ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c1610a0 con 0x7fa79c0cd660 2023-06-23T19:02:28.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.463+0000 7fa7a33ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c15d670 con 0x7fa79c15c570 2023-06-23T19:02:28.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.463+0000 7fa7a33ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c160eb0 con 0x7fa79c160a50 2023-06-23T19:02:28.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.463+0000 7fa7a119b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa79c15c570 0x7fa79c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.463+0000 7fa7a119b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa79c15c570 0x7fa79c0cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51812/0 (socket says 172.21.15.136:51812) 2023-06-23T19:02:28.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.463+0000 7fa7a119b700 1 -- 172.21.15.136:0/1546225632 learned_addr learned my addr 172.21.15.136:0/1546225632 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:28.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.463+0000 7fa7a199c700 1 --2- 172.21.15.136:0/1546225632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 0x7fa79c0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.464+0000 7fa7a119b700 1 -- 172.21.15.136:0/1546225632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 msgr2=0x7fa79c0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:28.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.464+0000 7fa7a119b700 1 --2- 172.21.15.136:0/1546225632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 0x7fa79c0d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.464+0000 7fa7a119b700 1 -- 172.21.15.136:0/1546225632 >> v1:172.21.15.178:6789/0 conn(0x7fa79c0cd660 legacy=0x7fa79c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.464+0000 7fa7a119b700 1 -- 172.21.15.136:0/1546225632 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c15da90 con 0x7fa79c15c570 2023-06-23T19:02:28.470 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.464+0000 7fa7a119b700 1 --2- 172.21.15.136:0/1546225632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 0x7fa79c0cd120 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa798009920 tx=0x7fa798009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c23147ff5ccd01 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:28.470 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.464+0000 7fa793fff700 1 -- 172.21.15.136:0/1546225632 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800ba20 con 0x7fa79c15c570 2023-06-23T19:02:28.470 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.464+0000 7fa793fff700 1 -- 172.21.15.136:0/1546225632 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79800bb80 con 0x7fa79c15c570 2023-06-23T19:02:28.470 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.464+0000 7fa793fff700 1 -- 172.21.15.136:0/1546225632 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798009e70 con 0x7fa79c15c570 2023-06-23T19:02:28.470 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.465+0000 7fa7a33ff700 1 -- 172.21.15.136:0/1546225632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 msgr2=0x7fa79c0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.470 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.465+0000 7fa7a33ff700 1 --2- 172.21.15.136:0/1546225632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 0x7fa79c0cd120 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa798009920 tx=0x7fa798009c30 comp rx=0 tx=0).stop 2023-06-23T19:02:28.471 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.465+0000 7fa7a33ff700 1 -- 172.21.15.136:0/1546225632 shutdown_connections 2023-06-23T19:02:28.471 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.465+0000 7fa7a33ff700 1 --2- 172.21.15.136:0/1546225632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 0x7fa79c0cd120 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.465+0000 7fa7a33ff700 1 --2- 172.21.15.136:0/1546225632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 0x7fa79c0d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.465+0000 7fa7a33ff700 1 -- 172.21.15.136:0/1546225632 >> 172.21.15.136:0/1546225632 conn(0x7fa79c071620 msgr2=0x7fa79c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:28.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.465+0000 7fa7a33ff700 1 -- 172.21.15.136:0/1546225632 shutdown_connections 2023-06-23T19:02:28.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.465+0000 7fa7a33ff700 1 -- 172.21.15.136:0/1546225632 wait complete. 2023-06-23T19:02:28.474 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.467+0000 7fa7a33ff700 1 Processor -- start 2023-06-23T19:02:28.474 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.467+0000 7fa7a33ff700 1 -- start start 2023-06-23T19:02:28.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.468+0000 7fa7a33ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa79c0cd660 0x7fa79c0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a33ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 0x7fa79c0b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a33ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 0x7fa79c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a33ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b2910 con 0x7fa79c15c570 2023-06-23T19:02:28.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a33ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b2bf0 con 0x7fa79c0cd660 2023-06-23T19:02:28.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a33ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b2ed0 con 0x7fa79c160a50 2023-06-23T19:02:28.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a099a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 0x7fa79c0b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a099a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 0x7fa79c0b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51820/0 (socket says 172.21.15.136:51820) 2023-06-23T19:02:28.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a099a700 1 -- 172.21.15.136:0/735230199 learned_addr learned my addr 172.21.15.136:0/735230199 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:28.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a119b700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa79c0cd660 0x7fa79c0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a199c700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 0x7fa79c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a099a700 1 -- 172.21.15.136:0/735230199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 msgr2=0x7fa79c1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a099a700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 0x7fa79c1562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a099a700 1 -- 172.21.15.136:0/735230199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa79c0cd660 msgr2=0x7fa79c0c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a099a700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa79c0cd660 0x7fa79c0c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a099a700 1 -- 172.21.15.136:0/735230199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798009550 con 0x7fa79c15c570 2023-06-23T19:02:28.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.469+0000 7fa7a099a700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 0x7fa79c0b41a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00c4e0 tx=0x7fa78c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:28.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.470+0000 7fa791ffb700 1 -- 172.21.15.136:0/735230199 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0052d0 con 0x7fa79c15c570 2023-06-23T19:02:28.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.470+0000 7fa791ffb700 1 -- 172.21.15.136:0/735230199 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c005430 con 0x7fa79c15c570 2023-06-23T19:02:28.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.470+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c0b31b0 con 0x7fa79c15c570 2023-06-23T19:02:28.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.470+0000 7fa791ffb700 1 -- 172.21.15.136:0/735230199 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0038c0 con 0x7fa79c15c570 2023-06-23T19:02:28.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.470+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c0b25c0 con 0x7fa79c15c570 2023-06-23T19:02:28.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.471+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c0666c0 con 0x7fa79c15c570 2023-06-23T19:02:28.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.472+0000 7fa791ffb700 1 -- 172.21.15.136:0/735230199 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa78c003a20 con 0x7fa79c15c570 2023-06-23T19:02:28.479 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.473+0000 7fa791ffb700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa78006ace0 0x7fa78006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.479 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.473+0000 7fa791ffb700 1 -- 172.21.15.136:0/735230199 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa78c088cf0 con 0x7fa79c15c570 2023-06-23T19:02:28.479 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.473+0000 7fa7a119b700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa78006ace0 0x7fa78006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.479 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.474+0000 7fa7a119b700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa78006ace0 0x7fa78006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa798000c00 tx=0x7fa798008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:28.480 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.477+0000 7fa791ffb700 1 -- 172.21.15.136:0/735230199 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa78c0539d0 con 0x7fa79c15c570 2023-06-23T19:02:28.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.671+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa79c073910 con 0x7fa79c15c570 2023-06-23T19:02:28.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.672+0000 7fa791ffb700 1 -- 172.21.15.136:0/735230199 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20240 (secure 0 0 0) 0x7fa78c056ff0 con 0x7fa79c15c570 2023-06-23T19:02:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:28.677 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":31,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:01:44.103576+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:01:02.019612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T19:01:03.332383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T19:01:06.399217+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:28.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa78006ace0 msgr2=0x7fa78006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa78006ace0 0x7fa78006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa798000c00 tx=0x7fa798008030 comp rx=0 tx=0).stop 2023-06-23T19:02:28.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 msgr2=0x7fa79c0b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 0x7fa79c0b41a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00c4e0 tx=0x7fa78c00c7f0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 shutdown_connections 2023-06-23T19:02:28.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa78006ace0 0x7fa78006d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa79c0cd660 0x7fa79c0c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa79c160a50 0x7fa79c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 --2- 172.21.15.136:0/735230199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa79c15c570 0x7fa79c0b41a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 >> 172.21.15.136:0/735230199 conn(0x7fa79c071620 msgr2=0x7fa79c0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:28.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 shutdown_connections 2023-06-23T19:02:28.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.675+0000 7fa7a33ff700 1 -- 172.21.15.136:0/735230199 wait complete. 2023-06-23T19:02:28.697 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-23T19:02:28.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.887+0000 7fc613bff700 1 Processor -- start 2023-06-23T19:02:28.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.887+0000 7fc613bff700 1 -- start start 2023-06-23T19:02:28.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.888+0000 7fc613bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c069ef0 0x7fc60c06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.888+0000 7fc613bff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c96f0 0x7fc60c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.888+0000 7fc613bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c06e190 con 0x7fc60c158550 2023-06-23T19:02:28.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.888+0000 7fc613bff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60c06a8d0 con 0x7fc60c0c96f0 2023-06-23T19:02:28.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.888+0000 7fc613bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0c8ce0 con 0x7fc60c069ef0 2023-06-23T19:02:28.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc61199b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc60c158550 0x7fc60c06d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36712/0 (socket says 172.21.15.136:36712) 2023-06-23T19:02:28.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc61199b700 1 -- 172.21.15.136:0/487908391 learned_addr learned my addr 172.21.15.136:0/487908391 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:28.895 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc61219c700 1 --2- 172.21.15.136:0/487908391 >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c96f0 0x7fc60c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.895 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc61119a700 1 --2- 172.21.15.136:0/487908391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c069ef0 0x7fc60c06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc610999700 1 -- 172.21.15.136:0/487908391 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584768159 0 0) 0x7fc60c06e190 con 0x7fc60c158550 2023-06-23T19:02:28.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc610999700 1 -- 172.21.15.136:0/487908391 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f80035b0 con 0x7fc60c158550 2023-06-23T19:02:28.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc610999700 1 -- 172.21.15.136:0/487908391 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 520979115 0 0) 0x7fc5f80035b0 con 0x7fc60c158550 2023-06-23T19:02:28.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc61119a700 1 -- 172.21.15.136:0/487908391 >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c96f0 msgr2=0x7fc60c0c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:28.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc61119a700 1 --2- 172.21.15.136:0/487908391 >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c96f0 0x7fc60c0c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc61119a700 1 -- 172.21.15.136:0/487908391 >> v1:172.21.15.136:6789/0 conn(0x7fc60c158550 legacy=0x7fc60c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc61119a700 1 -- 172.21.15.136:0/487908391 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c0ccdc0 con 0x7fc60c069ef0 2023-06-23T19:02:28.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.889+0000 7fc61219c700 1 --2- 172.21.15.136:0/487908391 >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c96f0 0x7fc60c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:28.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.890+0000 7fc61119a700 1 --2- 172.21.15.136:0/487908391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c069ef0 0x7fc60c06a390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009840 tx=0x7fc5fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=365d01c6cecc1396 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:28.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.890+0000 7fc610999700 1 -- 172.21.15.136:0/487908391 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608001670 con 0x7fc60c069ef0 2023-06-23T19:02:28.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.890+0000 7fc610999700 1 -- 172.21.15.136:0/487908391 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc004030 con 0x7fc60c069ef0 2023-06-23T19:02:28.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.890+0000 7fc610999700 1 -- 172.21.15.136:0/487908391 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0043c0 con 0x7fc60c069ef0 2023-06-23T19:02:28.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.890+0000 7fc613bff700 1 -- 172.21.15.136:0/487908391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c069ef0 msgr2=0x7fc60c06a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.890+0000 7fc613bff700 1 --2- 172.21.15.136:0/487908391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c069ef0 0x7fc60c06a390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009840 tx=0x7fc5fc009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:28.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.891+0000 7fc613bff700 1 -- 172.21.15.136:0/487908391 shutdown_connections 2023-06-23T19:02:28.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.891+0000 7fc613bff700 1 --2- 172.21.15.136:0/487908391 >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c96f0 0x7fc60c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.891+0000 7fc613bff700 1 --2- 172.21.15.136:0/487908391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c069ef0 0x7fc60c06a390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.891+0000 7fc613bff700 1 -- 172.21.15.136:0/487908391 >> 172.21.15.136:0/487908391 conn(0x7fc60c0b0ef0 msgr2=0x7fc60c0ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:28.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.891+0000 7fc613bff700 1 -- 172.21.15.136:0/487908391 shutdown_connections 2023-06-23T19:02:28.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.891+0000 7fc613bff700 1 -- 172.21.15.136:0/487908391 wait complete. 2023-06-23T19:02:28.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.892+0000 7fc613bff700 1 Processor -- start 2023-06-23T19:02:28.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.892+0000 7fc613bff700 1 -- start start 2023-06-23T19:02:28.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.893+0000 7fc613bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c069ef0 0x7fc60c14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.893+0000 7fc613bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c96f0 0x7fc60c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.893+0000 7fc613bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c158550 0x7fc60c1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.893+0000 7fc613bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c14e380 con 0x7fc60c069ef0 2023-06-23T19:02:28.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.893+0000 7fc613bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c14d770 con 0x7fc60c158550 2023-06-23T19:02:28.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.893+0000 7fc613bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c14da50 con 0x7fc60c0c96f0 2023-06-23T19:02:28.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.893+0000 7fc61199b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c069ef0 0x7fc60c14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61199b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c069ef0 0x7fc60c14bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51822/0 (socket says 172.21.15.136:51822) 2023-06-23T19:02:28.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61199b700 1 -- 172.21.15.136:0/2977879210 learned_addr learned my addr 172.21.15.136:0/2977879210 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:28.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61219c700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c158550 0x7fc60c1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61119a700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c96f0 0x7fc60c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61199b700 1 -- 172.21.15.136:0/2977879210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c96f0 msgr2=0x7fc60c150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61199b700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c96f0 0x7fc60c150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61199b700 1 -- 172.21.15.136:0/2977879210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c158550 msgr2=0x7fc60c1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:28.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61199b700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c158550 0x7fc60c1573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:28.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61199b700 1 -- 172.21.15.136:0/2977879210 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604009a70 con 0x7fc60c069ef0 2023-06-23T19:02:28.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61119a700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c96f0 0x7fc60c150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:28.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc61199b700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c069ef0 0x7fc60c14bc00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc60800c750 tx=0x7fc60800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:28.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc6027fc700 1 -- 172.21.15.136:0/2977879210 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608004c80 con 0x7fc60c069ef0 2023-06-23T19:02:28.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc6027fc700 1 -- 172.21.15.136:0/2977879210 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608004e00 con 0x7fc60c069ef0 2023-06-23T19:02:28.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc0094a0 con 0x7fc60c069ef0 2023-06-23T19:02:28.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.894+0000 7fc6027fc700 1 -- 172.21.15.136:0/2977879210 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608007310 con 0x7fc60c069ef0 2023-06-23T19:02:28.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.895+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c14e010 con 0x7fc60c069ef0 2023-06-23T19:02:28.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.896+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60c14e660 con 0x7fc60c069ef0 2023-06-23T19:02:28.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.896+0000 7fc6027fc700 1 -- 172.21.15.136:0/2977879210 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc608007470 con 0x7fc60c069ef0 2023-06-23T19:02:28.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.897+0000 7fc6027fc700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc5f006ace0 0x7fc5f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:28.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.897+0000 7fc6027fc700 1 -- 172.21.15.136:0/2977879210 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc608089510 con 0x7fc60c069ef0 2023-06-23T19:02:28.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.897+0000 7fc61119a700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc5f006ace0 0x7fc5f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:28.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.898+0000 7fc61119a700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc5f006ace0 0x7fc5f006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0090b0 tx=0x7fc5fc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:28.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:28.901+0000 7fc6027fc700 1 -- 172.21.15.136:0/2977879210 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc6080541f0 con 0x7fc60c069ef0 2023-06-23T19:02:29.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:29.148+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc60c073910 con 0x7fc60c069ef0 2023-06-23T19:02:30.120 INFO:tasks.ceph.mon.a.smithi136.stderr:2023-06-23T19:02:30.116+0000 7f35d6bf9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-23T19:02:30.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.120+0000 7fc6027fc700 1 -- 172.21.15.136:0/2977879210 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc608057810 con 0x7fc60c069ef0 2023-06-23T19:02:30.127 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc5f006ace0 msgr2=0x7fc5f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:30.127 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc5f006ace0 0x7fc5f006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0090b0 tx=0x7fc5fc008030 comp rx=0 tx=0).stop 2023-06-23T19:02:30.127 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c069ef0 msgr2=0x7fc60c14bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:30.127 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c069ef0 0x7fc60c14bc00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc60800c750 tx=0x7fc60800cb10 comp rx=0 tx=0).stop 2023-06-23T19:02:30.127 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 shutdown_connections 2023-06-23T19:02:30.128 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc5f006ace0 0x7fc5f006d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:30.128 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c158550 0x7fc60c1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:30.128 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c069ef0 0x7fc60c14bc00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:30.128 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 --2- 172.21.15.136:0/2977879210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c96f0 0x7fc60c150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:30.128 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 >> 172.21.15.136:0/2977879210 conn(0x7fc60c0b0ef0 msgr2=0x7fc60c0ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:30.129 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 shutdown_connections 2023-06-23T19:02:30.129 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.123+0000 7fc613bff700 1 -- 172.21.15.136:0/2977879210 wait complete. 2023-06-23T19:02:30.129 INFO:teuthology.orchestra.run.smithi136.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-23T19:02:30.135 INFO:tasks.ceph.mds.d.smithi178.stderr: -6582> 2023-06-23T19:01:09.222+0000 7f6091df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T19:02:30.148 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-23T19:02:30.190 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-06-23T19:02:30.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.349+0000 7f71e01ff700 1 Processor -- start 2023-06-23T19:02:30.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.350+0000 7f71e01ff700 1 -- start start 2023-06-23T19:02:30.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.351+0000 7f71e01ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:30.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.351+0000 7f71e01ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71d806ded0 0x7f71d8070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:30.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.351+0000 7f71e01ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d80c55e0 con 0x7f71d80b0e80 2023-06-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71e01ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d80b4420 con 0x7f71d806ded0 2023-06-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71e01ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d815d0e0 con 0x7f71d8158ad0 2023-06-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71de79c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71d806ded0 0x7f71d8070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71ddf9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71de79c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71d806ded0 0x7f71d8070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:49870/0 (socket says 172.21.15.136:49870) 2023-06-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71dd79a700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f71d80b0e80 0x7f71d806c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:37622/0 (socket says 172.21.15.136:37622) 2023-06-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71de79c700 1 -- 172.21.15.136:0/1088415398 learned_addr learned my addr 172.21.15.136:0/1088415398 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71ddf9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:50918/0 (socket says 172.21.15.136:50918) 2023-06-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71dcf99700 1 -- 172.21.15.136:0/1088415398 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901194499 0 0) 0x7f71d80c55e0 con 0x7f71d80b0e80 2023-06-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71dcf99700 1 -- 172.21.15.136:0/1088415398 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c40035b0 con 0x7f71d80b0e80 2023-06-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71ddf9b700 1 -- 172.21.15.136:0/1088415398 >> v2:172.21.15.178:3300/0 conn(0x7f71d806ded0 msgr2=0x7f71d8070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71ddf9b700 1 --2- 172.21.15.136:0/1088415398 >> v2:172.21.15.178:3300/0 conn(0x7f71d806ded0 0x7f71d8070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71ddf9b700 1 -- 172.21.15.136:0/1088415398 >> v1:172.21.15.178:6789/0 conn(0x7f71d80b0e80 legacy=0x7f71d806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.352+0000 7f71ddf9b700 1 -- 172.21.15.136:0/1088415398 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d815d570 con 0x7f71d8158ad0 2023-06-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.353+0000 7f71ddf9b700 1 --2- 172.21.15.136:0/1088415398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80702e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009840 tx=0x7f71d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f09776850d96c62 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.353+0000 7f71dcf99700 1 -- 172.21.15.136:0/1088415398 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4011830 con 0x7f71d8158ad0 2023-06-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.353+0000 7f71dcf99700 1 -- 172.21.15.136:0/1088415398 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d4011990 con 0x7f71d8158ad0 2023-06-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.353+0000 7f71dcf99700 1 -- 172.21.15.136:0/1088415398 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4011d20 con 0x7f71d8158ad0 2023-06-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.353+0000 7f71e01ff700 1 -- 172.21.15.136:0/1088415398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 msgr2=0x7f71d80702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.353+0000 7f71e01ff700 1 --2- 172.21.15.136:0/1088415398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80702e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009840 tx=0x7f71d4009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.354+0000 7f71e01ff700 1 -- 172.21.15.136:0/1088415398 shutdown_connections 2023-06-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.354+0000 7f71e01ff700 1 --2- 172.21.15.136:0/1088415398 >> v2:172.21.15.178:3300/0 conn(0x7f71d806ded0 0x7f71d8070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.354+0000 7f71e01ff700 1 --2- 172.21.15.136:0/1088415398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80702e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.354+0000 7f71e01ff700 1 -- 172.21.15.136:0/1088415398 >> 172.21.15.136:0/1088415398 conn(0x7f71d806ab80 msgr2=0x7f71d80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.354+0000 7f71e01ff700 1 -- 172.21.15.136:0/1088415398 shutdown_connections 2023-06-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.354+0000 7f71e01ff700 1 -- 172.21.15.136:0/1088415398 wait complete. 2023-06-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.356+0000 7f71e01ff700 1 Processor -- start 2023-06-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.356+0000 7f71e01ff700 1 -- start start 2023-06-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.357+0000 7f71e01ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71d806ded0 0x7f71d80c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.357+0000 7f71e01ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71d80b0e80 0x7f71d81f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71e01ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71e01ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80c6210 con 0x7f71d80b0e80 2023-06-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71e01ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d81f69b0 con 0x7f71d806ded0 2023-06-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71e01ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80b0a80 con 0x7f71d8158ad0 2023-06-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71dd79a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71d80b0e80 0x7f71d81f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71dd79a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71d80b0e80 0x7f71d81f6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51836/0 (socket says 172.21.15.136:51836) 2023-06-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71dd79a700 1 -- 172.21.15.136:0/4148449002 learned_addr learned my addr 172.21.15.136:0/4148449002 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71ddf9b700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71d806ded0 0x7f71d80c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71de79c700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71dd79a700 1 -- 172.21.15.136:0/4148449002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 msgr2=0x7f71d80b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71dd79a700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71dd79a700 1 -- 172.21.15.136:0/4148449002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71d806ded0 msgr2=0x7f71d80c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71dd79a700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71d806ded0 0x7f71d80c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.358+0000 7f71dd79a700 1 -- 172.21.15.136:0/4148449002 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40094a0 con 0x7f71d80b0e80 2023-06-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.359+0000 7f71dd79a700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71d80b0e80 0x7f71d81f6470 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c730 tx=0x7f71c800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.359+0000 7f71ce7fc700 1 -- 172.21.15.136:0/4148449002 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8005cb0 con 0x7f71d80b0e80 2023-06-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.359+0000 7f71ce7fc700 1 -- 172.21.15.136:0/4148449002 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8005e10 con 0x7f71d80b0e80 2023-06-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.359+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d80c8c00 con 0x7f71d80b0e80 2023-06-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.359+0000 7f71ce7fc700 1 -- 172.21.15.136:0/4148449002 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80072d0 con 0x7f71d80b0e80 2023-06-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.359+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d80c91c0 con 0x7f71d80b0e80 2023-06-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.360+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d80c6350 con 0x7f71d80b0e80 2023-06-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.361+0000 7f71ce7fc700 1 -- 172.21.15.136:0/4148449002 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71c8007430 con 0x7f71d80b0e80 2023-06-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.362+0000 7f71ce7fc700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f71bc06ace0 0x7f71bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.362+0000 7f71ce7fc700 1 -- 172.21.15.136:0/4148449002 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f71c8088b80 con 0x7f71d80b0e80 2023-06-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.362+0000 7f71ddf9b700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f71bc06ace0 0x7f71bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.363+0000 7f71ddf9b700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f71bc06ace0 0x7f71bc06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71d4000c00 tx=0x7f71d401d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.366+0000 7f71ce7fc700 1 -- 172.21.15.136:0/4148449002 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71d80c6350 con 0x7f71d80b0e80 2023-06-23T19:02:30.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:30.607+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f71d80c6350 con 0x7f71d80b0e80 2023-06-23T19:02:31.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.121+0000 7f71ce7fc700 1 -- 172.21.15.136:0/4148449002 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f71d80c6350 con 0x7f71d80b0e80 2023-06-23T19:02:31.128 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.123+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f71bc06ace0 msgr2=0x7f71bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:31.128 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.123+0000 7f71e01ff700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f71bc06ace0 0x7f71bc06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71d4000c00 tx=0x7f71d401d040 comp rx=0 tx=0).stop 2023-06-23T19:02:31.128 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.123+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71d80b0e80 msgr2=0x7f71d81f6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:31.129 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.123+0000 7f71e01ff700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71d80b0e80 0x7f71d81f6470 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c730 tx=0x7f71c800ca40 comp rx=0 tx=0).stop 2023-06-23T19:02:31.129 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.123+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 shutdown_connections 2023-06-23T19:02:31.129 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.124+0000 7f71e01ff700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f71bc06ace0 0x7f71bc06d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.129 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.124+0000 7f71e01ff700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71d806ded0 0x7f71d80c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.130 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.124+0000 7f71e01ff700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71d8158ad0 0x7f71d80b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.130 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.124+0000 7f71e01ff700 1 --2- 172.21.15.136:0/4148449002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71d80b0e80 0x7f71d81f6470 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.130 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.124+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 >> 172.21.15.136:0/4148449002 conn(0x7f71d806ab80 msgr2=0x7f71d8157a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:31.131 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.124+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 shutdown_connections 2023-06-23T19:02:31.131 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.124+0000 7f71e01ff700 1 -- 172.21.15.136:0/4148449002 wait complete. 2023-06-23T19:02:31.146 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-23T19:02:31.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.340+0000 7fd5275ff700 1 Processor -- start 2023-06-23T19:02:31.345 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.341+0000 7fd5275ff700 1 -- start start 2023-06-23T19:02:31.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd5275ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd5200d0a60 0x7fd5200b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:31.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd5275ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd5200b51d0 0x7fd5200cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:31.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd5275ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200d0e30 0x7fd5200d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:31.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd5275ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200d0060 con 0x7fd5200b51d0 2023-06-23T19:02:31.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd5275ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200cfe50 con 0x7fd5200d0a60 2023-06-23T19:02:31.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd5275ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200cd9d0 con 0x7fd5200d0e30 2023-06-23T19:02:31.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd524b9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd5200b51d0 0x7fd5200cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:31.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd524b9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd5200b51d0 0x7fd5200cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51844/0 (socket says 172.21.15.136:51844) 2023-06-23T19:02:31.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd524b9a700 1 -- 172.21.15.136:0/360977793 learned_addr learned my addr 172.21.15.136:0/360977793 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:31.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd52539b700 1 --2- 172.21.15.136:0/360977793 >> v2:172.21.15.178:3300/0 conn(0x7fd5200d0a60 0x7fd5200b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:31.350 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd525b9c700 1 --2- 172.21.15.136:0/360977793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200d0e30 0x7fd5200d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:31.350 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd524b9a700 1 -- 172.21.15.136:0/360977793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200d0e30 msgr2=0x7fd5200d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:31.350 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd524b9a700 1 --2- 172.21.15.136:0/360977793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200d0e30 0x7fd5200d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd524b9a700 1 -- 172.21.15.136:0/360977793 >> v2:172.21.15.178:3300/0 conn(0x7fd5200d0a60 msgr2=0x7fd5200b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:31.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd524b9a700 1 --2- 172.21.15.136:0/360977793 >> v2:172.21.15.178:3300/0 conn(0x7fd5200d0a60 0x7fd5200b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd524b9a700 1 -- 172.21.15.136:0/360977793 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200b5620 con 0x7fd5200b51d0 2023-06-23T19:02:31.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd52539b700 1 --2- 172.21.15.136:0/360977793 >> v2:172.21.15.178:3300/0 conn(0x7fd5200d0a60 0x7fd5200b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:31.351 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.342+0000 7fd525b9c700 1 --2- 172.21.15.136:0/360977793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200d0e30 0x7fd5200d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:31.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.343+0000 7fd524b9a700 1 --2- 172.21.15.136:0/360977793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200b51d0 0x7fd5200cf910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd52006c6e0 tx=0x7fd510009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd427552375360d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:31.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.343+0000 7fd517fff700 1 -- 172.21.15.136:0/360977793 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000b870 con 0x7fd5200b51d0 2023-06-23T19:02:31.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.343+0000 7fd517fff700 1 -- 172.21.15.136:0/360977793 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51000b9d0 con 0x7fd5200b51d0 2023-06-23T19:02:31.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.343+0000 7fd517fff700 1 -- 172.21.15.136:0/360977793 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000bd60 con 0x7fd5200b51d0 2023-06-23T19:02:31.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.343+0000 7fd5275ff700 1 -- 172.21.15.136:0/360977793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200b51d0 msgr2=0x7fd5200cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:31.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.343+0000 7fd5275ff700 1 --2- 172.21.15.136:0/360977793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200b51d0 0x7fd5200cf910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd52006c6e0 tx=0x7fd510009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.344+0000 7fd5275ff700 1 -- 172.21.15.136:0/360977793 shutdown_connections 2023-06-23T19:02:31.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.344+0000 7fd5275ff700 1 --2- 172.21.15.136:0/360977793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200d0e30 0x7fd5200d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.344+0000 7fd5275ff700 1 --2- 172.21.15.136:0/360977793 >> v2:172.21.15.178:3300/0 conn(0x7fd5200d0a60 0x7fd5200b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.344+0000 7fd5275ff700 1 --2- 172.21.15.136:0/360977793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200b51d0 0x7fd5200cf910 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.344+0000 7fd5275ff700 1 -- 172.21.15.136:0/360977793 >> 172.21.15.136:0/360977793 conn(0x7fd520071620 msgr2=0x7fd5200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.344+0000 7fd5275ff700 1 -- 172.21.15.136:0/360977793 shutdown_connections 2023-06-23T19:02:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.344+0000 7fd5275ff700 1 -- 172.21.15.136:0/360977793 wait complete. 2023-06-23T19:02:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.345+0000 7fd5275ff700 1 Processor -- start 2023-06-23T19:02:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.346+0000 7fd5275ff700 1 -- start start 2023-06-23T19:02:31.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.346+0000 7fd5275ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200b51d0 0x7fd5200c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:31.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.346+0000 7fd5275ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200d0a60 0x7fd5201584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:31.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd5275ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5200d0e30 0x7fd5200b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:31.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd5275ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520145f60 con 0x7fd5200d0a60 2023-06-23T19:02:31.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd5275ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5201f1e00 con 0x7fd5200d0e30 2023-06-23T19:02:31.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd5275ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200c6f20 con 0x7fd5200b51d0 2023-06-23T19:02:31.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd524b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200d0a60 0x7fd5201584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:31.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd524b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200d0a60 0x7fd5201584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51852/0 (socket says 172.21.15.136:51852) 2023-06-23T19:02:31.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd524b9a700 1 -- 172.21.15.136:0/745495630 learned_addr learned my addr 172.21.15.136:0/745495630 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:31.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd52539b700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200b51d0 0x7fd5200c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:31.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd525b9c700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5200d0e30 0x7fd5200b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:31.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd524b9a700 1 -- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200b51d0 msgr2=0x7fd5200c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:31.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd524b9a700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200b51d0 0x7fd5200c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd524b9a700 1 -- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5200d0e30 msgr2=0x7fd5200b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:31.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd524b9a700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5200d0e30 0x7fd5200b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:31.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd524b9a700 1 -- 172.21.15.136:0/745495630 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510009550 con 0x7fd5200d0a60 2023-06-23T19:02:31.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd52539b700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200b51d0 0x7fd5200c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:31.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd525b9c700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5200d0e30 0x7fd5200b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:31.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.347+0000 7fd524b9a700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200d0a60 0x7fd5201584e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd5200d3d20 tx=0x7fd510004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:31.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.348+0000 7fd515ffb700 1 -- 172.21.15.136:0/745495630 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510004310 con 0x7fd5200d0a60 2023-06-23T19:02:31.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.348+0000 7fd515ffb700 1 -- 172.21.15.136:0/745495630 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51001f070 con 0x7fd5200d0a60 2023-06-23T19:02:31.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.348+0000 7fd515ffb700 1 -- 172.21.15.136:0/745495630 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100036a0 con 0x7fd5200d0a60 2023-06-23T19:02:31.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.348+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd520145c80 con 0x7fd5200d0a60 2023-06-23T19:02:31.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.348+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5200c6bb0 con 0x7fd5200d0a60 2023-06-23T19:02:31.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.349+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5200c6730 con 0x7fd5200d0a60 2023-06-23T19:02:31.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.350+0000 7fd515ffb700 1 -- 172.21.15.136:0/745495630 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd510021030 con 0x7fd5200d0a60 2023-06-23T19:02:31.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.351+0000 7fd515ffb700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd50406ace0 0x7fd50406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:31.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.351+0000 7fd515ffb700 1 -- 172.21.15.136:0/745495630 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fd51008acf0 con 0x7fd5200d0a60 2023-06-23T19:02:31.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.351+0000 7fd52539b700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd50406ace0 0x7fd50406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:31.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.352+0000 7fd52539b700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd50406ace0 0x7fd50406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd51c008940 tx=0x7fd51c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:31.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.356+0000 7fd515ffb700 1 -- 172.21.15.136:0/745495630 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5200c6730 con 0x7fd5200d0a60 2023-06-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:31.555+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd5200c6730 con 0x7fd5200d0a60 2023-06-23T19:02:32.133 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.128+0000 7fd515ffb700 1 -- 172.21.15.136:0/745495630 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd5200c6730 con 0x7fd5200d0a60 2023-06-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd50406ace0 msgr2=0x7fd50406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd50406ace0 0x7fd50406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd51c008940 tx=0x7fd51c008040 comp rx=0 tx=0).stop 2023-06-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200d0a60 msgr2=0x7fd5201584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200d0a60 0x7fd5201584e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd5200d3d20 tx=0x7fd510004750 comp rx=0 tx=0).stop 2023-06-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 shutdown_connections 2023-06-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd50406ace0 0x7fd50406d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5200d0e30 0x7fd5200b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5200b51d0 0x7fd5200c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 --2- 172.21.15.136:0/745495630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5200d0a60 0x7fd5201584e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.132+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 >> 172.21.15.136:0/745495630 conn(0x7fd520071620 msgr2=0x7fd5200b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.133+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 shutdown_connections 2023-06-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.133+0000 7fd5275ff700 1 -- 172.21.15.136:0/745495630 wait complete. 2023-06-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_metadata' removed 2023-06-23T19:02:32.158 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-23T19:02:32.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.358+0000 7fbaaedff700 1 Processor -- start 2023-06-23T19:02:32.362 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.358+0000 7fbaaedff700 1 -- start start 2023-06-23T19:02:32.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.359+0000 7fbaaedff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80b51d0 0x7fbaa80cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:32.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.359+0000 7fbaaedff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa80b5ec0 con 0x7fbaa80b5a70 2023-06-23T19:02:32.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.359+0000 7fbaaedff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa80b5650 con 0x7fbaa80d0a60 2023-06-23T19:02:32.363 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.359+0000 7fbaaedff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80d0060 con 0x7fbaa80b51d0 2023-06-23T19:02:32.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.359+0000 7fbaa7fff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fbaa80b5a70 0x7fbaa80d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36718/0 (socket says 172.21.15.136:36718) 2023-06-23T19:02:32.364 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.359+0000 7fbaa7fff700 1 -- 172.21.15.136:0/3869752789 learned_addr learned my addr 172.21.15.136:0/3869752789 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:32.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaad39c700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80b51d0 0x7fbaa80cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:32.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283106888 0 0) 0x7fbaa80b5ec0 con 0x7fbaa80b5a70 2023-06-23T19:02:32.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba980035b0 con 0x7fbaa80b5a70 2023-06-23T19:02:32.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525823502 0 0) 0x7fbaa80b5650 con 0x7fbaa80d0a60 2023-06-23T19:02:32.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaa80b5ec0 con 0x7fbaa80d0a60 2023-06-23T19:02:32.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2959276774 0 0) 0x7fba980035b0 con 0x7fbaa80b5a70 2023-06-23T19:02:32.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80b51d0 msgr2=0x7fbaa80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:32.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80b51d0 0x7fbaa80cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:32.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 >> v1:172.21.15.178:6789/0 conn(0x7fbaa80d0a60 legacy=0x7fbaa80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:32.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa80cd9d0 con 0x7fbaa80b5a70 2023-06-23T19:02:32.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fba940015f0 con 0x7fbaa80b5a70 2023-06-23T19:02:32.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 >> v1:172.21.15.136:6789/0 conn(0x7fbaa80b5a70 legacy=0x7fbaa80d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:32.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fba98003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:32.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80b51d0 0x7fba98004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:32.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.360+0000 7fbaa77fe700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba98004d90 0x7fba98005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:32.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80d0060 con 0x7fba98003bc0 2023-06-23T19:02:32.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9800bac0 con 0x7fba98004d90 2023-06-23T19:02:32.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9800bc80 con 0x7fbaa80b51d0 2023-06-23T19:02:32.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaacb9b700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fba98003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:32.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaad39c700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba98004d90 0x7fba98005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:32.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaa7fff700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80b51d0 0x7fba98004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:32.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaacb9b700 1 -- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80b51d0 msgr2=0x7fba98004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:32.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaacb9b700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80b51d0 0x7fba98004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:32.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaacb9b700 1 -- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba98004d90 msgr2=0x7fba98005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:32.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaacb9b700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba98004d90 0x7fba98005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:32.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaacb9b700 1 -- 172.21.15.136:0/3869752789 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba980035b0 con 0x7fba98003bc0 2023-06-23T19:02:32.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.361+0000 7fbaad39c700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba98004d90 0x7fba98005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:32.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.362+0000 7fbaacb9b700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fba98003fb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fba9c007fd0 tx=0x7fba98005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c053f1848d0322a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:32.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.362+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c001430 con 0x7fba98003bc0 2023-06-23T19:02:32.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.362+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c0052d0 con 0x7fba98003bc0 2023-06-23T19:02:32.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.362+0000 7fbaa77fe700 1 -- 172.21.15.136:0/3869752789 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c001d40 con 0x7fba98003bc0 2023-06-23T19:02:32.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.362+0000 7fbaaedff700 1 -- 172.21.15.136:0/3869752789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 msgr2=0x7fba98003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:32.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.362+0000 7fbaaedff700 1 --2- 172.21.15.136:0/3869752789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fba98003fb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fba9c007fd0 tx=0x7fba98005880 comp rx=0 tx=0).stop 2023-06-23T19:02:32.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.362+0000 7fbaad39c700 1 -- 172.21.15.136:0/3869752789 reap_dead start 2023-06-23T19:02:32.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.362+0000 7fbaaedff700 1 -- 172.21.15.136:0/3869752789 shutdown_connections 2023-06-23T19:02:32.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.362+0000 7fbaaedff700 1 -- 172.21.15.136:0/3869752789 >> 172.21.15.136:0/3869752789 conn(0x7fbaa8071620 msgr2=0x7fbaa80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:32.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.363+0000 7fbaaedff700 1 -- 172.21.15.136:0/3869752789 shutdown_connections 2023-06-23T19:02:32.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.363+0000 7fbaaedff700 1 -- 172.21.15.136:0/3869752789 wait complete. 2023-06-23T19:02:32.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.364+0000 7fbaaedff700 1 Processor -- start 2023-06-23T19:02:32.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.364+0000 7fbaaedff700 1 -- start start 2023-06-23T19:02:32.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.365+0000 7fbaaedff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fbaa81f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:32.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.365+0000 7fbaaedff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80cb2e0 0x7fbaa80cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:32.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.365+0000 7fbaaedff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaa815df80 0x7fbaa815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:32.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.365+0000 7fbaaedff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa815f200 con 0x7fba98003bc0 2023-06-23T19:02:32.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.365+0000 7fbaaedff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80cbc90 con 0x7fbaa815df80 2023-06-23T19:02:32.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.365+0000 7fbaaedff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80cc580 con 0x7fbaa80cb2e0 2023-06-23T19:02:32.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.365+0000 7fbaacb9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fbaa81f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:32.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.365+0000 7fbaacb9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fbaa81f11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51872/0 (socket says 172.21.15.136:51872) 2023-06-23T19:02:32.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaacb9b700 1 -- 172.21.15.136:0/1986534363 learned_addr learned my addr 172.21.15.136:0/1986534363 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:32.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaad39c700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaa815df80 0x7fbaa815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:32.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaacb9b700 1 -- 172.21.15.136:0/1986534363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80cb2e0 msgr2=0x7fbaa80cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:32.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaacb9b700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80cb2e0 0x7fbaa80cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:32.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaacb9b700 1 -- 172.21.15.136:0/1986534363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaa815df80 msgr2=0x7fbaa815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:32.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaacb9b700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaa815df80 0x7fbaa815e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:32.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaacb9b700 1 -- 172.21.15.136:0/1986534363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa81f16f0 con 0x7fba98003bc0 2023-06-23T19:02:32.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaacb9b700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fbaa81f11b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fba9c006af0 tx=0x7fba9c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:32.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaa57fa700 1 -- 172.21.15.136:0/1986534363 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0013d0 con 0x7fba98003bc0 2023-06-23T19:02:32.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaa57fa700 1 -- 172.21.15.136:0/1986534363 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c007040 con 0x7fba98003bc0 2023-06-23T19:02:32.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa815ec40 con 0x7fba98003bc0 2023-06-23T19:02:32.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.366+0000 7fbaa57fa700 1 -- 172.21.15.136:0/1986534363 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0073d0 con 0x7fba98003bc0 2023-06-23T19:02:32.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.367+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa8142ba0 con 0x7fba98003bc0 2023-06-23T19:02:32.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.368+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa8142a00 con 0x7fba98003bc0 2023-06-23T19:02:32.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.368+0000 7fbaa57fa700 1 -- 172.21.15.136:0/1986534363 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba9c007530 con 0x7fba98003bc0 2023-06-23T19:02:32.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.370+0000 7fbaa57fa700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8c06ace0 0x7fba8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:32.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.370+0000 7fbaa57fa700 1 -- 172.21.15.136:0/1986534363 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fba9c08a9e0 con 0x7fba98003bc0 2023-06-23T19:02:32.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.370+0000 7fbaa7fff700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8c06ace0 0x7fba8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:32.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.370+0000 7fbaa7fff700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8c06ace0 0x7fba8c06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba94001050 tx=0x7fba94001170 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:32.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.374+0000 7fbaa57fa700 1 -- 172.21.15.136:0/1986534363 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbaa8142a00 con 0x7fba98003bc0 2023-06-23T19:02:32.576 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:32.572+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbaa8142a00 con 0x7fba98003bc0 2023-06-23T19:02:33.138 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.135+0000 7fbaa57fa700 1 -- 172.21.15.136:0/1986534363 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbaa8142a00 con 0x7fba98003bc0 2023-06-23T19:02:33.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8c06ace0 msgr2=0x7fba8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:33.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8c06ace0 0x7fba8c06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba94001050 tx=0x7fba94001170 comp rx=0 tx=0).stop 2023-06-23T19:02:33.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 msgr2=0x7fbaa81f11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:33.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fbaa81f11b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fba9c006af0 tx=0x7fba9c0012d0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 shutdown_connections 2023-06-23T19:02:33.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fba8c06ace0 0x7fba8c06d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaa815df80 0x7fbaa815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba98003bc0 0x7fbaa81f11b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 --2- 172.21.15.136:0/1986534363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaa80cb2e0 0x7fbaa80cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 >> 172.21.15.136:0/1986534363 conn(0x7fbaa8071620 msgr2=0x7fbaa80b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:33.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 shutdown_connections 2023-06-23T19:02:33.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.138+0000 7fbaaedff700 1 -- 172.21.15.136:0/1986534363 wait complete. 2023-06-23T19:02:33.144 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data' removed 2023-06-23T19:02:33.161 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-06-23T19:02:33.360 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.356+0000 7f3d11bff700 1 Processor -- start 2023-06-23T19:02:33.361 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.356+0000 7f3d11bff700 1 -- start start 2023-06-23T19:02:33.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d11bff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d0c0b1c20 0x7f3d0c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:33.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d11bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0c159960 0x7f3d0c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:33.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d11bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c0caee0 con 0x7f3d0c159590 2023-06-23T19:02:33.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d11bff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c0c8f30 con 0x7f3d0c0b1c20 2023-06-23T19:02:33.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d11bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c15a790 con 0x7f3d0c159960 2023-06-23T19:02:33.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d0b7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3d0c159590 0x7f3d0c0b1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36730/0 (socket says 172.21.15.136:36730) 2023-06-23T19:02:33.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d0b7fe700 1 -- 172.21.15.136:0/733932607 learned_addr learned my addr 172.21.15.136:0/733932607 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:33.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d0bfff700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0c159960 0x7f3d0c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:33.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d03fff700 1 --2- 172.21.15.136:0/733932607 >> v2:172.21.15.178:3300/0 conn(0x7f3d0c0b1c20 0x7f3d0c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:33.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274437950 0 0) 0x7f3d0c0caee0 con 0x7f3d0c159590 2023-06-23T19:02:33.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.358+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf80035b0 con 0x7f3d0c159590 2023-06-23T19:02:33.368 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1126293772 0 0) 0x7f3cf80035b0 con 0x7f3d0c159590 2023-06-23T19:02:33.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0c159960 msgr2=0x7f3d0c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:33.369 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0c159960 0x7f3d0c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 >> v2:172.21.15.178:3300/0 conn(0x7f3d0c0b1c20 msgr2=0x7f3d0c0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:33.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 --2- 172.21.15.136:0/733932607 >> v2:172.21.15.178:3300/0 conn(0x7f3d0c0b1c20 0x7f3d0c0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0c9180 con 0x7f3d0c159590 2023-06-23T19:02:33.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7f3cfc001670 con 0x7f3d0c159590 2023-06-23T19:02:33.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 >> v1:172.21.15.136:6789/0 conn(0x7f3d0c159590 legacy=0x7f3d0c0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:33.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cf8003a00 0x7f3cf8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:33.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8004850 0x7f3cf8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:33.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0c159960 0x7f3cf8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:33.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0c8f30 con 0x7f3cf8003a00 2023-06-23T19:02:33.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c15a790 con 0x7f3cf8004850 2023-06-23T19:02:33.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf800dca0 con 0x7f3d0c159960 2023-06-23T19:02:33.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0b7fe700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cf8003a00 0x7f3cf8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:33.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d03fff700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8004850 0x7f3cf8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:33.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0bfff700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0c159960 0x7f3cf8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:33.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0b7fe700 1 -- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0c159960 msgr2=0x7f3cf8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:33.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0b7fe700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0c159960 0x7f3cf8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0b7fe700 1 -- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8004850 msgr2=0x7f3cf8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:33.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0b7fe700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8004850 0x7f3cf8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0b7fe700 1 -- 172.21.15.136:0/733932607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80035b0 con 0x7f3cf8003a00 2023-06-23T19:02:33.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.359+0000 7f3d0bfff700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0c159960 0x7f3cf8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:33.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.360+0000 7f3d0b7fe700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cf8003a00 0x7f3cf8003e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c2f0 tx=0x7f3cf8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca3c8969700b376 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:33.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.360+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc007c40 con 0x7f3cf8003a00 2023-06-23T19:02:33.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.360+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc00ce30 con 0x7f3cf8003a00 2023-06-23T19:02:33.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.360+0000 7f3d0affd700 1 -- 172.21.15.136:0/733932607 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc005ba0 con 0x7f3cf8003a00 2023-06-23T19:02:33.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.360+0000 7f3d11bff700 1 -- 172.21.15.136:0/733932607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cf8003a00 msgr2=0x7f3cf8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:33.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.360+0000 7f3d11bff700 1 --2- 172.21.15.136:0/733932607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cf8003a00 0x7f3cf8003e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c2f0 tx=0x7f3cf8005880 comp rx=0 tx=0).stop 2023-06-23T19:02:33.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.360+0000 7f3d0bfff700 1 -- 172.21.15.136:0/733932607 reap_dead start 2023-06-23T19:02:33.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.360+0000 7f3d11bff700 1 -- 172.21.15.136:0/733932607 shutdown_connections 2023-06-23T19:02:33.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.360+0000 7f3d11bff700 1 -- 172.21.15.136:0/733932607 >> 172.21.15.136:0/733932607 conn(0x7f3d0c06ab80 msgr2=0x7f3d0c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:33.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.361+0000 7f3d11bff700 1 -- 172.21.15.136:0/733932607 shutdown_connections 2023-06-23T19:02:33.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.361+0000 7f3d11bff700 1 -- 172.21.15.136:0/733932607 wait complete. 2023-06-23T19:02:33.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.362+0000 7f3d11bff700 1 Processor -- start 2023-06-23T19:02:33.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.362+0000 7f3d11bff700 1 -- start start 2023-06-23T19:02:33.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.363+0000 7f3d11bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cf8003a00 0x7f3d0c1ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:33.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.363+0000 7f3d11bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0c152750 0x7f3d0c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:33.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.363+0000 7f3d11bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d0c15c180 0x7f3d0c1f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:33.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.363+0000 7f3d11bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c15c620 con 0x7f3d0c15c180 2023-06-23T19:02:33.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.363+0000 7f3d11bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0c41b0 con 0x7f3d0c152750 2023-06-23T19:02:33.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.363+0000 7f3d11bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c1ef5e0 con 0x7f3cf8003a00 2023-06-23T19:02:33.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d0c15c180 0x7f3d0c1f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:33.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d0c15c180 0x7f3d0c1f1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51890/0 (socket says 172.21.15.136:51890) 2023-06-23T19:02:33.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0bfff700 1 -- 172.21.15.136:0/914017319 learned_addr learned my addr 172.21.15.136:0/914017319 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:33.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d03fff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0c152750 0x7f3d0c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:33.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0b7fe700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cf8003a00 0x7f3d0c1ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:33.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0bfff700 1 -- 172.21.15.136:0/914017319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cf8003a00 msgr2=0x7f3d0c1ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:33.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0bfff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cf8003a00 0x7f3d0c1ef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0bfff700 1 -- 172.21.15.136:0/914017319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0c152750 msgr2=0x7f3d0c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:33.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0bfff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0c152750 0x7f3d0c15bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:33.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0bfff700 1 -- 172.21.15.136:0/914017319 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0c35a0 con 0x7f3d0c15c180 2023-06-23T19:02:33.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d0bfff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d0c15c180 0x7f3d0c1f1c10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0cedd0 tx=0x7f3d040104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:33.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d08ff9700 1 -- 172.21.15.136:0/914017319 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400e050 con 0x7f3d0c15c180 2023-06-23T19:02:33.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d08ff9700 1 -- 172.21.15.136:0/914017319 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400f040 con 0x7f3d0c15c180 2023-06-23T19:02:33.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.364+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c0c3880 con 0x7f3d0c15c180 2023-06-23T19:02:33.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.365+0000 7f3d08ff9700 1 -- 172.21.15.136:0/914017319 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04010e60 con 0x7f3d0c15c180 2023-06-23T19:02:33.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.365+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c0c3e40 con 0x7f3d0c15c180 2023-06-23T19:02:33.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.366+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c071620 con 0x7f3d0c15c180 2023-06-23T19:02:33.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.367+0000 7f3d08ff9700 1 -- 172.21.15.136:0/914017319 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d04015440 con 0x7f3d0c15c180 2023-06-23T19:02:33.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.367+0000 7f3d08ff9700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3cec06acd0 0x7f3cec06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:33.389 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.368+0000 7f3d08ff9700 1 -- 172.21.15.136:0/914017319 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f3d04089600 con 0x7f3d0c15c180 2023-06-23T19:02:33.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.368+0000 7f3d0b7fe700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3cec06acd0 0x7f3cec06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:33.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.368+0000 7f3d0b7fe700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3cec06acd0 0x7f3cec06d180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc015040 tx=0x7f3cfc00a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:33.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.372+0000 7f3d08ff9700 1 -- 172.21.15.136:0/914017319 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3d04054800 con 0x7f3d0c15c180 2023-06-23T19:02:33.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:33.567+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d0c0c5790 con 0x7f3d0c15c180 2023-06-23T19:02:34.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.139+0000 7f3d08ff9700 1 -- 172.21.15.136:0/914017319 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3d0c0c5790 con 0x7f3d0c15c180 2023-06-23T19:02:34.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.141+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3cec06acd0 msgr2=0x7f3cec06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:34.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.141+0000 7f3d11bff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3cec06acd0 0x7f3cec06d180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc015040 tx=0x7f3cfc00a000 comp rx=0 tx=0).stop 2023-06-23T19:02:34.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.141+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d0c15c180 msgr2=0x7f3d0c1f1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:34.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.141+0000 7f3d11bff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d0c15c180 0x7f3d0c1f1c10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0cedd0 tx=0x7f3d040104a0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.142+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 shutdown_connections 2023-06-23T19:02:34.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.142+0000 7f3d11bff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f3cec06acd0 0x7f3cec06d180 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.142+0000 7f3d11bff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d0c15c180 0x7f3d0c1f1c10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.142+0000 7f3d11bff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cf8003a00 0x7f3d0c1ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.146 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.142+0000 7f3d11bff700 1 --2- 172.21.15.136:0/914017319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0c152750 0x7f3d0c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.142+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 >> 172.21.15.136:0/914017319 conn(0x7f3d0c06ab80 msgr2=0x7f3d0c0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:34.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.142+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 shutdown_connections 2023-06-23T19:02:34.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.142+0000 7f3d11bff700 1 -- 172.21.15.136:0/914017319 wait complete. 2023-06-23T19:02:34.147 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data_ec' removed 2023-06-23T19:02:34.164 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-23T19:02:34.164 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-23T19:02:34.164 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-23T19:02:34.165 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T19:02:34.165 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-23T19:02:34.165 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-23T19:02:34.165 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-23T19:02:34.165 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T19:02:34.166 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-23T19:02:34.166 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-23T19:02:34.166 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-23T19:02:34.167 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T19:02:34.167 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-23T19:02:34.167 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-23T19:02:34.167 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-23T19:02:34.167 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T19:02:34.181 INFO:tasks.ceph.mds.a:Stopped 2023-06-23T19:02:34.181 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-23T19:02:34.182 INFO:tasks.ceph.mds.c:Stopped 2023-06-23T19:02:34.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-23T19:02:34.189 INFO:tasks.ceph.mds.d:Stopped 2023-06-23T19:02:34.190 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-23T19:02:34.190 INFO:tasks.ceph.mds.b:Stopped 2023-06-23T19:02:34.191 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-23T19:02:34.226 INFO:tasks.ceph.mds.a:Started 2023-06-23T19:02:34.226 DEBUG:teuthology.parallel:result is None 2023-06-23T19:02:34.235 INFO:tasks.ceph.mds.c:Started 2023-06-23T19:02:34.236 DEBUG:teuthology.parallel:result is None 2023-06-23T19:02:34.238 INFO:tasks.ceph.mds.d:Started 2023-06-23T19:02:34.238 DEBUG:teuthology.parallel:result is None 2023-06-23T19:02:34.241 INFO:tasks.ceph.mds.b:Started 2023-06-23T19:02:34.241 DEBUG:teuthology.parallel:result is None 2023-06-23T19:02:34.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-23T19:02:34.376 INFO:tasks.ceph.mds.a.smithi136.stdout:starting mds.a at 2023-06-23T19:02:34.377 INFO:tasks.ceph.mds.c.smithi136.stdout:starting mds.c at 2023-06-23T19:02:34.386 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-06-23T19:02:34.387 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-06-23T19:02:34.458 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.454+0000 7fe1419ff700 1 Processor -- start 2023-06-23T19:02:34.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.455+0000 7fe1419ff700 1 -- start start 2023-06-23T19:02:34.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe1419ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe13c069ef0 0x7fe13c06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:34.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe1419ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c0c96f0 0x7fe13c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:34.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe1419ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c06e190 con 0x7fe13c158550 2023-06-23T19:02:34.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe1419ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13c06a8d0 con 0x7fe13c069ef0 2023-06-23T19:02:34.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe1419ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c0c8ce0 con 0x7fe13c0c96f0 2023-06-23T19:02:34.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe13affd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe13c158550 0x7fe13c06d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36762/0 (socket says 172.21.15.136:36762) 2023-06-23T19:02:34.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe13affd700 1 -- 172.21.15.136:0/2634769741 learned_addr learned my addr 172.21.15.136:0/2634769741 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:34.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe13b7fe700 1 --2- 172.21.15.136:0/2634769741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c0c96f0 0x7fe13c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:34.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe13a7fc700 1 --2- 172.21.15.136:0/2634769741 >> v2:172.21.15.178:3300/0 conn(0x7fe13c069ef0 0x7fe13c06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:34.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.456+0000 7fe139ffb700 1 -- 172.21.15.136:0/2634769741 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771692296 0 0) 0x7fe13c06e190 con 0x7fe13c158550 2023-06-23T19:02:34.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe139ffb700 1 -- 172.21.15.136:0/2634769741 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1240035b0 con 0x7fe13c158550 2023-06-23T19:02:34.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe13b7fe700 1 -- 172.21.15.136:0/2634769741 >> v2:172.21.15.178:3300/0 conn(0x7fe13c069ef0 msgr2=0x7fe13c06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:34.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe13b7fe700 1 --2- 172.21.15.136:0/2634769741 >> v2:172.21.15.178:3300/0 conn(0x7fe13c069ef0 0x7fe13c06a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe13b7fe700 1 -- 172.21.15.136:0/2634769741 >> v1:172.21.15.136:6789/0 conn(0x7fe13c158550 legacy=0x7fe13c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:34.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe13b7fe700 1 -- 172.21.15.136:0/2634769741 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0ccdc0 con 0x7fe13c0c96f0 2023-06-23T19:02:34.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe13a7fc700 1 --2- 172.21.15.136:0/2634769741 >> v2:172.21.15.178:3300/0 conn(0x7fe13c069ef0 0x7fe13c06a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:34.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe13b7fe700 1 --2- 172.21.15.136:0/2634769741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c0c96f0 0x7fe13c0c9b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe134009dc0 tx=0x7fe13400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d5237fe2c6c5e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:34.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe139ffb700 1 -- 172.21.15.136:0/2634769741 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13400e070 con 0x7fe13c0c96f0 2023-06-23T19:02:34.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe139ffb700 1 -- 172.21.15.136:0/2634769741 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13400bae0 con 0x7fe13c0c96f0 2023-06-23T19:02:34.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.457+0000 7fe139ffb700 1 -- 172.21.15.136:0/2634769741 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13400be90 con 0x7fe13c0c96f0 2023-06-23T19:02:34.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.458+0000 7fe1419ff700 1 -- 172.21.15.136:0/2634769741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c0c96f0 msgr2=0x7fe13c0c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:34.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.458+0000 7fe1419ff700 1 --2- 172.21.15.136:0/2634769741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c0c96f0 0x7fe13c0c9b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe134009dc0 tx=0x7fe13400b330 comp rx=0 tx=0).stop 2023-06-23T19:02:34.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.458+0000 7fe1419ff700 1 -- 172.21.15.136:0/2634769741 shutdown_connections 2023-06-23T19:02:34.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.458+0000 7fe1419ff700 1 --2- 172.21.15.136:0/2634769741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c0c96f0 0x7fe13c0c9b70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.458+0000 7fe1419ff700 1 --2- 172.21.15.136:0/2634769741 >> v2:172.21.15.178:3300/0 conn(0x7fe13c069ef0 0x7fe13c06a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.458+0000 7fe1419ff700 1 -- 172.21.15.136:0/2634769741 >> 172.21.15.136:0/2634769741 conn(0x7fe13c0b0ef0 msgr2=0x7fe13c0ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:34.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.458+0000 7fe1419ff700 1 -- 172.21.15.136:0/2634769741 shutdown_connections 2023-06-23T19:02:34.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.458+0000 7fe1419ff700 1 -- 172.21.15.136:0/2634769741 wait complete. 2023-06-23T19:02:34.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.460+0000 7fe1419ff700 1 Processor -- start 2023-06-23T19:02:34.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.460+0000 7fe1419ff700 1 -- start start 2023-06-23T19:02:34.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe1419ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe13c069ef0 0x7fe13c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:34.467 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe1419ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe13c0c96f0 0x7fe13c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:34.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe1419ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c158550 0x7fe13c151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:34.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe1419ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c159de0 con 0x7fe13c0c96f0 2023-06-23T19:02:34.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe1419ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c15a0c0 con 0x7fe13c069ef0 2023-06-23T19:02:34.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe1419ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c15a3a0 con 0x7fe13c158550 2023-06-23T19:02:34.468 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13a7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe13c0c96f0 0x7fe13c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:34.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13a7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe13c0c96f0 0x7fe13c14ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:51934/0 (socket says 172.21.15.136:51934) 2023-06-23T19:02:34.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13a7fc700 1 -- 172.21.15.136:0/2725816025 learned_addr learned my addr 172.21.15.136:0/2725816025 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:34.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13affd700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe13c069ef0 0x7fe13c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:34.469 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13b7fe700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c158550 0x7fe13c151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:34.470 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13a7fc700 1 -- 172.21.15.136:0/2725816025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c158550 msgr2=0x7fe13c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:34.471 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13a7fc700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c158550 0x7fe13c151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.471 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13a7fc700 1 -- 172.21.15.136:0/2725816025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe13c069ef0 msgr2=0x7fe13c15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:34.471 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13a7fc700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe13c069ef0 0x7fe13c15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:34.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.461+0000 7fe13a7fc700 1 -- 172.21.15.136:0/2725816025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1300094a0 con 0x7fe13c0c96f0 2023-06-23T19:02:34.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.462+0000 7fe13a7fc700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe13c0c96f0 0x7fe13c14ba70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe13000ebe0 tx=0x7fe13000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:34.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.462+0000 7fe123fff700 1 -- 172.21.15.136:0/2725816025 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000c850 con 0x7fe13c0c96f0 2023-06-23T19:02:34.472 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.462+0000 7fe123fff700 1 -- 172.21.15.136:0/2725816025 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13000c9b0 con 0x7fe13c0c96f0 2023-06-23T19:02:34.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.462+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe134009a70 con 0x7fe13c0c96f0 2023-06-23T19:02:34.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.462+0000 7fe123fff700 1 -- 172.21.15.136:0/2725816025 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000cd40 con 0x7fe13c0c96f0 2023-06-23T19:02:34.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.462+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13c15a960 con 0x7fe13c0c96f0 2023-06-23T19:02:34.474 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.463+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13c15ab80 con 0x7fe13c0c96f0 2023-06-23T19:02:34.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.464+0000 7fe123fff700 1 -- 172.21.15.136:0/2725816025 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe130013470 con 0x7fe13c0c96f0 2023-06-23T19:02:34.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.465+0000 7fe123fff700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe12806ace0 0x7fe12806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:34.476 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.465+0000 7fe123fff700 1 -- 172.21.15.136:0/2725816025 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe1300893b0 con 0x7fe13c0c96f0 2023-06-23T19:02:34.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.465+0000 7fe13affd700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe12806ace0 0x7fe12806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:34.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.466+0000 7fe13affd700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe12806ace0 0x7fe12806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe12c007fd0 tx=0x7fe12c007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:34.478 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.469+0000 7fe123fff700 1 -- 172.21.15.136:0/2725816025 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe130054630 con 0x7fe13c0c96f0 2023-06-23T19:02:34.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:34.677+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe13c073910 con 0x7fe13c0c96f0 2023-06-23T19:02:35.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.415+0000 7fe123fff700 1 -- 172.21.15.136:0/2725816025 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe13000cea0 con 0x7fe13c0c96f0 2023-06-23T19:02:35.422 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe12806ace0 msgr2=0x7fe12806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:35.422 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe12806ace0 0x7fe12806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe12c007fd0 tx=0x7fe12c007dc0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.422 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe13c0c96f0 msgr2=0x7fe13c14ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:35.422 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe13c0c96f0 0x7fe13c14ba70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe13000ebe0 tx=0x7fe13000eef0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.424 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 shutdown_connections 2023-06-23T19:02:35.424 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe12806ace0 0x7fe12806d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.424 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe13c069ef0 0x7fe13c15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.424 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe13c158550 0x7fe13c151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.424 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 --2- 172.21.15.136:0/2725816025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe13c0c96f0 0x7fe13c14ba70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 >> 172.21.15.136:0/2725816025 conn(0x7fe13c0b0ef0 msgr2=0x7fe13c0c4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:35.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 shutdown_connections 2023-06-23T19:02:35.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.418+0000 7fe1419ff700 1 -- 172.21.15.136:0/2725816025 wait complete. 2023-06-23T19:02:35.425 INFO:teuthology.orchestra.run.smithi136.stderr: removed all blocklist entries 2023-06-23T19:02:35.443 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.635+0000 7fdaad7ff700 1 Processor -- start 2023-06-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.636+0000 7fdaad7ff700 1 -- start start 2023-06-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fdaad7ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdaa815a0c0 0x7fdaa80cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fdaad7ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdaa80c8ce0 0x7fdaa80ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fdaad7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8069ef0 0x7fdaa806a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fdaad7ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa806a850 con 0x7fdaa80c8ce0 2023-06-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fdaad7ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa80caea0 con 0x7fdaa815a0c0 2023-06-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fdaad7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa815a490 con 0x7fdaa8069ef0 2023-06-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fda9ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdaa80c8ce0 0x7fdaa80ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fda9ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdaa80c8ce0 0x7fdaa80ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58900/0 (socket says 172.21.15.136:58900) 2023-06-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fda9ffff700 1 -- 172.21.15.136:0/3900297039 learned_addr learned my addr 172.21.15.136:0/3900297039 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fdaa6ffd700 1 --2- 172.21.15.136:0/3900297039 >> v2:172.21.15.178:3300/0 conn(0x7fdaa815a0c0 0x7fdaa80cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.637+0000 7fdaa77fe700 1 --2- 172.21.15.136:0/3900297039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8069ef0 0x7fdaa806a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.638+0000 7fda9ffff700 1 -- 172.21.15.136:0/3900297039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8069ef0 msgr2=0x7fdaa806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.638+0000 7fda9ffff700 1 --2- 172.21.15.136:0/3900297039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8069ef0 0x7fdaa806a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.638+0000 7fda9ffff700 1 -- 172.21.15.136:0/3900297039 >> v2:172.21.15.178:3300/0 conn(0x7fdaa815a0c0 msgr2=0x7fdaa80cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.638+0000 7fda9ffff700 1 --2- 172.21.15.136:0/3900297039 >> v2:172.21.15.178:3300/0 conn(0x7fdaa815a0c0 0x7fdaa80cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.638+0000 7fda9ffff700 1 -- 172.21.15.136:0/3900297039 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80ca620 con 0x7fdaa80c8ce0 2023-06-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.638+0000 7fda9ffff700 1 --2- 172.21.15.136:0/3900297039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa80c8ce0 0x7fdaa80ccb70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80671b0 tx=0x7fda90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a61a5ccf8395cd server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.638+0000 7fdaa67fc700 1 -- 172.21.15.136:0/3900297039 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000b870 con 0x7fdaa80c8ce0 2023-06-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.638+0000 7fdaa67fc700 1 -- 172.21.15.136:0/3900297039 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9000b9d0 con 0x7fdaa80c8ce0 2023-06-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.638+0000 7fdaa67fc700 1 -- 172.21.15.136:0/3900297039 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000bd60 con 0x7fdaa80c8ce0 2023-06-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.639+0000 7fdaad7ff700 1 -- 172.21.15.136:0/3900297039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa80c8ce0 msgr2=0x7fdaa80ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.639+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/3900297039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa80c8ce0 0x7fdaa80ccb70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80671b0 tx=0x7fda90009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.639+0000 7fdaad7ff700 1 -- 172.21.15.136:0/3900297039 shutdown_connections 2023-06-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.639+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/3900297039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8069ef0 0x7fdaa806a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.639+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/3900297039 >> v2:172.21.15.178:3300/0 conn(0x7fdaa815a0c0 0x7fdaa80cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.639+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/3900297039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa80c8ce0 0x7fdaa80ccb70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.639+0000 7fdaad7ff700 1 -- 172.21.15.136:0/3900297039 >> 172.21.15.136:0/3900297039 conn(0x7fdaa80b0ef0 msgr2=0x7fdaa80ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.639+0000 7fdaad7ff700 1 -- 172.21.15.136:0/3900297039 shutdown_connections 2023-06-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.639+0000 7fdaad7ff700 1 -- 172.21.15.136:0/3900297039 wait complete. 2023-06-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.641+0000 7fdaad7ff700 1 Processor -- start 2023-06-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.641+0000 7fdaad7ff700 1 -- start start 2023-06-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaad7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa8069ef0 0x7fdaa8151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaad7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaa80c8ce0 0x7fdaa8153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaad7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa815a0c0 0x7fdaa80b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaad7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8154f60 con 0x7fdaa8069ef0 2023-06-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaad7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8154350 con 0x7fdaa80c8ce0 2023-06-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaad7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8154630 con 0x7fdaa815a0c0 2023-06-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaa6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa8069ef0 0x7fdaa8151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaa6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa8069ef0 0x7fdaa8151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58906/0 (socket says 172.21.15.136:58906) 2023-06-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaa6ffd700 1 -- 172.21.15.136:0/1594861395 learned_addr learned my addr 172.21.15.136:0/1594861395 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fda9ffff700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaa80c8ce0 0x7fdaa8153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaa77fe700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa815a0c0 0x7fdaa80b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaa6ffd700 1 -- 172.21.15.136:0/1594861395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa815a0c0 msgr2=0x7fdaa80b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaa6ffd700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa815a0c0 0x7fdaa80b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaa6ffd700 1 -- 172.21.15.136:0/1594861395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaa80c8ce0 msgr2=0x7fdaa8153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaa6ffd700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaa80c8ce0 0x7fdaa8153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.642+0000 7fdaa6ffd700 1 -- 172.21.15.136:0/1594861395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90009550 con 0x7fdaa8069ef0 2023-06-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.643+0000 7fdaa6ffd700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa8069ef0 0x7fdaa8151ad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fda9800d800 tx=0x7fda9800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.643+0000 7fda9f7fe700 1 -- 172.21.15.136:0/1594861395 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda980125f0 con 0x7fdaa8069ef0 2023-06-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.643+0000 7fda9f7fe700 1 -- 172.21.15.136:0/1594861395 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98012750 con 0x7fdaa8069ef0 2023-06-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.643+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa8154910 con 0x7fdaa8069ef0 2023-06-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.643+0000 7fda9f7fe700 1 -- 172.21.15.136:0/1594861395 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98012b00 con 0x7fdaa8069ef0 2023-06-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.643+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa8152010 con 0x7fdaa8069ef0 2023-06-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.644+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa80cd950 con 0x7fdaa8069ef0 2023-06-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.645+0000 7fda9f7fe700 1 -- 172.21.15.136:0/1594861395 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda98012c60 con 0x7fdaa8069ef0 2023-06-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.646+0000 7fda9f7fe700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fda8806ad10 0x7fda8806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.646+0000 7fda9f7fe700 1 -- 172.21.15.136:0/1594861395 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fda980892a0 con 0x7fdaa8069ef0 2023-06-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.646+0000 7fda9ffff700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fda8806ad10 0x7fda8806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.647+0000 7fda9ffff700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fda8806ad10 0x7fda8806d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda90000c00 tx=0x7fda90008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.650+0000 7fda9f7fe700 1 -- 172.21.15.136:0/1594861395 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda980544d0 con 0x7fdaa8069ef0 2023-06-23T19:02:35.924 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.921+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdaa8073910 con 0x7fdaa8069ef0 2023-06-23T19:02:35.925 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.921+0000 7fda9f7fe700 1 -- 172.21.15.136:0/1594861395 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fda98057af0 con 0x7fdaa8069ef0 2023-06-23T19:02:35.925 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:35.925 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2023-06-23T19:02:35.925 INFO:teuthology.orchestra.run.smithi136.stdout: "auth_dump": [ 2023-06-23T19:02:35.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.926 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mds.a", 2023-06-23T19:02:35.926 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCv65VkgJtBLxAALLUShhq5TOzfscbJVliFsg==", 2023-06-23T19:02:35.926 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.926 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2023-06-23T19:02:35.926 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2023-06-23T19:02:35.927 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2023-06-23T19:02:35.927 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.927 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.927 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.927 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mds.b", 2023-06-23T19:02:35.927 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCw65Vk7rkbDBAAOxmBal0flpFTShDcGxvtCA==", 2023-06-23T19:02:35.927 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.928 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2023-06-23T19:02:35.928 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2023-06-23T19:02:35.928 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2023-06-23T19:02:35.928 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.928 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.928 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mds.c", 2023-06-23T19:02:35.929 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCv65VkKAD6OhAA1g0UICoC3n8Hezg8NO7rrA==", 2023-06-23T19:02:35.929 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.929 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2023-06-23T19:02:35.929 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2023-06-23T19:02:35.929 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2023-06-23T19:02:35.929 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.929 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.930 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mds.d", 2023-06-23T19:02:35.930 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCw65Vk84sJGBAAqvFCgbT0gp9aWInFiJMogQ==", 2023-06-23T19:02:35.930 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.930 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2023-06-23T19:02:35.930 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2023-06-23T19:02:35.930 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2023-06-23T19:02:35.931 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.931 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.931 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.0", 2023-06-23T19:02:35.931 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQC065VkOY/nIhAAXBGComnktye+OUXf0sF+JQ==", 2023-06-23T19:02:35.931 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.931 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2023-06-23T19:02:35.932 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2023-06-23T19:02:35.932 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.932 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.932 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.932 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.1", 2023-06-23T19:02:35.932 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQC365Vk9DfZKhAA8UrZCfkwS2oaFK1qm9olrA==", 2023-06-23T19:02:35.932 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.933 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2023-06-23T19:02:35.933 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2023-06-23T19:02:35.933 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.933 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.933 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.2", 2023-06-23T19:02:35.933 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQC665VkNpjjMBAASmfj3XoAjA+FsQnFCDlbdA==", 2023-06-23T19:02:35.934 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.934 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2023-06-23T19:02:35.934 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2023-06-23T19:02:35.934 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.934 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.934 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.3", 2023-06-23T19:02:35.935 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQC965VkWYVcNxAAdykzMBeKfR0eZg4r0+ugrQ==", 2023-06-23T19:02:35.935 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.935 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2023-06-23T19:02:35.935 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2023-06-23T19:02:35.935 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.935 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.936 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.4", 2023-06-23T19:02:35.936 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDC65Vk6MJ2HRAAyIkE0Ed+8VBSjykKcB8xiw==", 2023-06-23T19:02:35.936 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.936 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2023-06-23T19:02:35.936 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2023-06-23T19:02:35.936 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.936 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.937 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.5", 2023-06-23T19:02:35.937 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDF65Vk4BXkJBAA6sarDd9WmApQCzhv3mmonQ==", 2023-06-23T19:02:35.937 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.937 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2023-06-23T19:02:35.937 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2023-06-23T19:02:35.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.938 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.938 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.6", 2023-06-23T19:02:35.938 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDI65Vk2x7IKxAAbL/KPWXJeLHbkOhA94XxDA==", 2023-06-23T19:02:35.938 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.938 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2023-06-23T19:02:35.938 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2023-06-23T19:02:35.939 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.939 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.939 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.7", 2023-06-23T19:02:35.939 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDL65VkX6FMMxAAbQmUjIN/ktBQT1YPfAWG0Q==", 2023-06-23T19:02:35.939 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.939 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2023-06-23T19:02:35.940 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2023-06-23T19:02:35.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.940 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.940 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.940 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.940 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.0", 2023-06-23T19:02:35.940 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCw65Vk9m0xIhAArVabtYN8Q1ol3rPOb8C1Fw==", 2023-06-23T19:02:35.940 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.941 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2023-06-23T19:02:35.941 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow r", 2023-06-23T19:02:35.941 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow rw", 2023-06-23T19:02:35.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow rwx" 2023-06-23T19:02:35.941 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.941 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.941 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.1", 2023-06-23T19:02:35.942 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCw65VkCphAMhAABxj47jbcdUFZDa8FQkF/Fg==", 2023-06-23T19:02:35.942 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.942 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2023-06-23T19:02:35.942 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow r", 2023-06-23T19:02:35.942 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow rw", 2023-06-23T19:02:35.942 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow rwx" 2023-06-23T19:02:35.942 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.942 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.943 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.943 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.2", 2023-06-23T19:02:35.943 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCw65Vk/wk5KhAA6Q4fWvV7QaMxKpxpxMfhAQ==", 2023-06-23T19:02:35.943 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.943 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2023-06-23T19:02:35.943 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow r", 2023-06-23T19:02:35.943 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow rw", 2023-06-23T19:02:35.943 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow rwx" 2023-06-23T19:02:35.944 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.944 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.944 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.3", 2023-06-23T19:02:35.944 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCw65VksTP/ORAA5MY1d29ddc25bYVCCphpjg==", 2023-06-23T19:02:35.944 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.944 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2023-06-23T19:02:35.945 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow r", 2023-06-23T19:02:35.945 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow rw", 2023-06-23T19:02:35.945 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow rwx" 2023-06-23T19:02:35.945 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.945 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.945 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.admin", 2023-06-23T19:02:35.945 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg==", 2023-06-23T19:02:35.946 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.946 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow *", 2023-06-23T19:02:35.946 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2023-06-23T19:02:35.946 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2023-06-23T19:02:35.946 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.946 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.946 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.947 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-mds", 2023-06-23T19:02:35.947 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDU65VkDjrIAxAAHP92f2/s9UZ22cwvQ7SdFg==", 2023-06-23T19:02:35.947 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.947 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-mds" 2023-06-23T19:02:35.947 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.947 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.947 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-mgr", 2023-06-23T19:02:35.948 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDU65Vk1krIAxAAOo3JlwS2so2+yh59RAnFEw==", 2023-06-23T19:02:35.948 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.948 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-23T19:02:35.948 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.948 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.948 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-osd", 2023-06-23T19:02:35.948 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDU65Vk4lPIAxAAQ5ZstX4hZ+PRbgj327OI4A==", 2023-06-23T19:02:35.949 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.949 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-osd" 2023-06-23T19:02:35.949 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.949 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.949 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.949 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-rbd", 2023-06-23T19:02:35.949 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDU65VkGlzIAxAAjZpA6Jwfb5H79oXlW1nBwA==", 2023-06-23T19:02:35.950 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.950 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-23T19:02:35.950 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.950 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.950 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.950 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-23T19:02:35.950 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDU65VkumTIAxAAZkq2UK8FevsX63eAbGbKYw==", 2023-06-23T19:02:35.950 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.951 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-23T19:02:35.951 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.951 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.951 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.951 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-rgw", 2023-06-23T19:02:35.951 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQDU65VkmW3IAxAAk+bHS5QP+brv5mnkX1ULRg==", 2023-06-23T19:02:35.951 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.951 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-23T19:02:35.952 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.952 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.952 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.952 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mgr.x", 2023-06-23T19:02:35.952 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCv65VkCZhkJxAAQAC8svONiU5OTkNrXm2I9A==", 2023-06-23T19:02:35.952 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.952 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow *", 2023-06-23T19:02:35.952 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile mgr", 2023-06-23T19:02:35.953 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.953 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.953 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:35.953 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:35.953 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mgr.y", 2023-06-23T19:02:35.953 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCv65VkUyZ7HhAAy50RyRlXSg8RXcPahtv0VA==", 2023-06-23T19:02:35.953 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2023-06-23T19:02:35.953 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow *", 2023-06-23T19:02:35.954 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile mgr", 2023-06-23T19:02:35.954 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2023-06-23T19:02:35.954 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.954 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:35.954 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2023-06-23T19:02:35.954 INFO:teuthology.orchestra.run.smithi136.stdout:} 2023-06-23T19:02:35.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.923+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fda8806ad10 msgr2=0x7fda8806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.923+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fda8806ad10 0x7fda8806d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda90000c00 tx=0x7fda90008030 comp rx=0 tx=0).stop 2023-06-23T19:02:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.923+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa8069ef0 msgr2=0x7fdaa8151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.923+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa8069ef0 0x7fdaa8151ad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fda9800d800 tx=0x7fda9800db10 comp rx=0 tx=0).stop 2023-06-23T19:02:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.924+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 shutdown_connections 2023-06-23T19:02:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.924+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fda8806ad10 0x7fda8806d1c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.924+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa815a0c0 0x7fdaa80b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.924+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdaa8069ef0 0x7fdaa8151ad0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.924+0000 7fdaad7ff700 1 --2- 172.21.15.136:0/1594861395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaa80c8ce0 0x7fdaa8153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.924+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 >> 172.21.15.136:0/1594861395 conn(0x7fdaa80b0ef0 msgr2=0x7fdaa81586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.924+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 shutdown_connections 2023-06-23T19:02:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:35.924+0000 7fdaad7ff700 1 -- 172.21.15.136:0/1594861395 wait complete. 2023-06-23T19:02:35.957 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-23T19:02:36.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.148+0000 7f7f739ff700 1 Processor -- start 2023-06-23T19:02:36.152 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.148+0000 7f7f739ff700 1 -- start start 2023-06-23T19:02:36.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.149+0000 7f7f739ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7f6c06ccc0 0x7f7f6c15fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.153 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.149+0000 7f7f739ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7f6c160340 0x7f7f6c0d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.149+0000 7f7f739ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c0afdb0 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.149+0000 7f7f739ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c0ceb90 con 0x7f7f6c160340 2023-06-23T19:02:36.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.149+0000 7f7f739ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c15c6b0 con 0x7f7f6c06ccc0 2023-06-23T19:02:36.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.149+0000 7f7f71f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7f6c160340 0x7f7f6c0d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.149+0000 7f7f71f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7f6c160340 0x7f7f6c0d0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58918/0 (socket says 172.21.15.136:58918) 2023-06-23T19:02:36.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.149+0000 7f7f71f9c700 1 -- 172.21.15.136:0/248589842 learned_addr learned my addr 172.21.15.136:0/248589842 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:36.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.149+0000 7f7f70f9a700 1 --2- 172.21.15.136:0/248589842 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c06ccc0 0x7f7f6c15fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.150+0000 7f7f71f9c700 1 -- 172.21.15.136:0/248589842 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c06ccc0 msgr2=0x7f7f6c15fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:36.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.150+0000 7f7f71f9c700 1 --2- 172.21.15.136:0/248589842 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c06ccc0 0x7f7f6c15fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.150+0000 7f7f71f9c700 1 -- 172.21.15.136:0/248589842 >> v1:172.21.15.178:6789/0 conn(0x7f7f6c15c2e0 legacy=0x7f7f6c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.150+0000 7f7f71f9c700 1 -- 172.21.15.136:0/248589842 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0b0000 con 0x7f7f6c160340 2023-06-23T19:02:36.155 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.150+0000 7f7f70f9a700 1 --2- 172.21.15.136:0/248589842 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c06ccc0 0x7f7f6c15fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:36.156 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.150+0000 7f7f71f9c700 1 --2- 172.21.15.136:0/248589842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c160340 0x7f7f6c0d0840 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c071f90 tx=0x7f7f6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46249c5f02d720c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:36.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.151+0000 7f7f63fff700 1 -- 172.21.15.136:0/248589842 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400e070 con 0x7f7f6c160340 2023-06-23T19:02:36.157 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.151+0000 7f7f63fff700 1 -- 172.21.15.136:0/248589842 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6400b9c0 con 0x7f7f6c160340 2023-06-23T19:02:36.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.151+0000 7f7f63fff700 1 -- 172.21.15.136:0/248589842 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400bd70 con 0x7f7f6c160340 2023-06-23T19:02:36.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.152+0000 7f7f739ff700 1 -- 172.21.15.136:0/248589842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c160340 msgr2=0x7f7f6c0d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.152+0000 7f7f739ff700 1 --2- 172.21.15.136:0/248589842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c160340 0x7f7f6c0d0840 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c071f90 tx=0x7f7f6400b330 comp rx=0 tx=0).stop 2023-06-23T19:02:36.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.152+0000 7f7f739ff700 1 -- 172.21.15.136:0/248589842 shutdown_connections 2023-06-23T19:02:36.158 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.152+0000 7f7f739ff700 1 --2- 172.21.15.136:0/248589842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c160340 0x7f7f6c0d0840 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.152+0000 7f7f739ff700 1 --2- 172.21.15.136:0/248589842 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c06ccc0 0x7f7f6c15fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.159 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.152+0000 7f7f739ff700 1 -- 172.21.15.136:0/248589842 >> 172.21.15.136:0/248589842 conn(0x7f7f6c06e530 msgr2=0x7f7f6c06e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:36.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.152+0000 7f7f739ff700 1 -- 172.21.15.136:0/248589842 shutdown_connections 2023-06-23T19:02:36.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.152+0000 7f7f739ff700 1 -- 172.21.15.136:0/248589842 wait complete. 2023-06-23T19:02:36.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.153+0000 7f7f739ff700 1 Processor -- start 2023-06-23T19:02:36.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.154+0000 7f7f739ff700 1 -- start start 2023-06-23T19:02:36.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.154+0000 7f7f739ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c06ccc0 0x7f7f6c14bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.154+0000 7f7f739ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c15c2e0 0x7f7f6c156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.154+0000 7f7f739ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c160340 0x7f7f6c0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.154+0000 7f7f739ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c14c220 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.162 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.154+0000 7f7f739ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c157430 con 0x7f7f6c160340 2023-06-23T19:02:36.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.154+0000 7f7f739ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c7770 con 0x7f7f6c06ccc0 2023-06-23T19:02:36.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f70f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c15c2e0 0x7f7f6c156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f70f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c15c2e0 0x7f7f6c156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58930/0 (socket says 172.21.15.136:58930) 2023-06-23T19:02:36.163 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f70f9a700 1 -- 172.21.15.136:0/1518767973 learned_addr learned my addr 172.21.15.136:0/1518767973 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:36.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f71f9c700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c160340 0x7f7f6c0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f7179b700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c06ccc0 0x7f7f6c14bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f70f9a700 1 -- 172.21.15.136:0/1518767973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c06ccc0 msgr2=0x7f7f6c14bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.164 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f70f9a700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c06ccc0 0x7f7f6c14bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f70f9a700 1 -- 172.21.15.136:0/1518767973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c160340 msgr2=0x7f7f6c0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f70f9a700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c160340 0x7f7f6c0b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f70f9a700 1 -- 172.21.15.136:0/1518767973 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64009b30 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f70f9a700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c15c2e0 0x7f7f6c156ef0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00e810 tx=0x7f7f5c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.155+0000 7f7f61ffb700 1 -- 172.21.15.136:0/1518767973 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c013610 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.156+0000 7f7f61ffb700 1 -- 172.21.15.136:0/1518767973 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c013770 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.156+0000 7f7f61ffb700 1 -- 172.21.15.136:0/1518767973 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c013b20 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.156+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c157f90 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.156+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c158230 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.157+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c06eae0 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.157+0000 7f7f61ffb700 1 -- 172.21.15.136:0/1518767973 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f5c013c80 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.158+0000 7f7f61ffb700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7f5006ace0 0x7f7f5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.158+0000 7f7f61ffb700 1 -- 172.21.15.136:0/1518767973 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7f5c088f50 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.159+0000 7f7f7179b700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7f5006ace0 0x7f7f5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.159+0000 7f7f7179b700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7f5006ace0 0x7f7f5006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000f60 tx=0x7f7f68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.163+0000 7f7f61ffb700 1 -- 172.21.15.136:0/1518767973 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7f5c057c90 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.433+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7f6c073910 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.439+0000 7f7f61ffb700 1 -- 172.21.15.136:0/1518767973 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7f5c0210a0 con 0x7f7f6c15c2e0 2023-06-23T19:02:36.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.441+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7f5006ace0 msgr2=0x7f7f5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.441+0000 7f7f739ff700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7f5006ace0 0x7f7f5006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000f60 tx=0x7f7f68009040 comp rx=0 tx=0).stop 2023-06-23T19:02:36.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.441+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c15c2e0 msgr2=0x7f7f6c156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.441+0000 7f7f739ff700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c15c2e0 0x7f7f6c156ef0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00e810 tx=0x7f7f5c00ebd0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.442+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 shutdown_connections 2023-06-23T19:02:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.442+0000 7f7f739ff700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7f5006ace0 0x7f7f5006d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.442+0000 7f7f739ff700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c160340 0x7f7f6c0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.442+0000 7f7f739ff700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c06ccc0 0x7f7f6c14bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.442+0000 7f7f739ff700 1 --2- 172.21.15.136:0/1518767973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f6c15c2e0 0x7f7f6c156ef0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.442+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 >> 172.21.15.136:0/1518767973 conn(0x7f7f6c06e530 msgr2=0x7f7f6c15f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.442+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 shutdown_connections 2023-06-23T19:02:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.442+0000 7f7f739ff700 1 -- 172.21.15.136:0/1518767973 wait complete. 2023-06-23T19:02:36.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-23T19:02:36.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.653+0000 7f86b4fff700 1 Processor -- start 2023-06-23T19:02:36.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.654+0000 7f86b4fff700 1 -- start start 2023-06-23T19:02:36.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.655+0000 7f86b4fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f86b015c380 0x7f86b00b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.655+0000 7f86b4fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b00ced80 con 0x7f86b00cf8c0 2023-06-23T19:02:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.655+0000 7f86b4fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b00d1760 con 0x7f86b00b4cf0 2023-06-23T19:02:36.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.655+0000 7f86b4fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b00d1480 con 0x7f86b015c380 2023-06-23T19:02:36.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.655+0000 7f86ae59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f86b015c380 0x7f86b00b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.655+0000 7f86aed9d700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f86b00cf8c0 0x7f86b015fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37386/0 (socket says 172.21.15.136:37386) 2023-06-23T19:02:36.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.655+0000 7f86aed9d700 1 -- 172.21.15.136:0/1509863998 learned_addr learned my addr 172.21.15.136:0/1509863998 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:36.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.656+0000 7f86ae59c700 1 -- 172.21.15.136:0/1509863998 >> v1:172.21.15.178:6789/0 conn(0x7f86b00b4cf0 legacy=0x7f86b00cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.656+0000 7f86ae59c700 1 -- 172.21.15.136:0/1509863998 >> v1:172.21.15.136:6789/0 conn(0x7f86b00cf8c0 legacy=0x7f86b015fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.656+0000 7f86ae59c700 1 -- 172.21.15.136:0/1509863998 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00cd2b0 con 0x7f86b015c380 2023-06-23T19:02:36.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.656+0000 7f86add9b700 1 -- 172.21.15.136:0/1509863998 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546049119 0 0) 0x7f86b00ced80 con 0x7f86b00cf8c0 2023-06-23T19:02:36.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.656+0000 7f86ae59c700 1 --2- 172.21.15.136:0/1509863998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 0x7f86b00b5980 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009840 tx=0x7f86a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3231eaca0dbd7e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:36.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.656+0000 7f86add9b700 1 -- 172.21.15.136:0/1509863998 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0011830 con 0x7f86b015c380 2023-06-23T19:02:36.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.656+0000 7f86add9b700 1 -- 172.21.15.136:0/1509863998 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a0011990 con 0x7f86b015c380 2023-06-23T19:02:36.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.656+0000 7f86add9b700 1 -- 172.21.15.136:0/1509863998 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0011d20 con 0x7f86b015c380 2023-06-23T19:02:36.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.657+0000 7f86b4fff700 1 -- 172.21.15.136:0/1509863998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 msgr2=0x7f86b00b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.657+0000 7f86b4fff700 1 --2- 172.21.15.136:0/1509863998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 0x7f86b00b5980 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009840 tx=0x7f86a0009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:36.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.657+0000 7f86b4fff700 1 -- 172.21.15.136:0/1509863998 shutdown_connections 2023-06-23T19:02:36.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.657+0000 7f86b4fff700 1 --2- 172.21.15.136:0/1509863998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 0x7f86b00b5980 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.657+0000 7f86b4fff700 1 -- 172.21.15.136:0/1509863998 >> 172.21.15.136:0/1509863998 conn(0x7f86b0071620 msgr2=0x7f86b00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:36.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.657+0000 7f86b4fff700 1 -- 172.21.15.136:0/1509863998 shutdown_connections 2023-06-23T19:02:36.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.657+0000 7f86b4fff700 1 -- 172.21.15.136:0/1509863998 wait complete. 2023-06-23T19:02:36.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.658+0000 7f86b4fff700 1 Processor -- start 2023-06-23T19:02:36.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.658+0000 7f86b4fff700 1 -- start start 2023-06-23T19:02:36.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.659+0000 7f86b4fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b00b4cf0 0x7f86b00c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.659+0000 7f86b4fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b00cf8c0 0x7f86b0146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.659+0000 7f86b4fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 0x7f86b01e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.659+0000 7f86b4fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00ca260 con 0x7f86b015c380 2023-06-23T19:02:36.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.659+0000 7f86b4fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b0146d50 con 0x7f86b00cf8c0 2023-06-23T19:02:36.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.659+0000 7f86b4fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00cc570 con 0x7f86b00b4cf0 2023-06-23T19:02:36.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86aed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 0x7f86b01e7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86aed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 0x7f86b01e7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58954/0 (socket says 172.21.15.136:58954) 2023-06-23T19:02:36.666 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86aed9d700 1 -- 172.21.15.136:0/265037683 learned_addr learned my addr 172.21.15.136:0/265037683 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:36.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86ae59c700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b00b4cf0 0x7f86b00c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86a7fff700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b00cf8c0 0x7f86b0146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86aed9d700 1 -- 172.21.15.136:0/265037683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b00b4cf0 msgr2=0x7f86b00c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86aed9d700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b00b4cf0 0x7f86b00c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.667 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86aed9d700 1 -- 172.21.15.136:0/265037683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b00cf8c0 msgr2=0x7f86b0146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86aed9d700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b00cf8c0 0x7f86b0146810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86aed9d700 1 -- 172.21.15.136:0/265037683 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00094a0 con 0x7f86b015c380 2023-06-23T19:02:36.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86ae59c700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b00b4cf0 0x7f86b00c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:36.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86aed9d700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 0x7f86b01e7ca0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f86a8002230 tx=0x7f86a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:36.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86a6ffd700 1 -- 172.21.15.136:0/265037683 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a800ac20 con 0x7f86b015c380 2023-06-23T19:02:36.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.660+0000 7f86a6ffd700 1 -- 172.21.15.136:0/265037683 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a800ada0 con 0x7f86b015c380 2023-06-23T19:02:36.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.661+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b015df80 con 0x7f86b015c380 2023-06-23T19:02:36.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.661+0000 7f86a6ffd700 1 -- 172.21.15.136:0/265037683 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8007310 con 0x7f86b015c380 2023-06-23T19:02:36.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.661+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b00ccaf0 con 0x7f86b015c380 2023-06-23T19:02:36.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.662+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b0073910 con 0x7f86b015c380 2023-06-23T19:02:36.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.663+0000 7f86a6ffd700 1 -- 172.21.15.136:0/265037683 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86a8007470 con 0x7f86b015c380 2023-06-23T19:02:36.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.664+0000 7f86a6ffd700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f869006ace0 0x7f869006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:36.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.664+0000 7f86a6ffd700 1 -- 172.21.15.136:0/265037683 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f86a8089100 con 0x7f86b015c380 2023-06-23T19:02:36.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.664+0000 7f86ae59c700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f869006ace0 0x7f869006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:36.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.664+0000 7f86ae59c700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f869006ace0 0x7f869006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f86b0143c40 tx=0x7f86a001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:36.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.668+0000 7f86a6ffd700 1 -- 172.21.15.136:0/265037683 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86a8054450 con 0x7f86b015c380 2023-06-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.942+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f86b015e110 con 0x7f86b015c380 2023-06-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.948+0000 7f86a6ffd700 1 -- 172.21.15.136:0/265037683 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f86a8057a70 con 0x7f86b015c380 2023-06-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f869006ace0 msgr2=0x7f869006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f869006ace0 0x7f869006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f86b0143c40 tx=0x7f86a001c040 comp rx=0 tx=0).stop 2023-06-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 msgr2=0x7f86b01e7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 0x7f86b01e7ca0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f86a8002230 tx=0x7f86a800a060 comp rx=0 tx=0).stop 2023-06-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 shutdown_connections 2023-06-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f869006ace0 0x7f869006d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86b015c380 0x7f86b01e7ca0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b00b4cf0 0x7f86b00c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 --2- 172.21.15.136:0/265037683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b00cf8c0 0x7f86b0146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:36.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 >> 172.21.15.136:0/265037683 conn(0x7f86b0071620 msgr2=0x7f86b00b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:36.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.950+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 shutdown_connections 2023-06-23T19:02:36.956 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:36.951+0000 7f86b4fff700 1 -- 172.21.15.136:0/265037683 wait complete. 2023-06-23T19:02:36.972 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-23T19:02:37.166 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.163+0000 7fcdfaf9d700 1 Processor -- start 2023-06-23T19:02:37.167 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.163+0000 7fcdfaf9d700 1 -- start start 2023-06-23T19:02:37.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.164+0000 7fcdfaf9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcdf41458c0 0x7fcdf406bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.164+0000 7fcdfaf9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40af5c0 0x7fcdf40afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.164+0000 7fcdfaf9d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf4146110 con 0x7fcdf40d0500 2023-06-23T19:02:37.168 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.164+0000 7fcdfaf9d700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf406ce00 con 0x7fcdf41458c0 2023-06-23T19:02:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.164+0000 7fcdfaf9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf415c9b0 con 0x7fcdf40af5c0 2023-06-23T19:02:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.164+0000 7fcdf979a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcdf41458c0 0x7fcdf406bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf979a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcdf41458c0 0x7fcdf406bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58966/0 (socket says 172.21.15.136:58966) 2023-06-23T19:02:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf979a700 1 -- 172.21.15.136:0/3050287501 learned_addr learned my addr 172.21.15.136:0/3050287501 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf9f9b700 1 --1- 172.21.15.136:0/3050287501 >> v1:172.21.15.178:6789/0 conn(0x7fcdf40d0500 0x7fcdf40d08d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:48380/0 (socket says 172.21.15.136:48380) 2023-06-23T19:02:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdfa79c700 1 --2- 172.21.15.136:0/3050287501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40af5c0 0x7fcdf40afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf979a700 1 -- 172.21.15.136:0/3050287501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40af5c0 msgr2=0x7fcdf40afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:37.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf979a700 1 --2- 172.21.15.136:0/3050287501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40af5c0 0x7fcdf40afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf979a700 1 -- 172.21.15.136:0/3050287501 >> v1:172.21.15.178:6789/0 conn(0x7fcdf40d0500 legacy=0x7fcdf40d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.171 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf979a700 1 -- 172.21.15.136:0/3050287501 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf406c1f0 con 0x7fcdf41458c0 2023-06-23T19:02:37.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf8f99700 1 -- 172.21.15.136:0/3050287501 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453173990 0 0) 0x7fcdf4146110 con 0x7fcdf40d0500 2023-06-23T19:02:37.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf979a700 1 --2- 172.21.15.136:0/3050287501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf41458c0 0x7fcdf406bb60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcde40098f0 tx=0x7fcde4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f87e60ce802f1d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:37.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf8f99700 1 -- 172.21.15.136:0/3050287501 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4011830 con 0x7fcdf41458c0 2023-06-23T19:02:37.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf8f99700 1 -- 172.21.15.136:0/3050287501 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde4011990 con 0x7fcdf41458c0 2023-06-23T19:02:37.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.165+0000 7fcdf8f99700 1 -- 172.21.15.136:0/3050287501 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4011d20 con 0x7fcdf41458c0 2023-06-23T19:02:37.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.166+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3050287501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf41458c0 msgr2=0x7fcdf406bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.172 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.166+0000 7fcdfaf9d700 1 --2- 172.21.15.136:0/3050287501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf41458c0 0x7fcdf406bb60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcde40098f0 tx=0x7fcde4009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:37.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.166+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3050287501 shutdown_connections 2023-06-23T19:02:37.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.166+0000 7fcdfaf9d700 1 --2- 172.21.15.136:0/3050287501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf40af5c0 0x7fcdf40afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.166+0000 7fcdfaf9d700 1 --2- 172.21.15.136:0/3050287501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf41458c0 0x7fcdf406bb60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.166+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3050287501 >> 172.21.15.136:0/3050287501 conn(0x7fcdf4071f40 msgr2=0x7fcdf409bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:37.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.166+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3050287501 shutdown_connections 2023-06-23T19:02:37.173 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.166+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3050287501 wait complete. 2023-06-23T19:02:37.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.168+0000 7fcdfaf9d700 1 Processor -- start 2023-06-23T19:02:37.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.169+0000 7fcdfaf9d700 1 -- start start 2023-06-23T19:02:37.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdfaf9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf40af5c0 0x7fcdf41466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.175 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdfaf9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf40d0500 0x7fcdf4146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdfaf9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf41458c0 0x7fcdf4149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdfaf9d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4147140 con 0x7fcdf40af5c0 2023-06-23T19:02:37.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdfaf9d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4147410 con 0x7fcdf40d0500 2023-06-23T19:02:37.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdfaf9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf415dbd0 con 0x7fcdf41458c0 2023-06-23T19:02:37.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdf9f9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf40af5c0 0x7fcdf41466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.176 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdf9f9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf40af5c0 0x7fcdf41466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58970/0 (socket says 172.21.15.136:58970) 2023-06-23T19:02:37.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdf9f9b700 1 -- 172.21.15.136:0/3535848802 learned_addr learned my addr 172.21.15.136:0/3535848802 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:37.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdf979a700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf40d0500 0x7fcdf4146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.177 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdfa79c700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf41458c0 0x7fcdf4149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdf9f9b700 1 -- 172.21.15.136:0/3535848802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf41458c0 msgr2=0x7fcdf4149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdf9f9b700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf41458c0 0x7fcdf4149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.178 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdf9f9b700 1 -- 172.21.15.136:0/3535848802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf40d0500 msgr2=0x7fcdf4146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdf9f9b700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf40d0500 0x7fcdf4146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.170+0000 7fcdf9f9b700 1 -- 172.21.15.136:0/3535848802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde4009550 con 0x7fcdf40af5c0 2023-06-23T19:02:37.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.171+0000 7fcdf979a700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf40d0500 0x7fcdf4146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:37.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.171+0000 7fcdf9f9b700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf40af5c0 0x7fcdf41466c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000c550 tx=0x7fcdf000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:37.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.171+0000 7fcdea7fc700 1 -- 172.21.15.136:0/3535848802 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0004c80 con 0x7fcdf40af5c0 2023-06-23T19:02:37.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.171+0000 7fcdea7fc700 1 -- 172.21.15.136:0/3535848802 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf0004e00 con 0x7fcdf40af5c0 2023-06-23T19:02:37.179 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.171+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf415deb0 con 0x7fcdf40af5c0 2023-06-23T19:02:37.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.171+0000 7fcdea7fc700 1 -- 172.21.15.136:0/3535848802 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0007310 con 0x7fcdf40af5c0 2023-06-23T19:02:37.180 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.171+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf415e470 con 0x7fcdf40af5c0 2023-06-23T19:02:37.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.172+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf415e660 con 0x7fcdf40af5c0 2023-06-23T19:02:37.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.173+0000 7fcdea7fc700 1 -- 172.21.15.136:0/3535848802 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcdf0007470 con 0x7fcdf40af5c0 2023-06-23T19:02:37.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.174+0000 7fcdea7fc700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd806ace0 0x7fcdd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.181 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.174+0000 7fcdea7fc700 1 -- 172.21.15.136:0/3535848802 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcdf0088f80 con 0x7fcdf40af5c0 2023-06-23T19:02:37.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.174+0000 7fcdf979a700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd806ace0 0x7fcdd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.175+0000 7fcdf979a700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd806ace0 0x7fcdd806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcde4000c00 tx=0x7fcde4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:37.182 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.178+0000 7fcdea7fc700 1 -- 172.21.15.136:0/3535848802 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcdf00bb310 con 0x7fcdf40af5c0 2023-06-23T19:02:37.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.450+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fcdf404ea20 con 0x7fcdf40af5c0 2023-06-23T19:02:37.458 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.455+0000 7fcdea7fc700 1 -- 172.21.15.136:0/3535848802 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcdf0054240 con 0x7fcdf40af5c0 2023-06-23T19:02:37.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.457+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd806ace0 msgr2=0x7fcdd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.457+0000 7fcdfaf9d700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd806ace0 0x7fcdd806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcde4000c00 tx=0x7fcde4008030 comp rx=0 tx=0).stop 2023-06-23T19:02:37.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.457+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf40af5c0 msgr2=0x7fcdf41466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.457+0000 7fcdfaf9d700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf40af5c0 0x7fcdf41466c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000c550 tx=0x7fcdf000c910 comp rx=0 tx=0).stop 2023-06-23T19:02:37.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.458+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 shutdown_connections 2023-06-23T19:02:37.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.458+0000 7fcdfaf9d700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcdd806ace0 0x7fcdd806d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.458+0000 7fcdfaf9d700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdf41458c0 0x7fcdf4149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.458+0000 7fcdfaf9d700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdf40af5c0 0x7fcdf41466c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.458+0000 7fcdfaf9d700 1 --2- 172.21.15.136:0/3535848802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdf40d0500 0x7fcdf4146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.458+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 >> 172.21.15.136:0/3535848802 conn(0x7fcdf4071f40 msgr2=0x7fcdf40b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:37.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.458+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 shutdown_connections 2023-06-23T19:02:37.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.458+0000 7fcdfaf9d700 1 -- 172.21.15.136:0/3535848802 wait complete. 2023-06-23T19:02:37.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-23T19:02:37.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.671+0000 7f15c33ff700 1 Processor -- start 2023-06-23T19:02:37.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.672+0000 7f15c33ff700 1 -- start start 2023-06-23T19:02:37.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.673+0000 7f15c33ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f15bc15c570 0x7f15bc0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.673+0000 7f15c33ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15bc160a50 0x7f15bc0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.673+0000 7f15c33ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc1610a0 con 0x7f15bc0cd660 2023-06-23T19:02:37.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.673+0000 7f15c33ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15bc15d670 con 0x7f15bc15c570 2023-06-23T19:02:37.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.673+0000 7f15c33ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc160eb0 con 0x7f15bc160a50 2023-06-23T19:02:37.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.673+0000 7f15c099a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f15bc0cd660 0x7f15bc160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37402/0 (socket says 172.21.15.136:37402) 2023-06-23T19:02:37.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.673+0000 7f15c119b700 1 --2- 172.21.15.136:0/153238351 >> v2:172.21.15.136:3300/0 conn(0x7f15bc15c570 0x7f15bc0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.673+0000 7f15c099a700 1 -- 172.21.15.136:0/153238351 learned_addr learned my addr 172.21.15.136:0/153238351 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:37.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.673+0000 7f15c199c700 1 --2- 172.21.15.136:0/153238351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15bc160a50 0x7f15bc0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.674+0000 7f15b3fff700 1 -- 172.21.15.136:0/153238351 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457097840 0 0) 0x7f15bc1610a0 con 0x7f15bc0cd660 2023-06-23T19:02:37.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.674+0000 7f15c119b700 1 -- 172.21.15.136:0/153238351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15bc160a50 msgr2=0x7f15bc0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:37.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.674+0000 7f15c119b700 1 --2- 172.21.15.136:0/153238351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15bc160a50 0x7f15bc0d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.674+0000 7f15c119b700 1 -- 172.21.15.136:0/153238351 >> v1:172.21.15.136:6789/0 conn(0x7f15bc0cd660 legacy=0x7f15bc160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.674+0000 7f15c119b700 1 -- 172.21.15.136:0/153238351 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc15da90 con 0x7f15bc15c570 2023-06-23T19:02:37.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.674+0000 7f15c119b700 1 --2- 172.21.15.136:0/153238351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 0x7f15bc0cd120 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009870 tx=0x7f15b8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a059b0d9bf6f1d0a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:37.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.674+0000 7f15b3fff700 1 -- 172.21.15.136:0/153238351 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8011830 con 0x7f15bc15c570 2023-06-23T19:02:37.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.674+0000 7f15b3fff700 1 -- 172.21.15.136:0/153238351 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b8011990 con 0x7f15bc15c570 2023-06-23T19:02:37.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.674+0000 7f15b3fff700 1 -- 172.21.15.136:0/153238351 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8011d20 con 0x7f15bc15c570 2023-06-23T19:02:37.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.675+0000 7f15c33ff700 1 -- 172.21.15.136:0/153238351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 msgr2=0x7f15bc0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.675+0000 7f15c33ff700 1 --2- 172.21.15.136:0/153238351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 0x7f15bc0cd120 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009870 tx=0x7f15b8009b80 comp rx=0 tx=0).stop 2023-06-23T19:02:37.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.675+0000 7f15c33ff700 1 -- 172.21.15.136:0/153238351 shutdown_connections 2023-06-23T19:02:37.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.675+0000 7f15c33ff700 1 --2- 172.21.15.136:0/153238351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 0x7f15bc0cd120 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.675+0000 7f15c33ff700 1 --2- 172.21.15.136:0/153238351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15bc160a50 0x7f15bc0d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.675+0000 7f15c33ff700 1 -- 172.21.15.136:0/153238351 >> 172.21.15.136:0/153238351 conn(0x7f15bc071620 msgr2=0x7f15bc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:37.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.675+0000 7f15c33ff700 1 -- 172.21.15.136:0/153238351 shutdown_connections 2023-06-23T19:02:37.681 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.675+0000 7f15c33ff700 1 -- 172.21.15.136:0/153238351 wait complete. 2023-06-23T19:02:37.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.676+0000 7f15c33ff700 1 Processor -- start 2023-06-23T19:02:37.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.677+0000 7f15c33ff700 1 -- start start 2023-06-23T19:02:37.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.677+0000 7f15c33ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15bc0cd660 0x7f15bc0b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c33ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 0x7f15bc1e67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c33ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15bc160a50 0x7f15bc0b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c33ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0c93c0 con 0x7f15bc15c570 2023-06-23T19:02:37.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c33ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1f2170 con 0x7f15bc0cd660 2023-06-23T19:02:37.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c33ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0c8840 con 0x7f15bc160a50 2023-06-23T19:02:37.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c099a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 0x7f15bc1e67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c099a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 0x7f15bc1e67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58992/0 (socket says 172.21.15.136:58992) 2023-06-23T19:02:37.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c099a700 1 -- 172.21.15.136:0/51405121 learned_addr learned my addr 172.21.15.136:0/51405121 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:37.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c099a700 1 -- 172.21.15.136:0/51405121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15bc160a50 msgr2=0x7f15bc0b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c099a700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15bc160a50 0x7f15bc0b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c099a700 1 -- 172.21.15.136:0/51405121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15bc0cd660 msgr2=0x7f15bc0b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c099a700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15bc0cd660 0x7f15bc0b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c099a700 1 -- 172.21.15.136:0/51405121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80094a0 con 0x7f15bc15c570 2023-06-23T19:02:37.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.678+0000 7f15c099a700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 0x7f15bc1e67a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0011e0 tx=0x7f15ac00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:37.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.679+0000 7f15b1ffb700 1 -- 172.21.15.136:0/51405121 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac004c80 con 0x7f15bc15c570 2023-06-23T19:02:37.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.679+0000 7f15b1ffb700 1 -- 172.21.15.136:0/51405121 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac004e00 con 0x7f15bc15c570 2023-06-23T19:02:37.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.679+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc0c8b20 con 0x7f15bc15c570 2023-06-23T19:02:37.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.679+0000 7f15b1ffb700 1 -- 172.21.15.136:0/51405121 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac007310 con 0x7f15bc15c570 2023-06-23T19:02:37.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.679+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc0c8eb0 con 0x7f15bc15c570 2023-06-23T19:02:37.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.680+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc0c8cb0 con 0x7f15bc15c570 2023-06-23T19:02:37.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.681+0000 7f15b1ffb700 1 -- 172.21.15.136:0/51405121 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15ac007470 con 0x7f15bc15c570 2023-06-23T19:02:37.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.682+0000 7f15b1ffb700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f15a006ace0 0x7f15a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:37.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.682+0000 7f15b1ffb700 1 -- 172.21.15.136:0/51405121 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f15ac089010 con 0x7f15bc15c570 2023-06-23T19:02:37.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.682+0000 7f15c119b700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f15a006ace0 0x7f15a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:37.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.682+0000 7f15c119b700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f15a006ace0 0x7f15a006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f15b80090b0 tx=0x7f15b8010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:37.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.686+0000 7f15b1ffb700 1 -- 172.21.15.136:0/51405121 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15ac054360 con 0x7f15bc15c570 2023-06-23T19:02:37.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.962+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f15bc15cf80 con 0x7f15bc15c570 2023-06-23T19:02:37.971 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.967+0000 7f15b1ffb700 1 -- 172.21.15.136:0/51405121 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f15ac057980 con 0x7f15bc15c570 2023-06-23T19:02:37.973 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f15a006ace0 msgr2=0x7f15a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f15a006ace0 0x7f15a006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f15b80090b0 tx=0x7f15b8010000 comp rx=0 tx=0).stop 2023-06-23T19:02:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 msgr2=0x7f15bc1e67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 0x7f15bc1e67a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0011e0 tx=0x7f15ac00cae0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 shutdown_connections 2023-06-23T19:02:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f15a006ace0 0x7f15a006d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15bc0cd660 0x7f15bc0b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15bc160a50 0x7f15bc0b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 --2- 172.21.15.136:0/51405121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15bc15c570 0x7f15bc1e67a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:37.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 >> 172.21.15.136:0/51405121 conn(0x7f15bc071620 msgr2=0x7f15bc15e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:37.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 shutdown_connections 2023-06-23T19:02:37.975 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:37.970+0000 7f15c33ff700 1 -- 172.21.15.136:0/51405121 wait complete. 2023-06-23T19:02:37.992 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-23T19:02:38.186 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.183+0000 7fccab7ff700 1 Processor -- start 2023-06-23T19:02:38.187 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.183+0000 7fccab7ff700 1 -- start start 2023-06-23T19:02:38.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.184+0000 7fccab7ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcca415c570 0x7fcca40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.184+0000 7fccab7ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcca40cd660 0x7fcca4160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.184+0000 7fccab7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.184+0000 7fccab7ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca415d670 con 0x7fcca415c570 2023-06-23T19:02:38.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.184+0000 7fccab7ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca40cdae0 con 0x7fcca40cd660 2023-06-23T19:02:38.188 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.184+0000 7fccab7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca41610a0 con 0x7fcca4160880 2023-06-23T19:02:38.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.184+0000 7fcca959b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcca415c570 0x7fcca40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca959b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcca415c570 0x7fcca40cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59004/0 (socket says 172.21.15.136:59004) 2023-06-23T19:02:38.190 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca959b700 1 -- 172.21.15.136:0/545924089 learned_addr learned my addr 172.21.15.136:0/545924089 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:38.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca9d9c700 1 --2- 172.21.15.136:0/545924089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca959b700 1 -- 172.21.15.136:0/545924089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 msgr2=0x7fcca406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:38.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca959b700 1 --2- 172.21.15.136:0/545924089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca959b700 1 -- 172.21.15.136:0/545924089 >> v2:172.21.15.178:3300/0 conn(0x7fcca40cd660 msgr2=0x7fcca4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:38.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca8d9a700 1 --2- 172.21.15.136:0/545924089 >> v2:172.21.15.178:3300/0 conn(0x7fcca40cd660 0x7fcca4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca959b700 1 --2- 172.21.15.136:0/545924089 >> v2:172.21.15.178:3300/0 conn(0x7fcca40cd660 0x7fcca4160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.191 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca959b700 1 -- 172.21.15.136:0/545924089 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca415da90 con 0x7fcca415c570 2023-06-23T19:02:38.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca9d9c700 1 --2- 172.21.15.136:0/545924089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:38.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca8d9a700 1 --2- 172.21.15.136:0/545924089 >> v2:172.21.15.178:3300/0 conn(0x7fcca40cd660 0x7fcca4160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:38.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcca959b700 1 --2- 172.21.15.136:0/545924089 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 0x7fcca40cd120 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcca408bc50 tx=0x7fcca0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c789984196b2e499 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:38.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.185+0000 7fcc9bfff700 1 -- 172.21.15.136:0/545924089 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000b870 con 0x7fcca415c570 2023-06-23T19:02:38.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fcc9bfff700 1 -- 172.21.15.136:0/545924089 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca000b9d0 con 0x7fcca415c570 2023-06-23T19:02:38.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fcc9bfff700 1 -- 172.21.15.136:0/545924089 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000bd60 con 0x7fcca415c570 2023-06-23T19:02:38.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fccab7ff700 1 -- 172.21.15.136:0/545924089 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 msgr2=0x7fcca40cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fccab7ff700 1 --2- 172.21.15.136:0/545924089 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 0x7fcca40cd120 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcca408bc50 tx=0x7fcca0009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fccab7ff700 1 -- 172.21.15.136:0/545924089 shutdown_connections 2023-06-23T19:02:38.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fccab7ff700 1 --2- 172.21.15.136:0/545924089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fccab7ff700 1 --2- 172.21.15.136:0/545924089 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 0x7fcca40cd120 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fccab7ff700 1 --2- 172.21.15.136:0/545924089 >> v2:172.21.15.178:3300/0 conn(0x7fcca40cd660 0x7fcca4160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.193 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fccab7ff700 1 -- 172.21.15.136:0/545924089 >> 172.21.15.136:0/545924089 conn(0x7fcca4071620 msgr2=0x7fcca40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:38.194 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fccab7ff700 1 -- 172.21.15.136:0/545924089 shutdown_connections 2023-06-23T19:02:38.194 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.186+0000 7fccab7ff700 1 -- 172.21.15.136:0/545924089 wait complete. 2023-06-23T19:02:38.196 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.188+0000 7fccab7ff700 1 Processor -- start 2023-06-23T19:02:38.196 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.188+0000 7fccab7ff700 1 -- start start 2023-06-23T19:02:38.196 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fccab7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcca40cd660 0x7fcca41f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.196 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fccab7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 0x7fcca40b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fccab7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca40b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fccab7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40ccea0 con 0x7fcca415c570 2023-06-23T19:02:38.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fccab7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40b8340 con 0x7fcca40cd660 2023-06-23T19:02:38.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fccab7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40b59b0 con 0x7fcca4160880 2023-06-23T19:02:38.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fcca8d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 0x7fcca40b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fcca8d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 0x7fcca40b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59008/0 (socket says 172.21.15.136:59008) 2023-06-23T19:02:38.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fcca8d9a700 1 -- 172.21.15.136:0/3498772848 learned_addr learned my addr 172.21.15.136:0/3498772848 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:38.197 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fcca959b700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcca40cd660 0x7fcca41f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.189+0000 7fcca9d9c700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca40b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcca8d9a700 1 -- 172.21.15.136:0/3498772848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 msgr2=0x7fcca40b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcca8d9a700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca40b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcca8d9a700 1 -- 172.21.15.136:0/3498772848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcca40cd660 msgr2=0x7fcca41f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcca8d9a700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcca40cd660 0x7fcca41f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.198 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcca8d9a700 1 -- 172.21.15.136:0/3498772848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0009550 con 0x7fcca415c570 2023-06-23T19:02:38.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcca9d9c700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:38.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcca8d9a700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 0x7fcca40b4120 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c7f0 tx=0x7fcc9400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:38.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcc99ffb700 1 -- 172.21.15.136:0/3498772848 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94011800 con 0x7fcca415c570 2023-06-23T19:02:38.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcc99ffb700 1 -- 172.21.15.136:0/3498772848 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc94011960 con 0x7fcca415c570 2023-06-23T19:02:38.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fcc99ffb700 1 -- 172.21.15.136:0/3498772848 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94011d10 con 0x7fcca415c570 2023-06-23T19:02:38.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca40b5c90 con 0x7fcca415c570 2023-06-23T19:02:38.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.190+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca40b6250 con 0x7fcca415c570 2023-06-23T19:02:38.199 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.191+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca40b6470 con 0x7fcca415c570 2023-06-23T19:02:38.200 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.192+0000 7fcc99ffb700 1 -- 172.21.15.136:0/3498772848 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc94018360 con 0x7fcca415c570 2023-06-23T19:02:38.200 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.193+0000 7fcc99ffb700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcc8806ace0 0x7fcc8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.200 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.193+0000 7fcc99ffb700 1 -- 172.21.15.136:0/3498772848 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcc940891e0 con 0x7fcca415c570 2023-06-23T19:02:38.201 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.193+0000 7fcca959b700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcc8806ace0 0x7fcc8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.201 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.194+0000 7fcca959b700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcc8806ace0 0x7fcc8806d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcca0014040 tx=0x7fcca0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:38.201 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.197+0000 7fcc99ffb700 1 -- 172.21.15.136:0/3498772848 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc94054410 con 0x7fcca415c570 2023-06-23T19:02:38.471 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.468+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fcca4073910 con 0x7fcca415c570 2023-06-23T19:02:38.477 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.473+0000 7fcc99ffb700 1 -- 172.21.15.136:0/3498772848 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcc94057a30 con 0x7fcca415c570 2023-06-23T19:02:38.480 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcc8806ace0 msgr2=0x7fcc8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcc8806ace0 0x7fcc8806d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcca0014040 tx=0x7fcca0008030 comp rx=0 tx=0).stop 2023-06-23T19:02:38.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 msgr2=0x7fcca40b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 0x7fcca40b4120 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c7f0 tx=0x7fcc9400cb00 comp rx=0 tx=0).stop 2023-06-23T19:02:38.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 shutdown_connections 2023-06-23T19:02:38.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fcc8806ace0 0x7fcc8806d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcca40cd660 0x7fcca41f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4160880 0x7fcca40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 --2- 172.21.15.136:0/3498772848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca415c570 0x7fcca40b4120 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 >> 172.21.15.136:0/3498772848 conn(0x7fcca4071620 msgr2=0x7fcca415a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:38.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 shutdown_connections 2023-06-23T19:02:38.484 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.476+0000 7fccab7ff700 1 -- 172.21.15.136:0/3498772848 wait complete. 2023-06-23T19:02:38.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-23T19:02:38.696 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.693+0000 7f9dfbfff700 1 Processor -- start 2023-06-23T19:02:38.697 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.693+0000 7f9dfbfff700 1 -- start start 2023-06-23T19:02:38.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.694+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df40cddf0 0x7f9df41607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.694+0000 7f9dfbfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9df406c060 0x7f9df406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.694+0000 7f9dfbfff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df415c770 con 0x7f9df415a000 2023-06-23T19:02:38.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.694+0000 7f9dfbfff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df415ca50 con 0x7f9df406c060 2023-06-23T19:02:38.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.694+0000 7f9dfbfff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40cc9c0 con 0x7f9df40cddf0 2023-06-23T19:02:38.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.694+0000 7f9dfa59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9df406c060 0x7f9df406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.694+0000 7f9dfa59c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9df406c060 0x7f9df406c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59024/0 (socket says 172.21.15.136:59024) 2023-06-23T19:02:38.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.694+0000 7f9dfa59c700 1 -- 172.21.15.136:0/3894695848 learned_addr learned my addr 172.21.15.136:0/3894695848 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:38.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.694+0000 7f9df959a700 1 --2- 172.21.15.136:0/3894695848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df40cddf0 0x7f9df41607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.695+0000 7f9dfa59c700 1 -- 172.21.15.136:0/3894695848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df40cddf0 msgr2=0x7f9df41607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:38.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.695+0000 7f9dfa59c700 1 --2- 172.21.15.136:0/3894695848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df40cddf0 0x7f9df41607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.695+0000 7f9dfa59c700 1 -- 172.21.15.136:0/3894695848 >> v1:172.21.15.178:6789/0 conn(0x7f9df415a000 legacy=0x7f9df415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:38.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.695+0000 7f9dfa59c700 1 -- 172.21.15.136:0/3894695848 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4160d10 con 0x7f9df406c060 2023-06-23T19:02:38.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.695+0000 7f9dfa59c700 1 --2- 172.21.15.136:0/3894695848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df406c060 0x7f9df406c4e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009e50 tx=0x7f9dec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c302cffbcf4129b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:38.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.695+0000 7f9df8d99700 1 -- 172.21.15.136:0/3894695848 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00e070 con 0x7f9df406c060 2023-06-23T19:02:38.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.695+0000 7f9df8d99700 1 -- 172.21.15.136:0/3894695848 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00b910 con 0x7f9df406c060 2023-06-23T19:02:38.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.695+0000 7f9df8d99700 1 -- 172.21.15.136:0/3894695848 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00bcc0 con 0x7f9df406c060 2023-06-23T19:02:38.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.696+0000 7f9dfbfff700 1 -- 172.21.15.136:0/3894695848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df406c060 msgr2=0x7f9df406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.696+0000 7f9dfbfff700 1 --2- 172.21.15.136:0/3894695848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df406c060 0x7f9df406c4e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009e50 tx=0x7f9dec00b330 comp rx=0 tx=0).stop 2023-06-23T19:02:38.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.696+0000 7f9dfbfff700 1 -- 172.21.15.136:0/3894695848 shutdown_connections 2023-06-23T19:02:38.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.696+0000 7f9dfbfff700 1 --2- 172.21.15.136:0/3894695848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df406c060 0x7f9df406c4e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.702 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.696+0000 7f9dfbfff700 1 --2- 172.21.15.136:0/3894695848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df40cddf0 0x7f9df41607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.696+0000 7f9dfbfff700 1 -- 172.21.15.136:0/3894695848 >> 172.21.15.136:0/3894695848 conn(0x7f9df40b0ef0 msgr2=0x7f9df40ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:38.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.696+0000 7f9dfbfff700 1 -- 172.21.15.136:0/3894695848 shutdown_connections 2023-06-23T19:02:38.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.696+0000 7f9dfbfff700 1 -- 172.21.15.136:0/3894695848 wait complete. 2023-06-23T19:02:38.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.698+0000 7f9dfbfff700 1 Processor -- start 2023-06-23T19:02:38.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.698+0000 7f9dfbfff700 1 -- start start 2023-06-23T19:02:38.704 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df406c060 0x7f9df414b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9df40cddf0 0x7f9df40ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df415a000 0x7f9df40ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfbfff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df415cf80 con 0x7f9df415a000 2023-06-23T19:02:38.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfbfff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df415d260 con 0x7f9df40cddf0 2023-06-23T19:02:38.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfbfff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df415d540 con 0x7f9df406c060 2023-06-23T19:02:38.705 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfa59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df415a000 0x7f9df40ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfa59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df415a000 0x7f9df40ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59030/0 (socket says 172.21.15.136:59030) 2023-06-23T19:02:38.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfa59c700 1 -- 172.21.15.136:0/123001137 learned_addr learned my addr 172.21.15.136:0/123001137 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:38.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfa59c700 1 -- 172.21.15.136:0/123001137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df406c060 msgr2=0x7f9df414b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfa59c700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df406c060 0x7f9df414b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfa59c700 1 -- 172.21.15.136:0/123001137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9df40cddf0 msgr2=0x7f9df40ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfa59c700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9df40cddf0 0x7f9df40ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfa59c700 1 -- 172.21.15.136:0/123001137 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec009b30 con 0x7f9df415a000 2023-06-23T19:02:38.706 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.699+0000 7f9dfa59c700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df415a000 0x7f9df40ace60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9df40723b0 tx=0x7f9dec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:38.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.700+0000 7f9dea7fc700 1 -- 172.21.15.136:0/123001137 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0092e0 con 0x7f9df415a000 2023-06-23T19:02:38.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.700+0000 7f9dea7fc700 1 -- 172.21.15.136:0/123001137 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec01c440 con 0x7f9df415a000 2023-06-23T19:02:38.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.700+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df415d820 con 0x7f9df415a000 2023-06-23T19:02:38.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.700+0000 7f9dea7fc700 1 -- 172.21.15.136:0/123001137 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec01c810 con 0x7f9df415a000 2023-06-23T19:02:38.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.700+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df415e870 con 0x7f9df415a000 2023-06-23T19:02:38.707 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.701+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df4160930 con 0x7f9df415a000 2023-06-23T19:02:38.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.702+0000 7f9dea7fc700 1 -- 172.21.15.136:0/123001137 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9dec01c970 con 0x7f9df415a000 2023-06-23T19:02:38.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.703+0000 7f9dea7fc700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9dd806ace0 0x7f9dd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:38.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.703+0000 7f9dea7fc700 1 -- 172.21.15.136:0/123001137 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9dec08ad00 con 0x7f9df415a000 2023-06-23T19:02:38.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.703+0000 7f9df9d9b700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9dd806ace0 0x7f9dd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:38.709 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.704+0000 7f9df9d9b700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9dd806ace0 0x7f9dd806d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9df0000f60 tx=0x7f9df0007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:38.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.707+0000 7f9dea7fc700 1 -- 172.21.15.136:0/123001137 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9dec055f20 con 0x7f9df415a000 2023-06-23T19:02:38.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.984+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f9df415d0c0 con 0x7f9df415a000 2023-06-23T19:02:38.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.988+0000 7f9dea7fc700 1 -- 172.21.15.136:0/123001137 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9df415d0c0 con 0x7f9df415a000 2023-06-23T19:02:38.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9dd806ace0 msgr2=0x7f9dd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9dd806ace0 0x7f9dd806d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9df0000f60 tx=0x7f9df0007a40 comp rx=0 tx=0).stop 2023-06-23T19:02:38.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df415a000 msgr2=0x7f9df40ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:38.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df415a000 0x7f9df40ace60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9df40723b0 tx=0x7f9dec004ad0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 shutdown_connections 2023-06-23T19:02:38.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f9dd806ace0 0x7f9dd806d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df415a000 0x7f9df40ace60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df406c060 0x7f9df414b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 --2- 172.21.15.136:0/123001137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9df40cddf0 0x7f9df40ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:38.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 >> 172.21.15.136:0/123001137 conn(0x7f9df40b0ef0 msgr2=0x7f9df40af040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:38.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.990+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 shutdown_connections 2023-06-23T19:02:38.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:38.991+0000 7f9dfbfff700 1 -- 172.21.15.136:0/123001137 wait complete. 2023-06-23T19:02:39.013 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.206+0000 7f5e6c5ff700 1 Processor -- start 2023-06-23T19:02:39.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.206+0000 7f5e6c5ff700 1 -- start start 2023-06-23T19:02:39.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.207+0000 7f5e6c5ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5e64158ef0 0x7f5e640cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.207+0000 7f5e6c5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 0x7f5e640702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.207+0000 7f5e6c5ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e64070c60 con 0x7f5e64070820 2023-06-23T19:02:39.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.207+0000 7f5e6c5ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6406c4d0 con 0x7f5e64158ef0 2023-06-23T19:02:39.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.207+0000 7f5e6c5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640c9510 con 0x7f5e6406c060 2023-06-23T19:02:39.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.207+0000 7f5e6ab9c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5e64070820 0x7f5e640ca290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37410/0 (socket says 172.21.15.136:37410) 2023-06-23T19:02:39.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.207+0000 7f5e6a39b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5e64158ef0 0x7f5e640cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.207+0000 7f5e6ab9c700 1 -- 172.21.15.136:0/13427674 learned_addr learned my addr 172.21.15.136:0/13427674 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:39.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e69b9a700 1 --2- 172.21.15.136:0/13427674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 0x7f5e640702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e6a39b700 1 -- 172.21.15.136:0/13427674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 msgr2=0x7f5e640702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:39.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e6a39b700 1 --2- 172.21.15.136:0/13427674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 0x7f5e640702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e6a39b700 1 -- 172.21.15.136:0/13427674 >> v1:172.21.15.136:6789/0 conn(0x7f5e64070820 legacy=0x7f5e640ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e6a39b700 1 -- 172.21.15.136:0/13427674 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e640cd6a0 con 0x7f5e64158ef0 2023-06-23T19:02:39.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e69399700 1 -- 172.21.15.136:0/13427674 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095202243 0 0) 0x7f5e64070c60 con 0x7f5e64070820 2023-06-23T19:02:39.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e6a39b700 1 --2- 172.21.15.136:0/13427674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64158ef0 0x7f5e640cf1e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009840 tx=0x7f5e60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227f4da41d880417 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:39.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e69399700 1 -- 172.21.15.136:0/13427674 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60011830 con 0x7f5e64158ef0 2023-06-23T19:02:39.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e69399700 1 -- 172.21.15.136:0/13427674 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e60011990 con 0x7f5e64158ef0 2023-06-23T19:02:39.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.208+0000 7f5e69399700 1 -- 172.21.15.136:0/13427674 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60011d20 con 0x7f5e64158ef0 2023-06-23T19:02:39.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.209+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/13427674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64158ef0 msgr2=0x7f5e640cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.209+0000 7f5e6c5ff700 1 --2- 172.21.15.136:0/13427674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64158ef0 0x7f5e640cf1e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009840 tx=0x7f5e60009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:39.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.209+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/13427674 shutdown_connections 2023-06-23T19:02:39.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.209+0000 7f5e6c5ff700 1 --2- 172.21.15.136:0/13427674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64158ef0 0x7f5e640cf1e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.209+0000 7f5e6c5ff700 1 --2- 172.21.15.136:0/13427674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 0x7f5e640702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.209+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/13427674 >> 172.21.15.136:0/13427674 conn(0x7f5e640b0ef0 msgr2=0x7f5e640ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:39.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.209+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/13427674 shutdown_connections 2023-06-23T19:02:39.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.209+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/13427674 wait complete. 2023-06-23T19:02:39.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.211+0000 7f5e6c5ff700 1 Processor -- start 2023-06-23T19:02:39.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.211+0000 7f5e6c5ff700 1 -- start start 2023-06-23T19:02:39.218 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6c5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 0x7f5e640c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6c5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64070820 0x7f5e640b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6c5ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e64158ef0 0x7f5e64157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6c5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640c4250 con 0x7f5e64070820 2023-06-23T19:02:39.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6c5ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640ad6e0 con 0x7f5e64158ef0 2023-06-23T19:02:39.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6c5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6415aec0 con 0x7f5e6406c060 2023-06-23T19:02:39.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e69b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64070820 0x7f5e640b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e69b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64070820 0x7f5e640b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59044/0 (socket says 172.21.15.136:59044) 2023-06-23T19:02:39.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e69b9a700 1 -- 172.21.15.136:0/918885125 learned_addr learned my addr 172.21.15.136:0/918885125 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:39.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6a39b700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 0x7f5e640c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e69b9a700 1 -- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 msgr2=0x7f5e640c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6ab9c700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e64158ef0 0x7f5e64157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e69b9a700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 0x7f5e640c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e69b9a700 1 -- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e64158ef0 msgr2=0x7f5e64157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e69b9a700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e64158ef0 0x7f5e64157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e69b9a700 1 -- 172.21.15.136:0/918885125 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e600094a0 con 0x7f5e64070820 2023-06-23T19:02:39.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6a39b700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 0x7f5e640c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:39.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.212+0000 7f5e6ab9c700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e64158ef0 0x7f5e64157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:39.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.213+0000 7f5e69b9a700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64070820 0x7f5e640b1560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400e810 tx=0x7f5e5400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:39.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.213+0000 7f5e5affd700 1 -- 172.21.15.136:0/918885125 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54013610 con 0x7f5e64070820 2023-06-23T19:02:39.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.213+0000 7f5e5affd700 1 -- 172.21.15.136:0/918885125 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e54013770 con 0x7f5e64070820 2023-06-23T19:02:39.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.213+0000 7f5e5affd700 1 -- 172.21.15.136:0/918885125 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54013b20 con 0x7f5e64070820 2023-06-23T19:02:39.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.213+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e640c3c90 con 0x7f5e64070820 2023-06-23T19:02:39.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.213+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6415b160 con 0x7f5e64070820 2023-06-23T19:02:39.222 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.214+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6415acf0 con 0x7f5e64070820 2023-06-23T19:02:39.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.215+0000 7f5e5affd700 1 -- 172.21.15.136:0/918885125 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e54013c80 con 0x7f5e64070820 2023-06-23T19:02:39.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.216+0000 7f5e5affd700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e4806ace0 0x7f5e4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.216+0000 7f5e5affd700 1 -- 172.21.15.136:0/918885125 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5e54088fe0 con 0x7f5e64070820 2023-06-23T19:02:39.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.216+0000 7f5e6a39b700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e4806ace0 0x7f5e4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.217+0000 7f5e6a39b700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e4806ace0 0x7f5e4806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5e600090b0 tx=0x7f5e60008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:39.224 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.220+0000 7f5e5affd700 1 -- 172.21.15.136:0/918885125 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e54054210 con 0x7f5e64070820 2023-06-23T19:02:39.424 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.420+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e64073910 con 0x7f5e64070820 2023-06-23T19:02:39.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.421+0000 7f5e5affd700 1 -- 172.21.15.136:0/918885125 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14868 (secure 0 0 0) 0x7f5e54057830 con 0x7f5e64070820 2023-06-23T19:02:39.425 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:39.425 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":40,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:02:35.408615+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:39.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e4806ace0 msgr2=0x7f5e4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e4806ace0 0x7f5e4806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5e600090b0 tx=0x7f5e60008030 comp rx=0 tx=0).stop 2023-06-23T19:02:39.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64070820 msgr2=0x7f5e640b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64070820 0x7f5e640b1560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400e810 tx=0x7f5e5400ebd0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 shutdown_connections 2023-06-23T19:02:39.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5e4806ace0 0x7f5e4806d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e64158ef0 0x7f5e64157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e6406c060 0x7f5e640c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 --2- 172.21.15.136:0/918885125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e64070820 0x7f5e640b1560 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 >> 172.21.15.136:0/918885125 conn(0x7f5e640b0ef0 msgr2=0x7f5e6406ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:39.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.423+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 shutdown_connections 2023-06-23T19:02:39.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.424+0000 7f5e6c5ff700 1 -- 172.21.15.136:0/918885125 wait complete. 2023-06-23T19:02:39.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T19:02:39.451 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:02:39.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.642+0000 7f8138dff700 1 Processor -- start 2023-06-23T19:02:39.647 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.643+0000 7f8138dff700 1 -- start start 2023-06-23T19:02:39.648 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f8138dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 0x7f81340b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f8138dff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f81340cf910 0x7f81340d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f8138dff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340cd9d0 con 0x7f81340b51d0 2023-06-23T19:02:39.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f8138dff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81340d0060 con 0x7f81340cf910 2023-06-23T19:02:39.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f8138dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81340b5640 con 0x7f81340d0a60 2023-06-23T19:02:39.649 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f812bfff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f81340b51d0 0x7f81340d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37418/0 (socket says 172.21.15.136:37418) 2023-06-23T19:02:39.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f812bfff700 1 -- 172.21.15.136:0/778646379 learned_addr learned my addr 172.21.15.136:0/778646379 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:39.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f8132d9d700 1 --2- 172.21.15.136:0/778646379 >> v2:172.21.15.136:3300/0 conn(0x7f81340cf910 0x7f81340d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f813259c700 1 --2- 172.21.15.136:0/778646379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 0x7f81340b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f8131d9b700 1 -- 172.21.15.136:0/778646379 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078124653 0 0) 0x7f81340cd9d0 con 0x7f81340b51d0 2023-06-23T19:02:39.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.644+0000 7f8131d9b700 1 -- 172.21.15.136:0/778646379 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81200035b0 con 0x7f81340b51d0 2023-06-23T19:02:39.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.645+0000 7f8132d9d700 1 -- 172.21.15.136:0/778646379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 msgr2=0x7f81340b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:39.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.645+0000 7f8132d9d700 1 --2- 172.21.15.136:0/778646379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 0x7f81340b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.645+0000 7f8132d9d700 1 -- 172.21.15.136:0/778646379 >> v1:172.21.15.136:6789/0 conn(0x7f81340b51d0 legacy=0x7f81340d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.645+0000 7f8132d9d700 1 -- 172.21.15.136:0/778646379 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340cfd90 con 0x7f81340cf910 2023-06-23T19:02:39.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.645+0000 7f8132d9d700 1 --2- 172.21.15.136:0/778646379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340cf910 0x7f81340d2e00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f812c009d90 tx=0x7f812c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbc1134352df88d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:39.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.645+0000 7f8131d9b700 1 -- 172.21.15.136:0/778646379 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00e070 con 0x7f81340cf910 2023-06-23T19:02:39.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.645+0000 7f8131d9b700 1 -- 172.21.15.136:0/778646379 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00bb20 con 0x7f81340cf910 2023-06-23T19:02:39.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.645+0000 7f8131d9b700 1 -- 172.21.15.136:0/778646379 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c012430 con 0x7f81340cf910 2023-06-23T19:02:39.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.645+0000 7f8138dff700 1 -- 172.21.15.136:0/778646379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340cf910 msgr2=0x7f81340d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.646+0000 7f8138dff700 1 --2- 172.21.15.136:0/778646379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340cf910 0x7f81340d2e00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f812c009d90 tx=0x7f812c00b330 comp rx=0 tx=0).stop 2023-06-23T19:02:39.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.646+0000 7f8138dff700 1 -- 172.21.15.136:0/778646379 shutdown_connections 2023-06-23T19:02:39.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.646+0000 7f8138dff700 1 --2- 172.21.15.136:0/778646379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340cf910 0x7f81340d2e00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.646+0000 7f8138dff700 1 --2- 172.21.15.136:0/778646379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 0x7f81340b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.646+0000 7f8138dff700 1 -- 172.21.15.136:0/778646379 >> 172.21.15.136:0/778646379 conn(0x7f8134071620 msgr2=0x7f81340719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:39.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.646+0000 7f8138dff700 1 -- 172.21.15.136:0/778646379 shutdown_connections 2023-06-23T19:02:39.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.646+0000 7f8138dff700 1 -- 172.21.15.136:0/778646379 wait complete. 2023-06-23T19:02:39.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.647+0000 7f8138dff700 1 Processor -- start 2023-06-23T19:02:39.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.648+0000 7f8138dff700 1 -- start start 2023-06-23T19:02:39.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.648+0000 7f8138dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340b51d0 0x7f81340b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.648+0000 7f8138dff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81340cf910 0x7f813415f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.648+0000 7f8138dff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 0x7f81341e4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.648+0000 7f8138dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81340b16e0 con 0x7f81340b51d0 2023-06-23T19:02:39.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.648+0000 7f8138dff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813415f610 con 0x7f81340cf910 2023-06-23T19:02:39.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.648+0000 7f8138dff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81340a9760 con 0x7f81340d0a60 2023-06-23T19:02:39.657 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f813259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340b51d0 0x7f81340b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f813259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340b51d0 0x7f81340b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59054/0 (socket says 172.21.15.136:59054) 2023-06-23T19:02:39.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f813259c700 1 -- 172.21.15.136:0/3869932128 learned_addr learned my addr 172.21.15.136:0/3869932128 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:39.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f8132d9d700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 0x7f81341e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f812bfff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81340cf910 0x7f813415f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f813259c700 1 -- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 msgr2=0x7f81341e4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f813259c700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 0x7f81341e4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f813259c700 1 -- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81340cf910 msgr2=0x7f813415f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f813259c700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81340cf910 0x7f813415f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f813259c700 1 -- 172.21.15.136:0/3869932128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c009a70 con 0x7f81340b51d0 2023-06-23T19:02:39.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f8132d9d700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 0x7f81341e4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:39.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f812bfff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81340cf910 0x7f813415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:39.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.649+0000 7f813259c700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340b51d0 0x7f81340b11a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f812400e870 tx=0x7f812400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:39.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.650+0000 7f812affd700 1 -- 172.21.15.136:0/3869932128 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124009590 con 0x7f81340b51d0 2023-06-23T19:02:39.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.650+0000 7f812affd700 1 -- 172.21.15.136:0/3869932128 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812400ee70 con 0x7f81340b51d0 2023-06-23T19:02:39.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.650+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8134147c90 con 0x7f81340b51d0 2023-06-23T19:02:39.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.650+0000 7f812affd700 1 -- 172.21.15.136:0/3869932128 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812400c9f0 con 0x7f81340b51d0 2023-06-23T19:02:39.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.650+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8134148250 con 0x7f81340b51d0 2023-06-23T19:02:39.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.651+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81340cd3d0 con 0x7f81340b51d0 2023-06-23T19:02:39.663 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.652+0000 7f812affd700 1 -- 172.21.15.136:0/3869932128 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f812400cb50 con 0x7f81340b51d0 2023-06-23T19:02:39.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.652+0000 7f812affd700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f811406ad10 0x7f811406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:39.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.653+0000 7f812affd700 1 -- 172.21.15.136:0/3869932128 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8124089240 con 0x7f81340b51d0 2023-06-23T19:02:39.664 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.653+0000 7f812bfff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f811406ad10 0x7f811406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:39.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.653+0000 7f812bfff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f811406ad10 0x7f811406d1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f813415f020 tx=0x7f811c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:39.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.657+0000 7f812affd700 1 -- 172.21.15.136:0/3869932128 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8124057ef0 con 0x7f81340b51d0 2023-06-23T19:02:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.853+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f813404ea20 con 0x7f81340b51d0 2023-06-23T19:02:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.853+0000 7f812affd700 1 -- 172.21.15.136:0/3869932128 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8124057a80 con 0x7f81340b51d0 2023-06-23T19:02:39.858 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-23T19:02:39.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.855+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f811406ad10 msgr2=0x7f811406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.855+0000 7f8138dff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f811406ad10 0x7f811406d1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f813415f020 tx=0x7f811c009040 comp rx=0 tx=0).stop 2023-06-23T19:02:39.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.855+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340b51d0 msgr2=0x7f81340b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:39.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.855+0000 7f8138dff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340b51d0 0x7f81340b11a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f812400e870 tx=0x7f812400ec30 comp rx=0 tx=0).stop 2023-06-23T19:02:39.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.856+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 shutdown_connections 2023-06-23T19:02:39.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.856+0000 7f8138dff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f811406ad10 0x7f811406d1c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.856+0000 7f8138dff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81340d0a60 0x7f81341e4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.856+0000 7f8138dff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81340b51d0 0x7f81340b11a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.856+0000 7f8138dff700 1 --2- 172.21.15.136:0/3869932128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81340cf910 0x7f813415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:39.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.856+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 >> 172.21.15.136:0/3869932128 conn(0x7f8134071620 msgr2=0x7f81340b8580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:39.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.856+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 shutdown_connections 2023-06-23T19:02:39.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:39.856+0000 7f8138dff700 1 -- 172.21.15.136:0/3869932128 wait complete. 2023-06-23T19:02:39.878 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:02:40.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.070+0000 7f1f979ff700 1 Processor -- start 2023-06-23T19:02:40.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.070+0000 7f1f979ff700 1 -- start start 2023-06-23T19:02:40.077 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.071+0000 7f1f979ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1f900d0a60 0x7f1f900b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.071+0000 7f1f979ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900b51d0 0x7f1f900cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.071+0000 7f1f979ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1f900d0e30 0x7f1f900d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.071+0000 7f1f979ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f900d0060 con 0x7f1f900d0e30 2023-06-23T19:02:40.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.071+0000 7f1f979ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f900cfe50 con 0x7f1f900d0a60 2023-06-23T19:02:40.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.071+0000 7f1f979ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900cd9d0 con 0x7f1f900b51d0 2023-06-23T19:02:40.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f95f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1f900d0e30 0x7f1f900d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f94f9a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900b51d0 0x7f1f900cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f9579b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1f900d0a60 0x7f1f900b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f95f9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1f900d0e30 0x7f1f900d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59058/0 (socket says 172.21.15.136:59058) 2023-06-23T19:02:40.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f95f9c700 1 -- 172.21.15.136:0/435089892 learned_addr learned my addr 172.21.15.136:0/435089892 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:40.079 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f94f9a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900b51d0 0x7f1f900cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:51590/0 (socket says 172.21.15.136:51590) 2023-06-23T19:02:40.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f95f9c700 1 -- 172.21.15.136:0/435089892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900b51d0 msgr2=0x7f1f900cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:40.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f95f9c700 1 --2- 172.21.15.136:0/435089892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900b51d0 0x7f1f900cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f95f9c700 1 -- 172.21.15.136:0/435089892 >> v2:172.21.15.178:3300/0 conn(0x7f1f900d0a60 msgr2=0x7f1f900b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:40.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f95f9c700 1 --2- 172.21.15.136:0/435089892 >> v2:172.21.15.178:3300/0 conn(0x7f1f900d0a60 0x7f1f900b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f95f9c700 1 -- 172.21.15.136:0/435089892 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f900b5620 con 0x7f1f900d0e30 2023-06-23T19:02:40.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.072+0000 7f1f95f9c700 1 --2- 172.21.15.136:0/435089892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900d0e30 0x7f1f900d12b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1f9006c6e0 tx=0x7f1f8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25fdc19fd59a143 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:40.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f87fff700 1 -- 172.21.15.136:0/435089892 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800e070 con 0x7f1f900d0e30 2023-06-23T19:02:40.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f87fff700 1 -- 172.21.15.136:0/435089892 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800b910 con 0x7f1f900d0e30 2023-06-23T19:02:40.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f87fff700 1 -- 172.21.15.136:0/435089892 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800bcc0 con 0x7f1f900d0e30 2023-06-23T19:02:40.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f979ff700 1 -- 172.21.15.136:0/435089892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900d0e30 msgr2=0x7f1f900d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f979ff700 1 --2- 172.21.15.136:0/435089892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900d0e30 0x7f1f900d12b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1f9006c6e0 tx=0x7f1f8800b330 comp rx=0 tx=0).stop 2023-06-23T19:02:40.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f979ff700 1 -- 172.21.15.136:0/435089892 shutdown_connections 2023-06-23T19:02:40.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f979ff700 1 --2- 172.21.15.136:0/435089892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900d0e30 0x7f1f900d12b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f979ff700 1 --2- 172.21.15.136:0/435089892 >> v2:172.21.15.178:3300/0 conn(0x7f1f900d0a60 0x7f1f900b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f979ff700 1 --2- 172.21.15.136:0/435089892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900b51d0 0x7f1f900cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f979ff700 1 -- 172.21.15.136:0/435089892 >> 172.21.15.136:0/435089892 conn(0x7f1f90071620 msgr2=0x7f1f900719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:40.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f979ff700 1 -- 172.21.15.136:0/435089892 shutdown_connections 2023-06-23T19:02:40.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.073+0000 7f1f979ff700 1 -- 172.21.15.136:0/435089892 wait complete. 2023-06-23T19:02:40.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.075+0000 7f1f979ff700 1 Processor -- start 2023-06-23T19:02:40.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.075+0000 7f1f979ff700 1 -- start start 2023-06-23T19:02:40.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.076+0000 7f1f979ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900b51d0 0x7f1f901f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.076+0000 7f1f979ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900d0a60 0x7f1f900b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.076+0000 7f1f979ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f900d0e30 0x7f1f900b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.076+0000 7f1f979ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f901f2d00 con 0x7f1f900b51d0 2023-06-23T19:02:40.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.076+0000 7f1f979ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9015cee0 con 0x7f1f900d0e30 2023-06-23T19:02:40.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.076+0000 7f1f979ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9015cc00 con 0x7f1f900d0a60 2023-06-23T19:02:40.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.076+0000 7f1f9579b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900b51d0 0x7f1f901f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.076+0000 7f1f9579b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900b51d0 0x7f1f901f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59070/0 (socket says 172.21.15.136:59070) 2023-06-23T19:02:40.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.076+0000 7f1f9579b700 1 -- 172.21.15.136:0/3783106510 learned_addr learned my addr 172.21.15.136:0/3783106510 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:40.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f94f9a700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900d0a60 0x7f1f900b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f95f9c700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f900d0e30 0x7f1f900b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f9579b700 1 -- 172.21.15.136:0/3783106510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900d0a60 msgr2=0x7f1f900b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f9579b700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900d0a60 0x7f1f900b7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f9579b700 1 -- 172.21.15.136:0/3783106510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f900d0e30 msgr2=0x7f1f900b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f9579b700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f900d0e30 0x7f1f900b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f9579b700 1 -- 172.21.15.136:0/3783106510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88009b30 con 0x7f1f900b51d0 2023-06-23T19:02:40.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f9579b700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900b51d0 0x7f1f901f4780 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00e9b0 tx=0x7f1f8c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:40.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f85ffb700 1 -- 172.21.15.136:0/3783106510 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c009710 con 0x7f1f900b51d0 2023-06-23T19:02:40.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f85ffb700 1 -- 172.21.15.136:0/3783106510 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c00ee50 con 0x7f1f900b51d0 2023-06-23T19:02:40.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f900b5b10 con 0x7f1f900b51d0 2023-06-23T19:02:40.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.077+0000 7f1f85ffb700 1 -- 172.21.15.136:0/3783106510 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00ca50 con 0x7f1f900b51d0 2023-06-23T19:02:40.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.078+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f900b60d0 con 0x7f1f900b51d0 2023-06-23T19:02:40.087 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.078+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9004ea20 con 0x7f1f900b51d0 2023-06-23T19:02:40.088 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.080+0000 7f1f85ffb700 1 -- 172.21.15.136:0/3783106510 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f8c00cbb0 con 0x7f1f900b51d0 2023-06-23T19:02:40.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.081+0000 7f1f85ffb700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.081+0000 7f1f85ffb700 1 -- 172.21.15.136:0/3783106510 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1f8c089330 con 0x7f1f900b51d0 2023-06-23T19:02:40.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.081+0000 7f1f94f9a700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.082+0000 7f1f94f9a700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009b60 tx=0x7f1f80009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:40.089 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.085+0000 7f1f85ffb700 1 -- 172.21.15.136:0/3783106510 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f8c057fe0 con 0x7f1f900b51d0 2023-06-23T19:02:40.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.281+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f900b6440 con 0x7f1f900b51d0 2023-06-23T19:02:40.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.282+0000 7f1f85ffb700 1 -- 172.21.15.136:0/3783106510 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f8c00ce60 con 0x7f1f900b51d0 2023-06-23T19:02:40.286 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-23T19:02:40.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 msgr2=0x7f1f7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009b60 tx=0x7f1f80009210 comp rx=0 tx=0).stop 2023-06-23T19:02:40.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900b51d0 msgr2=0x7f1f901f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900b51d0 0x7f1f901f4780 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00e9b0 tx=0x7f1f8c00ecc0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 shutdown_connections 2023-06-23T19:02:40.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1f7406ace0 0x7f1f7406d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f900d0e30 0x7f1f900b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f900b51d0 0x7f1f901f4780 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 --2- 172.21.15.136:0/3783106510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f900d0a60 0x7f1f900b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 >> 172.21.15.136:0/3783106510 conn(0x7f1f90071620 msgr2=0x7f1f900b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:40.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 shutdown_connections 2023-06-23T19:02:40.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.284+0000 7f1f979ff700 1 -- 172.21.15.136:0/3783106510 wait complete. 2023-06-23T19:02:40.306 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-23T19:02:40.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.495+0000 7ff7cddff700 1 Processor -- start 2023-06-23T19:02:40.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.496+0000 7ff7cddff700 1 -- start start 2023-06-23T19:02:40.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.497+0000 7ff7cddff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff7c815c570 0x7ff7c80cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.497+0000 7ff7cddff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c8160e70 con 0x7ff7c80cd660 2023-06-23T19:02:40.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.497+0000 7ff7cddff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c81610a0 con 0x7ff7c8160a50 2023-06-23T19:02:40.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.497+0000 7ff7cddff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c815d670 con 0x7ff7c815c570 2023-06-23T19:02:40.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.497+0000 7ff7c6ffd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff7c80cd660 0x7ff7c8160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37430/0 (socket says 172.21.15.136:37430) 2023-06-23T19:02:40.501 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.497+0000 7ff7c6ffd700 1 -- 172.21.15.136:0/771121917 learned_addr learned my addr 172.21.15.136:0/771121917 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:40.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.497+0000 7ff7c77fe700 1 --2- 172.21.15.136:0/771121917 >> v2:172.21.15.178:3300/0 conn(0x7ff7c815c570 0x7ff7c80cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.497+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856371974 0 0) 0x7ff7c8160e70 con 0x7ff7c80cd660 2023-06-23T19:02:40.502 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.497+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b00035b0 con 0x7ff7c80cd660 2023-06-23T19:02:40.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 827988889 0 0) 0x7ff7b00035b0 con 0x7ff7c80cd660 2023-06-23T19:02:40.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 >> v2:172.21.15.178:3300/0 conn(0x7ff7c815c570 msgr2=0x7ff7c80cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:40.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 --2- 172.21.15.136:0/771121917 >> v2:172.21.15.178:3300/0 conn(0x7ff7c815c570 0x7ff7c80cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 >> v1:172.21.15.178:6789/0 conn(0x7ff7c8160a50 legacy=0x7ff7c80d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c815da90 con 0x7ff7c80cd660 2023-06-23T19:02:40.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7ff7bc001670 con 0x7ff7c80cd660 2023-06-23T19:02:40.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 >> v1:172.21.15.136:6789/0 conn(0x7ff7c80cd660 legacy=0x7ff7c8160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0003a50 0x7ff7b0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7b0004850 0x7ff7b0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7b0005200 0x7ff7b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c815d670 con 0x7ff7b0005200 2023-06-23T19:02:40.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b000c0e0 con 0x7ff7b0004850 2023-06-23T19:02:40.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b000c2a0 con 0x7ff7b0003a50 2023-06-23T19:02:40.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c7fff700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7b0005200 0x7ff7b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c6ffd700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7b0004850 0x7ff7b0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c77fe700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0003a50 0x7ff7b0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c7fff700 1 -- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0003a50 msgr2=0x7ff7b0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:40.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c7fff700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0003a50 0x7ff7b0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c7fff700 1 -- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7b0004850 msgr2=0x7ff7b0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:40.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c7fff700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7b0004850 0x7ff7b0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c7fff700 1 -- 172.21.15.136:0/771121917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b00035b0 con 0x7ff7b0005200 2023-06-23T19:02:40.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c6ffd700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7b0004850 0x7ff7b0004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:40.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.498+0000 7ff7c77fe700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0003a50 0x7ff7b0003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:40.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.499+0000 7ff7c7fff700 1 -- 172.21.15.136:0/771121917 reap_dead start 2023-06-23T19:02:40.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.499+0000 7ff7c7fff700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7b0005200 0x7ff7b000ba10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c160 tx=0x7ff7b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5bbfacc59c64c1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:40.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.499+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0001db0 con 0x7ff7b0005200 2023-06-23T19:02:40.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.499+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000cca0 con 0x7ff7b0005200 2023-06-23T19:02:40.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.499+0000 7ff7c67fc700 1 -- 172.21.15.136:0/771121917 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0003c00 con 0x7ff7b0005200 2023-06-23T19:02:40.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.499+0000 7ff7cddff700 1 -- 172.21.15.136:0/771121917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7b0005200 msgr2=0x7ff7b000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.499+0000 7ff7cddff700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7b0005200 0x7ff7b000ba10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c160 tx=0x7ff7b0005880 comp rx=0 tx=0).stop 2023-06-23T19:02:40.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.500+0000 7ff7cddff700 1 -- 172.21.15.136:0/771121917 shutdown_connections 2023-06-23T19:02:40.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.500+0000 7ff7cddff700 1 --2- 172.21.15.136:0/771121917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7b0005200 0x7ff7b000ba10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.500+0000 7ff7cddff700 1 -- 172.21.15.136:0/771121917 >> 172.21.15.136:0/771121917 conn(0x7ff7c8071620 msgr2=0x7ff7c80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:40.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.500+0000 7ff7cddff700 1 -- 172.21.15.136:0/771121917 shutdown_connections 2023-06-23T19:02:40.509 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.500+0000 7ff7cddff700 1 -- 172.21.15.136:0/771121917 wait complete. 2023-06-23T19:02:40.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.501+0000 7ff7cddff700 1 Processor -- start 2023-06-23T19:02:40.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.502+0000 7ff7cddff700 1 -- start start 2023-06-23T19:02:40.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.502+0000 7ff7cddff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0005200 0x7ff7c814f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.502+0000 7ff7cddff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c8150030 0x7ff7c80b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.502+0000 7ff7cddff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7c80b68b0 0x7ff7c80b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.502+0000 7ff7cddff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80c69b0 con 0x7ff7c8150030 2023-06-23T19:02:40.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.502+0000 7ff7cddff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80b7990 con 0x7ff7c80b68b0 2023-06-23T19:02:40.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.502+0000 7ff7cddff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80b6d80 con 0x7ff7b0005200 2023-06-23T19:02:40.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c8150030 0x7ff7c80b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c8150030 0x7ff7c80b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59086/0 (socket says 172.21.15.136:59086) 2023-06-23T19:02:40.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c6ffd700 1 -- 172.21.15.136:0/2363077436 learned_addr learned my addr 172.21.15.136:0/2363077436 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:40.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c77fe700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0005200 0x7ff7c814f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c7fff700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7c80b68b0 0x7ff7c80b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c6ffd700 1 -- 172.21.15.136:0/2363077436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0005200 msgr2=0x7ff7c814f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c6ffd700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0005200 0x7ff7c814f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c6ffd700 1 -- 172.21.15.136:0/2363077436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7c80b68b0 msgr2=0x7ff7c80b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c6ffd700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7c80b68b0 0x7ff7c80b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c6ffd700 1 -- 172.21.15.136:0/2363077436 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80b7060 con 0x7ff7c8150030 2023-06-23T19:02:40.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.503+0000 7ff7c6ffd700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c8150030 0x7ff7c80b6370 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e800 tx=0x7ff7bc00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:40.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.504+0000 7ff7affff700 1 -- 172.21.15.136:0/2363077436 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc012590 con 0x7ff7c8150030 2023-06-23T19:02:40.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.504+0000 7ff7affff700 1 -- 172.21.15.136:0/2363077436 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc0126f0 con 0x7ff7c8150030 2023-06-23T19:02:40.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.504+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c80b7340 con 0x7ff7c8150030 2023-06-23T19:02:40.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.504+0000 7ff7affff700 1 -- 172.21.15.136:0/2363077436 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc012a60 con 0x7ff7c8150030 2023-06-23T19:02:40.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.504+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c80b40f0 con 0x7ff7c8150030 2023-06-23T19:02:40.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.505+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c8073910 con 0x7ff7c8150030 2023-06-23T19:02:40.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.506+0000 7ff7affff700 1 -- 172.21.15.136:0/2363077436 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7bc012bc0 con 0x7ff7c8150030 2023-06-23T19:02:40.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.506+0000 7ff7affff700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff7b406ace0 0x7ff7b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.507+0000 7ff7affff700 1 -- 172.21.15.136:0/2363077436 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff7bc089020 con 0x7ff7c8150030 2023-06-23T19:02:40.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.507+0000 7ff7c77fe700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff7b406ace0 0x7ff7b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.507+0000 7ff7c77fe700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff7b406ace0 0x7ff7b406d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009a90 tx=0x7ff7b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:40.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.511+0000 7ff7affff700 1 -- 172.21.15.136:0/2363077436 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff7bc057d70 con 0x7ff7c8150030 2023-06-23T19:02:40.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.712+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff7c80b5360 con 0x7ff7c8150030 2023-06-23T19:02:40.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.712+0000 7ff7affff700 1 -- 172.21.15.136:0/2363077436 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff7bc001b30 con 0x7ff7c8150030 2023-06-23T19:02:40.717 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:40.717 INFO:teuthology.orchestra.run.smithi136.stdout:[ 2023-06-23T19:02:40.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:40.718 INFO:teuthology.orchestra.run.smithi136.stdout: "poolnum": 1, 2023-06-23T19:02:40.718 INFO:teuthology.orchestra.run.smithi136.stdout: "poolname": ".mgr" 2023-06-23T19:02:40.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2023-06-23T19:02:40.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2023-06-23T19:02:40.718 INFO:teuthology.orchestra.run.smithi136.stdout: "poolnum": 2, 2023-06-23T19:02:40.718 INFO:teuthology.orchestra.run.smithi136.stdout: "poolname": "rbd" 2023-06-23T19:02:40.718 INFO:teuthology.orchestra.run.smithi136.stdout: } 2023-06-23T19:02:40.719 INFO:teuthology.orchestra.run.smithi136.stdout:] 2023-06-23T19:02:40.719 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff7b406ace0 msgr2=0x7ff7b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff7b406ace0 0x7ff7b406d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009a90 tx=0x7ff7b8008040 comp rx=0 tx=0).stop 2023-06-23T19:02:40.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c8150030 msgr2=0x7ff7c80b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c8150030 0x7ff7c80b6370 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e800 tx=0x7ff7bc00ebc0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 shutdown_connections 2023-06-23T19:02:40.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7ff7b406ace0 0x7ff7b406d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7c80b68b0 0x7ff7c80b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7b0005200 0x7ff7c814f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 --2- 172.21.15.136:0/2363077436 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c8150030 0x7ff7c80b6370 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 >> 172.21.15.136:0/2363077436 conn(0x7ff7c8071620 msgr2=0x7ff7c815ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:40.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 shutdown_connections 2023-06-23T19:02:40.721 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.715+0000 7ff7cddff700 1 -- 172.21.15.136:0/2363077436 wait complete. 2023-06-23T19:02:40.737 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-23T19:02:40.737 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.931+0000 7f59c91ff700 1 Processor -- start 2023-06-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.931+0000 7f59c91ff700 1 -- start start 2023-06-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.932+0000 7f59c91ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f59c40d0a60 0x7f59c40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.932+0000 7f59c91ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f59c40b51d0 0x7f59c40cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.932+0000 7f59c91ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c40cd9d0 con 0x7f59c40d0e30 2023-06-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.932+0000 7f59c91ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40d0060 con 0x7f59c40b51d0 2023-06-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.932+0000 7f59c91ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40cfe50 con 0x7f59c40d0a60 2023-06-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c259c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f59c40b51d0 0x7f59c40cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c359e700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f59c40d0e30 0x7f59c40d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37440/0 (socket says 172.21.15.136:37440) 2023-06-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c359e700 1 -- 172.21.15.136:0/37408950 learned_addr learned my addr 172.21.15.136:0/37408950 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c2d9d700 1 --2- 172.21.15.136:0/37408950 >> v2:172.21.15.178:3300/0 conn(0x7f59c40d0a60 0x7f59c40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c1d9b700 1 -- 172.21.15.136:0/37408950 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693407126 0 0) 0x7f59c40cd9d0 con 0x7f59c40d0e30 2023-06-23T19:02:40.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c259c700 1 -- 172.21.15.136:0/37408950 >> v2:172.21.15.178:3300/0 conn(0x7f59c40d0a60 msgr2=0x7f59c40b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:40.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c259c700 1 --2- 172.21.15.136:0/37408950 >> v2:172.21.15.178:3300/0 conn(0x7f59c40d0a60 0x7f59c40b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c259c700 1 -- 172.21.15.136:0/37408950 >> v1:172.21.15.136:6789/0 conn(0x7f59c40d0e30 legacy=0x7f59c40d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c259c700 1 -- 172.21.15.136:0/37408950 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40b5620 con 0x7f59c40b51d0 2023-06-23T19:02:40.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c2d9d700 1 --2- 172.21.15.136:0/37408950 >> v2:172.21.15.178:3300/0 conn(0x7f59c40d0a60 0x7f59c40b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:40.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.933+0000 7f59c259c700 1 --2- 172.21.15.136:0/37408950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40b51d0 0x7f59c40cf910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f59c406c6e0 tx=0x7f59b8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6222ce55ada7121f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:40.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c1d9b700 1 -- 172.21.15.136:0/37408950 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8011830 con 0x7f59c40b51d0 2023-06-23T19:02:40.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c1d9b700 1 -- 172.21.15.136:0/37408950 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8011990 con 0x7f59c40b51d0 2023-06-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c1d9b700 1 -- 172.21.15.136:0/37408950 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8011d20 con 0x7f59c40b51d0 2023-06-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c91ff700 1 -- 172.21.15.136:0/37408950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40b51d0 msgr2=0x7f59c40cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c91ff700 1 --2- 172.21.15.136:0/37408950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40b51d0 0x7f59c40cf910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f59c406c6e0 tx=0x7f59b8009b20 comp rx=0 tx=0).stop 2023-06-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c91ff700 1 -- 172.21.15.136:0/37408950 shutdown_connections 2023-06-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c91ff700 1 --2- 172.21.15.136:0/37408950 >> v2:172.21.15.178:3300/0 conn(0x7f59c40d0a60 0x7f59c40b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c91ff700 1 --2- 172.21.15.136:0/37408950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40b51d0 0x7f59c40cf910 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c91ff700 1 -- 172.21.15.136:0/37408950 >> 172.21.15.136:0/37408950 conn(0x7f59c4071620 msgr2=0x7f59c40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c91ff700 1 -- 172.21.15.136:0/37408950 shutdown_connections 2023-06-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.934+0000 7f59c91ff700 1 -- 172.21.15.136:0/37408950 wait complete. 2023-06-23T19:02:40.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.936+0000 7f59c91ff700 1 Processor -- start 2023-06-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.936+0000 7f59c91ff700 1 -- start start 2023-06-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.937+0000 7f59c91ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c40b51d0 0x7f59c4150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.937+0000 7f59c91ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40d0a60 0x7f59c40cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.937+0000 7f59c91ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c40d0e30 0x7f59c40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.937+0000 7f59c91ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40c7040 con 0x7f59c40d0a60 2023-06-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.937+0000 7f59c91ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40c6730 con 0x7f59c40b51d0 2023-06-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.937+0000 7f59c91ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4150f60 con 0x7f59c40d0e30 2023-06-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.937+0000 7f59c259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40d0a60 0x7f59c40cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.937+0000 7f59c259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40d0a60 0x7f59c40cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59102/0 (socket says 172.21.15.136:59102) 2023-06-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.937+0000 7f59c259c700 1 -- 172.21.15.136:0/2494677352 learned_addr learned my addr 172.21.15.136:0/2494677352 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c2d9d700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c40b51d0 0x7f59c4150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c359e700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c40d0e30 0x7f59c40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c259c700 1 -- 172.21.15.136:0/2494677352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c40d0e30 msgr2=0x7f59c40cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c259c700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c40d0e30 0x7f59c40cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c259c700 1 -- 172.21.15.136:0/2494677352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c40b51d0 msgr2=0x7f59c4150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c259c700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c40b51d0 0x7f59c4150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c259c700 1 -- 172.21.15.136:0/2494677352 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80094a0 con 0x7f59c40d0a60 2023-06-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c359e700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c40d0e30 0x7f59c40cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c259c700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40d0a60 0x7f59c40cbec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f59c40d3d20 tx=0x7f59b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59ab7fe700 1 -- 172.21.15.136:0/2494677352 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80038a0 con 0x7f59c40d0a60 2023-06-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59ab7fe700 1 -- 172.21.15.136:0/2494677352 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b801f070 con 0x7f59c40d0a60 2023-06-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c415d7d0 con 0x7f59c40d0a60 2023-06-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.938+0000 7f59ab7fe700 1 -- 172.21.15.136:0/2494677352 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8003c20 con 0x7f59c40d0a60 2023-06-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.939+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c40c6c60 con 0x7f59c40d0a60 2023-06-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.939+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c404ea20 con 0x7f59c40d0a60 2023-06-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.940+0000 7f59ab7fe700 1 -- 172.21.15.136:0/2494677352 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59b801a430 con 0x7f59c40d0a60 2023-06-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.941+0000 7f59ab7fe700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f59b006ace0 0x7f59b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.941+0000 7f59ab7fe700 1 -- 172.21.15.136:0/2494677352 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f59b8021070 con 0x7f59c40d0a60 2023-06-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.942+0000 7f59c2d9d700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f59b006ace0 0x7f59b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.942+0000 7f59c2d9d700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f59b006ace0 0x7f59b006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f59c4151790 tx=0x7f59b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:40.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:40.946+0000 7f59ab7fe700 1 -- 172.21.15.136:0/2494677352 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59b8055ee0 con 0x7f59c40d0a60 2023-06-23T19:02:41.149 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.146+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f59c406a2b0 con 0x7f59c40d0a60 2023-06-23T19:02:41.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.865+0000 7f59ab7fe700 1 -- 172.21.15.136:0/2494677352 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f59b80150b0 con 0x7f59c40d0a60 2023-06-23T19:02:41.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f59b006ace0 msgr2=0x7f59b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:41.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f59b006ace0 0x7f59b006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f59c4151790 tx=0x7f59b4008040 comp rx=0 tx=0).stop 2023-06-23T19:02:41.875 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40d0a60 msgr2=0x7f59c40cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:41.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40d0a60 0x7f59c40cbec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f59c40d3d20 tx=0x7f59b8004750 comp rx=0 tx=0).stop 2023-06-23T19:02:41.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 shutdown_connections 2023-06-23T19:02:41.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f59b006ace0 0x7f59b006d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:41.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c40b51d0 0x7f59c4150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:41.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c40d0e30 0x7f59c40cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:41.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 --2- 172.21.15.136:0/2494677352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c40d0a60 0x7f59c40cbec0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:41.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.871+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 >> 172.21.15.136:0/2494677352 conn(0x7f59c4071620 msgr2=0x7f59c40b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:41.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.872+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 shutdown_connections 2023-06-23T19:02:41.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:41.872+0000 7f59c91ff700 1 -- 172.21.15.136:0/2494677352 wait complete. 2023-06-23T19:02:41.877 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_metadata' created 2023-06-23T19:02:41.898 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-23T19:02:42.102 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.099+0000 7f52c67ff700 1 Processor -- start 2023-06-23T19:02:42.103 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.099+0000 7f52c67ff700 1 -- start start 2023-06-23T19:02:42.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.100+0000 7f52c67ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f52c00b1fe0 0x7f52c00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:42.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.100+0000 7f52c67ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cfc00 0x7f52c00b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:42.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.100+0000 7f52c67ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00d1320 con 0x7f52c00cd6c0 2023-06-23T19:02:42.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.100+0000 7f52c67ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c00b5c90 con 0x7f52c00b1fe0 2023-06-23T19:02:42.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.100+0000 7f52c67ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00b5980 con 0x7f52c00cfc00 2023-06-23T19:02:42.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.101+0000 7f52c4d9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cfc00 0x7f52c00b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:42.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.101+0000 7f52c4d9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cfc00 0x7f52c00b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:51624/0 (socket says 172.21.15.136:51624) 2023-06-23T19:02:42.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.101+0000 7f52c4d9c700 1 -- 172.21.15.136:0/546073112 learned_addr learned my addr 172.21.15.136:0/546073112 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:42.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.101+0000 7f52bffff700 1 --2- 172.21.15.136:0/546073112 >> v2:172.21.15.178:3300/0 conn(0x7f52c00b1fe0 0x7f52c00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:42.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.101+0000 7f52bffff700 1 -- 172.21.15.136:0/546073112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cfc00 msgr2=0x7f52c00b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:42.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.101+0000 7f52bffff700 1 --2- 172.21.15.136:0/546073112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cfc00 0x7f52c00b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.101+0000 7f52bffff700 1 -- 172.21.15.136:0/546073112 >> v1:172.21.15.178:6789/0 conn(0x7f52c00cd6c0 legacy=0x7f52c00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:42.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.101+0000 7f52bffff700 1 -- 172.21.15.136:0/546073112 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c00d1600 con 0x7f52c00b1fe0 2023-06-23T19:02:42.108 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.101+0000 7f52c4d9c700 1 --2- 172.21.15.136:0/546073112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cfc00 0x7f52c00b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:42.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.102+0000 7f52bffff700 1 --2- 172.21.15.136:0/546073112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 0x7f52c00cd180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009840 tx=0x7f52b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa1db8be6226707 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:42.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.102+0000 7f52beffd700 1 -- 172.21.15.136:0/546073112 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0011830 con 0x7f52c00b1fe0 2023-06-23T19:02:42.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.102+0000 7f52beffd700 1 -- 172.21.15.136:0/546073112 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0011990 con 0x7f52c00b1fe0 2023-06-23T19:02:42.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.102+0000 7f52beffd700 1 -- 172.21.15.136:0/546073112 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0011d20 con 0x7f52c00b1fe0 2023-06-23T19:02:42.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.103+0000 7f52c67ff700 1 -- 172.21.15.136:0/546073112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 msgr2=0x7f52c00cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:42.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.103+0000 7f52c67ff700 1 --2- 172.21.15.136:0/546073112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 0x7f52c00cd180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009840 tx=0x7f52b0009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:42.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.103+0000 7f52c67ff700 1 -- 172.21.15.136:0/546073112 shutdown_connections 2023-06-23T19:02:42.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.103+0000 7f52c67ff700 1 --2- 172.21.15.136:0/546073112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 0x7f52c00cd180 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.103+0000 7f52c67ff700 1 --2- 172.21.15.136:0/546073112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cfc00 0x7f52c00b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.103+0000 7f52c67ff700 1 -- 172.21.15.136:0/546073112 >> 172.21.15.136:0/546073112 conn(0x7f52c0071620 msgr2=0x7f52c0071a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:42.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.103+0000 7f52c67ff700 1 -- 172.21.15.136:0/546073112 shutdown_connections 2023-06-23T19:02:42.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.103+0000 7f52c67ff700 1 -- 172.21.15.136:0/546073112 wait complete. 2023-06-23T19:02:42.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.104+0000 7f52c67ff700 1 Processor -- start 2023-06-23T19:02:42.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.105+0000 7f52c67ff700 1 -- start start 2023-06-23T19:02:42.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.105+0000 7f52c67ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 0x7f52c01529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:42.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c67ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cd6c0 0x7f52c00cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:42.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c67ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52c00cfc00 0x7f52c00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:42.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c67ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00cc730 con 0x7f52c00cfc00 2023-06-23T19:02:42.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c67ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0152f30 con 0x7f52c00b1fe0 2023-06-23T19:02:42.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c67ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00ca6b0 con 0x7f52c00cd6c0 2023-06-23T19:02:42.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c4d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52c00cfc00 0x7f52c00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:42.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c4d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52c00cfc00 0x7f52c00b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59106/0 (socket says 172.21.15.136:59106) 2023-06-23T19:02:42.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c4d9c700 1 -- 172.21.15.136:0/4105849748 learned_addr learned my addr 172.21.15.136:0/4105849748 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:42.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52bffff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 0x7f52c01529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:42.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52bf7fe700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cd6c0 0x7f52c00cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:42.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c4d9c700 1 -- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cd6c0 msgr2=0x7f52c00cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:42.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c4d9c700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cd6c0 0x7f52c00cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c4d9c700 1 -- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 msgr2=0x7f52c01529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:42.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c4d9c700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 0x7f52c01529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52c4d9c700 1 -- 172.21.15.136:0/4105849748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009b30 con 0x7f52c00cfc00 2023-06-23T19:02:42.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52bf7fe700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cd6c0 0x7f52c00cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:42.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.106+0000 7f52bffff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 0x7f52c01529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:42.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.107+0000 7f52c4d9c700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52c00cfc00 0x7f52c00b4450 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f52b800efc0 tx=0x7f52b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:42.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.107+0000 7f52bcff9700 1 -- 172.21.15.136:0/4105849748 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8018070 con 0x7f52c00cfc00 2023-06-23T19:02:42.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.107+0000 7f52bcff9700 1 -- 172.21.15.136:0/4105849748 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b800f040 con 0x7f52c00cfc00 2023-06-23T19:02:42.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.107+0000 7f52bcff9700 1 -- 172.21.15.136:0/4105849748 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8003c40 con 0x7f52c00cfc00 2023-06-23T19:02:42.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.107+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b00094a0 con 0x7f52c00cfc00 2023-06-23T19:02:42.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.107+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c00cac70 con 0x7f52c00cfc00 2023-06-23T19:02:42.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.108+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c004ea20 con 0x7f52c00cfc00 2023-06-23T19:02:42.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.109+0000 7f52bcff9700 1 -- 172.21.15.136:0/4105849748 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52b800c9f0 con 0x7f52c00cfc00 2023-06-23T19:02:42.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.110+0000 7f52bcff9700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f52ac06ace0 0x7f52ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:42.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.110+0000 7f52bcff9700 1 -- 172.21.15.136:0/4105849748 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f52b8089650 con 0x7f52c00cfc00 2023-06-23T19:02:42.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.110+0000 7f52bffff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f52ac06ace0 0x7f52ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:42.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.111+0000 7f52bffff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f52ac06ace0 0x7f52ac06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52b0000c00 tx=0x7f52b0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:42.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.115+0000 7f52bcff9700 1 -- 172.21.15.136:0/4105849748 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f52b8058220 con 0x7f52c00cfc00 2023-06-23T19:02:42.320 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.316+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f52c00c63e0 con 0x7f52c00cfc00 2023-06-23T19:02:42.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.870+0000 7f52bcff9700 1 -- 172.21.15.136:0/4105849748 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7f52b8057db0 con 0x7f52c00cfc00 2023-06-23T19:02:42.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.874+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f52ac06ace0 msgr2=0x7f52ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:42.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.874+0000 7f52c67ff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f52ac06ace0 0x7f52ac06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52b0000c00 tx=0x7f52b0008030 comp rx=0 tx=0).stop 2023-06-23T19:02:42.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.874+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52c00cfc00 msgr2=0x7f52c00b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:42.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.874+0000 7f52c67ff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52c00cfc00 0x7f52c00b4450 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f52b800efc0 tx=0x7f52b800c3a0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.876+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 shutdown_connections 2023-06-23T19:02:42.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.876+0000 7f52c67ff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f52ac06ace0 0x7f52ac06d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.876+0000 7f52c67ff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52c00b1fe0 0x7f52c01529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.883 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.876+0000 7f52c67ff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52c00cfc00 0x7f52c00b4450 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.883 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.876+0000 7f52c67ff700 1 --2- 172.21.15.136:0/4105849748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52c00cd6c0 0x7f52c00cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:42.883 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.876+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 >> 172.21.15.136:0/4105849748 conn(0x7f52c0071620 msgr2=0x7f52c015cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:42.883 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.876+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 shutdown_connections 2023-06-23T19:02:42.883 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:42.876+0000 7f52c67ff700 1 -- 172.21.15.136:0/4105849748 wait complete. 2023-06-23T19:02:42.884 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data' created 2023-06-23T19:02:42.910 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-23T19:02:43.109 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.105+0000 7f7cdc5ff700 1 Processor -- start 2023-06-23T19:02:43.110 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.106+0000 7f7cdc5ff700 1 -- start start 2023-06-23T19:02:43.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.107+0000 7f7cdc5ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7cd40b5a70 0x7f7cd40b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.107+0000 7f7cdc5ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7cd40cf910 0x7f7cd40d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.107+0000 7f7cdc5ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd40b5ec0 con 0x7f7cd40d0a60 2023-06-23T19:02:43.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.107+0000 7f7cdc5ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd40d0060 con 0x7f7cd40cf910 2023-06-23T19:02:43.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.107+0000 7f7cdc5ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd40cd9d0 con 0x7f7cd40b5a70 2023-06-23T19:02:43.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.107+0000 7f7cdab9c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7cd40cf910 0x7f7cd40d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.107+0000 7f7cda39b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f7cd40d0a60 0x7f7cd40d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37450/0 (socket says 172.21.15.136:37450) 2023-06-23T19:02:43.112 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.107+0000 7f7cda39b700 1 -- 172.21.15.136:0/250637094 learned_addr learned my addr 172.21.15.136:0/250637094 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:43.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.107+0000 7f7cd9b9a700 1 --2- 172.21.15.136:0/250637094 >> v2:172.21.15.178:3300/0 conn(0x7f7cd40b5a70 0x7f7cd40b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.108+0000 7f7cdab9c700 1 -- 172.21.15.136:0/250637094 >> v2:172.21.15.178:3300/0 conn(0x7f7cd40b5a70 msgr2=0x7f7cd40b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:43.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.108+0000 7f7cdab9c700 1 --2- 172.21.15.136:0/250637094 >> v2:172.21.15.178:3300/0 conn(0x7f7cd40b5a70 0x7f7cd40b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.108+0000 7f7cdab9c700 1 -- 172.21.15.136:0/250637094 >> v1:172.21.15.136:6789/0 conn(0x7f7cd40d0a60 legacy=0x7f7cd40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.108+0000 7f7cdab9c700 1 -- 172.21.15.136:0/250637094 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40cd410 con 0x7f7cd40cf910 2023-06-23T19:02:43.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.108+0000 7f7cdab9c700 1 --2- 172.21.15.136:0/250637094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40cf910 0x7f7cd40d2e00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40d07a0 tx=0x7f7ccc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8aeb8742aec88c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:43.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.108+0000 7f7cd9399700 1 -- 172.21.15.136:0/250637094 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00e070 con 0x7f7cd40cf910 2023-06-23T19:02:43.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.108+0000 7f7cd9399700 1 -- 172.21.15.136:0/250637094 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc00bbd0 con 0x7f7cd40cf910 2023-06-23T19:02:43.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.108+0000 7f7cd9399700 1 -- 172.21.15.136:0/250637094 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc012430 con 0x7f7cd40cf910 2023-06-23T19:02:43.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.109+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/250637094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40cf910 msgr2=0x7f7cd40d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.109+0000 7f7cdc5ff700 1 --2- 172.21.15.136:0/250637094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40cf910 0x7f7cd40d2e00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40d07a0 tx=0x7f7ccc00b330 comp rx=0 tx=0).stop 2023-06-23T19:02:43.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.109+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/250637094 shutdown_connections 2023-06-23T19:02:43.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.109+0000 7f7cdc5ff700 1 --2- 172.21.15.136:0/250637094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40cf910 0x7f7cd40d2e00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.109+0000 7f7cdc5ff700 1 --2- 172.21.15.136:0/250637094 >> v2:172.21.15.178:3300/0 conn(0x7f7cd40b5a70 0x7f7cd40b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.109+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/250637094 >> 172.21.15.136:0/250637094 conn(0x7f7cd4071620 msgr2=0x7f7cd40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:43.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.109+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/250637094 shutdown_connections 2023-06-23T19:02:43.115 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.109+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/250637094 wait complete. 2023-06-23T19:02:43.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.111+0000 7f7cdc5ff700 1 Processor -- start 2023-06-23T19:02:43.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.111+0000 7f7cdc5ff700 1 -- start start 2023-06-23T19:02:43.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cdc5ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cd40b5a70 0x7f7cd414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cdc5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cd40cf910 0x7f7cd41f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cdc5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40d0a60 0x7f7cd41f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cdc5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40c8060 con 0x7f7cd40d0a60 2023-06-23T19:02:43.120 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cdc5ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40c74e0 con 0x7f7cd40b5a70 2023-06-23T19:02:43.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cdc5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40c77c0 con 0x7f7cd40cf910 2023-06-23T19:02:43.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cdab9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40d0a60 0x7f7cd41f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cdab9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40d0a60 0x7f7cd41f5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59124/0 (socket says 172.21.15.136:59124) 2023-06-23T19:02:43.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cdab9c700 1 -- 172.21.15.136:0/1309629180 learned_addr learned my addr 172.21.15.136:0/1309629180 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:43.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.112+0000 7f7cda39b700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cd40b5a70 0x7f7cd414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cd9b9a700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cd40cf910 0x7f7cd41f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cdab9c700 1 -- 172.21.15.136:0/1309629180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cd40cf910 msgr2=0x7f7cd41f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cdab9c700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cd40cf910 0x7f7cd41f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cdab9c700 1 -- 172.21.15.136:0/1309629180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cd40b5a70 msgr2=0x7f7cd414afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cdab9c700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cd40b5a70 0x7f7cd414afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cdab9c700 1 -- 172.21.15.136:0/1309629180 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc009a70 con 0x7f7cd40d0a60 2023-06-23T19:02:43.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cd9b9a700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cd40cf910 0x7f7cd41f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:43.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cdab9c700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40d0a60 0x7f7cd41f5ae0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc014040 tx=0x7f7ccc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:43.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7ccaffd700 1 -- 172.21.15.136:0/1309629180 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc012430 con 0x7f7cd40d0a60 2023-06-23T19:02:43.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7ccaffd700 1 -- 172.21.15.136:0/1309629180 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc020070 con 0x7f7cd40d0a60 2023-06-23T19:02:43.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd40c7aa0 con 0x7f7cd40d0a60 2023-06-23T19:02:43.125 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7ccaffd700 1 -- 172.21.15.136:0/1309629180 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc003ea0 con 0x7f7cd40d0a60 2023-06-23T19:02:43.125 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.113+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd414b510 con 0x7f7cd40d0a60 2023-06-23T19:02:43.125 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.114+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd40d3a50 con 0x7f7cd40d0a60 2023-06-23T19:02:43.126 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.116+0000 7f7ccaffd700 1 -- 172.21.15.136:0/1309629180 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ccc004280 con 0x7f7cd40d0a60 2023-06-23T19:02:43.126 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.117+0000 7f7ccaffd700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7cb806ace0 0x7f7cb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.126 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.117+0000 7f7ccaffd700 1 -- 172.21.15.136:0/1309629180 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f7ccc022070 con 0x7f7cd40d0a60 2023-06-23T19:02:43.126 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.117+0000 7f7cda39b700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7cb806ace0 0x7f7cb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.126 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.117+0000 7f7cda39b700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7cb806ace0 0x7f7cb806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0005910 tx=0x7f7cd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:43.127 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.122+0000 7f7ccaffd700 1 -- 172.21.15.136:0/1309629180 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ccc0564f0 con 0x7f7cd40d0a60 2023-06-23T19:02:43.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.361+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7cd404ea20 con 0x7f7cd40d0a60 2023-06-23T19:02:43.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.371+0000 7f7ccaffd700 1 -- 172.21.15.136:0/1309629180 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7ccc059b10 con 0x7f7cd40d0a60 2023-06-23T19:02:43.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.377+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7cb806ace0 msgr2=0x7f7cb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.377+0000 7f7cdc5ff700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7cb806ace0 0x7f7cb806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0005910 tx=0x7f7cd0009040 comp rx=0 tx=0).stop 2023-06-23T19:02:43.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.377+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40d0a60 msgr2=0x7f7cd41f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.377+0000 7f7cdc5ff700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40d0a60 0x7f7cd41f5ae0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc014040 tx=0x7f7ccc004ad0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.379+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 shutdown_connections 2023-06-23T19:02:43.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.379+0000 7f7cdc5ff700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f7cb806ace0 0x7f7cb806d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.379+0000 7f7cdc5ff700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cd40b5a70 0x7f7cd414afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.379+0000 7f7cdc5ff700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cd40d0a60 0x7f7cd41f5ae0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.379+0000 7f7cdc5ff700 1 --2- 172.21.15.136:0/1309629180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cd40cf910 0x7f7cd41f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.379+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 >> 172.21.15.136:0/1309629180 conn(0x7f7cd4071620 msgr2=0x7f7cd40b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:43.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.380+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 shutdown_connections 2023-06-23T19:02:43.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.382+0000 7f7cdc5ff700 1 -- 172.21.15.136:0/1309629180 wait complete. 2023-06-23T19:02:43.395 INFO:teuthology.orchestra.run.smithi136.stderr:new fs with metadata pool 6 and data pool 7 2023-06-23T19:02:43.418 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:43.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.608+0000 7f1de7fff700 1 Processor -- start 2023-06-23T19:02:43.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.608+0000 7f1de7fff700 1 -- start start 2023-06-23T19:02:43.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.609+0000 7f1de7fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1de0158550 0x7f1de006d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.610+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de006d5a0 0x7f1de0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.610+0000 7f1de7fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de006e190 con 0x7f1de006a430 2023-06-23T19:02:43.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.610+0000 7f1de7fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00c8ce0 con 0x7f1de0158550 2023-06-23T19:02:43.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.610+0000 7f1de7fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de006a870 con 0x7f1de006d5a0 2023-06-23T19:02:43.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.610+0000 7f1de659c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f1de006a430 0x7f1de00702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:48428/0 (socket says 172.21.15.136:48428) 2023-06-23T19:02:43.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.610+0000 7f1de559a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de006d5a0 0x7f1de0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.610+0000 7f1de5d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1de0158550 0x7f1de006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.610+0000 7f1de659c700 1 -- 172.21.15.136:0/3934039115 learned_addr learned my addr 172.21.15.136:0/3934039115 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:43.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.611+0000 7f1de559a700 1 -- 172.21.15.136:0/3934039115 >> v2:172.21.15.178:3300/0 conn(0x7f1de0158550 msgr2=0x7f1de006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:43.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.611+0000 7f1de559a700 1 --2- 172.21.15.136:0/3934039115 >> v2:172.21.15.178:3300/0 conn(0x7f1de0158550 0x7f1de006d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.611+0000 7f1de559a700 1 -- 172.21.15.136:0/3934039115 >> v1:172.21.15.178:6789/0 conn(0x7f1de006a430 legacy=0x7f1de00702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.611+0000 7f1de559a700 1 -- 172.21.15.136:0/3934039115 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00ccdc0 con 0x7f1de006d5a0 2023-06-23T19:02:43.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.611+0000 7f1de5d9b700 1 --2- 172.21.15.136:0/3934039115 >> v2:172.21.15.178:3300/0 conn(0x7f1de0158550 0x7f1de006d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:43.616 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.611+0000 7f1de559a700 1 --2- 172.21.15.136:0/3934039115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de006d5a0 0x7f1de0069ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009840 tx=0x7f1dd0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65f66799103eee0f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:43.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de4d99700 1 -- 172.21.15.136:0/3934039115 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000f940 con 0x7f1de006d5a0 2023-06-23T19:02:43.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de4d99700 1 -- 172.21.15.136:0/3934039115 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd000faa0 con 0x7f1de006d5a0 2023-06-23T19:02:43.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de4d99700 1 -- 172.21.15.136:0/3934039115 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000fe30 con 0x7f1de006d5a0 2023-06-23T19:02:43.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de7fff700 1 -- 172.21.15.136:0/3934039115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de006d5a0 msgr2=0x7f1de0069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de7fff700 1 --2- 172.21.15.136:0/3934039115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de006d5a0 0x7f1de0069ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009840 tx=0x7f1dd0009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:43.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de7fff700 1 -- 172.21.15.136:0/3934039115 shutdown_connections 2023-06-23T19:02:43.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de7fff700 1 --2- 172.21.15.136:0/3934039115 >> v2:172.21.15.178:3300/0 conn(0x7f1de0158550 0x7f1de006d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de7fff700 1 --2- 172.21.15.136:0/3934039115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de006d5a0 0x7f1de0069ef0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de7fff700 1 -- 172.21.15.136:0/3934039115 >> 172.21.15.136:0/3934039115 conn(0x7f1de00b0ef0 msgr2=0x7f1de00ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:43.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de7fff700 1 -- 172.21.15.136:0/3934039115 shutdown_connections 2023-06-23T19:02:43.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.612+0000 7f1de7fff700 1 -- 172.21.15.136:0/3934039115 wait complete. 2023-06-23T19:02:43.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.614+0000 7f1de7fff700 1 Processor -- start 2023-06-23T19:02:43.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.614+0000 7f1de7fff700 1 -- start start 2023-06-23T19:02:43.621 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.615+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de006a430 0x7f1de01f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.621 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.615+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1de006d5a0 0x7f1de0156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.621 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.615+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de0158550 0x7f1de01e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.621 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.615+0000 7f1de7fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0157f80 con 0x7f1de006d5a0 2023-06-23T19:02:43.621 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.615+0000 7f1de7fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00c6c70 con 0x7f1de006a430 2023-06-23T19:02:43.621 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.615+0000 7f1de7fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00c6f50 con 0x7f1de0158550 2023-06-23T19:02:43.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.615+0000 7f1de559a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1de006d5a0 0x7f1de0156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.615+0000 7f1de559a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1de006d5a0 0x7f1de0156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59130/0 (socket says 172.21.15.136:59130) 2023-06-23T19:02:43.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.615+0000 7f1de559a700 1 -- 172.21.15.136:0/4236117232 learned_addr learned my addr 172.21.15.136:0/4236117232 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:43.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de5d9b700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de006a430 0x7f1de01f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de659c700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de0158550 0x7f1de01e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de559a700 1 -- 172.21.15.136:0/4236117232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de0158550 msgr2=0x7f1de01e7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de559a700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de0158550 0x7f1de01e7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de559a700 1 -- 172.21.15.136:0/4236117232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de006a430 msgr2=0x7f1de01f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de559a700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de006a430 0x7f1de01f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de559a700 1 -- 172.21.15.136:0/4236117232 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0094a0 con 0x7f1de006d5a0 2023-06-23T19:02:43.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de559a700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1de006d5a0 0x7f1de0156fd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0019040 tx=0x7f1dd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:43.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1dd67fc700 1 -- 172.21.15.136:0/4236117232 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00038a0 con 0x7f1de006d5a0 2023-06-23T19:02:43.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1dd67fc700 1 -- 172.21.15.136:0/4236117232 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd0003a00 con 0x7f1de006d5a0 2023-06-23T19:02:43.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd00094a0 con 0x7f1de006d5a0 2023-06-23T19:02:43.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1dd67fc700 1 -- 172.21.15.136:0/4236117232 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0003d70 con 0x7f1de006d5a0 2023-06-23T19:02:43.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.616+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de00c7510 con 0x7f1de006d5a0 2023-06-23T19:02:43.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.618+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de0073910 con 0x7f1de006d5a0 2023-06-23T19:02:43.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.619+0000 7f1dd67fc700 1 -- 172.21.15.136:0/4236117232 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1dd0017420 con 0x7f1de006d5a0 2023-06-23T19:02:43.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.620+0000 7f1dd67fc700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1dc406ace0 0x7f1dc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:43.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.620+0000 7f1dd67fc700 1 -- 172.21.15.136:0/4236117232 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1dd0013070 con 0x7f1de006d5a0 2023-06-23T19:02:43.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.620+0000 7f1de5d9b700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1dc406ace0 0x7f1dc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:43.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.620+0000 7f1de5d9b700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1dc406ace0 0x7f1dc406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1de00cbe00 tx=0x7f1ddc009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:43.628 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.624+0000 7f1dd67fc700 1 -- 172.21.15.136:0/4236117232 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1dd0056250 con 0x7f1de006d5a0 2023-06-23T19:02:43.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.822+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1de0157510 con 0x7f1de006d5a0 2023-06-23T19:02:43.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.823+0000 7f1dd67fc700 1 -- 172.21.15.136:0/4236117232 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18537 (secure 0 0 0) 0x7f1dd0059870 con 0x7f1de006d5a0 2023-06-23T19:02:43.827 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:43.827 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":43,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:02:43.363181+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:02:41.186859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-23T19:02:42.355631+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:43.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1dc406ace0 msgr2=0x7f1dc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1dc406ace0 0x7f1dc406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1de00cbe00 tx=0x7f1ddc009210 comp rx=0 tx=0).stop 2023-06-23T19:02:43.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1de006d5a0 msgr2=0x7f1de0156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:43.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1de006d5a0 0x7f1de0156fd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0019040 tx=0x7f1dd0004750 comp rx=0 tx=0).stop 2023-06-23T19:02:43.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 shutdown_connections 2023-06-23T19:02:43.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1dc406ace0 0x7f1dc406d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de006a430 0x7f1de01f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de0158550 0x7f1de01e7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 --2- 172.21.15.136:0/4236117232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1de006d5a0 0x7f1de0156fd0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:43.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.825+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 >> 172.21.15.136:0/4236117232 conn(0x7f1de00b0ef0 msgr2=0x7f1de00abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:43.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.826+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 shutdown_connections 2023-06-23T19:02:43.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:43.826+0000 7f1de7fff700 1 -- 172.21.15.136:0/4236117232 wait complete. 2023-06-23T19:02:43.849 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:44.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.041+0000 7fd0dc5ff700 1 Processor -- start 2023-06-23T19:02:44.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.041+0000 7fd0dc5ff700 1 -- start start 2023-06-23T19:02:44.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.042+0000 7fd0dc5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d415c570 0x7fd0d40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.042+0000 7fd0dc5ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd0d40cd660 0x7fd0d4160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.042+0000 7fd0dc5ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d41610a0 con 0x7fd0d4160880 2023-06-23T19:02:44.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.042+0000 7fd0dc5ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d415d670 con 0x7fd0d40cd660 2023-06-23T19:02:44.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.042+0000 7fd0dc5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d40cdad0 con 0x7fd0d415c570 2023-06-23T19:02:44.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0dab9c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd0d4160880 0x7fd0d406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37460/0 (socket says 172.21.15.136:37460) 2023-06-23T19:02:44.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0dab9c700 1 -- 172.21.15.136:0/700150357 learned_addr learned my addr 172.21.15.136:0/700150357 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:44.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0d9b9a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd0d40cd660 0x7fd0d4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0da39b700 1 --2- 172.21.15.136:0/700150357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d415c570 0x7fd0d40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0d9b9a700 1 -- 172.21.15.136:0/700150357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d415c570 msgr2=0x7fd0d40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:44.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0d9b9a700 1 --2- 172.21.15.136:0/700150357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d415c570 0x7fd0d40cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0d9b9a700 1 -- 172.21.15.136:0/700150357 >> v1:172.21.15.136:6789/0 conn(0x7fd0d4160880 legacy=0x7fd0d406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0d9b9a700 1 -- 172.21.15.136:0/700150357 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d415da90 con 0x7fd0d40cd660 2023-06-23T19:02:44.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0d9399700 1 -- 172.21.15.136:0/700150357 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702117331 0 0) 0x7fd0d41610a0 con 0x7fd0d4160880 2023-06-23T19:02:44.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0da39b700 1 --2- 172.21.15.136:0/700150357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d415c570 0x7fd0d40cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:44.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0d9b9a700 1 --2- 172.21.15.136:0/700150357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d40cd660 0x7fd0d4160340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009870 tx=0x7fd0c4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f78bdc9c2089fc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:44.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.043+0000 7fd0d9399700 1 -- 172.21.15.136:0/700150357 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4011830 con 0x7fd0d40cd660 2023-06-23T19:02:44.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0d9399700 1 -- 172.21.15.136:0/700150357 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c4011990 con 0x7fd0d40cd660 2023-06-23T19:02:44.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0d9399700 1 -- 172.21.15.136:0/700150357 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4011d20 con 0x7fd0d40cd660 2023-06-23T19:02:44.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/700150357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d40cd660 msgr2=0x7fd0d4160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0dc5ff700 1 --2- 172.21.15.136:0/700150357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d40cd660 0x7fd0d4160340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009870 tx=0x7fd0c4009b80 comp rx=0 tx=0).stop 2023-06-23T19:02:44.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/700150357 shutdown_connections 2023-06-23T19:02:44.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0dc5ff700 1 --2- 172.21.15.136:0/700150357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d415c570 0x7fd0d40cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0dc5ff700 1 --2- 172.21.15.136:0/700150357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d40cd660 0x7fd0d4160340 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/700150357 >> 172.21.15.136:0/700150357 conn(0x7fd0d4071620 msgr2=0x7fd0d40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:44.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/700150357 shutdown_connections 2023-06-23T19:02:44.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.044+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/700150357 wait complete. 2023-06-23T19:02:44.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.047+0000 7fd0dc5ff700 1 Processor -- start 2023-06-23T19:02:44.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.047+0000 7fd0dc5ff700 1 -- start start 2023-06-23T19:02:44.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0dc5ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d40cd660 0x7fd0d4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0dc5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d415c570 0x7fd0d40cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0dc5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d4160880 0x7fd0d40b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0dc5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d40b6b80 con 0x7fd0d415c570 2023-06-23T19:02:44.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0dc5ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d40b66f0 con 0x7fd0d40cd660 2023-06-23T19:02:44.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0dc5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d40b5ae0 con 0x7fd0d4160880 2023-06-23T19:02:44.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0d9b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d415c570 0x7fd0d40cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.054 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0d9b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d415c570 0x7fd0d40cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59152/0 (socket says 172.21.15.136:59152) 2023-06-23T19:02:44.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0d9b9a700 1 -- 172.21.15.136:0/3810267351 learned_addr learned my addr 172.21.15.136:0/3810267351 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:44.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0da39b700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d40cd660 0x7fd0d4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.048+0000 7fd0dab9c700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d4160880 0x7fd0d40b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0d9b9a700 1 -- 172.21.15.136:0/3810267351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d4160880 msgr2=0x7fd0d40b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0d9b9a700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d4160880 0x7fd0d40b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0d9b9a700 1 -- 172.21.15.136:0/3810267351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d40cd660 msgr2=0x7fd0d4150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0d9b9a700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d40cd660 0x7fd0d4150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0d9b9a700 1 -- 172.21.15.136:0/3810267351 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c40094a0 con 0x7fd0d415c570 2023-06-23T19:02:44.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0d9b9a700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d415c570 0x7fd0d40cc1f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40097c0 tx=0x7fd0c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:44.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0caffd700 1 -- 172.21.15.136:0/3810267351 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4004510 con 0x7fd0d415c570 2023-06-23T19:02:44.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0caffd700 1 -- 172.21.15.136:0/3810267351 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c401e070 con 0x7fd0d415c570 2023-06-23T19:02:44.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d40b5dc0 con 0x7fd0d415c570 2023-06-23T19:02:44.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0caffd700 1 -- 172.21.15.136:0/3810267351 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40038e0 con 0x7fd0d415c570 2023-06-23T19:02:44.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.049+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d40b6380 con 0x7fd0d415c570 2023-06-23T19:02:44.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.050+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d40b6860 con 0x7fd0d415c570 2023-06-23T19:02:44.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.051+0000 7fd0caffd700 1 -- 172.21.15.136:0/3810267351 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0c4003a40 con 0x7fd0d415c570 2023-06-23T19:02:44.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.052+0000 7fd0caffd700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd0b806ace0 0x7fd0b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.053+0000 7fd0caffd700 1 -- 172.21.15.136:0/3810267351 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd0c408a3f0 con 0x7fd0d415c570 2023-06-23T19:02:44.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.053+0000 7fd0da39b700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd0b806ace0 0x7fd0b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.053+0000 7fd0da39b700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd0b806ace0 0x7fd0b806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00099d0 tx=0x7fd0d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:44.060 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.057+0000 7fd0caffd700 1 -- 172.21.15.136:0/3810267351 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd0c4055350 con 0x7fd0d415c570 2023-06-23T19:02:44.260 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.257+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0d4073910 con 0x7fd0d415c570 2023-06-23T19:02:44.262 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.258+0000 7fd0caffd700 1 -- 172.21.15.136:0/3810267351 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18537 (secure 0 0 0) 0x7fd0c4020090 con 0x7fd0d415c570 2023-06-23T19:02:44.262 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:44.263 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":43,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:02:43.363181+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:02:41.186859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-23T19:02:42.355631+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:44.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd0b806ace0 msgr2=0x7fd0b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd0b806ace0 0x7fd0b806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00099d0 tx=0x7fd0d0008040 comp rx=0 tx=0).stop 2023-06-23T19:02:44.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d415c570 msgr2=0x7fd0d40cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d415c570 0x7fd0d40cc1f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40097c0 tx=0x7fd0c4004750 comp rx=0 tx=0).stop 2023-06-23T19:02:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 shutdown_connections 2023-06-23T19:02:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fd0b806ace0 0x7fd0b806d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d40cd660 0x7fd0d4150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d4160880 0x7fd0d40b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 --2- 172.21.15.136:0/3810267351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0d415c570 0x7fd0d40cc1f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 >> 172.21.15.136:0/3810267351 conn(0x7fd0d4071620 msgr2=0x7fd0d415b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 shutdown_connections 2023-06-23T19:02:44.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.261+0000 7fd0dc5ff700 1 -- 172.21.15.136:0/3810267351 wait complete. 2023-06-23T19:02:44.284 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-23T19:02:44.483 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.479+0000 7efe157ff700 1 Processor -- start 2023-06-23T19:02:44.484 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.479+0000 7efe157ff700 1 -- start start 2023-06-23T19:02:44.485 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe157ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efe100709f0 0x7efe100b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.485 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe157ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe100b2b40 0x7efe1006d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe157ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1006d130 con 0x7efe1015a5a0 2023-06-23T19:02:44.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe157ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe100cf6a0 con 0x7efe100709f0 2023-06-23T19:02:44.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe157ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1006c520 con 0x7efe100b2b40 2023-06-23T19:02:44.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe07fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efe100709f0 0x7efe100b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe07fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efe100709f0 0x7efe100b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59158/0 (socket says 172.21.15.136:59158) 2023-06-23T19:02:44.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe07fff700 1 -- 172.21.15.136:0/1237573957 learned_addr learned my addr 172.21.15.136:0/1237573957 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:44.486 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe0f7fe700 1 --2- 172.21.15.136:0/1237573957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe100b2b40 0x7efe1006d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.487 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe07fff700 1 -- 172.21.15.136:0/1237573957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe100b2b40 msgr2=0x7efe1006d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:44.487 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe07fff700 1 --2- 172.21.15.136:0/1237573957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe100b2b40 0x7efe1006d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.487 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe07fff700 1 -- 172.21.15.136:0/1237573957 >> v1:172.21.15.178:6789/0 conn(0x7efe1015a5a0 legacy=0x7efe100702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.487 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.481+0000 7efe07fff700 1 -- 172.21.15.136:0/1237573957 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1006c800 con 0x7efe100709f0 2023-06-23T19:02:44.487 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe07fff700 1 --2- 172.21.15.136:0/1237573957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 0x7efe100b4210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efdf80098f0 tx=0x7efdf8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757dedd3e71bfc0b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:44.487 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe0e7fc700 1 -- 172.21.15.136:0/1237573957 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800b8a0 con 0x7efe100709f0 2023-06-23T19:02:44.487 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe0e7fc700 1 -- 172.21.15.136:0/1237573957 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf800ba00 con 0x7efe100709f0 2023-06-23T19:02:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe0e7fc700 1 -- 172.21.15.136:0/1237573957 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800bd90 con 0x7efe100709f0 2023-06-23T19:02:44.490 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe157ff700 1 -- 172.21.15.136:0/1237573957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 msgr2=0x7efe100b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.490 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe157ff700 1 --2- 172.21.15.136:0/1237573957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 0x7efe100b4210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efdf80098f0 tx=0x7efdf8009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:44.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe157ff700 1 -- 172.21.15.136:0/1237573957 shutdown_connections 2023-06-23T19:02:44.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe157ff700 1 --2- 172.21.15.136:0/1237573957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe100b2b40 0x7efe1006d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe157ff700 1 --2- 172.21.15.136:0/1237573957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 0x7efe100b4210 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.482+0000 7efe157ff700 1 -- 172.21.15.136:0/1237573957 >> 172.21.15.136:0/1237573957 conn(0x7efe1006ab80 msgr2=0x7efe100ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:44.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.483+0000 7efe157ff700 1 -- 172.21.15.136:0/1237573957 shutdown_connections 2023-06-23T19:02:44.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.483+0000 7efe157ff700 1 -- 172.21.15.136:0/1237573957 wait complete. 2023-06-23T19:02:44.491 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.484+0000 7efe157ff700 1 Processor -- start 2023-06-23T19:02:44.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.484+0000 7efe157ff700 1 -- start start 2023-06-23T19:02:44.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.485+0000 7efe157ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 0x7efe100ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.485+0000 7efe157ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe100b2b40 0x7efe10148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.485+0000 7efe157ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe1015a5a0 0x7efe1015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.485+0000 7efe157ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe100ca820 con 0x7efe100709f0 2023-06-23T19:02:44.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.485+0000 7efe157ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe100c9e50 con 0x7efe100b2b40 2023-06-23T19:02:44.492 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.485+0000 7efe157ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe100c9240 con 0x7efe1015a5a0 2023-06-23T19:02:44.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 0x7efe100ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 0x7efe100ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59172/0 (socket says 172.21.15.136:59172) 2023-06-23T19:02:44.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0effd700 1 -- 172.21.15.136:0/2164570219 learned_addr learned my addr 172.21.15.136:0/2164570219 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:44.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe07fff700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe100b2b40 0x7efe10148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0f7fe700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe1015a5a0 0x7efe1015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0effd700 1 -- 172.21.15.136:0/2164570219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe1015a5a0 msgr2=0x7efe1015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0effd700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe1015a5a0 0x7efe1015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.493 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0effd700 1 -- 172.21.15.136:0/2164570219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe100b2b40 msgr2=0x7efe10148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:44.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0effd700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe100b2b40 0x7efe10148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:44.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0effd700 1 -- 172.21.15.136:0/2164570219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf8009550 con 0x7efe100709f0 2023-06-23T19:02:44.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe0effd700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 0x7efe100ca2e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c450 tx=0x7efe0000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:44.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.486+0000 7efe077fe700 1 -- 172.21.15.136:0/2164570219 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000052d0 con 0x7efe100709f0 2023-06-23T19:02:44.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.487+0000 7efe077fe700 1 -- 172.21.15.136:0/2164570219 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe00005430 con 0x7efe100709f0 2023-06-23T19:02:44.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.487+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe100c9520 con 0x7efe100709f0 2023-06-23T19:02:44.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.487+0000 7efe077fe700 1 -- 172.21.15.136:0/2164570219 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000038c0 con 0x7efe100709f0 2023-06-23T19:02:44.494 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.487+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe100c9ae0 con 0x7efe100709f0 2023-06-23T19:02:44.495 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.488+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe100ca130 con 0x7efe100709f0 2023-06-23T19:02:44.496 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.489+0000 7efe077fe700 1 -- 172.21.15.136:0/2164570219 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe00003a20 con 0x7efe100709f0 2023-06-23T19:02:44.496 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.489+0000 7efe077fe700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efdf006ace0 0x7efdf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:44.496 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.489+0000 7efe077fe700 1 -- 172.21.15.136:0/2164570219 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efe00088810 con 0x7efe100709f0 2023-06-23T19:02:44.496 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.490+0000 7efe07fff700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efdf006ace0 0x7efdf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:44.496 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.490+0000 7efe07fff700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efdf006ace0 0x7efdf006d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe10070de0 tx=0x7efdf8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:44.498 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.494+0000 7efe077fe700 1 -- 172.21.15.136:0/2164570219 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efe000536f0 con 0x7efe100709f0 2023-06-23T19:02:44.740 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:44.736+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efe1004ea20 con 0x7efe100709f0 2023-06-23T19:02:45.153 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T19:02:45.150+0000 7f11371f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T19:02:45.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.374+0000 7efe077fe700 1 -- 172.21.15.136:0/2164570219 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7efe0000ce60 con 0x7efe100709f0 2023-06-23T19:02:45.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.376+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efdf006ace0 msgr2=0x7efdf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:45.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efdf006ace0 0x7efdf006d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe10070de0 tx=0x7efdf8008030 comp rx=0 tx=0).stop 2023-06-23T19:02:45.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 msgr2=0x7efe100ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:45.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 0x7efe100ca2e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c450 tx=0x7efe0000c760 comp rx=0 tx=0).stop 2023-06-23T19:02:45.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 shutdown_connections 2023-06-23T19:02:45.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7efdf006ace0 0x7efdf006d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe1015a5a0 0x7efe1015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe100709f0 0x7efe100ca2e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 --2- 172.21.15.136:0/2164570219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe100b2b40 0x7efe10148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 >> 172.21.15.136:0/2164570219 conn(0x7efe1006ab80 msgr2=0x7efe100b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:45.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 shutdown_connections 2023-06-23T19:02:45.388 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.377+0000 7efe157ff700 1 -- 172.21.15.136:0/2164570219 wait complete. 2023-06-23T19:02:45.401 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-23T19:02:45.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-23T19:02:45.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.594+0000 7eff3cbff700 1 Processor -- start 2023-06-23T19:02:45.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.595+0000 7eff3cbff700 1 -- start start 2023-06-23T19:02:45.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.596+0000 7eff3cbff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff380b5a70 0x7eff380b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:45.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.596+0000 7eff3cbff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff380b5ec0 con 0x7eff380cf910 2023-06-23T19:02:45.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.596+0000 7eff3cbff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff380cd9d0 con 0x7eff380d0a60 2023-06-23T19:02:45.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.596+0000 7eff3cbff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff380d0060 con 0x7eff380b5a70 2023-06-23T19:02:45.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.596+0000 7eff36d9d700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7eff380cf910 0x7eff380d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53688/0 (socket says 172.21.15.136:53688) 2023-06-23T19:02:45.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.596+0000 7eff36d9d700 1 -- 172.21.15.136:0/463235132 learned_addr learned my addr 172.21.15.136:0/463235132 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:45.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.596+0000 7eff2ffff700 1 --2- 172.21.15.136:0/463235132 >> v2:172.21.15.178:3300/0 conn(0x7eff380b5a70 0x7eff380b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:45.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.596+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662929115 0 0) 0x7eff380b5ec0 con 0x7eff380cf910 2023-06-23T19:02:45.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.596+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff240035b0 con 0x7eff380cf910 2023-06-23T19:02:45.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 81435333 0 0) 0x7eff240035b0 con 0x7eff380cf910 2023-06-23T19:02:45.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 >> v2:172.21.15.178:3300/0 conn(0x7eff380b5a70 msgr2=0x7eff380b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:45.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 --2- 172.21.15.136:0/463235132 >> v2:172.21.15.178:3300/0 conn(0x7eff380b5a70 0x7eff380b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 >> v1:172.21.15.178:6789/0 conn(0x7eff380d0a60 legacy=0x7eff380d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:45.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff380cd410 con 0x7eff380cf910 2023-06-23T19:02:45.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7eff300019f0 con 0x7eff380cf910 2023-06-23T19:02:45.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff2ffff700 1 --2- 172.21.15.136:0/463235132 >> v2:172.21.15.178:3300/0 conn(0x7eff380b5a70 0x7eff380b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:45.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 >> v1:172.21.15.136:6789/0 conn(0x7eff380cf910 legacy=0x7eff380d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:45.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff24003a00 0x7eff24003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:45.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24004850 0x7eff24004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:45.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff24005200 0x7eff2400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:45.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380d0060 con 0x7eff24003a00 2023-06-23T19:02:45.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2400c080 con 0x7eff24005200 2023-06-23T19:02:45.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2400c240 con 0x7eff24004850 2023-06-23T19:02:45.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff3659c700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff24003a00 0x7eff24003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:45.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff2ffff700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24004850 0x7eff24004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:45.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.597+0000 7eff36d9d700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff24005200 0x7eff2400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:45.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff3659c700 1 -- 172.21.15.136:0/463235132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24004850 msgr2=0x7eff24004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:45.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff3659c700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24004850 0x7eff24004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff3659c700 1 -- 172.21.15.136:0/463235132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff24005200 msgr2=0x7eff2400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:45.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff3659c700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff24005200 0x7eff2400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff3659c700 1 -- 172.21.15.136:0/463235132 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff240035b0 con 0x7eff24003a00 2023-06-23T19:02:45.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff36d9d700 1 -- 172.21.15.136:0/463235132 reap_dead start 2023-06-23T19:02:45.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff3659c700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff24003a00 0x7eff24003e10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7eff280017c0 tx=0x7eff24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a207873eb0dd90 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:45.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280052d0 con 0x7eff24003a00 2023-06-23T19:02:45.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff28005430 con 0x7eff24003a00 2023-06-23T19:02:45.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff35d9b700 1 -- 172.21.15.136:0/463235132 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280038c0 con 0x7eff24003a00 2023-06-23T19:02:45.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff3cbff700 1 -- 172.21.15.136:0/463235132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff24003a00 msgr2=0x7eff24003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:45.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.598+0000 7eff3cbff700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff24003a00 0x7eff24003e10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7eff280017c0 tx=0x7eff24005880 comp rx=0 tx=0).stop 2023-06-23T19:02:45.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.599+0000 7eff3cbff700 1 -- 172.21.15.136:0/463235132 shutdown_connections 2023-06-23T19:02:45.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.599+0000 7eff3cbff700 1 --2- 172.21.15.136:0/463235132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff24003a00 0x7eff24003e10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.599+0000 7eff3cbff700 1 -- 172.21.15.136:0/463235132 >> 172.21.15.136:0/463235132 conn(0x7eff38071620 msgr2=0x7eff380719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:45.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.599+0000 7eff3cbff700 1 -- 172.21.15.136:0/463235132 shutdown_connections 2023-06-23T19:02:45.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.599+0000 7eff3cbff700 1 -- 172.21.15.136:0/463235132 wait complete. 2023-06-23T19:02:45.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.601+0000 7eff3cbff700 1 Processor -- start 2023-06-23T19:02:45.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.601+0000 7eff3cbff700 1 -- start start 2023-06-23T19:02:45.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.602+0000 7eff3cbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24003a00 0x7eff380cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:45.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.602+0000 7eff3cbff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff380cc3c0 0x7eff380c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:45.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.602+0000 7eff3cbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff380c6c50 0x7eff3813edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:45.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.602+0000 7eff3cbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380c70c0 con 0x7eff380c6c50 2023-06-23T19:02:45.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.602+0000 7eff3cbff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380cbf30 con 0x7eff380cc3c0 2023-06-23T19:02:45.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.602+0000 7eff3cbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3813fbe0 con 0x7eff24003a00 2023-06-23T19:02:45.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff36d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff380c6c50 0x7eff3813edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:45.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff36d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff380c6c50 0x7eff3813edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55828/0 (socket says 172.21.15.136:55828) 2023-06-23T19:02:45.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff36d9d700 1 -- 172.21.15.136:0/3507456735 learned_addr learned my addr 172.21.15.136:0/3507456735 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:45.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff2ffff700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff380cc3c0 0x7eff380c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:45.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff3659c700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24003a00 0x7eff380cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:45.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff36d9d700 1 -- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24003a00 msgr2=0x7eff380cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:45.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff36d9d700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24003a00 0x7eff380cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff36d9d700 1 -- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff380cc3c0 msgr2=0x7eff380c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:45.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff36d9d700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff380cc3c0 0x7eff380c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:45.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff36d9d700 1 -- 172.21.15.136:0/3507456735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff380cb320 con 0x7eff380c6c50 2023-06-23T19:02:45.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff2ffff700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff380cc3c0 0x7eff380c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:45.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff3659c700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24003a00 0x7eff380cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:45.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff36d9d700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff380c6c50 0x7eff3813edc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff380d3cc0 tx=0x7eff3000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:45.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff2effd700 1 -- 172.21.15.136:0/3507456735 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000ec50 con 0x7eff380c6c50 2023-06-23T19:02:45.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.603+0000 7eff2effd700 1 -- 172.21.15.136:0/3507456735 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3000edb0 con 0x7eff380c6c50 2023-06-23T19:02:45.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.604+0000 7eff2effd700 1 -- 172.21.15.136:0/3507456735 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30013640 con 0x7eff380c6c50 2023-06-23T19:02:45.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.604+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff380cb600 con 0x7eff380c6c50 2023-06-23T19:02:45.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.604+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff380cbbc0 con 0x7eff380c6c50 2023-06-23T19:02:45.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.605+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff380cbd80 con 0x7eff380c6c50 2023-06-23T19:02:45.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.606+0000 7eff2effd700 1 -- 172.21.15.136:0/3507456735 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff300137a0 con 0x7eff380c6c50 2023-06-23T19:02:45.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.606+0000 7eff2effd700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff1806ace0 0x7eff1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:45.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.607+0000 7eff2effd700 1 -- 172.21.15.136:0/3507456735 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7eff30089bc0 con 0x7eff380c6c50 2023-06-23T19:02:45.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.607+0000 7eff3659c700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff1806ace0 0x7eff1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:45.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.607+0000 7eff3659c700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff1806ace0 0x7eff1806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff28015040 tx=0x7eff28009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:45.615 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.611+0000 7eff2effd700 1 -- 172.21.15.136:0/3507456735 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff30054a90 con 0x7eff380c6c50 2023-06-23T19:02:45.854 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:45.850+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7eff380cbd50 con 0x7eff380c6c50 2023-06-23T19:02:46.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.379+0000 7eff2effd700 1 -- 172.21.15.136:0/3507456735 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7eff300580b0 con 0x7eff380c6c50 2023-06-23T19:02:46.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff1806ace0 msgr2=0x7eff1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:46.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff1806ace0 0x7eff1806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff28015040 tx=0x7eff28009030 comp rx=0 tx=0).stop 2023-06-23T19:02:46.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff380c6c50 msgr2=0x7eff3813edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:46.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff380c6c50 0x7eff3813edc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff380d3cc0 tx=0x7eff3000e440 comp rx=0 tx=0).stop 2023-06-23T19:02:46.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 shutdown_connections 2023-06-23T19:02:46.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7eff1806ace0 0x7eff1806d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff380c6c50 0x7eff3813edc0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff24003a00 0x7eff380cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 --2- 172.21.15.136:0/3507456735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff380cc3c0 0x7eff380c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 >> 172.21.15.136:0/3507456735 conn(0x7eff38071620 msgr2=0x7eff380b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:46.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 shutdown_connections 2023-06-23T19:02:46.387 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.382+0000 7eff3cbff700 1 -- 172.21.15.136:0/3507456735 wait complete. 2023-06-23T19:02:46.405 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-23T19:02:46.406 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:02:46.599 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.595+0000 7fa4461ff700 1 Processor -- start 2023-06-23T19:02:46.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.595+0000 7fa4461ff700 1 -- start start 2023-06-23T19:02:46.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.597+0000 7fa4461ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa440160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:46.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.597+0000 7fa4461ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa440160880 0x7fa4400d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:46.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.597+0000 7fa4461ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4401610a0 con 0x7fa44015c570 2023-06-23T19:02:46.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.597+0000 7fa4461ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44015d670 con 0x7fa440160880 2023-06-23T19:02:46.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.597+0000 7fa4461ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44015da90 con 0x7fa4400cd830 2023-06-23T19:02:46.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.597+0000 7fa43effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa440160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:46.602 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.597+0000 7fa43ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa440160880 0x7fa4400d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:46.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.597+0000 7fa43effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa440160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:48574/0 (socket says 172.21.15.136:48574) 2023-06-23T19:02:46.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.597+0000 7fa43effd700 1 -- 172.21.15.136:0/4039929051 learned_addr learned my addr 172.21.15.136:0/4039929051 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:46.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43ffff700 1 -- 172.21.15.136:0/4039929051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 msgr2=0x7fa440160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:46.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43ffff700 1 --2- 172.21.15.136:0/4039929051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa440160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.603 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43ffff700 1 -- 172.21.15.136:0/4039929051 >> v1:172.21.15.178:6789/0 conn(0x7fa44015c570 legacy=0x7fa4400cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:46.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43ffff700 1 -- 172.21.15.136:0/4039929051 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44015ccd0 con 0x7fa440160880 2023-06-23T19:02:46.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43effd700 1 --2- 172.21.15.136:0/4039929051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa440160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:46.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43e7fc700 1 -- 172.21.15.136:0/4039929051 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140252274 0 0) 0x7fa4401610a0 con 0x7fa44015c570 2023-06-23T19:02:46.604 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43ffff700 1 --2- 172.21.15.136:0/4039929051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa440160880 0x7fa4400d0bb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa438009d90 tx=0x7fa43800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aea62b360427dff2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:46.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43e7fc700 1 -- 172.21.15.136:0/4039929051 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43800e070 con 0x7fa440160880 2023-06-23T19:02:46.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43e7fc700 1 -- 172.21.15.136:0/4039929051 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43800bb20 con 0x7fa440160880 2023-06-23T19:02:46.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.598+0000 7fa43e7fc700 1 -- 172.21.15.136:0/4039929051 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438012430 con 0x7fa440160880 2023-06-23T19:02:46.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.599+0000 7fa4461ff700 1 -- 172.21.15.136:0/4039929051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa440160880 msgr2=0x7fa4400d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:46.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.599+0000 7fa4461ff700 1 --2- 172.21.15.136:0/4039929051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa440160880 0x7fa4400d0bb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa438009d90 tx=0x7fa43800b330 comp rx=0 tx=0).stop 2023-06-23T19:02:46.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.599+0000 7fa4461ff700 1 -- 172.21.15.136:0/4039929051 shutdown_connections 2023-06-23T19:02:46.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.599+0000 7fa4461ff700 1 --2- 172.21.15.136:0/4039929051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa440160880 0x7fa4400d0bb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.599+0000 7fa4461ff700 1 --2- 172.21.15.136:0/4039929051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa440160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.599+0000 7fa4461ff700 1 -- 172.21.15.136:0/4039929051 >> 172.21.15.136:0/4039929051 conn(0x7fa440071620 msgr2=0x7fa4400719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:46.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.599+0000 7fa4461ff700 1 -- 172.21.15.136:0/4039929051 shutdown_connections 2023-06-23T19:02:46.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.599+0000 7fa4461ff700 1 -- 172.21.15.136:0/4039929051 wait complete. 2023-06-23T19:02:46.608 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.601+0000 7fa4461ff700 1 Processor -- start 2023-06-23T19:02:46.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.601+0000 7fa4461ff700 1 -- start start 2023-06-23T19:02:46.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa4461ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa4401f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:46.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa4461ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa44015c570 0x7fa4400c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:46.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa4461ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa440160880 0x7fa4400c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:46.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa4461ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44014c660 con 0x7fa440160880 2023-06-23T19:02:46.609 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa4461ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401f62a0 con 0x7fa44015c570 2023-06-23T19:02:46.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa4461ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4400b5b70 con 0x7fa4400cd830 2023-06-23T19:02:46.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa43ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa440160880 0x7fa4400c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:46.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa43ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa440160880 0x7fa4400c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55842/0 (socket says 172.21.15.136:55842) 2023-06-23T19:02:46.610 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa43ffff700 1 -- 172.21.15.136:0/4110866277 learned_addr learned my addr 172.21.15.136:0/4110866277 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:46.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa43f7fe700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa4401f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:46.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.602+0000 7fa43effd700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa44015c570 0x7fa4400c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:46.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa43ffff700 1 -- 172.21.15.136:0/4110866277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 msgr2=0x7fa4401f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:46.611 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa43ffff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa4401f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa43ffff700 1 -- 172.21.15.136:0/4110866277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa44015c570 msgr2=0x7fa4400c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:46.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa43ffff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa44015c570 0x7fa4400c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.612 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa43ffff700 1 -- 172.21.15.136:0/4110866277 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434009550 con 0x7fa440160880 2023-06-23T19:02:46.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa43ffff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa440160880 0x7fa4400c7640 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa43800b680 tx=0x7fa438004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:46.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa427fff700 1 -- 172.21.15.136:0/4110866277 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438012430 con 0x7fa440160880 2023-06-23T19:02:46.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa427fff700 1 -- 172.21.15.136:0/4110866277 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa438020070 con 0x7fa440160880 2023-06-23T19:02:46.613 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa427fff700 1 -- 172.21.15.136:0/4110866277 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438004280 con 0x7fa440160880 2023-06-23T19:02:46.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa438009a70 con 0x7fa440160880 2023-06-23T19:02:46.614 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.603+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4401f5ce0 con 0x7fa440160880 2023-06-23T19:02:46.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.604+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa440073910 con 0x7fa440160880 2023-06-23T19:02:46.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.605+0000 7fa427fff700 1 -- 172.21.15.136:0/4110866277 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa4380043e0 con 0x7fa440160880 2023-06-23T19:02:46.617 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.607+0000 7fa427fff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa42c06ace0 0x7fa42c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:46.618 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.607+0000 7fa427fff700 1 -- 172.21.15.136:0/4110866277 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa438022070 con 0x7fa440160880 2023-06-23T19:02:46.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.607+0000 7fa43f7fe700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa42c06ace0 0x7fa42c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:46.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.608+0000 7fa43f7fe700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa42c06ace0 0x7fa42c06d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa430007fd0 tx=0x7fa430009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:46.619 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.611+0000 7fa427fff700 1 -- 172.21.15.136:0/4110866277 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa4380bd310 con 0x7fa440160880 2023-06-23T19:02:46.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.851+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4400b5cb0 con 0x7fa440160880 2023-06-23T19:02:46.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.852+0000 7fa427fff700 1 -- 172.21.15.136:0/4110866277 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fa438056180 con 0x7fa440160880 2023-06-23T19:02:46.856 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:46.856 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3115197879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":3115197879},{"type":"v1","addr":"172.21.15.136:6837","nonce":3115197879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1648844207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1648844207},{"type":"v1","addr":"172.21.15.178:6835","nonce":1648844207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/1238300343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1238300343},{"type":"v1","addr":"172.21.15.136:6836","nonce":1238300343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:02:43.363636+0000","modified":"2023-06-23T19:02:46.377337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5358":{"gid":5358,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.178:6834/1813513530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1813513530},{"type":"v1","addr":"172.21.15.178:6834","nonce":1813513530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-23T19:02:46.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa42c06ace0 msgr2=0x7fa42c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:46.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa42c06ace0 0x7fa42c06d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa430007fd0 tx=0x7fa430009040 comp rx=0 tx=0).stop 2023-06-23T19:02:46.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa440160880 msgr2=0x7fa4400c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:46.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa440160880 0x7fa4400c7640 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa43800b680 tx=0x7fa438004ad0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 shutdown_connections 2023-06-23T19:02:46.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa42c06ace0 0x7fa42c06d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa440160880 0x7fa4400c7640 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cd830 0x7fa4401f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 --2- 172.21.15.136:0/4110866277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa44015c570 0x7fa4400c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:46.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 >> 172.21.15.136:0/4110866277 conn(0x7fa440071620 msgr2=0x7fa4400719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:46.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 shutdown_connections 2023-06-23T19:02:46.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:46.854+0000 7fa4461ff700 1 -- 172.21.15.136:0/4110866277 wait complete. 2023-06-23T19:02:46.861 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 17 2023-06-23T19:02:46.876 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:02:47.070 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.067+0000 7f457a7ff700 1 Processor -- start 2023-06-23T19:02:47.071 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.067+0000 7f457a7ff700 1 -- start start 2023-06-23T19:02:47.071 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.068+0000 7f457a7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45740cd830 0x7f4574160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.068+0000 7f457a7ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45741610a0 con 0x7f4574160880 2023-06-23T19:02:47.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.068+0000 7f457a7ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457415da90 con 0x7f457415c570 2023-06-23T19:02:47.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.068+0000 7f457a7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457415d670 con 0x7f45740cd830 2023-06-23T19:02:47.073 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.068+0000 7f4578d9c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f4574160880 0x7f45740d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53692/0 (socket says 172.21.15.136:53692) 2023-06-23T19:02:47.073 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.068+0000 7f4578d9c700 1 -- 172.21.15.136:0/1696861566 learned_addr learned my addr 172.21.15.136:0/1696861566 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:47.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.069+0000 7f45737fe700 1 --2- 172.21.15.136:0/1696861566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45740cd830 0x7f4574160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.069+0000 7f4572ffd700 1 -- 172.21.15.136:0/1696861566 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471859072 0 0) 0x7f45741610a0 con 0x7f4574160880 2023-06-23T19:02:47.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.069+0000 7f4572ffd700 1 -- 172.21.15.136:0/1696861566 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f455c0035b0 con 0x7f4574160880 2023-06-23T19:02:47.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.069+0000 7f4572ffd700 1 -- 172.21.15.136:0/1696861566 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833310903 0 0) 0x7f457415da90 con 0x7f457415c570 2023-06-23T19:02:47.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.069+0000 7f4572ffd700 1 -- 172.21.15.136:0/1696861566 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45741610a0 con 0x7f457415c570 2023-06-23T19:02:47.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.069+0000 7f45737fe700 1 -- 172.21.15.136:0/1696861566 >> v1:172.21.15.178:6789/0 conn(0x7f457415c570 legacy=0x7f45740cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.069+0000 7f45737fe700 1 -- 172.21.15.136:0/1696861566 >> v1:172.21.15.136:6789/0 conn(0x7f4574160880 legacy=0x7f45740d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.069+0000 7f45737fe700 1 -- 172.21.15.136:0/1696861566 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457415ccd0 con 0x7f45740cd830 2023-06-23T19:02:47.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.069+0000 7f45737fe700 1 --2- 172.21.15.136:0/1696861566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45740cd830 0x7f4574160340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4568009870 tx=0x7f4568009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=109e5a0055d49858 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:47.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f4572ffd700 1 -- 172.21.15.136:0/1696861566 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4568011830 con 0x7f45740cd830 2023-06-23T19:02:47.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f4572ffd700 1 -- 172.21.15.136:0/1696861566 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4568011990 con 0x7f45740cd830 2023-06-23T19:02:47.075 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f4572ffd700 1 -- 172.21.15.136:0/1696861566 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4568011d20 con 0x7f45740cd830 2023-06-23T19:02:47.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f457a7ff700 1 -- 172.21.15.136:0/1696861566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45740cd830 msgr2=0x7f4574160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f457a7ff700 1 --2- 172.21.15.136:0/1696861566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45740cd830 0x7f4574160340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4568009870 tx=0x7f4568009b80 comp rx=0 tx=0).stop 2023-06-23T19:02:47.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f457a7ff700 1 -- 172.21.15.136:0/1696861566 shutdown_connections 2023-06-23T19:02:47.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f457a7ff700 1 --2- 172.21.15.136:0/1696861566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45740cd830 0x7f4574160340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.077 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f457a7ff700 1 -- 172.21.15.136:0/1696861566 >> 172.21.15.136:0/1696861566 conn(0x7f4574071620 msgr2=0x7f45740719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:47.077 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f457a7ff700 1 -- 172.21.15.136:0/1696861566 shutdown_connections 2023-06-23T19:02:47.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.070+0000 7f457a7ff700 1 -- 172.21.15.136:0/1696861566 wait complete. 2023-06-23T19:02:47.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.072+0000 7f457a7ff700 1 Processor -- start 2023-06-23T19:02:47.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.072+0000 7f457a7ff700 1 -- start start 2023-06-23T19:02:47.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.073+0000 7f457a7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45740cd830 0x7f457414d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.073+0000 7f457a7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f457415c570 0x7f45740b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.073+0000 7f457a7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4574160880 0x7f457414fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.073+0000 7f457a7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45740c6830 con 0x7f457415c570 2023-06-23T19:02:47.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.073+0000 7f457a7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45740b7ed0 con 0x7f45740cd830 2023-06-23T19:02:47.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.073+0000 7f457a7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45740b7630 con 0x7f4574160880 2023-06-23T19:02:47.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.073+0000 7f45737fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f457415c570 0x7f45740b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f45737fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f457415c570 0x7f45740b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55850/0 (socket says 172.21.15.136:55850) 2023-06-23T19:02:47.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f45737fe700 1 -- 172.21.15.136:0/2214018433 learned_addr learned my addr 172.21.15.136:0/2214018433 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:47.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f4578d9c700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4574160880 0x7f457414fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f4573fff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45740cd830 0x7f457414d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f45737fe700 1 -- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4574160880 msgr2=0x7f457414fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f45737fe700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4574160880 0x7f457414fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f45737fe700 1 -- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45740cd830 msgr2=0x7f457414d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f45737fe700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45740cd830 0x7f457414d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f45737fe700 1 -- 172.21.15.136:0/2214018433 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45680094a0 con 0x7f457415c570 2023-06-23T19:02:47.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f4578d9c700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4574160880 0x7f457414fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:47.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f4573fff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45740cd830 0x7f457414d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:47.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f45737fe700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f457415c570 0x7f45740b42d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f45680090b0 tx=0x7f4568004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:47.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f4570ff9700 1 -- 172.21.15.136:0/2214018433 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456801a860 con 0x7f457415c570 2023-06-23T19:02:47.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f4570ff9700 1 -- 172.21.15.136:0/2214018433 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456801a9c0 con 0x7f457415c570 2023-06-23T19:02:47.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f4570ff9700 1 -- 172.21.15.136:0/2214018433 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456801ad30 con 0x7f457415c570 2023-06-23T19:02:47.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.074+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45740b7910 con 0x7f457415c570 2023-06-23T19:02:47.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.075+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457414dac0 con 0x7f457415c570 2023-06-23T19:02:47.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.076+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457414dc50 con 0x7f457415c570 2023-06-23T19:02:47.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.077+0000 7f4570ff9700 1 -- 172.21.15.136:0/2214018433 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4568022070 con 0x7f457415c570 2023-06-23T19:02:47.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.077+0000 7f4570ff9700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f456006ace0 0x7f456006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.077+0000 7f4570ff9700 1 -- 172.21.15.136:0/2214018433 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f456808a2a0 con 0x7f457415c570 2023-06-23T19:02:47.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.078+0000 7f4573fff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f456006ace0 0x7f456006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.078+0000 7f4573fff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f456006ace0 0x7f456006d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45640011e0 tx=0x7f4564009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:47.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.082+0000 7f4570ff9700 1 -- 172.21.15.136:0/2214018433 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f457414dc50 con 0x7f457415c570 2023-06-23T19:02:47.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.282+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45740c69a0 con 0x7f457415c570 2023-06-23T19:02:47.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.283+0000 7f4570ff9700 1 -- 172.21.15.136:0/2214018433 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18524 (secure 0 0 0) 0x7f45740c69a0 con 0x7f457415c570 2023-06-23T19:02:47.287 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:47.288 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":44,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:02:44.367325+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:02:41.186859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-23T19:02:42.355631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:02:47.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f456006ace0 msgr2=0x7f456006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f456006ace0 0x7f456006d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45640011e0 tx=0x7f4564009040 comp rx=0 tx=0).stop 2023-06-23T19:02:47.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f457415c570 msgr2=0x7f45740b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f457415c570 0x7f45740b42d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f45680090b0 tx=0x7f4568004750 comp rx=0 tx=0).stop 2023-06-23T19:02:47.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 shutdown_connections 2023-06-23T19:02:47.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f456006ace0 0x7f456006d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45740cd830 0x7f457414d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4574160880 0x7f457414fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 --2- 172.21.15.136:0/2214018433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f457415c570 0x7f45740b42d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 >> 172.21.15.136:0/2214018433 conn(0x7f4574071620 msgr2=0x7f45740719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:47.291 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 shutdown_connections 2023-06-23T19:02:47.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.286+0000 7f457a7ff700 1 -- 172.21.15.136:0/2214018433 wait complete. 2023-06-23T19:02:47.308 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-23T19:02:47.309 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T19:02:47.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.500+0000 7f1d0cbff700 1 Processor -- start 2023-06-23T19:02:47.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.501+0000 7f1d0cbff700 1 -- start start 2023-06-23T19:02:47.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1d0cbff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1d0815c570 0x7f1d080cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1d0cbff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d08160e70 con 0x7f1d080cd660 2023-06-23T19:02:47.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1d0cbff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d081610a0 con 0x7f1d08160a50 2023-06-23T19:02:47.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1d0cbff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0815d670 con 0x7f1d0815c570 2023-06-23T19:02:47.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1d0659c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1d0815c570 0x7f1d080cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1cfffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f1d080cd660 0x7f1d08160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53702/0 (socket says 172.21.15.136:53702) 2023-06-23T19:02:47.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1cfffff700 1 -- 172.21.15.136:0/719481857 learned_addr learned my addr 172.21.15.136:0/719481857 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:47.516 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1d0659c700 1 -- 172.21.15.136:0/719481857 >> v1:172.21.15.178:6789/0 conn(0x7f1d08160a50 legacy=0x7f1d080d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1d0659c700 1 -- 172.21.15.136:0/719481857 >> v1:172.21.15.136:6789/0 conn(0x7f1d080cd660 legacy=0x7f1d08160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.502+0000 7f1d0659c700 1 -- 172.21.15.136:0/719481857 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0815da90 con 0x7f1d0815c570 2023-06-23T19:02:47.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.503+0000 7f1d0659c700 1 --2- 172.21.15.136:0/719481857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d0815c570 0x7f1d080cd120 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009840 tx=0x7f1cf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be26d4d0d62347a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:47.517 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.503+0000 7f1d05d9b700 1 -- 172.21.15.136:0/719481857 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8011830 con 0x7f1d0815c570 2023-06-23T19:02:47.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.503+0000 7f1d05d9b700 1 -- 172.21.15.136:0/719481857 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf8011990 con 0x7f1d0815c570 2023-06-23T19:02:47.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.503+0000 7f1d05d9b700 1 -- 172.21.15.136:0/719481857 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8011d20 con 0x7f1d0815c570 2023-06-23T19:02:47.518 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.503+0000 7f1d0cbff700 1 -- 172.21.15.136:0/719481857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d0815c570 msgr2=0x7f1d080cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.503+0000 7f1d0cbff700 1 --2- 172.21.15.136:0/719481857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d0815c570 0x7f1d080cd120 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009840 tx=0x7f1cf8009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:47.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.504+0000 7f1d0cbff700 1 -- 172.21.15.136:0/719481857 shutdown_connections 2023-06-23T19:02:47.519 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.504+0000 7f1d0cbff700 1 --2- 172.21.15.136:0/719481857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d0815c570 0x7f1d080cd120 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.504+0000 7f1d0cbff700 1 -- 172.21.15.136:0/719481857 >> 172.21.15.136:0/719481857 conn(0x7f1d08071620 msgr2=0x7f1d080719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:47.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.504+0000 7f1d0cbff700 1 -- 172.21.15.136:0/719481857 shutdown_connections 2023-06-23T19:02:47.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.504+0000 7f1d0cbff700 1 -- 172.21.15.136:0/719481857 wait complete. 2023-06-23T19:02:47.520 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.505+0000 7f1d0cbff700 1 Processor -- start 2023-06-23T19:02:47.521 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.506+0000 7f1d0cbff700 1 -- start start 2023-06-23T19:02:47.521 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.506+0000 7f1d0cbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d080cd660 0x7f1d0814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.521 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.506+0000 7f1d0cbff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d0815c570 0x7f1d08147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.521 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.506+0000 7f1d0cbff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d08160a50 0x7f1d080cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.506+0000 7f1d0cbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08147fb0 con 0x7f1d080cd660 2023-06-23T19:02:47.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.506+0000 7f1d0cbff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08148290 con 0x7f1d08160a50 2023-06-23T19:02:47.522 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.506+0000 7f1d0cbff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08148570 con 0x7f1d0815c570 2023-06-23T19:02:47.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.507+0000 7f1d0659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d080cd660 0x7f1d0814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.507+0000 7f1d0659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d080cd660 0x7f1d0814a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55872/0 (socket says 172.21.15.136:55872) 2023-06-23T19:02:47.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.507+0000 7f1d0659c700 1 -- 172.21.15.136:0/1848457680 learned_addr learned my addr 172.21.15.136:0/1848457680 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:47.523 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.507+0000 7f1d0659c700 1 -- 172.21.15.136:0/1848457680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d0815c570 msgr2=0x7f1d08147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.507+0000 7f1d0659c700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d0815c570 0x7f1d08147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.507+0000 7f1d0659c700 1 -- 172.21.15.136:0/1848457680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d08160a50 msgr2=0x7f1d080cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.507+0000 7f1d0659c700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d08160a50 0x7f1d080cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.507+0000 7f1d0659c700 1 -- 172.21.15.136:0/1848457680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80094a0 con 0x7f1d080cd660 2023-06-23T19:02:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.507+0000 7f1d0659c700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d080cd660 0x7f1d0814a680 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80090b0 tx=0x7f1cf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.508+0000 7f1cfeffd700 1 -- 172.21.15.136:0/1848457680 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80038a0 con 0x7f1d080cd660 2023-06-23T19:02:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.508+0000 7f1cfeffd700 1 -- 172.21.15.136:0/1848457680 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf801f070 con 0x7f1d080cd660 2023-06-23T19:02:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.508+0000 7f1cfeffd700 1 -- 172.21.15.136:0/1848457680 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8003c60 con 0x7f1d080cd660 2023-06-23T19:02:47.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.508+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d08148850 con 0x7f1d080cd660 2023-06-23T19:02:47.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.508+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0814abc0 con 0x7f1d080cd660 2023-06-23T19:02:47.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.509+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d08148d70 con 0x7f1d080cd660 2023-06-23T19:02:47.526 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.510+0000 7f1cfeffd700 1 -- 172.21.15.136:0/1848457680 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cf801a430 con 0x7f1d080cd660 2023-06-23T19:02:47.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.510+0000 7f1cfeffd700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1ce806ace0 0x7f1ce806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.511+0000 7f1cfeffd700 1 -- 172.21.15.136:0/1848457680 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1cf8021070 con 0x7f1d080cd660 2023-06-23T19:02:47.527 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.511+0000 7f1cfffff700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1ce806ace0 0x7f1ce806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.511+0000 7f1cfffff700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1ce806ace0 0x7f1ce806d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1d080b7b00 tx=0x7f1cf0007ad0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.515+0000 7f1cfeffd700 1 -- 172.21.15.136:0/1848457680 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1d08148d70 con 0x7f1d080cd660 2023-06-23T19:02:47.710 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.706+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 --> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d0815cfb0 con 0x7f1ce806ace0 2023-06-23T19:02:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.716+0000 7f1cfeffd700 1 -- 172.21.15.136:0/1848457680 <== mgr.4105 v2:172.21.15.136:6832/2653877961 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308160 (secure 0 0 0) 0x7f1cf00012c0 con 0x7f1ce806ace0 2023-06-23T19:02:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:47.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1ce806ace0 msgr2=0x7f1ce806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.727 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1ce806ace0 0x7f1ce806d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1d080b7b00 tx=0x7f1cf0007ad0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d080cd660 msgr2=0x7f1d0814a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d080cd660 0x7f1d0814a680 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80090b0 tx=0x7f1cf8004750 comp rx=0 tx=0).stop 2023-06-23T19:02:47.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 shutdown_connections 2023-06-23T19:02:47.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f1ce806ace0 0x7f1ce806d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d08160a50 0x7f1d080cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.728 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d080cd660 0x7f1d0814a680 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 --2- 172.21.15.136:0/1848457680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d0815c570 0x7f1d08147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 >> 172.21.15.136:0/1848457680 conn(0x7f1d08071620 msgr2=0x7f1d080d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:47.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 shutdown_connections 2023-06-23T19:02:47.729 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.721+0000 7f1d0cbff700 1 -- 172.21.15.136:0/1848457680 wait complete. 2023-06-23T19:02:47.729 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2023-06-23T19:02:47.743 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-06-23T19:02:46.956551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":198,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220492,"kb_used_data":4876,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754228,"statfs":{"total":773094113280,"available":772868329472,"internally_reserved":0,"allocated":4993024,"data_stored":2844339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.091817"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875866+0000","last_change":"2023-06-23T19:02:42.875866+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875866+0000","last_undegraded":"2023-06-23T19:02:42.875866+0000","last_fullsized":"2023-06-23T19:02:42.875866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.406971+0000","last_change":"2023-06-23T19:02:43.405015+0000","last_active":"2023-06-23T19:02:43.406971+0000","last_peered":"2023-06-23T19:02:43.406971+0000","last_clean":"2023-06-23T19:02:43.406971+0000","last_became_active":"2023-06-23T19:02:43.404718+0000","last_became_peered":"2023-06-23T19:02:43.404718+0000","last_unstale":"2023-06-23T19:02:43.406971+0000","last_undegraded":"2023-06-23T19:02:43.406971+0000","last_fullsized":"2023-06-23T19:02:43.406971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:13:11.771904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.882083+0000","last_change":"2023-06-23T19:02:42.882083+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.882083+0000","last_undegraded":"2023-06-23T19:02:42.882083+0000","last_fullsized":"2023-06-23T19:02:42.882083+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405222+0000","last_change":"2023-06-23T19:02:43.402422+0000","last_active":"2023-06-23T19:02:43.405222+0000","last_peered":"2023-06-23T19:02:43.405222+0000","last_clean":"2023-06-23T19:02:43.405222+0000","last_became_active":"2023-06-23T19:02:43.402157+0000","last_became_peered":"2023-06-23T19:02:43.402157+0000","last_unstale":"2023-06-23T19:02:43.405222+0000","last_undegraded":"2023-06-23T19:02:43.405222+0000","last_fullsized":"2023-06-23T19:02:43.405222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:57:50.309764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.403065+0000","last_change":"2023-06-23T19:02:43.395438+0000","last_active":"2023-06-23T19:02:43.403065+0000","last_peered":"2023-06-23T19:02:43.403065+0000","last_clean":"2023-06-23T19:02:43.403065+0000","last_became_active":"2023-06-23T19:02:43.395153+0000","last_became_peered":"2023-06-23T19:02:43.395153+0000","last_unstale":"2023-06-23T19:02:43.403065+0000","last_undegraded":"2023-06-23T19:02:43.403065+0000","last_fullsized":"2023-06-23T19:02:43.403065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:41:51.912362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875376+0000","last_change":"2023-06-23T19:02:42.875376+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875376+0000","last_undegraded":"2023-06-23T19:02:42.875376+0000","last_fullsized":"2023-06-23T19:02:42.875376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875598+0000","last_change":"2023-06-23T19:02:42.875598+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875598+0000","last_undegraded":"2023-06-23T19:02:42.875598+0000","last_fullsized":"2023-06-23T19:02:42.875598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405254+0000","last_change":"2023-06-23T19:02:43.403369+0000","last_active":"2023-06-23T19:02:43.405254+0000","last_peered":"2023-06-23T19:02:43.405254+0000","last_clean":"2023-06-23T19:02:43.405254+0000","last_became_active":"2023-06-23T19:02:43.403084+0000","last_became_peered":"2023-06-23T19:02:43.403084+0000","last_unstale":"2023-06-23T19:02:43.405254+0000","last_undegraded":"2023-06-23T19:02:43.405254+0000","last_fullsized":"2023-06-23T19:02:43.405254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:07:48.893356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394405+0000","last_change":"2023-06-23T19:02:43.386467+0000","last_active":"2023-06-23T19:02:43.394405+0000","last_peered":"2023-06-23T19:02:43.394405+0000","last_clean":"2023-06-23T19:02:43.394405+0000","last_became_active":"2023-06-23T19:02:43.386192+0000","last_became_peered":"2023-06-23T19:02:43.386192+0000","last_unstale":"2023-06-23T19:02:43.394405+0000","last_undegraded":"2023-06-23T19:02:43.394405+0000","last_fullsized":"2023-06-23T19:02:43.394405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:12.505159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405097+0000","last_change":"2023-06-23T19:02:43.402134+0000","last_active":"2023-06-23T19:02:43.405097+0000","last_peered":"2023-06-23T19:02:43.405097+0000","last_clean":"2023-06-23T19:02:43.405097+0000","last_became_active":"2023-06-23T19:02:43.401870+0000","last_became_peered":"2023-06-23T19:02:43.401870+0000","last_unstale":"2023-06-23T19:02:43.405097+0000","last_undegraded":"2023-06-23T19:02:43.405097+0000","last_fullsized":"2023-06-23T19:02:43.405097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:45.418052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.393949+0000","last_change":"2023-06-23T19:02:43.386081+0000","last_active":"2023-06-23T19:02:43.393949+0000","last_peered":"2023-06-23T19:02:43.393949+0000","last_clean":"2023-06-23T19:02:43.393949+0000","last_became_active":"2023-06-23T19:02:43.385795+0000","last_became_peered":"2023-06-23T19:02:43.385795+0000","last_unstale":"2023-06-23T19:02:43.393949+0000","last_undegraded":"2023-06-23T19:02:43.393949+0000","last_fullsized":"2023-06-23T19:02:43.393949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:58:59.234601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.402361+0000","last_change":"2023-06-23T19:02:43.395109+0000","last_active":"2023-06-23T19:02:43.402361+0000","last_peered":"2023-06-23T19:02:43.402361+0000","last_clean":"2023-06-23T19:02:43.402361+0000","last_became_active":"2023-06-23T19:02:43.394402+0000","last_became_peered":"2023-06-23T19:02:43.394402+0000","last_unstale":"2023-06-23T19:02:43.402361+0000","last_undegraded":"2023-06-23T19:02:43.402361+0000","last_fullsized":"2023-06-23T19:02:43.402361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:57:20.585183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.393814+0000","last_change":"2023-06-23T19:02:43.383462+0000","last_active":"2023-06-23T19:02:43.393814+0000","last_peered":"2023-06-23T19:02:43.393814+0000","last_clean":"2023-06-23T19:02:43.393814+0000","last_became_active":"2023-06-23T19:02:43.383158+0000","last_became_peered":"2023-06-23T19:02:43.383158+0000","last_unstale":"2023-06-23T19:02:43.393814+0000","last_undegraded":"2023-06-23T19:02:43.393814+0000","last_fullsized":"2023-06-23T19:02:43.393814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:31:01.213549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874398+0000","last_change":"2023-06-23T19:02:42.874398+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874398+0000","last_undegraded":"2023-06-23T19:02:42.874398+0000","last_fullsized":"2023-06-23T19:02:42.874398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724048+0000","last_change":"2023-06-23T19:02:43.400056+0000","last_active":"2023-06-23T19:02:44.724048+0000","last_peered":"2023-06-23T19:02:44.724048+0000","last_clean":"2023-06-23T19:02:44.724048+0000","last_became_active":"2023-06-23T19:02:43.399740+0000","last_became_peered":"2023-06-23T19:02:43.399740+0000","last_unstale":"2023-06-23T19:02:44.724048+0000","last_undegraded":"2023-06-23T19:02:44.724048+0000","last_fullsized":"2023-06-23T19:02:44.724048+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:32:56.376089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.883405+0000","last_change":"2023-06-23T19:02:42.883405+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.883405+0000","last_undegraded":"2023-06-23T19:02:42.883405+0000","last_fullsized":"2023-06-23T19:02:42.883405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.884789+0000","last_change":"2023-06-23T19:02:42.884789+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.884789+0000","last_undegraded":"2023-06-23T19:02:42.884789+0000","last_fullsized":"2023-06-23T19:02:42.884789+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725030+0000","last_change":"2023-06-23T19:02:43.400304+0000","last_active":"2023-06-23T19:02:44.725030+0000","last_peered":"2023-06-23T19:02:44.725030+0000","last_clean":"2023-06-23T19:02:44.725030+0000","last_became_active":"2023-06-23T19:02:43.396953+0000","last_became_peered":"2023-06-23T19:02:43.396953+0000","last_unstale":"2023-06-23T19:02:44.725030+0000","last_undegraded":"2023-06-23T19:02:44.725030+0000","last_fullsized":"2023-06-23T19:02:44.725030+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:41.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.876390+0000","last_change":"2023-06-23T19:02:42.876390+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.876390+0000","last_undegraded":"2023-06-23T19:02:42.876390+0000","last_fullsized":"2023-06-23T19:02:42.876390+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405195+0000","last_change":"2023-06-23T19:02:43.402236+0000","last_active":"2023-06-23T19:02:43.405195+0000","last_peered":"2023-06-23T19:02:43.405195+0000","last_clean":"2023-06-23T19:02:43.405195+0000","last_became_active":"2023-06-23T19:02:43.401856+0000","last_became_peered":"2023-06-23T19:02:43.401856+0000","last_unstale":"2023-06-23T19:02:43.405195+0000","last_undegraded":"2023-06-23T19:02:43.405195+0000","last_fullsized":"2023-06-23T19:02:43.405195+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:11:17.204985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723948+0000","last_change":"2023-06-23T19:02:43.404668+0000","last_active":"2023-06-23T19:02:44.723948+0000","last_peered":"2023-06-23T19:02:44.723948+0000","last_clean":"2023-06-23T19:02:44.723948+0000","last_became_active":"2023-06-23T19:02:43.404069+0000","last_became_peered":"2023-06-23T19:02:43.404069+0000","last_unstale":"2023-06-23T19:02:44.723948+0000","last_undegraded":"2023-06-23T19:02:44.723948+0000","last_fullsized":"2023-06-23T19:02:44.723948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:03.176159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724003+0000","last_change":"2023-06-23T19:02:43.395358+0000","last_active":"2023-06-23T19:02:44.724003+0000","last_peered":"2023-06-23T19:02:44.724003+0000","last_clean":"2023-06-23T19:02:44.724003+0000","last_became_active":"2023-06-23T19:02:43.394956+0000","last_became_peered":"2023-06-23T19:02:43.394956+0000","last_unstale":"2023-06-23T19:02:44.724003+0000","last_undegraded":"2023-06-23T19:02:44.724003+0000","last_fullsized":"2023-06-23T19:02:44.724003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:20.784110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725079+0000","last_change":"2023-06-23T19:02:43.395135+0000","last_active":"2023-06-23T19:02:44.725079+0000","last_peered":"2023-06-23T19:02:44.725079+0000","last_clean":"2023-06-23T19:02:44.725079+0000","last_became_active":"2023-06-23T19:02:43.394454+0000","last_became_peered":"2023-06-23T19:02:43.394454+0000","last_unstale":"2023-06-23T19:02:44.725079+0000","last_undegraded":"2023-06-23T19:02:44.725079+0000","last_fullsized":"2023-06-23T19:02:44.725079+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:46:33.411319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.880250+0000","last_change":"2023-06-23T19:02:42.880250+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.880250+0000","last_undegraded":"2023-06-23T19:02:42.880250+0000","last_fullsized":"2023-06-23T19:02:42.880250+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.402382+0000","last_change":"2023-06-23T19:02:43.395428+0000","last_active":"2023-06-23T19:02:43.402382+0000","last_peered":"2023-06-23T19:02:43.402382+0000","last_clean":"2023-06-23T19:02:43.402382+0000","last_became_active":"2023-06-23T19:02:43.394828+0000","last_became_peered":"2023-06-23T19:02:43.394828+0000","last_unstale":"2023-06-23T19:02:43.402382+0000","last_undegraded":"2023-06-23T19:02:43.402382+0000","last_fullsized":"2023-06-23T19:02:43.402382+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:57:38.773378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724266+0000","last_change":"2023-06-23T19:02:43.390376+0000","last_active":"2023-06-23T19:02:44.724266+0000","last_peered":"2023-06-23T19:02:44.724266+0000","last_clean":"2023-06-23T19:02:44.724266+0000","last_became_active":"2023-06-23T19:02:43.390091+0000","last_became_peered":"2023-06-23T19:02:43.390091+0000","last_unstale":"2023-06-23T19:02:44.724266+0000","last_undegraded":"2023-06-23T19:02:44.724266+0000","last_fullsized":"2023-06-23T19:02:44.724266+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:38:21.075927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.883638+0000","last_change":"2023-06-23T19:02:42.883638+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.883638+0000","last_undegraded":"2023-06-23T19:02:42.883638+0000","last_fullsized":"2023-06-23T19:02:42.883638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.876479+0000","last_change":"2023-06-23T19:02:42.876479+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.876479+0000","last_undegraded":"2023-06-23T19:02:42.876479+0000","last_fullsized":"2023-06-23T19:02:42.876479+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.881101+0000","last_change":"2023-06-23T19:02:42.881101+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.881101+0000","last_undegraded":"2023-06-23T19:02:42.881101+0000","last_fullsized":"2023-06-23T19:02:42.881101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.890507+0000","last_change":"2023-06-23T19:02:42.887806+0000","last_active":"2023-06-23T19:02:42.890507+0000","last_peered":"2023-06-23T19:02:42.890507+0000","last_clean":"2023-06-23T19:02:42.890507+0000","last_became_active":"2023-06-23T19:02:42.887517+0000","last_became_peered":"2023-06-23T19:02:42.887517+0000","last_unstale":"2023-06-23T19:02:42.890507+0000","last_undegraded":"2023-06-23T19:02:42.890507+0000","last_fullsized":"2023-06-23T19:02:42.890507+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:04:34.712857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724889+0000","last_change":"2023-06-23T19:02:43.395362+0000","last_active":"2023-06-23T19:02:44.724889+0000","last_peered":"2023-06-23T19:02:44.724889+0000","last_clean":"2023-06-23T19:02:44.724889+0000","last_became_active":"2023-06-23T19:02:43.394818+0000","last_became_peered":"2023-06-23T19:02:43.394818+0000","last_unstale":"2023-06-23T19:02:44.724889+0000","last_undegraded":"2023-06-23T19:02:44.724889+0000","last_fullsized":"2023-06-23T19:02:44.724889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:04:50.409635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.893903+0000","last_change":"2023-06-23T19:02:42.891979+0000","last_active":"2023-06-23T19:02:42.893903+0000","last_peered":"2023-06-23T19:02:42.893903+0000","last_clean":"2023-06-23T19:02:42.893903+0000","last_became_active":"2023-06-23T19:02:42.890688+0000","last_became_peered":"2023-06-23T19:02:42.890688+0000","last_unstale":"2023-06-23T19:02:42.893903+0000","last_undegraded":"2023-06-23T19:02:42.893903+0000","last_fullsized":"2023-06-23T19:02:42.893903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:31.221738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.395814+0000","last_change":"2023-06-23T19:02:43.393361+0000","last_active":"2023-06-23T19:02:43.395814+0000","last_peered":"2023-06-23T19:02:43.395814+0000","last_clean":"2023-06-23T19:02:43.395814+0000","last_became_active":"2023-06-23T19:02:43.393080+0000","last_became_peered":"2023-06-23T19:02:43.393080+0000","last_unstale":"2023-06-23T19:02:43.395814+0000","last_undegraded":"2023-06-23T19:02:43.395814+0000","last_fullsized":"2023-06-23T19:02:43.395814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:09:46.104708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.896429+0000","last_change":"2023-06-23T19:02:42.893081+0000","last_active":"2023-06-23T19:02:42.896429+0000","last_peered":"2023-06-23T19:02:42.896429+0000","last_clean":"2023-06-23T19:02:42.896429+0000","last_became_active":"2023-06-23T19:02:42.892723+0000","last_became_peered":"2023-06-23T19:02:42.892723+0000","last_unstale":"2023-06-23T19:02:42.896429+0000","last_undegraded":"2023-06-23T19:02:42.896429+0000","last_fullsized":"2023-06-23T19:02:42.896429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:45:17.678934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.882330+0000","last_change":"2023-06-23T19:02:42.882330+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.882330+0000","last_undegraded":"2023-06-23T19:02:42.882330+0000","last_fullsized":"2023-06-23T19:02:42.882330+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889906+0000","last_change":"2023-06-23T19:02:42.887480+0000","last_active":"2023-06-23T19:02:42.889906+0000","last_peered":"2023-06-23T19:02:42.889906+0000","last_clean":"2023-06-23T19:02:42.889906+0000","last_became_active":"2023-06-23T19:02:42.887193+0000","last_became_peered":"2023-06-23T19:02:42.887193+0000","last_unstale":"2023-06-23T19:02:42.889906+0000","last_undegraded":"2023-06-23T19:02:42.889906+0000","last_fullsized":"2023-06-23T19:02:42.889906+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:53.956771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.880391+0000","last_change":"2023-06-23T19:02:42.880391+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.880391+0000","last_undegraded":"2023-06-23T19:02:42.880391+0000","last_fullsized":"2023-06-23T19:02:42.880391+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892302+0000","last_change":"2023-06-23T19:02:42.887196+0000","last_active":"2023-06-23T19:02:42.892302+0000","last_peered":"2023-06-23T19:02:42.892302+0000","last_clean":"2023-06-23T19:02:42.892302+0000","last_became_active":"2023-06-23T19:02:42.886915+0000","last_became_peered":"2023-06-23T19:02:42.886915+0000","last_unstale":"2023-06-23T19:02:42.892302+0000","last_undegraded":"2023-06-23T19:02:42.892302+0000","last_fullsized":"2023-06-23T19:02:42.892302+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:32:34.112575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.381832+0000","last_change":"2023-06-23T19:02:43.379396+0000","last_active":"2023-06-23T19:02:43.381832+0000","last_peered":"2023-06-23T19:02:43.381832+0000","last_clean":"2023-06-23T19:02:43.381832+0000","last_became_active":"2023-06-23T19:02:43.379137+0000","last_became_peered":"2023-06-23T19:02:43.379137+0000","last_unstale":"2023-06-23T19:02:43.381832+0000","last_undegraded":"2023-06-23T19:02:43.381832+0000","last_fullsized":"2023-06-23T19:02:43.381832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:45:18.683469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892290+0000","last_change":"2023-06-23T19:02:42.890175+0000","last_active":"2023-06-23T19:02:42.892290+0000","last_peered":"2023-06-23T19:02:42.892290+0000","last_clean":"2023-06-23T19:02:42.892290+0000","last_became_active":"2023-06-23T19:02:42.889717+0000","last_became_peered":"2023-06-23T19:02:42.889717+0000","last_unstale":"2023-06-23T19:02:42.892290+0000","last_undegraded":"2023-06-23T19:02:42.892290+0000","last_fullsized":"2023-06-23T19:02:42.892290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:46:23.845577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405241+0000","last_change":"2023-06-23T19:02:43.403277+0000","last_active":"2023-06-23T19:02:43.405241+0000","last_peered":"2023-06-23T19:02:43.405241+0000","last_clean":"2023-06-23T19:02:43.405241+0000","last_became_active":"2023-06-23T19:02:43.402771+0000","last_became_peered":"2023-06-23T19:02:43.402771+0000","last_unstale":"2023-06-23T19:02:43.405241+0000","last_undegraded":"2023-06-23T19:02:43.405241+0000","last_fullsized":"2023-06-23T19:02:43.405241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:03:01.052439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.379649+0000","last_change":"2023-06-23T19:02:42.887165+0000","last_active":"2023-06-23T19:02:43.379649+0000","last_peered":"2023-06-23T19:02:43.379649+0000","last_clean":"2023-06-23T19:02:43.379649+0000","last_became_active":"2023-06-23T19:02:42.886870+0000","last_became_peered":"2023-06-23T19:02:42.886870+0000","last_unstale":"2023-06-23T19:02:43.379649+0000","last_undegraded":"2023-06-23T19:02:43.379649+0000","last_fullsized":"2023-06-23T19:02:43.379649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:04:52.545693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724033+0000","last_change":"2023-06-23T19:02:43.404348+0000","last_active":"2023-06-23T19:02:44.724033+0000","last_peered":"2023-06-23T19:02:44.724033+0000","last_clean":"2023-06-23T19:02:44.724033+0000","last_became_active":"2023-06-23T19:02:43.403667+0000","last_became_peered":"2023-06-23T19:02:43.403667+0000","last_unstale":"2023-06-23T19:02:44.724033+0000","last_undegraded":"2023-06-23T19:02:44.724033+0000","last_fullsized":"2023-06-23T19:02:44.724033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:45.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.373226+0000","last_change":"2023-06-23T19:02:42.890898+0000","last_active":"2023-06-23T19:02:43.373226+0000","last_peered":"2023-06-23T19:02:43.373226+0000","last_clean":"2023-06-23T19:02:43.373226+0000","last_became_active":"2023-06-23T19:02:42.890663+0000","last_became_peered":"2023-06-23T19:02:42.890663+0000","last_unstale":"2023-06-23T19:02:43.373226+0000","last_undegraded":"2023-06-23T19:02:43.373226+0000","last_fullsized":"2023-06-23T19:02:43.373226+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:34:16.195266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.882525+0000","last_change":"2023-06-23T19:02:42.882525+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.882525+0000","last_undegraded":"2023-06-23T19:02:42.882525+0000","last_fullsized":"2023-06-23T19:02:42.882525+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.891509+0000","last_change":"2023-06-23T19:02:42.888633+0000","last_active":"2023-06-23T19:02:42.891509+0000","last_peered":"2023-06-23T19:02:42.891509+0000","last_clean":"2023-06-23T19:02:42.891509+0000","last_became_active":"2023-06-23T19:02:42.888018+0000","last_became_peered":"2023-06-23T19:02:42.888018+0000","last_unstale":"2023-06-23T19:02:42.891509+0000","last_undegraded":"2023-06-23T19:02:42.891509+0000","last_fullsized":"2023-06-23T19:02:42.891509+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:45:27.338493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875297+0000","last_change":"2023-06-23T19:02:42.875297+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875297+0000","last_undegraded":"2023-06-23T19:02:42.875297+0000","last_fullsized":"2023-06-23T19:02:42.875297+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.373732+0000","last_change":"2023-06-23T19:02:42.890196+0000","last_active":"2023-06-23T19:02:43.373732+0000","last_peered":"2023-06-23T19:02:43.373732+0000","last_clean":"2023-06-23T19:02:43.373732+0000","last_became_active":"2023-06-23T19:02:42.889975+0000","last_became_peered":"2023-06-23T19:02:42.889975+0000","last_unstale":"2023-06-23T19:02:43.373732+0000","last_undegraded":"2023-06-23T19:02:43.373732+0000","last_fullsized":"2023-06-23T19:02:43.373732+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:51:45.663216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874979+0000","last_change":"2023-06-23T19:02:42.874979+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874979+0000","last_undegraded":"2023-06-23T19:02:42.874979+0000","last_fullsized":"2023-06-23T19:02:42.874979+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.893706+0000","last_change":"2023-06-23T19:02:42.891197+0000","last_active":"2023-06-23T19:02:42.893706+0000","last_peered":"2023-06-23T19:02:42.893706+0000","last_clean":"2023-06-23T19:02:42.893706+0000","last_became_active":"2023-06-23T19:02:42.890890+0000","last_became_peered":"2023-06-23T19:02:42.890890+0000","last_unstale":"2023-06-23T19:02:42.893706+0000","last_undegraded":"2023-06-23T19:02:42.893706+0000","last_fullsized":"2023-06-23T19:02:42.893706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:25:12.283569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875504+0000","last_change":"2023-06-23T19:02:42.875504+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875504+0000","last_undegraded":"2023-06-23T19:02:42.875504+0000","last_fullsized":"2023-06-23T19:02:42.875504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-06-23T19:02:41.869925+0000","last_change":"2023-06-23T19:02:41.869925+0000","last_active":"2023-06-23T19:02:41.859689+0000","last_peered":"2023-06-23T19:02:41.859689+0000","last_clean":"2023-06-23T19:02:41.859689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:41.869925+0000","last_undegraded":"2023-06-23T19:02:41.869925+0000","last_fullsized":"2023-06-23T19:02:41.869925+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724215+0000","last_change":"2023-06-23T19:02:43.398669+0000","last_active":"2023-06-23T19:02:44.724215+0000","last_peered":"2023-06-23T19:02:44.724215+0000","last_clean":"2023-06-23T19:02:44.724215+0000","last_became_active":"2023-06-23T19:02:43.396528+0000","last_became_peered":"2023-06-23T19:02:43.396528+0000","last_unstale":"2023-06-23T19:02:44.724215+0000","last_undegraded":"2023-06-23T19:02:44.724215+0000","last_fullsized":"2023-06-23T19:02:44.724215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:07:50.110076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.901915+0000","last_change":"2023-06-23T19:02:42.891024+0000","last_active":"2023-06-23T19:02:42.901915+0000","last_peered":"2023-06-23T19:02:42.901915+0000","last_clean":"2023-06-23T19:02:42.901915+0000","last_became_active":"2023-06-23T19:02:42.890651+0000","last_became_peered":"2023-06-23T19:02:42.890651+0000","last_unstale":"2023-06-23T19:02:42.901915+0000","last_undegraded":"2023-06-23T19:02:42.901915+0000","last_fullsized":"2023-06-23T19:02:42.901915+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:12.247020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404133+0000","last_change":"2023-06-23T19:02:43.389803+0000","last_active":"2023-06-23T19:02:43.404133+0000","last_peered":"2023-06-23T19:02:43.404133+0000","last_clean":"2023-06-23T19:02:43.404133+0000","last_became_active":"2023-06-23T19:02:43.389537+0000","last_became_peered":"2023-06-23T19:02:43.389537+0000","last_unstale":"2023-06-23T19:02:43.404133+0000","last_undegraded":"2023-06-23T19:02:43.404133+0000","last_fullsized":"2023-06-23T19:02:43.404133+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:39.499477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889021+0000","last_change":"2023-06-23T19:02:42.886300+0000","last_active":"2023-06-23T19:02:42.889021+0000","last_peered":"2023-06-23T19:02:42.889021+0000","last_clean":"2023-06-23T19:02:42.889021+0000","last_became_active":"2023-06-23T19:02:42.886024+0000","last_became_peered":"2023-06-23T19:02:42.886024+0000","last_unstale":"2023-06-23T19:02:42.889021+0000","last_undegraded":"2023-06-23T19:02:42.889021+0000","last_fullsized":"2023-06-23T19:02:42.889021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:52:00.154380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874376+0000","last_change":"2023-06-23T19:02:42.874376+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874376+0000","last_undegraded":"2023-06-23T19:02:42.874376+0000","last_fullsized":"2023-06-23T19:02:42.874376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.901927+0000","last_change":"2023-06-23T19:02:42.891524+0000","last_active":"2023-06-23T19:02:42.901927+0000","last_peered":"2023-06-23T19:02:42.901927+0000","last_clean":"2023-06-23T19:02:42.901927+0000","last_became_active":"2023-06-23T19:02:42.891246+0000","last_became_peered":"2023-06-23T19:02:42.891246+0000","last_unstale":"2023-06-23T19:02:42.901927+0000","last_undegraded":"2023-06-23T19:02:42.901927+0000","last_fullsized":"2023-06-23T19:02:42.901927+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:58:35.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874957+0000","last_change":"2023-06-23T19:02:42.874957+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874957+0000","last_undegraded":"2023-06-23T19:02:42.874957+0000","last_fullsized":"2023-06-23T19:02:42.874957+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.400568+0000","last_change":"2023-06-23T19:02:42.893070+0000","last_active":"2023-06-23T19:02:43.400568+0000","last_peered":"2023-06-23T19:02:43.400568+0000","last_clean":"2023-06-23T19:02:43.400568+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:43.400568+0000","last_undegraded":"2023-06-23T19:02:43.400568+0000","last_fullsized":"2023-06-23T19:02:43.400568+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:31:59.559596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-06-23T19:02:41.870408+0000","last_change":"2023-06-23T19:02:41.870408+0000","last_active":"2023-06-23T19:02:41.859689+0000","last_peered":"2023-06-23T19:02:41.859689+0000","last_clean":"2023-06-23T19:02:41.859689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:41.870408+0000","last_undegraded":"2023-06-23T19:02:41.870408+0000","last_fullsized":"2023-06-23T19:02:41.870408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394423+0000","last_change":"2023-06-23T19:02:43.388207+0000","last_active":"2023-06-23T19:02:43.394423+0000","last_peered":"2023-06-23T19:02:43.394423+0000","last_clean":"2023-06-23T19:02:43.394423+0000","last_became_active":"2023-06-23T19:02:43.386722+0000","last_became_peered":"2023-06-23T19:02:43.386722+0000","last_unstale":"2023-06-23T19:02:43.394423+0000","last_undegraded":"2023-06-23T19:02:43.394423+0000","last_fullsized":"2023-06-23T19:02:43.394423+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:52:09.018540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892963+0000","last_change":"2023-06-23T19:02:42.890680+0000","last_active":"2023-06-23T19:02:42.892963+0000","last_peered":"2023-06-23T19:02:42.892963+0000","last_clean":"2023-06-23T19:02:42.892963+0000","last_became_active":"2023-06-23T19:02:42.890295+0000","last_became_peered":"2023-06-23T19:02:42.890295+0000","last_unstale":"2023-06-23T19:02:42.892963+0000","last_undegraded":"2023-06-23T19:02:42.892963+0000","last_fullsized":"2023-06-23T19:02:42.892963+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:01.645618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724213+0000","last_change":"2023-06-23T19:02:43.402338+0000","last_active":"2023-06-23T19:02:44.724213+0000","last_peered":"2023-06-23T19:02:44.724213+0000","last_clean":"2023-06-23T19:02:44.724213+0000","last_became_active":"2023-06-23T19:02:43.402031+0000","last_became_peered":"2023-06-23T19:02:43.402031+0000","last_unstale":"2023-06-23T19:02:44.724213+0000","last_undegraded":"2023-06-23T19:02:44.724213+0000","last_fullsized":"2023-06-23T19:02:44.724213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:38.519908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.401703+0000","last_change":"2023-06-23T19:02:42.887220+0000","last_active":"2023-06-23T19:02:43.401703+0000","last_peered":"2023-06-23T19:02:43.401703+0000","last_clean":"2023-06-23T19:02:43.401703+0000","last_became_active":"2023-06-23T19:02:42.886868+0000","last_became_peered":"2023-06-23T19:02:42.886868+0000","last_unstale":"2023-06-23T19:02:43.401703+0000","last_undegraded":"2023-06-23T19:02:43.401703+0000","last_fullsized":"2023-06-23T19:02:43.401703+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:55.099541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725181+0000","last_change":"2023-06-23T19:02:43.394474+0000","last_active":"2023-06-23T19:02:44.725181+0000","last_peered":"2023-06-23T19:02:44.725181+0000","last_clean":"2023-06-23T19:02:44.725181+0000","last_became_active":"2023-06-23T19:02:43.394113+0000","last_became_peered":"2023-06-23T19:02:43.394113+0000","last_unstale":"2023-06-23T19:02:44.725181+0000","last_undegraded":"2023-06-23T19:02:44.725181+0000","last_fullsized":"2023-06-23T19:02:44.725181+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:04.527287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.888799+0000","last_change":"2023-06-23T19:02:42.884554+0000","last_active":"2023-06-23T19:02:42.888799+0000","last_peered":"2023-06-23T19:02:42.888799+0000","last_clean":"2023-06-23T19:02:42.888799+0000","last_became_active":"2023-06-23T19:02:42.884275+0000","last_became_peered":"2023-06-23T19:02:42.884275+0000","last_unstale":"2023-06-23T19:02:42.888799+0000","last_undegraded":"2023-06-23T19:02:42.888799+0000","last_fullsized":"2023-06-23T19:02:42.888799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:42:01.141611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.876172+0000","last_change":"2023-06-23T19:02:42.876172+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.876172+0000","last_undegraded":"2023-06-23T19:02:42.876172+0000","last_fullsized":"2023-06-23T19:02:42.876172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889314+0000","last_change":"2023-06-23T19:02:42.884561+0000","last_active":"2023-06-23T19:02:42.889314+0000","last_peered":"2023-06-23T19:02:42.889314+0000","last_clean":"2023-06-23T19:02:42.889314+0000","last_became_active":"2023-06-23T19:02:42.884240+0000","last_became_peered":"2023-06-23T19:02:42.884240+0000","last_unstale":"2023-06-23T19:02:42.889314+0000","last_undegraded":"2023-06-23T19:02:42.889314+0000","last_fullsized":"2023-06-23T19:02:42.889314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:01.558584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.880610+0000","last_change":"2023-06-23T19:02:42.880610+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.880610+0000","last_undegraded":"2023-06-23T19:02:42.880610+0000","last_fullsized":"2023-06-23T19:02:42.880610+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.379862+0000","last_change":"2023-06-23T19:02:42.884674+0000","last_active":"2023-06-23T19:02:43.379862+0000","last_peered":"2023-06-23T19:02:43.379862+0000","last_clean":"2023-06-23T19:02:43.379862+0000","last_became_active":"2023-06-23T19:02:42.883763+0000","last_became_peered":"2023-06-23T19:02:42.883763+0000","last_unstale":"2023-06-23T19:02:43.379862+0000","last_undegraded":"2023-06-23T19:02:43.379862+0000","last_fullsized":"2023-06-23T19:02:43.379862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:02:36.921665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.371223+0000","last_change":"2023-06-23T19:02:42.889204+0000","last_active":"2023-06-23T19:02:43.371223+0000","last_peered":"2023-06-23T19:02:43.371223+0000","last_clean":"2023-06-23T19:02:43.371223+0000","last_became_active":"2023-06-23T19:02:42.888819+0000","last_became_peered":"2023-06-23T19:02:42.888819+0000","last_unstale":"2023-06-23T19:02:43.371223+0000","last_undegraded":"2023-06-23T19:02:43.371223+0000","last_fullsized":"2023-06-23T19:02:43.371223+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:30:36.052035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394362+0000","last_change":"2023-06-23T19:02:43.383467+0000","last_active":"2023-06-23T19:02:43.394362+0000","last_peered":"2023-06-23T19:02:43.394362+0000","last_clean":"2023-06-23T19:02:43.394362+0000","last_became_active":"2023-06-23T19:02:43.383168+0000","last_became_peered":"2023-06-23T19:02:43.383168+0000","last_unstale":"2023-06-23T19:02:43.394362+0000","last_undegraded":"2023-06-23T19:02:43.394362+0000","last_fullsized":"2023-06-23T19:02:43.394362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:05:15.959248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889758+0000","last_change":"2023-06-23T19:02:42.887650+0000","last_active":"2023-06-23T19:02:42.889758+0000","last_peered":"2023-06-23T19:02:42.889758+0000","last_clean":"2023-06-23T19:02:42.889758+0000","last_became_active":"2023-06-23T19:02:42.887327+0000","last_became_peered":"2023-06-23T19:02:42.887327+0000","last_unstale":"2023-06-23T19:02:42.889758+0000","last_undegraded":"2023-06-23T19:02:42.889758+0000","last_fullsized":"2023-06-23T19:02:42.889758+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:44.889242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.879590+0000","last_change":"2023-06-23T19:02:42.879590+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.879590+0000","last_undegraded":"2023-06-23T19:02:42.879590+0000","last_fullsized":"2023-06-23T19:02:42.879590+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.372976+0000","last_change":"2023-06-23T19:02:42.889687+0000","last_active":"2023-06-23T19:02:43.372976+0000","last_peered":"2023-06-23T19:02:43.372976+0000","last_clean":"2023-06-23T19:02:43.372976+0000","last_became_active":"2023-06-23T19:02:42.889440+0000","last_became_peered":"2023-06-23T19:02:42.889440+0000","last_unstale":"2023-06-23T19:02:43.372976+0000","last_undegraded":"2023-06-23T19:02:43.372976+0000","last_fullsized":"2023-06-23T19:02:43.372976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:07:59.809093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.883175+0000","last_change":"2023-06-23T19:00:58.992193+0000","last_active":"2023-06-23T19:02:42.883175+0000","last_peered":"2023-06-23T19:02:42.883175+0000","last_clean":"2023-06-23T19:02:42.883175+0000","last_became_active":"2023-06-23T19:00:58.991974+0000","last_became_peered":"2023-06-23T19:00:58.991974+0000","last_unstale":"2023-06-23T19:02:42.883175+0000","last_undegraded":"2023-06-23T19:02:42.883175+0000","last_fullsized":"2023-06-23T19:02:42.883175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:27:37.930240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724922+0000","last_change":"2023-06-23T19:02:43.402921+0000","last_active":"2023-06-23T19:02:44.724922+0000","last_peered":"2023-06-23T19:02:44.724922+0000","last_clean":"2023-06-23T19:02:44.724922+0000","last_became_active":"2023-06-23T19:02:43.402032+0000","last_became_peered":"2023-06-23T19:02:43.402032+0000","last_unstale":"2023-06-23T19:02:44.724922+0000","last_undegraded":"2023-06-23T19:02:44.724922+0000","last_fullsized":"2023-06-23T19:02:44.724922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:00:17.700963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.901939+0000","last_change":"2023-06-23T19:02:42.891573+0000","last_active":"2023-06-23T19:02:42.901939+0000","last_peered":"2023-06-23T19:02:42.901939+0000","last_clean":"2023-06-23T19:02:42.901939+0000","last_became_active":"2023-06-23T19:02:42.891289+0000","last_became_peered":"2023-06-23T19:02:42.891289+0000","last_unstale":"2023-06-23T19:02:42.901939+0000","last_undegraded":"2023-06-23T19:02:42.901939+0000","last_fullsized":"2023-06-23T19:02:42.901939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:17:26.599119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.380034+0000","last_change":"2023-06-23T19:00:58.032255+0000","last_active":"2023-06-23T19:02:43.380034+0000","last_peered":"2023-06-23T19:02:43.380034+0000","last_clean":"2023-06-23T19:02:43.380034+0000","last_became_active":"2023-06-23T19:00:58.031815+0000","last_became_peered":"2023-06-23T19:00:58.031815+0000","last_unstale":"2023-06-23T19:02:43.380034+0000","last_undegraded":"2023-06-23T19:02:43.380034+0000","last_fullsized":"2023-06-23T19:02:43.380034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:00:58.953928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404952+0000","last_change":"2023-06-23T19:02:43.396991+0000","last_active":"2023-06-23T19:02:43.404952+0000","last_peered":"2023-06-23T19:02:43.404952+0000","last_clean":"2023-06-23T19:02:43.404952+0000","last_became_active":"2023-06-23T19:02:43.396725+0000","last_became_peered":"2023-06-23T19:02:43.396725+0000","last_unstale":"2023-06-23T19:02:43.404952+0000","last_undegraded":"2023-06-23T19:02:43.404952+0000","last_fullsized":"2023-06-23T19:02:43.404952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:23.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.895015+0000","last_change":"2023-06-23T19:02:42.893342+0000","last_active":"2023-06-23T19:02:42.895015+0000","last_peered":"2023-06-23T19:02:42.895015+0000","last_clean":"2023-06-23T19:02:42.895015+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:42.895015+0000","last_undegraded":"2023-06-23T19:02:42.895015+0000","last_fullsized":"2023-06-23T19:02:42.895015+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:24:50.998086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-23T19:02:41.869802+0000","last_change":"2023-06-23T19:00:58.810848+0000","last_active":"2023-06-23T19:02:41.869802+0000","last_peered":"2023-06-23T19:02:41.869802+0000","last_clean":"2023-06-23T19:02:41.869802+0000","last_became_active":"2023-06-23T19:00:58.810530+0000","last_became_peered":"2023-06-23T19:00:58.810530+0000","last_unstale":"2023-06-23T19:02:41.869802+0000","last_undegraded":"2023-06-23T19:02:41.869802+0000","last_fullsized":"2023-06-23T19:02:41.869802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:20:36.196696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404159+0000","last_change":"2023-06-23T19:02:43.390188+0000","last_active":"2023-06-23T19:02:43.404159+0000","last_peered":"2023-06-23T19:02:43.404159+0000","last_clean":"2023-06-23T19:02:43.404159+0000","last_became_active":"2023-06-23T19:02:43.389894+0000","last_became_peered":"2023-06-23T19:02:43.389894+0000","last_unstale":"2023-06-23T19:02:43.404159+0000","last_undegraded":"2023-06-23T19:02:43.404159+0000","last_fullsized":"2023-06-23T19:02:43.404159+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:18:40.426963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404937+0000","last_change":"2023-06-23T19:02:42.889466+0000","last_active":"2023-06-23T19:02:43.404937+0000","last_peered":"2023-06-23T19:02:43.404937+0000","last_clean":"2023-06-23T19:02:43.404937+0000","last_became_active":"2023-06-23T19:02:42.889189+0000","last_became_peered":"2023-06-23T19:02:42.889189+0000","last_unstale":"2023-06-23T19:02:43.404937+0000","last_undegraded":"2023-06-23T19:02:43.404937+0000","last_fullsized":"2023-06-23T19:02:43.404937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:54.621572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.377300+0000","last_change":"2023-06-23T19:00:58.032352+0000","last_active":"2023-06-23T19:02:43.377300+0000","last_peered":"2023-06-23T19:02:43.377300+0000","last_clean":"2023-06-23T19:02:43.377300+0000","last_became_active":"2023-06-23T19:00:58.031905+0000","last_became_peered":"2023-06-23T19:00:58.031905+0000","last_unstale":"2023-06-23T19:02:43.377300+0000","last_undegraded":"2023-06-23T19:02:43.377300+0000","last_fullsized":"2023-06-23T19:02:43.377300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:14:56.282366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.878044+0000","last_change":"2023-06-23T19:00:50.002765+0000","last_active":"2023-06-23T19:02:42.878044+0000","last_peered":"2023-06-23T19:02:42.878044+0000","last_clean":"2023-06-23T19:02:42.878044+0000","last_became_active":"2023-06-23T19:00:50.002445+0000","last_became_peered":"2023-06-23T19:00:50.002445+0000","last_unstale":"2023-06-23T19:02:42.878044+0000","last_undegraded":"2023-06-23T19:02:42.878044+0000","last_fullsized":"2023-06-23T19:02:42.878044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_clean_scrub_stamp":"2023-06-23T19:00:48.989242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:36.277808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874940+0000","last_change":"2023-06-23T19:02:42.874940+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874940+0000","last_undegraded":"2023-06-23T19:02:42.874940+0000","last_fullsized":"2023-06-23T19:02:42.874940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.896404+0000","last_change":"2023-06-23T19:02:42.892907+0000","last_active":"2023-06-23T19:02:42.896404+0000","last_peered":"2023-06-23T19:02:42.896404+0000","last_clean":"2023-06-23T19:02:42.896404+0000","last_became_active":"2023-06-23T19:02:42.892670+0000","last_became_peered":"2023-06-23T19:02:42.892670+0000","last_unstale":"2023-06-23T19:02:42.896404+0000","last_undegraded":"2023-06-23T19:02:42.896404+0000","last_fullsized":"2023-06-23T19:02:42.896404+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:18:39.422428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.878177+0000","last_change":"2023-06-23T19:00:58.034045+0000","last_active":"2023-06-23T19:02:42.878177+0000","last_peered":"2023-06-23T19:02:42.878177+0000","last_clean":"2023-06-23T19:02:42.878177+0000","last_became_active":"2023-06-23T19:00:58.033654+0000","last_became_peered":"2023-06-23T19:00:58.033654+0000","last_unstale":"2023-06-23T19:02:42.878177+0000","last_undegraded":"2023-06-23T19:02:42.878177+0000","last_fullsized":"2023-06-23T19:02:42.878177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:00:00.508536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.400804+0000","last_change":"2023-06-23T19:02:43.394471+0000","last_active":"2023-06-23T19:02:43.400804+0000","last_peered":"2023-06-23T19:02:43.400804+0000","last_clean":"2023-06-23T19:02:43.400804+0000","last_became_active":"2023-06-23T19:02:43.394192+0000","last_became_peered":"2023-06-23T19:02:43.394192+0000","last_unstale":"2023-06-23T19:02:43.400804+0000","last_undegraded":"2023-06-23T19:02:43.400804+0000","last_fullsized":"2023-06-23T19:02:43.400804+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:30:39.670564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.893989+0000","last_change":"2023-06-23T19:02:42.891170+0000","last_active":"2023-06-23T19:02:42.893989+0000","last_peered":"2023-06-23T19:02:42.893989+0000","last_clean":"2023-06-23T19:02:42.893989+0000","last_became_active":"2023-06-23T19:02:42.890891+0000","last_became_peered":"2023-06-23T19:02:42.890891+0000","last_unstale":"2023-06-23T19:02:42.893989+0000","last_undegraded":"2023-06-23T19:02:42.893989+0000","last_fullsized":"2023-06-23T19:02:42.893989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:05:14.954713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.878747+0000","last_change":"2023-06-23T19:00:58.992645+0000","last_active":"2023-06-23T19:02:42.878747+0000","last_peered":"2023-06-23T19:02:42.878747+0000","last_clean":"2023-06-23T19:02:42.878747+0000","last_became_active":"2023-06-23T19:00:58.992291+0000","last_became_peered":"2023-06-23T19:00:58.992291+0000","last_unstale":"2023-06-23T19:02:42.878747+0000","last_undegraded":"2023-06-23T19:02:42.878747+0000","last_fullsized":"2023-06-23T19:02:42.878747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:17:46.386176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875537+0000","last_change":"2023-06-23T19:02:42.875537+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875537+0000","last_undegraded":"2023-06-23T19:02:42.875537+0000","last_fullsized":"2023-06-23T19:02:42.875537+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892271+0000","last_change":"2023-06-23T19:02:42.889986+0000","last_active":"2023-06-23T19:02:42.892271+0000","last_peered":"2023-06-23T19:02:42.892271+0000","last_clean":"2023-06-23T19:02:42.892271+0000","last_became_active":"2023-06-23T19:02:42.889346+0000","last_became_peered":"2023-06-23T19:02:42.889346+0000","last_unstale":"2023-06-23T19:02:42.892271+0000","last_undegraded":"2023-06-23T19:02:42.892271+0000","last_fullsized":"2023-06-23T19:02:42.892271+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:32.354763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.883265+0000","last_change":"2023-06-23T19:00:58.034828+0000","last_active":"2023-06-23T19:02:42.883265+0000","last_peered":"2023-06-23T19:02:42.883265+0000","last_clean":"2023-06-23T19:02:42.883265+0000","last_became_active":"2023-06-23T19:00:58.034502+0000","last_became_peered":"2023-06-23T19:00:58.034502+0000","last_unstale":"2023-06-23T19:02:42.883265+0000","last_undegraded":"2023-06-23T19:02:42.883265+0000","last_fullsized":"2023-06-23T19:02:42.883265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:28:51.207968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874413+0000","last_change":"2023-06-23T19:02:42.874413+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874413+0000","last_undegraded":"2023-06-23T19:02:42.874413+0000","last_fullsized":"2023-06-23T19:02:42.874413+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.894456+0000","last_change":"2023-06-23T19:02:42.893057+0000","last_active":"2023-06-23T19:02:42.894456+0000","last_peered":"2023-06-23T19:02:42.894456+0000","last_clean":"2023-06-23T19:02:42.894456+0000","last_became_active":"2023-06-23T19:02:42.891406+0000","last_became_peered":"2023-06-23T19:02:42.891406+0000","last_unstale":"2023-06-23T19:02:42.894456+0000","last_undegraded":"2023-06-23T19:02:42.894456+0000","last_fullsized":"2023-06-23T19:02:42.894456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:09:56.709855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725059+0000","last_change":"2023-06-23T19:00:58.035530+0000","last_active":"2023-06-23T19:02:44.725059+0000","last_peered":"2023-06-23T19:02:44.725059+0000","last_clean":"2023-06-23T19:02:44.725059+0000","last_became_active":"2023-06-23T19:00:58.035130+0000","last_became_peered":"2023-06-23T19:00:58.035130+0000","last_unstale":"2023-06-23T19:02:44.725059+0000","last_undegraded":"2023-06-23T19:02:44.725059+0000","last_fullsized":"2023-06-23T19:02:44.725059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:46:47.648237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":800713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.433},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.95099999999999996}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.008}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":210345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.499},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.88}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.92200000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":196915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.375}]},{"osd":1,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.318},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":5.6539999999999999,"5min":5.6539999999999999,"15min":5.6539999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.875},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jun 23 19:01:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.84299999999999997}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":225438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.629},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70099999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":203405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.501}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.83799999999999997}]},{"osd":6,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":9.6329999999999991,"5min":9.6329999999999991,"15min":9.6329999999999991},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.75},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.86199999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":203405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.441}]},{"osd":1,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.751}]}]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":203405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.88300000000000001}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.748},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92400000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":800713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.992,"5min":7.992,"15min":7.992},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":7.9500000000000002,"5min":7.9500000000000002,"15min":7.9500000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":10.835000000000001,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.625},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T19:02:47.751 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T19:02:47.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.972+0000 7fa915bff700 1 Processor -- start 2023-06-23T19:02:47.976 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.972+0000 7fa915bff700 1 -- start start 2023-06-23T19:02:47.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa915bff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa910158ef0 0x7fa9100cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.977 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa915bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 0x7fa9100702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa915bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa910070c60 con 0x7fa910070820 2023-06-23T19:02:47.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa915bff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91006c4d0 con 0x7fa910158ef0 2023-06-23T19:02:47.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa915bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100c9510 con 0x7fa91006c060 2023-06-23T19:02:47.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90ffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa910070820 0x7fa9100ca290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53710/0 (socket says 172.21.15.136:53710) 2023-06-23T19:02:47.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90ffff700 1 -- 172.21.15.136:0/2948625425 learned_addr learned my addr 172.21.15.136:0/2948625425 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:47.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90f7fe700 1 --2- 172.21.15.136:0/2948625425 >> v2:172.21.15.136:3300/0 conn(0x7fa910158ef0 0x7fa9100cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90effd700 1 --2- 172.21.15.136:0/2948625425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 0x7fa9100702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90e7fc700 1 -- 172.21.15.136:0/2948625425 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293699368 0 0) 0x7fa910070c60 con 0x7fa910070820 2023-06-23T19:02:47.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90e7fc700 1 -- 172.21.15.136:0/2948625425 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f80035b0 con 0x7fa910070820 2023-06-23T19:02:47.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90f7fe700 1 -- 172.21.15.136:0/2948625425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 msgr2=0x7fa9100702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:47.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90f7fe700 1 --2- 172.21.15.136:0/2948625425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 0x7fa9100702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.980 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90f7fe700 1 -- 172.21.15.136:0/2948625425 >> v1:172.21.15.136:6789/0 conn(0x7fa910070820 legacy=0x7fa9100ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.974+0000 7fa90f7fe700 1 -- 172.21.15.136:0/2948625425 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9100cd6a0 con 0x7fa910158ef0 2023-06-23T19:02:47.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.975+0000 7fa90f7fe700 1 --2- 172.21.15.136:0/2948625425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 0x7fa9100cf1e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa900009840 tx=0x7fa900009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a274918a9c44f4d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:47.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.975+0000 7fa90e7fc700 1 -- 172.21.15.136:0/2948625425 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900011830 con 0x7fa910158ef0 2023-06-23T19:02:47.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.975+0000 7fa90e7fc700 1 -- 172.21.15.136:0/2948625425 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa900011990 con 0x7fa910158ef0 2023-06-23T19:02:47.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.975+0000 7fa90e7fc700 1 -- 172.21.15.136:0/2948625425 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900011d00 con 0x7fa910158ef0 2023-06-23T19:02:47.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.975+0000 7fa915bff700 1 -- 172.21.15.136:0/2948625425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 msgr2=0x7fa9100cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.975+0000 7fa915bff700 1 --2- 172.21.15.136:0/2948625425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 0x7fa9100cf1e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa900009840 tx=0x7fa900009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:47.981 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.976+0000 7fa915bff700 1 -- 172.21.15.136:0/2948625425 shutdown_connections 2023-06-23T19:02:47.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.976+0000 7fa915bff700 1 --2- 172.21.15.136:0/2948625425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 0x7fa9100cf1e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.976+0000 7fa915bff700 1 --2- 172.21.15.136:0/2948625425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 0x7fa9100702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.976+0000 7fa915bff700 1 -- 172.21.15.136:0/2948625425 >> 172.21.15.136:0/2948625425 conn(0x7fa9100b0ef0 msgr2=0x7fa9100ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:47.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.976+0000 7fa915bff700 1 -- 172.21.15.136:0/2948625425 shutdown_connections 2023-06-23T19:02:47.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.976+0000 7fa915bff700 1 -- 172.21.15.136:0/2948625425 wait complete. 2023-06-23T19:02:47.983 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.977+0000 7fa915bff700 1 Processor -- start 2023-06-23T19:02:47.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.978+0000 7fa915bff700 1 -- start start 2023-06-23T19:02:47.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.978+0000 7fa915bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 0x7fa9100c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.978+0000 7fa915bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa910070820 0x7fa9101f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.978+0000 7fa915bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 0x7fa9100ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.978+0000 7fa915bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100c74a0 con 0x7fa910158ef0 2023-06-23T19:02:47.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.978+0000 7fa915bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100c7e70 con 0x7fa910070820 2023-06-23T19:02:47.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.978+0000 7fa915bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100c6890 con 0x7fa91006c060 2023-06-23T19:02:47.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 0x7fa9100ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 0x7fa9100ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55898/0 (socket says 172.21.15.136:55898) 2023-06-23T19:02:47.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90ffff700 1 -- 172.21.15.136:0/525594924 learned_addr learned my addr 172.21.15.136:0/525594924 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:47.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90effd700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa910070820 0x7fa9101f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90f7fe700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 0x7fa9100c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90ffff700 1 -- 172.21.15.136:0/525594924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 msgr2=0x7fa9100c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90ffff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 0x7fa9100c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90ffff700 1 -- 172.21.15.136:0/525594924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa910070820 msgr2=0x7fa9101f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:47.993 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90ffff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa910070820 0x7fa9101f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:47.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90ffff700 1 -- 172.21.15.136:0/525594924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000094a0 con 0x7fa910158ef0 2023-06-23T19:02:47.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa90ffff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 0x7fa9100ae1d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa90800cb40 tx=0x7fa90800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:47.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.979+0000 7fa8f7fff700 1 -- 172.21.15.136:0/525594924 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90800ab50 con 0x7fa910158ef0 2023-06-23T19:02:47.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.980+0000 7fa8f7fff700 1 -- 172.21.15.136:0/525594924 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90800acb0 con 0x7fa910158ef0 2023-06-23T19:02:47.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.980+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9100c6b70 con 0x7fa910158ef0 2023-06-23T19:02:47.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.980+0000 7fa8f7fff700 1 -- 172.21.15.136:0/525594924 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908012620 con 0x7fa910158ef0 2023-06-23T19:02:47.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.980+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9100c7130 con 0x7fa910158ef0 2023-06-23T19:02:47.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.981+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9100c7610 con 0x7fa910158ef0 2023-06-23T19:02:47.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.982+0000 7fa8f7fff700 1 -- 172.21.15.136:0/525594924 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa90801b3b0 con 0x7fa910158ef0 2023-06-23T19:02:47.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.983+0000 7fa8f7fff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa8fc06ace0 0x7fa8fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:47.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.983+0000 7fa8f7fff700 1 -- 172.21.15.136:0/525594924 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa9080893f0 con 0x7fa910158ef0 2023-06-23T19:02:47.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.983+0000 7fa90f7fe700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa8fc06ace0 0x7fa8fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:47.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.984+0000 7fa90f7fe700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa8fc06ace0 0x7fa8fc06d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9100c82b0 tx=0x7fa900008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:47.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:47.987+0000 7fa8f7fff700 1 -- 172.21.15.136:0/525594924 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa908054350 con 0x7fa910158ef0 2023-06-23T19:02:48.186 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.183+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 --> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9100c97b0 con 0x7fa8fc06ace0 2023-06-23T19:02:48.195 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.191+0000 7fa8f7fff700 1 -- 172.21.15.136:0/525594924 <== mgr.4105 v2:172.21.15.136:6832/2653877961 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308160 (secure 0 0 0) 0x7fa900011b00 con 0x7fa8fc06ace0 2023-06-23T19:02:48.199 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:48.201 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa8fc06ace0 msgr2=0x7fa8fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.201 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa8fc06ace0 0x7fa8fc06d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9100c82b0 tx=0x7fa900008030 comp rx=0 tx=0).stop 2023-06-23T19:02:48.201 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 msgr2=0x7fa9100ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.201 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 0x7fa9100ae1d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa90800cb40 tx=0x7fa90800cf00 comp rx=0 tx=0).stop 2023-06-23T19:02:48.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 shutdown_connections 2023-06-23T19:02:48.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa8fc06ace0 0x7fa8fc06d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910158ef0 0x7fa9100ae1d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa91006c060 0x7fa9100c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 --2- 172.21.15.136:0/525594924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa910070820 0x7fa9101f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 >> 172.21.15.136:0/525594924 conn(0x7fa9100b0ef0 msgr2=0x7fa91006d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:48.202 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 shutdown_connections 2023-06-23T19:02:48.203 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.196+0000 7fa915bff700 1 -- 172.21.15.136:0/525594924 wait complete. 2023-06-23T19:02:48.203 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2023-06-23T19:02:48.217 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-06-23T19:02:46.956551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":198,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220492,"kb_used_data":4876,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754228,"statfs":{"total":773094113280,"available":772868329472,"internally_reserved":0,"allocated":4993024,"data_stored":2844339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.091817"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875866+0000","last_change":"2023-06-23T19:02:42.875866+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875866+0000","last_undegraded":"2023-06-23T19:02:42.875866+0000","last_fullsized":"2023-06-23T19:02:42.875866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.406971+0000","last_change":"2023-06-23T19:02:43.405015+0000","last_active":"2023-06-23T19:02:43.406971+0000","last_peered":"2023-06-23T19:02:43.406971+0000","last_clean":"2023-06-23T19:02:43.406971+0000","last_became_active":"2023-06-23T19:02:43.404718+0000","last_became_peered":"2023-06-23T19:02:43.404718+0000","last_unstale":"2023-06-23T19:02:43.406971+0000","last_undegraded":"2023-06-23T19:02:43.406971+0000","last_fullsized":"2023-06-23T19:02:43.406971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:13:11.771904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.882083+0000","last_change":"2023-06-23T19:02:42.882083+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.882083+0000","last_undegraded":"2023-06-23T19:02:42.882083+0000","last_fullsized":"2023-06-23T19:02:42.882083+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405222+0000","last_change":"2023-06-23T19:02:43.402422+0000","last_active":"2023-06-23T19:02:43.405222+0000","last_peered":"2023-06-23T19:02:43.405222+0000","last_clean":"2023-06-23T19:02:43.405222+0000","last_became_active":"2023-06-23T19:02:43.402157+0000","last_became_peered":"2023-06-23T19:02:43.402157+0000","last_unstale":"2023-06-23T19:02:43.405222+0000","last_undegraded":"2023-06-23T19:02:43.405222+0000","last_fullsized":"2023-06-23T19:02:43.405222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:57:50.309764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.403065+0000","last_change":"2023-06-23T19:02:43.395438+0000","last_active":"2023-06-23T19:02:43.403065+0000","last_peered":"2023-06-23T19:02:43.403065+0000","last_clean":"2023-06-23T19:02:43.403065+0000","last_became_active":"2023-06-23T19:02:43.395153+0000","last_became_peered":"2023-06-23T19:02:43.395153+0000","last_unstale":"2023-06-23T19:02:43.403065+0000","last_undegraded":"2023-06-23T19:02:43.403065+0000","last_fullsized":"2023-06-23T19:02:43.403065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:41:51.912362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875376+0000","last_change":"2023-06-23T19:02:42.875376+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875376+0000","last_undegraded":"2023-06-23T19:02:42.875376+0000","last_fullsized":"2023-06-23T19:02:42.875376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875598+0000","last_change":"2023-06-23T19:02:42.875598+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875598+0000","last_undegraded":"2023-06-23T19:02:42.875598+0000","last_fullsized":"2023-06-23T19:02:42.875598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405254+0000","last_change":"2023-06-23T19:02:43.403369+0000","last_active":"2023-06-23T19:02:43.405254+0000","last_peered":"2023-06-23T19:02:43.405254+0000","last_clean":"2023-06-23T19:02:43.405254+0000","last_became_active":"2023-06-23T19:02:43.403084+0000","last_became_peered":"2023-06-23T19:02:43.403084+0000","last_unstale":"2023-06-23T19:02:43.405254+0000","last_undegraded":"2023-06-23T19:02:43.405254+0000","last_fullsized":"2023-06-23T19:02:43.405254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:07:48.893356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394405+0000","last_change":"2023-06-23T19:02:43.386467+0000","last_active":"2023-06-23T19:02:43.394405+0000","last_peered":"2023-06-23T19:02:43.394405+0000","last_clean":"2023-06-23T19:02:43.394405+0000","last_became_active":"2023-06-23T19:02:43.386192+0000","last_became_peered":"2023-06-23T19:02:43.386192+0000","last_unstale":"2023-06-23T19:02:43.394405+0000","last_undegraded":"2023-06-23T19:02:43.394405+0000","last_fullsized":"2023-06-23T19:02:43.394405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:12.505159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405097+0000","last_change":"2023-06-23T19:02:43.402134+0000","last_active":"2023-06-23T19:02:43.405097+0000","last_peered":"2023-06-23T19:02:43.405097+0000","last_clean":"2023-06-23T19:02:43.405097+0000","last_became_active":"2023-06-23T19:02:43.401870+0000","last_became_peered":"2023-06-23T19:02:43.401870+0000","last_unstale":"2023-06-23T19:02:43.405097+0000","last_undegraded":"2023-06-23T19:02:43.405097+0000","last_fullsized":"2023-06-23T19:02:43.405097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:45.418052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.393949+0000","last_change":"2023-06-23T19:02:43.386081+0000","last_active":"2023-06-23T19:02:43.393949+0000","last_peered":"2023-06-23T19:02:43.393949+0000","last_clean":"2023-06-23T19:02:43.393949+0000","last_became_active":"2023-06-23T19:02:43.385795+0000","last_became_peered":"2023-06-23T19:02:43.385795+0000","last_unstale":"2023-06-23T19:02:43.393949+0000","last_undegraded":"2023-06-23T19:02:43.393949+0000","last_fullsized":"2023-06-23T19:02:43.393949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:58:59.234601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.402361+0000","last_change":"2023-06-23T19:02:43.395109+0000","last_active":"2023-06-23T19:02:43.402361+0000","last_peered":"2023-06-23T19:02:43.402361+0000","last_clean":"2023-06-23T19:02:43.402361+0000","last_became_active":"2023-06-23T19:02:43.394402+0000","last_became_peered":"2023-06-23T19:02:43.394402+0000","last_unstale":"2023-06-23T19:02:43.402361+0000","last_undegraded":"2023-06-23T19:02:43.402361+0000","last_fullsized":"2023-06-23T19:02:43.402361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:57:20.585183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.393814+0000","last_change":"2023-06-23T19:02:43.383462+0000","last_active":"2023-06-23T19:02:43.393814+0000","last_peered":"2023-06-23T19:02:43.393814+0000","last_clean":"2023-06-23T19:02:43.393814+0000","last_became_active":"2023-06-23T19:02:43.383158+0000","last_became_peered":"2023-06-23T19:02:43.383158+0000","last_unstale":"2023-06-23T19:02:43.393814+0000","last_undegraded":"2023-06-23T19:02:43.393814+0000","last_fullsized":"2023-06-23T19:02:43.393814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:31:01.213549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874398+0000","last_change":"2023-06-23T19:02:42.874398+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874398+0000","last_undegraded":"2023-06-23T19:02:42.874398+0000","last_fullsized":"2023-06-23T19:02:42.874398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724048+0000","last_change":"2023-06-23T19:02:43.400056+0000","last_active":"2023-06-23T19:02:44.724048+0000","last_peered":"2023-06-23T19:02:44.724048+0000","last_clean":"2023-06-23T19:02:44.724048+0000","last_became_active":"2023-06-23T19:02:43.399740+0000","last_became_peered":"2023-06-23T19:02:43.399740+0000","last_unstale":"2023-06-23T19:02:44.724048+0000","last_undegraded":"2023-06-23T19:02:44.724048+0000","last_fullsized":"2023-06-23T19:02:44.724048+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:32:56.376089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.883405+0000","last_change":"2023-06-23T19:02:42.883405+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.883405+0000","last_undegraded":"2023-06-23T19:02:42.883405+0000","last_fullsized":"2023-06-23T19:02:42.883405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.884789+0000","last_change":"2023-06-23T19:02:42.884789+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.884789+0000","last_undegraded":"2023-06-23T19:02:42.884789+0000","last_fullsized":"2023-06-23T19:02:42.884789+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725030+0000","last_change":"2023-06-23T19:02:43.400304+0000","last_active":"2023-06-23T19:02:44.725030+0000","last_peered":"2023-06-23T19:02:44.725030+0000","last_clean":"2023-06-23T19:02:44.725030+0000","last_became_active":"2023-06-23T19:02:43.396953+0000","last_became_peered":"2023-06-23T19:02:43.396953+0000","last_unstale":"2023-06-23T19:02:44.725030+0000","last_undegraded":"2023-06-23T19:02:44.725030+0000","last_fullsized":"2023-06-23T19:02:44.725030+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:41.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.876390+0000","last_change":"2023-06-23T19:02:42.876390+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.876390+0000","last_undegraded":"2023-06-23T19:02:42.876390+0000","last_fullsized":"2023-06-23T19:02:42.876390+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405195+0000","last_change":"2023-06-23T19:02:43.402236+0000","last_active":"2023-06-23T19:02:43.405195+0000","last_peered":"2023-06-23T19:02:43.405195+0000","last_clean":"2023-06-23T19:02:43.405195+0000","last_became_active":"2023-06-23T19:02:43.401856+0000","last_became_peered":"2023-06-23T19:02:43.401856+0000","last_unstale":"2023-06-23T19:02:43.405195+0000","last_undegraded":"2023-06-23T19:02:43.405195+0000","last_fullsized":"2023-06-23T19:02:43.405195+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:11:17.204985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723948+0000","last_change":"2023-06-23T19:02:43.404668+0000","last_active":"2023-06-23T19:02:44.723948+0000","last_peered":"2023-06-23T19:02:44.723948+0000","last_clean":"2023-06-23T19:02:44.723948+0000","last_became_active":"2023-06-23T19:02:43.404069+0000","last_became_peered":"2023-06-23T19:02:43.404069+0000","last_unstale":"2023-06-23T19:02:44.723948+0000","last_undegraded":"2023-06-23T19:02:44.723948+0000","last_fullsized":"2023-06-23T19:02:44.723948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:03.176159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724003+0000","last_change":"2023-06-23T19:02:43.395358+0000","last_active":"2023-06-23T19:02:44.724003+0000","last_peered":"2023-06-23T19:02:44.724003+0000","last_clean":"2023-06-23T19:02:44.724003+0000","last_became_active":"2023-06-23T19:02:43.394956+0000","last_became_peered":"2023-06-23T19:02:43.394956+0000","last_unstale":"2023-06-23T19:02:44.724003+0000","last_undegraded":"2023-06-23T19:02:44.724003+0000","last_fullsized":"2023-06-23T19:02:44.724003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:20.784110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725079+0000","last_change":"2023-06-23T19:02:43.395135+0000","last_active":"2023-06-23T19:02:44.725079+0000","last_peered":"2023-06-23T19:02:44.725079+0000","last_clean":"2023-06-23T19:02:44.725079+0000","last_became_active":"2023-06-23T19:02:43.394454+0000","last_became_peered":"2023-06-23T19:02:43.394454+0000","last_unstale":"2023-06-23T19:02:44.725079+0000","last_undegraded":"2023-06-23T19:02:44.725079+0000","last_fullsized":"2023-06-23T19:02:44.725079+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:46:33.411319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.880250+0000","last_change":"2023-06-23T19:02:42.880250+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.880250+0000","last_undegraded":"2023-06-23T19:02:42.880250+0000","last_fullsized":"2023-06-23T19:02:42.880250+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.402382+0000","last_change":"2023-06-23T19:02:43.395428+0000","last_active":"2023-06-23T19:02:43.402382+0000","last_peered":"2023-06-23T19:02:43.402382+0000","last_clean":"2023-06-23T19:02:43.402382+0000","last_became_active":"2023-06-23T19:02:43.394828+0000","last_became_peered":"2023-06-23T19:02:43.394828+0000","last_unstale":"2023-06-23T19:02:43.402382+0000","last_undegraded":"2023-06-23T19:02:43.402382+0000","last_fullsized":"2023-06-23T19:02:43.402382+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:57:38.773378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724266+0000","last_change":"2023-06-23T19:02:43.390376+0000","last_active":"2023-06-23T19:02:44.724266+0000","last_peered":"2023-06-23T19:02:44.724266+0000","last_clean":"2023-06-23T19:02:44.724266+0000","last_became_active":"2023-06-23T19:02:43.390091+0000","last_became_peered":"2023-06-23T19:02:43.390091+0000","last_unstale":"2023-06-23T19:02:44.724266+0000","last_undegraded":"2023-06-23T19:02:44.724266+0000","last_fullsized":"2023-06-23T19:02:44.724266+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:38:21.075927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.883638+0000","last_change":"2023-06-23T19:02:42.883638+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.883638+0000","last_undegraded":"2023-06-23T19:02:42.883638+0000","last_fullsized":"2023-06-23T19:02:42.883638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.876479+0000","last_change":"2023-06-23T19:02:42.876479+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.876479+0000","last_undegraded":"2023-06-23T19:02:42.876479+0000","last_fullsized":"2023-06-23T19:02:42.876479+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.881101+0000","last_change":"2023-06-23T19:02:42.881101+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.881101+0000","last_undegraded":"2023-06-23T19:02:42.881101+0000","last_fullsized":"2023-06-23T19:02:42.881101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.890507+0000","last_change":"2023-06-23T19:02:42.887806+0000","last_active":"2023-06-23T19:02:42.890507+0000","last_peered":"2023-06-23T19:02:42.890507+0000","last_clean":"2023-06-23T19:02:42.890507+0000","last_became_active":"2023-06-23T19:02:42.887517+0000","last_became_peered":"2023-06-23T19:02:42.887517+0000","last_unstale":"2023-06-23T19:02:42.890507+0000","last_undegraded":"2023-06-23T19:02:42.890507+0000","last_fullsized":"2023-06-23T19:02:42.890507+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:04:34.712857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724889+0000","last_change":"2023-06-23T19:02:43.395362+0000","last_active":"2023-06-23T19:02:44.724889+0000","last_peered":"2023-06-23T19:02:44.724889+0000","last_clean":"2023-06-23T19:02:44.724889+0000","last_became_active":"2023-06-23T19:02:43.394818+0000","last_became_peered":"2023-06-23T19:02:43.394818+0000","last_unstale":"2023-06-23T19:02:44.724889+0000","last_undegraded":"2023-06-23T19:02:44.724889+0000","last_fullsized":"2023-06-23T19:02:44.724889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:04:50.409635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.893903+0000","last_change":"2023-06-23T19:02:42.891979+0000","last_active":"2023-06-23T19:02:42.893903+0000","last_peered":"2023-06-23T19:02:42.893903+0000","last_clean":"2023-06-23T19:02:42.893903+0000","last_became_active":"2023-06-23T19:02:42.890688+0000","last_became_peered":"2023-06-23T19:02:42.890688+0000","last_unstale":"2023-06-23T19:02:42.893903+0000","last_undegraded":"2023-06-23T19:02:42.893903+0000","last_fullsized":"2023-06-23T19:02:42.893903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:31.221738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.395814+0000","last_change":"2023-06-23T19:02:43.393361+0000","last_active":"2023-06-23T19:02:43.395814+0000","last_peered":"2023-06-23T19:02:43.395814+0000","last_clean":"2023-06-23T19:02:43.395814+0000","last_became_active":"2023-06-23T19:02:43.393080+0000","last_became_peered":"2023-06-23T19:02:43.393080+0000","last_unstale":"2023-06-23T19:02:43.395814+0000","last_undegraded":"2023-06-23T19:02:43.395814+0000","last_fullsized":"2023-06-23T19:02:43.395814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:09:46.104708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.896429+0000","last_change":"2023-06-23T19:02:42.893081+0000","last_active":"2023-06-23T19:02:42.896429+0000","last_peered":"2023-06-23T19:02:42.896429+0000","last_clean":"2023-06-23T19:02:42.896429+0000","last_became_active":"2023-06-23T19:02:42.892723+0000","last_became_peered":"2023-06-23T19:02:42.892723+0000","last_unstale":"2023-06-23T19:02:42.896429+0000","last_undegraded":"2023-06-23T19:02:42.896429+0000","last_fullsized":"2023-06-23T19:02:42.896429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:45:17.678934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.882330+0000","last_change":"2023-06-23T19:02:42.882330+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.882330+0000","last_undegraded":"2023-06-23T19:02:42.882330+0000","last_fullsized":"2023-06-23T19:02:42.882330+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889906+0000","last_change":"2023-06-23T19:02:42.887480+0000","last_active":"2023-06-23T19:02:42.889906+0000","last_peered":"2023-06-23T19:02:42.889906+0000","last_clean":"2023-06-23T19:02:42.889906+0000","last_became_active":"2023-06-23T19:02:42.887193+0000","last_became_peered":"2023-06-23T19:02:42.887193+0000","last_unstale":"2023-06-23T19:02:42.889906+0000","last_undegraded":"2023-06-23T19:02:42.889906+0000","last_fullsized":"2023-06-23T19:02:42.889906+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:53.956771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.880391+0000","last_change":"2023-06-23T19:02:42.880391+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.880391+0000","last_undegraded":"2023-06-23T19:02:42.880391+0000","last_fullsized":"2023-06-23T19:02:42.880391+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892302+0000","last_change":"2023-06-23T19:02:42.887196+0000","last_active":"2023-06-23T19:02:42.892302+0000","last_peered":"2023-06-23T19:02:42.892302+0000","last_clean":"2023-06-23T19:02:42.892302+0000","last_became_active":"2023-06-23T19:02:42.886915+0000","last_became_peered":"2023-06-23T19:02:42.886915+0000","last_unstale":"2023-06-23T19:02:42.892302+0000","last_undegraded":"2023-06-23T19:02:42.892302+0000","last_fullsized":"2023-06-23T19:02:42.892302+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:32:34.112575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.381832+0000","last_change":"2023-06-23T19:02:43.379396+0000","last_active":"2023-06-23T19:02:43.381832+0000","last_peered":"2023-06-23T19:02:43.381832+0000","last_clean":"2023-06-23T19:02:43.381832+0000","last_became_active":"2023-06-23T19:02:43.379137+0000","last_became_peered":"2023-06-23T19:02:43.379137+0000","last_unstale":"2023-06-23T19:02:43.381832+0000","last_undegraded":"2023-06-23T19:02:43.381832+0000","last_fullsized":"2023-06-23T19:02:43.381832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:45:18.683469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892290+0000","last_change":"2023-06-23T19:02:42.890175+0000","last_active":"2023-06-23T19:02:42.892290+0000","last_peered":"2023-06-23T19:02:42.892290+0000","last_clean":"2023-06-23T19:02:42.892290+0000","last_became_active":"2023-06-23T19:02:42.889717+0000","last_became_peered":"2023-06-23T19:02:42.889717+0000","last_unstale":"2023-06-23T19:02:42.892290+0000","last_undegraded":"2023-06-23T19:02:42.892290+0000","last_fullsized":"2023-06-23T19:02:42.892290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:46:23.845577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405241+0000","last_change":"2023-06-23T19:02:43.403277+0000","last_active":"2023-06-23T19:02:43.405241+0000","last_peered":"2023-06-23T19:02:43.405241+0000","last_clean":"2023-06-23T19:02:43.405241+0000","last_became_active":"2023-06-23T19:02:43.402771+0000","last_became_peered":"2023-06-23T19:02:43.402771+0000","last_unstale":"2023-06-23T19:02:43.405241+0000","last_undegraded":"2023-06-23T19:02:43.405241+0000","last_fullsized":"2023-06-23T19:02:43.405241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:03:01.052439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.379649+0000","last_change":"2023-06-23T19:02:42.887165+0000","last_active":"2023-06-23T19:02:43.379649+0000","last_peered":"2023-06-23T19:02:43.379649+0000","last_clean":"2023-06-23T19:02:43.379649+0000","last_became_active":"2023-06-23T19:02:42.886870+0000","last_became_peered":"2023-06-23T19:02:42.886870+0000","last_unstale":"2023-06-23T19:02:43.379649+0000","last_undegraded":"2023-06-23T19:02:43.379649+0000","last_fullsized":"2023-06-23T19:02:43.379649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:04:52.545693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724033+0000","last_change":"2023-06-23T19:02:43.404348+0000","last_active":"2023-06-23T19:02:44.724033+0000","last_peered":"2023-06-23T19:02:44.724033+0000","last_clean":"2023-06-23T19:02:44.724033+0000","last_became_active":"2023-06-23T19:02:43.403667+0000","last_became_peered":"2023-06-23T19:02:43.403667+0000","last_unstale":"2023-06-23T19:02:44.724033+0000","last_undegraded":"2023-06-23T19:02:44.724033+0000","last_fullsized":"2023-06-23T19:02:44.724033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:45.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.373226+0000","last_change":"2023-06-23T19:02:42.890898+0000","last_active":"2023-06-23T19:02:43.373226+0000","last_peered":"2023-06-23T19:02:43.373226+0000","last_clean":"2023-06-23T19:02:43.373226+0000","last_became_active":"2023-06-23T19:02:42.890663+0000","last_became_peered":"2023-06-23T19:02:42.890663+0000","last_unstale":"2023-06-23T19:02:43.373226+0000","last_undegraded":"2023-06-23T19:02:43.373226+0000","last_fullsized":"2023-06-23T19:02:43.373226+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:34:16.195266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.882525+0000","last_change":"2023-06-23T19:02:42.882525+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.882525+0000","last_undegraded":"2023-06-23T19:02:42.882525+0000","last_fullsized":"2023-06-23T19:02:42.882525+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.891509+0000","last_change":"2023-06-23T19:02:42.888633+0000","last_active":"2023-06-23T19:02:42.891509+0000","last_peered":"2023-06-23T19:02:42.891509+0000","last_clean":"2023-06-23T19:02:42.891509+0000","last_became_active":"2023-06-23T19:02:42.888018+0000","last_became_peered":"2023-06-23T19:02:42.888018+0000","last_unstale":"2023-06-23T19:02:42.891509+0000","last_undegraded":"2023-06-23T19:02:42.891509+0000","last_fullsized":"2023-06-23T19:02:42.891509+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:45:27.338493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875297+0000","last_change":"2023-06-23T19:02:42.875297+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875297+0000","last_undegraded":"2023-06-23T19:02:42.875297+0000","last_fullsized":"2023-06-23T19:02:42.875297+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.373732+0000","last_change":"2023-06-23T19:02:42.890196+0000","last_active":"2023-06-23T19:02:43.373732+0000","last_peered":"2023-06-23T19:02:43.373732+0000","last_clean":"2023-06-23T19:02:43.373732+0000","last_became_active":"2023-06-23T19:02:42.889975+0000","last_became_peered":"2023-06-23T19:02:42.889975+0000","last_unstale":"2023-06-23T19:02:43.373732+0000","last_undegraded":"2023-06-23T19:02:43.373732+0000","last_fullsized":"2023-06-23T19:02:43.373732+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:51:45.663216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874979+0000","last_change":"2023-06-23T19:02:42.874979+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874979+0000","last_undegraded":"2023-06-23T19:02:42.874979+0000","last_fullsized":"2023-06-23T19:02:42.874979+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.893706+0000","last_change":"2023-06-23T19:02:42.891197+0000","last_active":"2023-06-23T19:02:42.893706+0000","last_peered":"2023-06-23T19:02:42.893706+0000","last_clean":"2023-06-23T19:02:42.893706+0000","last_became_active":"2023-06-23T19:02:42.890890+0000","last_became_peered":"2023-06-23T19:02:42.890890+0000","last_unstale":"2023-06-23T19:02:42.893706+0000","last_undegraded":"2023-06-23T19:02:42.893706+0000","last_fullsized":"2023-06-23T19:02:42.893706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:25:12.283569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875504+0000","last_change":"2023-06-23T19:02:42.875504+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875504+0000","last_undegraded":"2023-06-23T19:02:42.875504+0000","last_fullsized":"2023-06-23T19:02:42.875504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-06-23T19:02:41.869925+0000","last_change":"2023-06-23T19:02:41.869925+0000","last_active":"2023-06-23T19:02:41.859689+0000","last_peered":"2023-06-23T19:02:41.859689+0000","last_clean":"2023-06-23T19:02:41.859689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:41.869925+0000","last_undegraded":"2023-06-23T19:02:41.869925+0000","last_fullsized":"2023-06-23T19:02:41.869925+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724215+0000","last_change":"2023-06-23T19:02:43.398669+0000","last_active":"2023-06-23T19:02:44.724215+0000","last_peered":"2023-06-23T19:02:44.724215+0000","last_clean":"2023-06-23T19:02:44.724215+0000","last_became_active":"2023-06-23T19:02:43.396528+0000","last_became_peered":"2023-06-23T19:02:43.396528+0000","last_unstale":"2023-06-23T19:02:44.724215+0000","last_undegraded":"2023-06-23T19:02:44.724215+0000","last_fullsized":"2023-06-23T19:02:44.724215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:07:50.110076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.901915+0000","last_change":"2023-06-23T19:02:42.891024+0000","last_active":"2023-06-23T19:02:42.901915+0000","last_peered":"2023-06-23T19:02:42.901915+0000","last_clean":"2023-06-23T19:02:42.901915+0000","last_became_active":"2023-06-23T19:02:42.890651+0000","last_became_peered":"2023-06-23T19:02:42.890651+0000","last_unstale":"2023-06-23T19:02:42.901915+0000","last_undegraded":"2023-06-23T19:02:42.901915+0000","last_fullsized":"2023-06-23T19:02:42.901915+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:12.247020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404133+0000","last_change":"2023-06-23T19:02:43.389803+0000","last_active":"2023-06-23T19:02:43.404133+0000","last_peered":"2023-06-23T19:02:43.404133+0000","last_clean":"2023-06-23T19:02:43.404133+0000","last_became_active":"2023-06-23T19:02:43.389537+0000","last_became_peered":"2023-06-23T19:02:43.389537+0000","last_unstale":"2023-06-23T19:02:43.404133+0000","last_undegraded":"2023-06-23T19:02:43.404133+0000","last_fullsized":"2023-06-23T19:02:43.404133+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:39.499477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889021+0000","last_change":"2023-06-23T19:02:42.886300+0000","last_active":"2023-06-23T19:02:42.889021+0000","last_peered":"2023-06-23T19:02:42.889021+0000","last_clean":"2023-06-23T19:02:42.889021+0000","last_became_active":"2023-06-23T19:02:42.886024+0000","last_became_peered":"2023-06-23T19:02:42.886024+0000","last_unstale":"2023-06-23T19:02:42.889021+0000","last_undegraded":"2023-06-23T19:02:42.889021+0000","last_fullsized":"2023-06-23T19:02:42.889021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:52:00.154380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874376+0000","last_change":"2023-06-23T19:02:42.874376+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874376+0000","last_undegraded":"2023-06-23T19:02:42.874376+0000","last_fullsized":"2023-06-23T19:02:42.874376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.901927+0000","last_change":"2023-06-23T19:02:42.891524+0000","last_active":"2023-06-23T19:02:42.901927+0000","last_peered":"2023-06-23T19:02:42.901927+0000","last_clean":"2023-06-23T19:02:42.901927+0000","last_became_active":"2023-06-23T19:02:42.891246+0000","last_became_peered":"2023-06-23T19:02:42.891246+0000","last_unstale":"2023-06-23T19:02:42.901927+0000","last_undegraded":"2023-06-23T19:02:42.901927+0000","last_fullsized":"2023-06-23T19:02:42.901927+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:58:35.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874957+0000","last_change":"2023-06-23T19:02:42.874957+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874957+0000","last_undegraded":"2023-06-23T19:02:42.874957+0000","last_fullsized":"2023-06-23T19:02:42.874957+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.400568+0000","last_change":"2023-06-23T19:02:42.893070+0000","last_active":"2023-06-23T19:02:43.400568+0000","last_peered":"2023-06-23T19:02:43.400568+0000","last_clean":"2023-06-23T19:02:43.400568+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:43.400568+0000","last_undegraded":"2023-06-23T19:02:43.400568+0000","last_fullsized":"2023-06-23T19:02:43.400568+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:31:59.559596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-06-23T19:02:41.870408+0000","last_change":"2023-06-23T19:02:41.870408+0000","last_active":"2023-06-23T19:02:41.859689+0000","last_peered":"2023-06-23T19:02:41.859689+0000","last_clean":"2023-06-23T19:02:41.859689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:41.870408+0000","last_undegraded":"2023-06-23T19:02:41.870408+0000","last_fullsized":"2023-06-23T19:02:41.870408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394423+0000","last_change":"2023-06-23T19:02:43.388207+0000","last_active":"2023-06-23T19:02:43.394423+0000","last_peered":"2023-06-23T19:02:43.394423+0000","last_clean":"2023-06-23T19:02:43.394423+0000","last_became_active":"2023-06-23T19:02:43.386722+0000","last_became_peered":"2023-06-23T19:02:43.386722+0000","last_unstale":"2023-06-23T19:02:43.394423+0000","last_undegraded":"2023-06-23T19:02:43.394423+0000","last_fullsized":"2023-06-23T19:02:43.394423+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:52:09.018540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892963+0000","last_change":"2023-06-23T19:02:42.890680+0000","last_active":"2023-06-23T19:02:42.892963+0000","last_peered":"2023-06-23T19:02:42.892963+0000","last_clean":"2023-06-23T19:02:42.892963+0000","last_became_active":"2023-06-23T19:02:42.890295+0000","last_became_peered":"2023-06-23T19:02:42.890295+0000","last_unstale":"2023-06-23T19:02:42.892963+0000","last_undegraded":"2023-06-23T19:02:42.892963+0000","last_fullsized":"2023-06-23T19:02:42.892963+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:01.645618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724213+0000","last_change":"2023-06-23T19:02:43.402338+0000","last_active":"2023-06-23T19:02:44.724213+0000","last_peered":"2023-06-23T19:02:44.724213+0000","last_clean":"2023-06-23T19:02:44.724213+0000","last_became_active":"2023-06-23T19:02:43.402031+0000","last_became_peered":"2023-06-23T19:02:43.402031+0000","last_unstale":"2023-06-23T19:02:44.724213+0000","last_undegraded":"2023-06-23T19:02:44.724213+0000","last_fullsized":"2023-06-23T19:02:44.724213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:38.519908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.401703+0000","last_change":"2023-06-23T19:02:42.887220+0000","last_active":"2023-06-23T19:02:43.401703+0000","last_peered":"2023-06-23T19:02:43.401703+0000","last_clean":"2023-06-23T19:02:43.401703+0000","last_became_active":"2023-06-23T19:02:42.886868+0000","last_became_peered":"2023-06-23T19:02:42.886868+0000","last_unstale":"2023-06-23T19:02:43.401703+0000","last_undegraded":"2023-06-23T19:02:43.401703+0000","last_fullsized":"2023-06-23T19:02:43.401703+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:55.099541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725181+0000","last_change":"2023-06-23T19:02:43.394474+0000","last_active":"2023-06-23T19:02:44.725181+0000","last_peered":"2023-06-23T19:02:44.725181+0000","last_clean":"2023-06-23T19:02:44.725181+0000","last_became_active":"2023-06-23T19:02:43.394113+0000","last_became_peered":"2023-06-23T19:02:43.394113+0000","last_unstale":"2023-06-23T19:02:44.725181+0000","last_undegraded":"2023-06-23T19:02:44.725181+0000","last_fullsized":"2023-06-23T19:02:44.725181+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:04.527287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.888799+0000","last_change":"2023-06-23T19:02:42.884554+0000","last_active":"2023-06-23T19:02:42.888799+0000","last_peered":"2023-06-23T19:02:42.888799+0000","last_clean":"2023-06-23T19:02:42.888799+0000","last_became_active":"2023-06-23T19:02:42.884275+0000","last_became_peered":"2023-06-23T19:02:42.884275+0000","last_unstale":"2023-06-23T19:02:42.888799+0000","last_undegraded":"2023-06-23T19:02:42.888799+0000","last_fullsized":"2023-06-23T19:02:42.888799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:42:01.141611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.876172+0000","last_change":"2023-06-23T19:02:42.876172+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.876172+0000","last_undegraded":"2023-06-23T19:02:42.876172+0000","last_fullsized":"2023-06-23T19:02:42.876172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889314+0000","last_change":"2023-06-23T19:02:42.884561+0000","last_active":"2023-06-23T19:02:42.889314+0000","last_peered":"2023-06-23T19:02:42.889314+0000","last_clean":"2023-06-23T19:02:42.889314+0000","last_became_active":"2023-06-23T19:02:42.884240+0000","last_became_peered":"2023-06-23T19:02:42.884240+0000","last_unstale":"2023-06-23T19:02:42.889314+0000","last_undegraded":"2023-06-23T19:02:42.889314+0000","last_fullsized":"2023-06-23T19:02:42.889314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:01.558584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.880610+0000","last_change":"2023-06-23T19:02:42.880610+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.880610+0000","last_undegraded":"2023-06-23T19:02:42.880610+0000","last_fullsized":"2023-06-23T19:02:42.880610+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.379862+0000","last_change":"2023-06-23T19:02:42.884674+0000","last_active":"2023-06-23T19:02:43.379862+0000","last_peered":"2023-06-23T19:02:43.379862+0000","last_clean":"2023-06-23T19:02:43.379862+0000","last_became_active":"2023-06-23T19:02:42.883763+0000","last_became_peered":"2023-06-23T19:02:42.883763+0000","last_unstale":"2023-06-23T19:02:43.379862+0000","last_undegraded":"2023-06-23T19:02:43.379862+0000","last_fullsized":"2023-06-23T19:02:43.379862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:02:36.921665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.371223+0000","last_change":"2023-06-23T19:02:42.889204+0000","last_active":"2023-06-23T19:02:43.371223+0000","last_peered":"2023-06-23T19:02:43.371223+0000","last_clean":"2023-06-23T19:02:43.371223+0000","last_became_active":"2023-06-23T19:02:42.888819+0000","last_became_peered":"2023-06-23T19:02:42.888819+0000","last_unstale":"2023-06-23T19:02:43.371223+0000","last_undegraded":"2023-06-23T19:02:43.371223+0000","last_fullsized":"2023-06-23T19:02:43.371223+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:30:36.052035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394362+0000","last_change":"2023-06-23T19:02:43.383467+0000","last_active":"2023-06-23T19:02:43.394362+0000","last_peered":"2023-06-23T19:02:43.394362+0000","last_clean":"2023-06-23T19:02:43.394362+0000","last_became_active":"2023-06-23T19:02:43.383168+0000","last_became_peered":"2023-06-23T19:02:43.383168+0000","last_unstale":"2023-06-23T19:02:43.394362+0000","last_undegraded":"2023-06-23T19:02:43.394362+0000","last_fullsized":"2023-06-23T19:02:43.394362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:05:15.959248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889758+0000","last_change":"2023-06-23T19:02:42.887650+0000","last_active":"2023-06-23T19:02:42.889758+0000","last_peered":"2023-06-23T19:02:42.889758+0000","last_clean":"2023-06-23T19:02:42.889758+0000","last_became_active":"2023-06-23T19:02:42.887327+0000","last_became_peered":"2023-06-23T19:02:42.887327+0000","last_unstale":"2023-06-23T19:02:42.889758+0000","last_undegraded":"2023-06-23T19:02:42.889758+0000","last_fullsized":"2023-06-23T19:02:42.889758+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:44.889242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.879590+0000","last_change":"2023-06-23T19:02:42.879590+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.879590+0000","last_undegraded":"2023-06-23T19:02:42.879590+0000","last_fullsized":"2023-06-23T19:02:42.879590+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.372976+0000","last_change":"2023-06-23T19:02:42.889687+0000","last_active":"2023-06-23T19:02:43.372976+0000","last_peered":"2023-06-23T19:02:43.372976+0000","last_clean":"2023-06-23T19:02:43.372976+0000","last_became_active":"2023-06-23T19:02:42.889440+0000","last_became_peered":"2023-06-23T19:02:42.889440+0000","last_unstale":"2023-06-23T19:02:43.372976+0000","last_undegraded":"2023-06-23T19:02:43.372976+0000","last_fullsized":"2023-06-23T19:02:43.372976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:07:59.809093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.883175+0000","last_change":"2023-06-23T19:00:58.992193+0000","last_active":"2023-06-23T19:02:42.883175+0000","last_peered":"2023-06-23T19:02:42.883175+0000","last_clean":"2023-06-23T19:02:42.883175+0000","last_became_active":"2023-06-23T19:00:58.991974+0000","last_became_peered":"2023-06-23T19:00:58.991974+0000","last_unstale":"2023-06-23T19:02:42.883175+0000","last_undegraded":"2023-06-23T19:02:42.883175+0000","last_fullsized":"2023-06-23T19:02:42.883175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:27:37.930240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724922+0000","last_change":"2023-06-23T19:02:43.402921+0000","last_active":"2023-06-23T19:02:44.724922+0000","last_peered":"2023-06-23T19:02:44.724922+0000","last_clean":"2023-06-23T19:02:44.724922+0000","last_became_active":"2023-06-23T19:02:43.402032+0000","last_became_peered":"2023-06-23T19:02:43.402032+0000","last_unstale":"2023-06-23T19:02:44.724922+0000","last_undegraded":"2023-06-23T19:02:44.724922+0000","last_fullsized":"2023-06-23T19:02:44.724922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:00:17.700963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.901939+0000","last_change":"2023-06-23T19:02:42.891573+0000","last_active":"2023-06-23T19:02:42.901939+0000","last_peered":"2023-06-23T19:02:42.901939+0000","last_clean":"2023-06-23T19:02:42.901939+0000","last_became_active":"2023-06-23T19:02:42.891289+0000","last_became_peered":"2023-06-23T19:02:42.891289+0000","last_unstale":"2023-06-23T19:02:42.901939+0000","last_undegraded":"2023-06-23T19:02:42.901939+0000","last_fullsized":"2023-06-23T19:02:42.901939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:17:26.599119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.380034+0000","last_change":"2023-06-23T19:00:58.032255+0000","last_active":"2023-06-23T19:02:43.380034+0000","last_peered":"2023-06-23T19:02:43.380034+0000","last_clean":"2023-06-23T19:02:43.380034+0000","last_became_active":"2023-06-23T19:00:58.031815+0000","last_became_peered":"2023-06-23T19:00:58.031815+0000","last_unstale":"2023-06-23T19:02:43.380034+0000","last_undegraded":"2023-06-23T19:02:43.380034+0000","last_fullsized":"2023-06-23T19:02:43.380034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:00:58.953928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404952+0000","last_change":"2023-06-23T19:02:43.396991+0000","last_active":"2023-06-23T19:02:43.404952+0000","last_peered":"2023-06-23T19:02:43.404952+0000","last_clean":"2023-06-23T19:02:43.404952+0000","last_became_active":"2023-06-23T19:02:43.396725+0000","last_became_peered":"2023-06-23T19:02:43.396725+0000","last_unstale":"2023-06-23T19:02:43.404952+0000","last_undegraded":"2023-06-23T19:02:43.404952+0000","last_fullsized":"2023-06-23T19:02:43.404952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:23.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.895015+0000","last_change":"2023-06-23T19:02:42.893342+0000","last_active":"2023-06-23T19:02:42.895015+0000","last_peered":"2023-06-23T19:02:42.895015+0000","last_clean":"2023-06-23T19:02:42.895015+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:42.895015+0000","last_undegraded":"2023-06-23T19:02:42.895015+0000","last_fullsized":"2023-06-23T19:02:42.895015+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:24:50.998086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-23T19:02:41.869802+0000","last_change":"2023-06-23T19:00:58.810848+0000","last_active":"2023-06-23T19:02:41.869802+0000","last_peered":"2023-06-23T19:02:41.869802+0000","last_clean":"2023-06-23T19:02:41.869802+0000","last_became_active":"2023-06-23T19:00:58.810530+0000","last_became_peered":"2023-06-23T19:00:58.810530+0000","last_unstale":"2023-06-23T19:02:41.869802+0000","last_undegraded":"2023-06-23T19:02:41.869802+0000","last_fullsized":"2023-06-23T19:02:41.869802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:20:36.196696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404159+0000","last_change":"2023-06-23T19:02:43.390188+0000","last_active":"2023-06-23T19:02:43.404159+0000","last_peered":"2023-06-23T19:02:43.404159+0000","last_clean":"2023-06-23T19:02:43.404159+0000","last_became_active":"2023-06-23T19:02:43.389894+0000","last_became_peered":"2023-06-23T19:02:43.389894+0000","last_unstale":"2023-06-23T19:02:43.404159+0000","last_undegraded":"2023-06-23T19:02:43.404159+0000","last_fullsized":"2023-06-23T19:02:43.404159+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:18:40.426963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404937+0000","last_change":"2023-06-23T19:02:42.889466+0000","last_active":"2023-06-23T19:02:43.404937+0000","last_peered":"2023-06-23T19:02:43.404937+0000","last_clean":"2023-06-23T19:02:43.404937+0000","last_became_active":"2023-06-23T19:02:42.889189+0000","last_became_peered":"2023-06-23T19:02:42.889189+0000","last_unstale":"2023-06-23T19:02:43.404937+0000","last_undegraded":"2023-06-23T19:02:43.404937+0000","last_fullsized":"2023-06-23T19:02:43.404937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:54.621572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.377300+0000","last_change":"2023-06-23T19:00:58.032352+0000","last_active":"2023-06-23T19:02:43.377300+0000","last_peered":"2023-06-23T19:02:43.377300+0000","last_clean":"2023-06-23T19:02:43.377300+0000","last_became_active":"2023-06-23T19:00:58.031905+0000","last_became_peered":"2023-06-23T19:00:58.031905+0000","last_unstale":"2023-06-23T19:02:43.377300+0000","last_undegraded":"2023-06-23T19:02:43.377300+0000","last_fullsized":"2023-06-23T19:02:43.377300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:14:56.282366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.878044+0000","last_change":"2023-06-23T19:00:50.002765+0000","last_active":"2023-06-23T19:02:42.878044+0000","last_peered":"2023-06-23T19:02:42.878044+0000","last_clean":"2023-06-23T19:02:42.878044+0000","last_became_active":"2023-06-23T19:00:50.002445+0000","last_became_peered":"2023-06-23T19:00:50.002445+0000","last_unstale":"2023-06-23T19:02:42.878044+0000","last_undegraded":"2023-06-23T19:02:42.878044+0000","last_fullsized":"2023-06-23T19:02:42.878044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_clean_scrub_stamp":"2023-06-23T19:00:48.989242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:36.277808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874940+0000","last_change":"2023-06-23T19:02:42.874940+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874940+0000","last_undegraded":"2023-06-23T19:02:42.874940+0000","last_fullsized":"2023-06-23T19:02:42.874940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.896404+0000","last_change":"2023-06-23T19:02:42.892907+0000","last_active":"2023-06-23T19:02:42.896404+0000","last_peered":"2023-06-23T19:02:42.896404+0000","last_clean":"2023-06-23T19:02:42.896404+0000","last_became_active":"2023-06-23T19:02:42.892670+0000","last_became_peered":"2023-06-23T19:02:42.892670+0000","last_unstale":"2023-06-23T19:02:42.896404+0000","last_undegraded":"2023-06-23T19:02:42.896404+0000","last_fullsized":"2023-06-23T19:02:42.896404+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:18:39.422428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.878177+0000","last_change":"2023-06-23T19:00:58.034045+0000","last_active":"2023-06-23T19:02:42.878177+0000","last_peered":"2023-06-23T19:02:42.878177+0000","last_clean":"2023-06-23T19:02:42.878177+0000","last_became_active":"2023-06-23T19:00:58.033654+0000","last_became_peered":"2023-06-23T19:00:58.033654+0000","last_unstale":"2023-06-23T19:02:42.878177+0000","last_undegraded":"2023-06-23T19:02:42.878177+0000","last_fullsized":"2023-06-23T19:02:42.878177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:00:00.508536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.400804+0000","last_change":"2023-06-23T19:02:43.394471+0000","last_active":"2023-06-23T19:02:43.400804+0000","last_peered":"2023-06-23T19:02:43.400804+0000","last_clean":"2023-06-23T19:02:43.400804+0000","last_became_active":"2023-06-23T19:02:43.394192+0000","last_became_peered":"2023-06-23T19:02:43.394192+0000","last_unstale":"2023-06-23T19:02:43.400804+0000","last_undegraded":"2023-06-23T19:02:43.400804+0000","last_fullsized":"2023-06-23T19:02:43.400804+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:30:39.670564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.893989+0000","last_change":"2023-06-23T19:02:42.891170+0000","last_active":"2023-06-23T19:02:42.893989+0000","last_peered":"2023-06-23T19:02:42.893989+0000","last_clean":"2023-06-23T19:02:42.893989+0000","last_became_active":"2023-06-23T19:02:42.890891+0000","last_became_peered":"2023-06-23T19:02:42.890891+0000","last_unstale":"2023-06-23T19:02:42.893989+0000","last_undegraded":"2023-06-23T19:02:42.893989+0000","last_fullsized":"2023-06-23T19:02:42.893989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:05:14.954713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.878747+0000","last_change":"2023-06-23T19:00:58.992645+0000","last_active":"2023-06-23T19:02:42.878747+0000","last_peered":"2023-06-23T19:02:42.878747+0000","last_clean":"2023-06-23T19:02:42.878747+0000","last_became_active":"2023-06-23T19:00:58.992291+0000","last_became_peered":"2023-06-23T19:00:58.992291+0000","last_unstale":"2023-06-23T19:02:42.878747+0000","last_undegraded":"2023-06-23T19:02:42.878747+0000","last_fullsized":"2023-06-23T19:02:42.878747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:17:46.386176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875537+0000","last_change":"2023-06-23T19:02:42.875537+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875537+0000","last_undegraded":"2023-06-23T19:02:42.875537+0000","last_fullsized":"2023-06-23T19:02:42.875537+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892271+0000","last_change":"2023-06-23T19:02:42.889986+0000","last_active":"2023-06-23T19:02:42.892271+0000","last_peered":"2023-06-23T19:02:42.892271+0000","last_clean":"2023-06-23T19:02:42.892271+0000","last_became_active":"2023-06-23T19:02:42.889346+0000","last_became_peered":"2023-06-23T19:02:42.889346+0000","last_unstale":"2023-06-23T19:02:42.892271+0000","last_undegraded":"2023-06-23T19:02:42.892271+0000","last_fullsized":"2023-06-23T19:02:42.892271+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:32.354763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.883265+0000","last_change":"2023-06-23T19:00:58.034828+0000","last_active":"2023-06-23T19:02:42.883265+0000","last_peered":"2023-06-23T19:02:42.883265+0000","last_clean":"2023-06-23T19:02:42.883265+0000","last_became_active":"2023-06-23T19:00:58.034502+0000","last_became_peered":"2023-06-23T19:00:58.034502+0000","last_unstale":"2023-06-23T19:02:42.883265+0000","last_undegraded":"2023-06-23T19:02:42.883265+0000","last_fullsized":"2023-06-23T19:02:42.883265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:28:51.207968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874413+0000","last_change":"2023-06-23T19:02:42.874413+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874413+0000","last_undegraded":"2023-06-23T19:02:42.874413+0000","last_fullsized":"2023-06-23T19:02:42.874413+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.894456+0000","last_change":"2023-06-23T19:02:42.893057+0000","last_active":"2023-06-23T19:02:42.894456+0000","last_peered":"2023-06-23T19:02:42.894456+0000","last_clean":"2023-06-23T19:02:42.894456+0000","last_became_active":"2023-06-23T19:02:42.891406+0000","last_became_peered":"2023-06-23T19:02:42.891406+0000","last_unstale":"2023-06-23T19:02:42.894456+0000","last_undegraded":"2023-06-23T19:02:42.894456+0000","last_fullsized":"2023-06-23T19:02:42.894456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:09:56.709855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725059+0000","last_change":"2023-06-23T19:00:58.035530+0000","last_active":"2023-06-23T19:02:44.725059+0000","last_peered":"2023-06-23T19:02:44.725059+0000","last_clean":"2023-06-23T19:02:44.725059+0000","last_became_active":"2023-06-23T19:00:58.035130+0000","last_became_peered":"2023-06-23T19:00:58.035130+0000","last_unstale":"2023-06-23T19:02:44.725059+0000","last_undegraded":"2023-06-23T19:02:44.725059+0000","last_fullsized":"2023-06-23T19:02:44.725059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:46:47.648237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":800713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.433},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.95099999999999996}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.008}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":210345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.499},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.88}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.92200000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":196915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.375}]},{"osd":1,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.318},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":5.6539999999999999,"5min":5.6539999999999999,"15min":5.6539999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.875},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jun 23 19:01:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.84299999999999997}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":225438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.629},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70099999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":203405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.501}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.83799999999999997}]},{"osd":6,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":9.6329999999999991,"5min":9.6329999999999991,"15min":9.6329999999999991},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.75},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.86199999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":203405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.441}]},{"osd":1,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.751}]}]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":203405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.88300000000000001}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.748},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92400000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":800713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.992,"5min":7.992,"15min":7.992},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":7.9500000000000002,"5min":7.9500000000000002,"15min":7.9500000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":10.835000000000001,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.625},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T19:02:48.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T19:02:48.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.447+0000 7fb38bfff700 1 Processor -- start 2023-06-23T19:02:48.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.447+0000 7fb38bfff700 1 -- start start 2023-06-23T19:02:48.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.448+0000 7fb38bfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb38415c570 0x7fb3840cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.448+0000 7fb38bfff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb384160e70 con 0x7fb384160a50 2023-06-23T19:02:48.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.448+0000 7fb38bfff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3841610a0 con 0x7fb3840cd660 2023-06-23T19:02:48.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.448+0000 7fb38bfff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38415d670 con 0x7fb38415c570 2023-06-23T19:02:48.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.449+0000 7fb389d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb38415c570 0x7fb3840cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.449+0000 7fb38a59c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb384160a50 0x7fb3840d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53720/0 (socket says 172.21.15.136:53720) 2023-06-23T19:02:48.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.449+0000 7fb38a59c700 1 -- 172.21.15.136:0/2087057138 learned_addr learned my addr 172.21.15.136:0/2087057138 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:48.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.449+0000 7fb388d99700 1 -- 172.21.15.136:0/2087057138 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148552099 0 0) 0x7fb384160e70 con 0x7fb384160a50 2023-06-23T19:02:48.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.449+0000 7fb388d99700 1 -- 172.21.15.136:0/2087057138 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3700035b0 con 0x7fb384160a50 2023-06-23T19:02:48.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.449+0000 7fb389d9b700 1 -- 172.21.15.136:0/2087057138 >> v1:172.21.15.178:6789/0 conn(0x7fb3840cd660 legacy=0x7fb384160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.449+0000 7fb389d9b700 1 -- 172.21.15.136:0/2087057138 >> v1:172.21.15.136:6789/0 conn(0x7fb384160a50 legacy=0x7fb3840d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.449+0000 7fb389d9b700 1 -- 172.21.15.136:0/2087057138 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38415da90 con 0x7fb38415c570 2023-06-23T19:02:48.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.449+0000 7fb389d9b700 1 --2- 172.21.15.136:0/2087057138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb38415c570 0x7fb3840cd120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb380009840 tx=0x7fb380009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3919df49bebe2743 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:48.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb388d99700 1 -- 172.21.15.136:0/2087057138 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380011830 con 0x7fb38415c570 2023-06-23T19:02:48.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb388d99700 1 -- 172.21.15.136:0/2087057138 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb380011990 con 0x7fb38415c570 2023-06-23T19:02:48.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb388d99700 1 -- 172.21.15.136:0/2087057138 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380011d20 con 0x7fb38415c570 2023-06-23T19:02:48.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb38bfff700 1 -- 172.21.15.136:0/2087057138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb38415c570 msgr2=0x7fb3840cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb38bfff700 1 --2- 172.21.15.136:0/2087057138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb38415c570 0x7fb3840cd120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb380009840 tx=0x7fb380009b50 comp rx=0 tx=0).stop 2023-06-23T19:02:48.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb38bfff700 1 -- 172.21.15.136:0/2087057138 shutdown_connections 2023-06-23T19:02:48.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb38bfff700 1 --2- 172.21.15.136:0/2087057138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb38415c570 0x7fb3840cd120 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb38bfff700 1 -- 172.21.15.136:0/2087057138 >> 172.21.15.136:0/2087057138 conn(0x7fb384071620 msgr2=0x7fb3840719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:48.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb38bfff700 1 -- 172.21.15.136:0/2087057138 shutdown_connections 2023-06-23T19:02:48.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.450+0000 7fb38bfff700 1 -- 172.21.15.136:0/2087057138 wait complete. 2023-06-23T19:02:48.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.452+0000 7fb38bfff700 1 Processor -- start 2023-06-23T19:02:48.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.452+0000 7fb38bfff700 1 -- start start 2023-06-23T19:02:48.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.453+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3840cd660 0x7fb3840c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.453+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38415c570 0x7fb3841e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.453+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb384160a50 0x7fb384159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.453+0000 7fb38bfff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3841e78c0 con 0x7fb3840cd660 2023-06-23T19:02:48.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.453+0000 7fb38bfff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840c9540 con 0x7fb38415c570 2023-06-23T19:02:48.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.453+0000 7fb38bfff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840c8ca0 con 0x7fb384160a50 2023-06-23T19:02:48.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.453+0000 7fb389d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3840cd660 0x7fb3840c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.453+0000 7fb389d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3840cd660 0x7fb3840c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55924/0 (socket says 172.21.15.136:55924) 2023-06-23T19:02:48.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.453+0000 7fb389d9b700 1 -- 172.21.15.136:0/1426577665 learned_addr learned my addr 172.21.15.136:0/1426577665 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:48.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb38a59c700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb384160a50 0x7fb384159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb38959a700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38415c570 0x7fb3841e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb389d9b700 1 -- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb384160a50 msgr2=0x7fb384159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb389d9b700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb384160a50 0x7fb384159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb389d9b700 1 -- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38415c570 msgr2=0x7fb3841e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb389d9b700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38415c570 0x7fb3841e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb389d9b700 1 -- 172.21.15.136:0/1426577665 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3800094a0 con 0x7fb3840cd660 2023-06-23T19:02:48.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb38959a700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38415c570 0x7fb3841e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:48.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb38a59c700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb384160a50 0x7fb384159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:48.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb389d9b700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3840cd660 0x7fb3840c85a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb380009fd0 tx=0x7fb380004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:48.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb37a7fc700 1 -- 172.21.15.136:0/1426577665 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3800038a0 con 0x7fb3840cd660 2023-06-23T19:02:48.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb37a7fc700 1 -- 172.21.15.136:0/1426577665 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38001f070 con 0x7fb3840cd660 2023-06-23T19:02:48.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb38bfff700 1 -- 172.21.15.136:0/1426577665 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3840c8f80 con 0x7fb3840cd660 2023-06-23T19:02:48.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.454+0000 7fb37a7fc700 1 -- 172.21.15.136:0/1426577665 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380003c40 con 0x7fb3840cd660 2023-06-23T19:02:48.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.455+0000 7fb38bfff700 1 -- 172.21.15.136:0/1426577665 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3841f2650 con 0x7fb3840cd660 2023-06-23T19:02:48.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.456+0000 7fb367fff700 1 -- 172.21.15.136:0/1426577665 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3600052f0 con 0x7fb3840cd660 2023-06-23T19:02:48.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.457+0000 7fb37a7fc700 1 -- 172.21.15.136:0/1426577665 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb380026480 con 0x7fb3840cd660 2023-06-23T19:02:48.463 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.457+0000 7fb37a7fc700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb36806ace0 0x7fb36806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.458+0000 7fb37a7fc700 1 -- 172.21.15.136:0/1426577665 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb380021070 con 0x7fb3840cd660 2023-06-23T19:02:48.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.458+0000 7fb38959a700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb36806ace0 0x7fb36806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.464 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.458+0000 7fb38959a700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb36806ace0 0x7fb36806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb3840d2480 tx=0x7fb374009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:48.465 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.462+0000 7fb37a7fc700 1 -- 172.21.15.136:0/1426577665 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb380055f00 con 0x7fb3840cd660 2023-06-23T19:02:48.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.656+0000 7fb367fff700 1 -- 172.21.15.136:0/1426577665 --> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb360000bc0 con 0x7fb36806ace0 2023-06-23T19:02:48.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.664+0000 7fb37a7fc700 1 -- 172.21.15.136:0/1426577665 <== mgr.4105 v2:172.21.15.136:6832/2653877961 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308160 (secure 0 0 0) 0x7fb360000bc0 con 0x7fb36806ace0 2023-06-23T19:02:48.674 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:48.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 -- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb36806ace0 msgr2=0x7fb36806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb36806ace0 0x7fb36806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb3840d2480 tx=0x7fb374009040 comp rx=0 tx=0).stop 2023-06-23T19:02:48.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 -- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3840cd660 msgr2=0x7fb3840c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3840cd660 0x7fb3840c85a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb380009fd0 tx=0x7fb380004750 comp rx=0 tx=0).stop 2023-06-23T19:02:48.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 -- 172.21.15.136:0/1426577665 shutdown_connections 2023-06-23T19:02:48.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fb36806ace0 0x7fb36806d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb384160a50 0x7fb384159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3840cd660 0x7fb3840c85a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 --2- 172.21.15.136:0/1426577665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38415c570 0x7fb3841e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 -- 172.21.15.136:0/1426577665 >> 172.21.15.136:0/1426577665 conn(0x7fb384071620 msgr2=0x7fb38415dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:48.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 -- 172.21.15.136:0/1426577665 shutdown_connections 2023-06-23T19:02:48.680 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.669+0000 7fb367fff700 1 -- 172.21.15.136:0/1426577665 wait complete. 2023-06-23T19:02:48.680 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2023-06-23T19:02:48.692 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-06-23T19:02:46.956551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":198,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220492,"kb_used_data":4876,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754228,"statfs":{"total":773094113280,"available":772868329472,"internally_reserved":0,"allocated":4993024,"data_stored":2844339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.091817"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875866+0000","last_change":"2023-06-23T19:02:42.875866+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875866+0000","last_undegraded":"2023-06-23T19:02:42.875866+0000","last_fullsized":"2023-06-23T19:02:42.875866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.406971+0000","last_change":"2023-06-23T19:02:43.405015+0000","last_active":"2023-06-23T19:02:43.406971+0000","last_peered":"2023-06-23T19:02:43.406971+0000","last_clean":"2023-06-23T19:02:43.406971+0000","last_became_active":"2023-06-23T19:02:43.404718+0000","last_became_peered":"2023-06-23T19:02:43.404718+0000","last_unstale":"2023-06-23T19:02:43.406971+0000","last_undegraded":"2023-06-23T19:02:43.406971+0000","last_fullsized":"2023-06-23T19:02:43.406971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:13:11.771904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.882083+0000","last_change":"2023-06-23T19:02:42.882083+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.882083+0000","last_undegraded":"2023-06-23T19:02:42.882083+0000","last_fullsized":"2023-06-23T19:02:42.882083+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405222+0000","last_change":"2023-06-23T19:02:43.402422+0000","last_active":"2023-06-23T19:02:43.405222+0000","last_peered":"2023-06-23T19:02:43.405222+0000","last_clean":"2023-06-23T19:02:43.405222+0000","last_became_active":"2023-06-23T19:02:43.402157+0000","last_became_peered":"2023-06-23T19:02:43.402157+0000","last_unstale":"2023-06-23T19:02:43.405222+0000","last_undegraded":"2023-06-23T19:02:43.405222+0000","last_fullsized":"2023-06-23T19:02:43.405222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:57:50.309764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.403065+0000","last_change":"2023-06-23T19:02:43.395438+0000","last_active":"2023-06-23T19:02:43.403065+0000","last_peered":"2023-06-23T19:02:43.403065+0000","last_clean":"2023-06-23T19:02:43.403065+0000","last_became_active":"2023-06-23T19:02:43.395153+0000","last_became_peered":"2023-06-23T19:02:43.395153+0000","last_unstale":"2023-06-23T19:02:43.403065+0000","last_undegraded":"2023-06-23T19:02:43.403065+0000","last_fullsized":"2023-06-23T19:02:43.403065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:41:51.912362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875376+0000","last_change":"2023-06-23T19:02:42.875376+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875376+0000","last_undegraded":"2023-06-23T19:02:42.875376+0000","last_fullsized":"2023-06-23T19:02:42.875376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875598+0000","last_change":"2023-06-23T19:02:42.875598+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875598+0000","last_undegraded":"2023-06-23T19:02:42.875598+0000","last_fullsized":"2023-06-23T19:02:42.875598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405254+0000","last_change":"2023-06-23T19:02:43.403369+0000","last_active":"2023-06-23T19:02:43.405254+0000","last_peered":"2023-06-23T19:02:43.405254+0000","last_clean":"2023-06-23T19:02:43.405254+0000","last_became_active":"2023-06-23T19:02:43.403084+0000","last_became_peered":"2023-06-23T19:02:43.403084+0000","last_unstale":"2023-06-23T19:02:43.405254+0000","last_undegraded":"2023-06-23T19:02:43.405254+0000","last_fullsized":"2023-06-23T19:02:43.405254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:07:48.893356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394405+0000","last_change":"2023-06-23T19:02:43.386467+0000","last_active":"2023-06-23T19:02:43.394405+0000","last_peered":"2023-06-23T19:02:43.394405+0000","last_clean":"2023-06-23T19:02:43.394405+0000","last_became_active":"2023-06-23T19:02:43.386192+0000","last_became_peered":"2023-06-23T19:02:43.386192+0000","last_unstale":"2023-06-23T19:02:43.394405+0000","last_undegraded":"2023-06-23T19:02:43.394405+0000","last_fullsized":"2023-06-23T19:02:43.394405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:12.505159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405097+0000","last_change":"2023-06-23T19:02:43.402134+0000","last_active":"2023-06-23T19:02:43.405097+0000","last_peered":"2023-06-23T19:02:43.405097+0000","last_clean":"2023-06-23T19:02:43.405097+0000","last_became_active":"2023-06-23T19:02:43.401870+0000","last_became_peered":"2023-06-23T19:02:43.401870+0000","last_unstale":"2023-06-23T19:02:43.405097+0000","last_undegraded":"2023-06-23T19:02:43.405097+0000","last_fullsized":"2023-06-23T19:02:43.405097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:45.418052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.393949+0000","last_change":"2023-06-23T19:02:43.386081+0000","last_active":"2023-06-23T19:02:43.393949+0000","last_peered":"2023-06-23T19:02:43.393949+0000","last_clean":"2023-06-23T19:02:43.393949+0000","last_became_active":"2023-06-23T19:02:43.385795+0000","last_became_peered":"2023-06-23T19:02:43.385795+0000","last_unstale":"2023-06-23T19:02:43.393949+0000","last_undegraded":"2023-06-23T19:02:43.393949+0000","last_fullsized":"2023-06-23T19:02:43.393949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:58:59.234601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.402361+0000","last_change":"2023-06-23T19:02:43.395109+0000","last_active":"2023-06-23T19:02:43.402361+0000","last_peered":"2023-06-23T19:02:43.402361+0000","last_clean":"2023-06-23T19:02:43.402361+0000","last_became_active":"2023-06-23T19:02:43.394402+0000","last_became_peered":"2023-06-23T19:02:43.394402+0000","last_unstale":"2023-06-23T19:02:43.402361+0000","last_undegraded":"2023-06-23T19:02:43.402361+0000","last_fullsized":"2023-06-23T19:02:43.402361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:57:20.585183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.393814+0000","last_change":"2023-06-23T19:02:43.383462+0000","last_active":"2023-06-23T19:02:43.393814+0000","last_peered":"2023-06-23T19:02:43.393814+0000","last_clean":"2023-06-23T19:02:43.393814+0000","last_became_active":"2023-06-23T19:02:43.383158+0000","last_became_peered":"2023-06-23T19:02:43.383158+0000","last_unstale":"2023-06-23T19:02:43.393814+0000","last_undegraded":"2023-06-23T19:02:43.393814+0000","last_fullsized":"2023-06-23T19:02:43.393814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:31:01.213549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874398+0000","last_change":"2023-06-23T19:02:42.874398+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874398+0000","last_undegraded":"2023-06-23T19:02:42.874398+0000","last_fullsized":"2023-06-23T19:02:42.874398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724048+0000","last_change":"2023-06-23T19:02:43.400056+0000","last_active":"2023-06-23T19:02:44.724048+0000","last_peered":"2023-06-23T19:02:44.724048+0000","last_clean":"2023-06-23T19:02:44.724048+0000","last_became_active":"2023-06-23T19:02:43.399740+0000","last_became_peered":"2023-06-23T19:02:43.399740+0000","last_unstale":"2023-06-23T19:02:44.724048+0000","last_undegraded":"2023-06-23T19:02:44.724048+0000","last_fullsized":"2023-06-23T19:02:44.724048+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:32:56.376089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.883405+0000","last_change":"2023-06-23T19:02:42.883405+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.883405+0000","last_undegraded":"2023-06-23T19:02:42.883405+0000","last_fullsized":"2023-06-23T19:02:42.883405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.884789+0000","last_change":"2023-06-23T19:02:42.884789+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.884789+0000","last_undegraded":"2023-06-23T19:02:42.884789+0000","last_fullsized":"2023-06-23T19:02:42.884789+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725030+0000","last_change":"2023-06-23T19:02:43.400304+0000","last_active":"2023-06-23T19:02:44.725030+0000","last_peered":"2023-06-23T19:02:44.725030+0000","last_clean":"2023-06-23T19:02:44.725030+0000","last_became_active":"2023-06-23T19:02:43.396953+0000","last_became_peered":"2023-06-23T19:02:43.396953+0000","last_unstale":"2023-06-23T19:02:44.725030+0000","last_undegraded":"2023-06-23T19:02:44.725030+0000","last_fullsized":"2023-06-23T19:02:44.725030+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:41.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.876390+0000","last_change":"2023-06-23T19:02:42.876390+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.876390+0000","last_undegraded":"2023-06-23T19:02:42.876390+0000","last_fullsized":"2023-06-23T19:02:42.876390+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405195+0000","last_change":"2023-06-23T19:02:43.402236+0000","last_active":"2023-06-23T19:02:43.405195+0000","last_peered":"2023-06-23T19:02:43.405195+0000","last_clean":"2023-06-23T19:02:43.405195+0000","last_became_active":"2023-06-23T19:02:43.401856+0000","last_became_peered":"2023-06-23T19:02:43.401856+0000","last_unstale":"2023-06-23T19:02:43.405195+0000","last_undegraded":"2023-06-23T19:02:43.405195+0000","last_fullsized":"2023-06-23T19:02:43.405195+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:11:17.204985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723948+0000","last_change":"2023-06-23T19:02:43.404668+0000","last_active":"2023-06-23T19:02:44.723948+0000","last_peered":"2023-06-23T19:02:44.723948+0000","last_clean":"2023-06-23T19:02:44.723948+0000","last_became_active":"2023-06-23T19:02:43.404069+0000","last_became_peered":"2023-06-23T19:02:43.404069+0000","last_unstale":"2023-06-23T19:02:44.723948+0000","last_undegraded":"2023-06-23T19:02:44.723948+0000","last_fullsized":"2023-06-23T19:02:44.723948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:03.176159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724003+0000","last_change":"2023-06-23T19:02:43.395358+0000","last_active":"2023-06-23T19:02:44.724003+0000","last_peered":"2023-06-23T19:02:44.724003+0000","last_clean":"2023-06-23T19:02:44.724003+0000","last_became_active":"2023-06-23T19:02:43.394956+0000","last_became_peered":"2023-06-23T19:02:43.394956+0000","last_unstale":"2023-06-23T19:02:44.724003+0000","last_undegraded":"2023-06-23T19:02:44.724003+0000","last_fullsized":"2023-06-23T19:02:44.724003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:20.784110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725079+0000","last_change":"2023-06-23T19:02:43.395135+0000","last_active":"2023-06-23T19:02:44.725079+0000","last_peered":"2023-06-23T19:02:44.725079+0000","last_clean":"2023-06-23T19:02:44.725079+0000","last_became_active":"2023-06-23T19:02:43.394454+0000","last_became_peered":"2023-06-23T19:02:43.394454+0000","last_unstale":"2023-06-23T19:02:44.725079+0000","last_undegraded":"2023-06-23T19:02:44.725079+0000","last_fullsized":"2023-06-23T19:02:44.725079+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:46:33.411319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.880250+0000","last_change":"2023-06-23T19:02:42.880250+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.880250+0000","last_undegraded":"2023-06-23T19:02:42.880250+0000","last_fullsized":"2023-06-23T19:02:42.880250+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.402382+0000","last_change":"2023-06-23T19:02:43.395428+0000","last_active":"2023-06-23T19:02:43.402382+0000","last_peered":"2023-06-23T19:02:43.402382+0000","last_clean":"2023-06-23T19:02:43.402382+0000","last_became_active":"2023-06-23T19:02:43.394828+0000","last_became_peered":"2023-06-23T19:02:43.394828+0000","last_unstale":"2023-06-23T19:02:43.402382+0000","last_undegraded":"2023-06-23T19:02:43.402382+0000","last_fullsized":"2023-06-23T19:02:43.402382+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:57:38.773378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724266+0000","last_change":"2023-06-23T19:02:43.390376+0000","last_active":"2023-06-23T19:02:44.724266+0000","last_peered":"2023-06-23T19:02:44.724266+0000","last_clean":"2023-06-23T19:02:44.724266+0000","last_became_active":"2023-06-23T19:02:43.390091+0000","last_became_peered":"2023-06-23T19:02:43.390091+0000","last_unstale":"2023-06-23T19:02:44.724266+0000","last_undegraded":"2023-06-23T19:02:44.724266+0000","last_fullsized":"2023-06-23T19:02:44.724266+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:38:21.075927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.883638+0000","last_change":"2023-06-23T19:02:42.883638+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.883638+0000","last_undegraded":"2023-06-23T19:02:42.883638+0000","last_fullsized":"2023-06-23T19:02:42.883638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.876479+0000","last_change":"2023-06-23T19:02:42.876479+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.876479+0000","last_undegraded":"2023-06-23T19:02:42.876479+0000","last_fullsized":"2023-06-23T19:02:42.876479+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.881101+0000","last_change":"2023-06-23T19:02:42.881101+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.881101+0000","last_undegraded":"2023-06-23T19:02:42.881101+0000","last_fullsized":"2023-06-23T19:02:42.881101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.890507+0000","last_change":"2023-06-23T19:02:42.887806+0000","last_active":"2023-06-23T19:02:42.890507+0000","last_peered":"2023-06-23T19:02:42.890507+0000","last_clean":"2023-06-23T19:02:42.890507+0000","last_became_active":"2023-06-23T19:02:42.887517+0000","last_became_peered":"2023-06-23T19:02:42.887517+0000","last_unstale":"2023-06-23T19:02:42.890507+0000","last_undegraded":"2023-06-23T19:02:42.890507+0000","last_fullsized":"2023-06-23T19:02:42.890507+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:04:34.712857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724889+0000","last_change":"2023-06-23T19:02:43.395362+0000","last_active":"2023-06-23T19:02:44.724889+0000","last_peered":"2023-06-23T19:02:44.724889+0000","last_clean":"2023-06-23T19:02:44.724889+0000","last_became_active":"2023-06-23T19:02:43.394818+0000","last_became_peered":"2023-06-23T19:02:43.394818+0000","last_unstale":"2023-06-23T19:02:44.724889+0000","last_undegraded":"2023-06-23T19:02:44.724889+0000","last_fullsized":"2023-06-23T19:02:44.724889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:04:50.409635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.893903+0000","last_change":"2023-06-23T19:02:42.891979+0000","last_active":"2023-06-23T19:02:42.893903+0000","last_peered":"2023-06-23T19:02:42.893903+0000","last_clean":"2023-06-23T19:02:42.893903+0000","last_became_active":"2023-06-23T19:02:42.890688+0000","last_became_peered":"2023-06-23T19:02:42.890688+0000","last_unstale":"2023-06-23T19:02:42.893903+0000","last_undegraded":"2023-06-23T19:02:42.893903+0000","last_fullsized":"2023-06-23T19:02:42.893903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:31.221738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.395814+0000","last_change":"2023-06-23T19:02:43.393361+0000","last_active":"2023-06-23T19:02:43.395814+0000","last_peered":"2023-06-23T19:02:43.395814+0000","last_clean":"2023-06-23T19:02:43.395814+0000","last_became_active":"2023-06-23T19:02:43.393080+0000","last_became_peered":"2023-06-23T19:02:43.393080+0000","last_unstale":"2023-06-23T19:02:43.395814+0000","last_undegraded":"2023-06-23T19:02:43.395814+0000","last_fullsized":"2023-06-23T19:02:43.395814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:09:46.104708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.896429+0000","last_change":"2023-06-23T19:02:42.893081+0000","last_active":"2023-06-23T19:02:42.896429+0000","last_peered":"2023-06-23T19:02:42.896429+0000","last_clean":"2023-06-23T19:02:42.896429+0000","last_became_active":"2023-06-23T19:02:42.892723+0000","last_became_peered":"2023-06-23T19:02:42.892723+0000","last_unstale":"2023-06-23T19:02:42.896429+0000","last_undegraded":"2023-06-23T19:02:42.896429+0000","last_fullsized":"2023-06-23T19:02:42.896429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:45:17.678934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.882330+0000","last_change":"2023-06-23T19:02:42.882330+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.882330+0000","last_undegraded":"2023-06-23T19:02:42.882330+0000","last_fullsized":"2023-06-23T19:02:42.882330+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889906+0000","last_change":"2023-06-23T19:02:42.887480+0000","last_active":"2023-06-23T19:02:42.889906+0000","last_peered":"2023-06-23T19:02:42.889906+0000","last_clean":"2023-06-23T19:02:42.889906+0000","last_became_active":"2023-06-23T19:02:42.887193+0000","last_became_peered":"2023-06-23T19:02:42.887193+0000","last_unstale":"2023-06-23T19:02:42.889906+0000","last_undegraded":"2023-06-23T19:02:42.889906+0000","last_fullsized":"2023-06-23T19:02:42.889906+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:53.956771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.880391+0000","last_change":"2023-06-23T19:02:42.880391+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.880391+0000","last_undegraded":"2023-06-23T19:02:42.880391+0000","last_fullsized":"2023-06-23T19:02:42.880391+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892302+0000","last_change":"2023-06-23T19:02:42.887196+0000","last_active":"2023-06-23T19:02:42.892302+0000","last_peered":"2023-06-23T19:02:42.892302+0000","last_clean":"2023-06-23T19:02:42.892302+0000","last_became_active":"2023-06-23T19:02:42.886915+0000","last_became_peered":"2023-06-23T19:02:42.886915+0000","last_unstale":"2023-06-23T19:02:42.892302+0000","last_undegraded":"2023-06-23T19:02:42.892302+0000","last_fullsized":"2023-06-23T19:02:42.892302+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:32:34.112575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.381832+0000","last_change":"2023-06-23T19:02:43.379396+0000","last_active":"2023-06-23T19:02:43.381832+0000","last_peered":"2023-06-23T19:02:43.381832+0000","last_clean":"2023-06-23T19:02:43.381832+0000","last_became_active":"2023-06-23T19:02:43.379137+0000","last_became_peered":"2023-06-23T19:02:43.379137+0000","last_unstale":"2023-06-23T19:02:43.381832+0000","last_undegraded":"2023-06-23T19:02:43.381832+0000","last_fullsized":"2023-06-23T19:02:43.381832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:45:18.683469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892290+0000","last_change":"2023-06-23T19:02:42.890175+0000","last_active":"2023-06-23T19:02:42.892290+0000","last_peered":"2023-06-23T19:02:42.892290+0000","last_clean":"2023-06-23T19:02:42.892290+0000","last_became_active":"2023-06-23T19:02:42.889717+0000","last_became_peered":"2023-06-23T19:02:42.889717+0000","last_unstale":"2023-06-23T19:02:42.892290+0000","last_undegraded":"2023-06-23T19:02:42.892290+0000","last_fullsized":"2023-06-23T19:02:42.892290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:46:23.845577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405241+0000","last_change":"2023-06-23T19:02:43.403277+0000","last_active":"2023-06-23T19:02:43.405241+0000","last_peered":"2023-06-23T19:02:43.405241+0000","last_clean":"2023-06-23T19:02:43.405241+0000","last_became_active":"2023-06-23T19:02:43.402771+0000","last_became_peered":"2023-06-23T19:02:43.402771+0000","last_unstale":"2023-06-23T19:02:43.405241+0000","last_undegraded":"2023-06-23T19:02:43.405241+0000","last_fullsized":"2023-06-23T19:02:43.405241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:03:01.052439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.379649+0000","last_change":"2023-06-23T19:02:42.887165+0000","last_active":"2023-06-23T19:02:43.379649+0000","last_peered":"2023-06-23T19:02:43.379649+0000","last_clean":"2023-06-23T19:02:43.379649+0000","last_became_active":"2023-06-23T19:02:42.886870+0000","last_became_peered":"2023-06-23T19:02:42.886870+0000","last_unstale":"2023-06-23T19:02:43.379649+0000","last_undegraded":"2023-06-23T19:02:43.379649+0000","last_fullsized":"2023-06-23T19:02:43.379649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:04:52.545693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724033+0000","last_change":"2023-06-23T19:02:43.404348+0000","last_active":"2023-06-23T19:02:44.724033+0000","last_peered":"2023-06-23T19:02:44.724033+0000","last_clean":"2023-06-23T19:02:44.724033+0000","last_became_active":"2023-06-23T19:02:43.403667+0000","last_became_peered":"2023-06-23T19:02:43.403667+0000","last_unstale":"2023-06-23T19:02:44.724033+0000","last_undegraded":"2023-06-23T19:02:44.724033+0000","last_fullsized":"2023-06-23T19:02:44.724033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:45.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.373226+0000","last_change":"2023-06-23T19:02:42.890898+0000","last_active":"2023-06-23T19:02:43.373226+0000","last_peered":"2023-06-23T19:02:43.373226+0000","last_clean":"2023-06-23T19:02:43.373226+0000","last_became_active":"2023-06-23T19:02:42.890663+0000","last_became_peered":"2023-06-23T19:02:42.890663+0000","last_unstale":"2023-06-23T19:02:43.373226+0000","last_undegraded":"2023-06-23T19:02:43.373226+0000","last_fullsized":"2023-06-23T19:02:43.373226+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:34:16.195266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.882525+0000","last_change":"2023-06-23T19:02:42.882525+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.882525+0000","last_undegraded":"2023-06-23T19:02:42.882525+0000","last_fullsized":"2023-06-23T19:02:42.882525+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.891509+0000","last_change":"2023-06-23T19:02:42.888633+0000","last_active":"2023-06-23T19:02:42.891509+0000","last_peered":"2023-06-23T19:02:42.891509+0000","last_clean":"2023-06-23T19:02:42.891509+0000","last_became_active":"2023-06-23T19:02:42.888018+0000","last_became_peered":"2023-06-23T19:02:42.888018+0000","last_unstale":"2023-06-23T19:02:42.891509+0000","last_undegraded":"2023-06-23T19:02:42.891509+0000","last_fullsized":"2023-06-23T19:02:42.891509+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:45:27.338493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875297+0000","last_change":"2023-06-23T19:02:42.875297+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875297+0000","last_undegraded":"2023-06-23T19:02:42.875297+0000","last_fullsized":"2023-06-23T19:02:42.875297+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.373732+0000","last_change":"2023-06-23T19:02:42.890196+0000","last_active":"2023-06-23T19:02:43.373732+0000","last_peered":"2023-06-23T19:02:43.373732+0000","last_clean":"2023-06-23T19:02:43.373732+0000","last_became_active":"2023-06-23T19:02:42.889975+0000","last_became_peered":"2023-06-23T19:02:42.889975+0000","last_unstale":"2023-06-23T19:02:43.373732+0000","last_undegraded":"2023-06-23T19:02:43.373732+0000","last_fullsized":"2023-06-23T19:02:43.373732+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:51:45.663216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874979+0000","last_change":"2023-06-23T19:02:42.874979+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874979+0000","last_undegraded":"2023-06-23T19:02:42.874979+0000","last_fullsized":"2023-06-23T19:02:42.874979+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.893706+0000","last_change":"2023-06-23T19:02:42.891197+0000","last_active":"2023-06-23T19:02:42.893706+0000","last_peered":"2023-06-23T19:02:42.893706+0000","last_clean":"2023-06-23T19:02:42.893706+0000","last_became_active":"2023-06-23T19:02:42.890890+0000","last_became_peered":"2023-06-23T19:02:42.890890+0000","last_unstale":"2023-06-23T19:02:42.893706+0000","last_undegraded":"2023-06-23T19:02:42.893706+0000","last_fullsized":"2023-06-23T19:02:42.893706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:25:12.283569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875504+0000","last_change":"2023-06-23T19:02:42.875504+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875504+0000","last_undegraded":"2023-06-23T19:02:42.875504+0000","last_fullsized":"2023-06-23T19:02:42.875504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-06-23T19:02:41.869925+0000","last_change":"2023-06-23T19:02:41.869925+0000","last_active":"2023-06-23T19:02:41.859689+0000","last_peered":"2023-06-23T19:02:41.859689+0000","last_clean":"2023-06-23T19:02:41.859689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:41.869925+0000","last_undegraded":"2023-06-23T19:02:41.869925+0000","last_fullsized":"2023-06-23T19:02:41.869925+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724215+0000","last_change":"2023-06-23T19:02:43.398669+0000","last_active":"2023-06-23T19:02:44.724215+0000","last_peered":"2023-06-23T19:02:44.724215+0000","last_clean":"2023-06-23T19:02:44.724215+0000","last_became_active":"2023-06-23T19:02:43.396528+0000","last_became_peered":"2023-06-23T19:02:43.396528+0000","last_unstale":"2023-06-23T19:02:44.724215+0000","last_undegraded":"2023-06-23T19:02:44.724215+0000","last_fullsized":"2023-06-23T19:02:44.724215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:07:50.110076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.901915+0000","last_change":"2023-06-23T19:02:42.891024+0000","last_active":"2023-06-23T19:02:42.901915+0000","last_peered":"2023-06-23T19:02:42.901915+0000","last_clean":"2023-06-23T19:02:42.901915+0000","last_became_active":"2023-06-23T19:02:42.890651+0000","last_became_peered":"2023-06-23T19:02:42.890651+0000","last_unstale":"2023-06-23T19:02:42.901915+0000","last_undegraded":"2023-06-23T19:02:42.901915+0000","last_fullsized":"2023-06-23T19:02:42.901915+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:12.247020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404133+0000","last_change":"2023-06-23T19:02:43.389803+0000","last_active":"2023-06-23T19:02:43.404133+0000","last_peered":"2023-06-23T19:02:43.404133+0000","last_clean":"2023-06-23T19:02:43.404133+0000","last_became_active":"2023-06-23T19:02:43.389537+0000","last_became_peered":"2023-06-23T19:02:43.389537+0000","last_unstale":"2023-06-23T19:02:43.404133+0000","last_undegraded":"2023-06-23T19:02:43.404133+0000","last_fullsized":"2023-06-23T19:02:43.404133+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:39.499477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889021+0000","last_change":"2023-06-23T19:02:42.886300+0000","last_active":"2023-06-23T19:02:42.889021+0000","last_peered":"2023-06-23T19:02:42.889021+0000","last_clean":"2023-06-23T19:02:42.889021+0000","last_became_active":"2023-06-23T19:02:42.886024+0000","last_became_peered":"2023-06-23T19:02:42.886024+0000","last_unstale":"2023-06-23T19:02:42.889021+0000","last_undegraded":"2023-06-23T19:02:42.889021+0000","last_fullsized":"2023-06-23T19:02:42.889021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:52:00.154380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874376+0000","last_change":"2023-06-23T19:02:42.874376+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874376+0000","last_undegraded":"2023-06-23T19:02:42.874376+0000","last_fullsized":"2023-06-23T19:02:42.874376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.901927+0000","last_change":"2023-06-23T19:02:42.891524+0000","last_active":"2023-06-23T19:02:42.901927+0000","last_peered":"2023-06-23T19:02:42.901927+0000","last_clean":"2023-06-23T19:02:42.901927+0000","last_became_active":"2023-06-23T19:02:42.891246+0000","last_became_peered":"2023-06-23T19:02:42.891246+0000","last_unstale":"2023-06-23T19:02:42.901927+0000","last_undegraded":"2023-06-23T19:02:42.901927+0000","last_fullsized":"2023-06-23T19:02:42.901927+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:58:35.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874957+0000","last_change":"2023-06-23T19:02:42.874957+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874957+0000","last_undegraded":"2023-06-23T19:02:42.874957+0000","last_fullsized":"2023-06-23T19:02:42.874957+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.400568+0000","last_change":"2023-06-23T19:02:42.893070+0000","last_active":"2023-06-23T19:02:43.400568+0000","last_peered":"2023-06-23T19:02:43.400568+0000","last_clean":"2023-06-23T19:02:43.400568+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:43.400568+0000","last_undegraded":"2023-06-23T19:02:43.400568+0000","last_fullsized":"2023-06-23T19:02:43.400568+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:31:59.559596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-06-23T19:02:41.870408+0000","last_change":"2023-06-23T19:02:41.870408+0000","last_active":"2023-06-23T19:02:41.859689+0000","last_peered":"2023-06-23T19:02:41.859689+0000","last_clean":"2023-06-23T19:02:41.859689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:41.870408+0000","last_undegraded":"2023-06-23T19:02:41.870408+0000","last_fullsized":"2023-06-23T19:02:41.870408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394423+0000","last_change":"2023-06-23T19:02:43.388207+0000","last_active":"2023-06-23T19:02:43.394423+0000","last_peered":"2023-06-23T19:02:43.394423+0000","last_clean":"2023-06-23T19:02:43.394423+0000","last_became_active":"2023-06-23T19:02:43.386722+0000","last_became_peered":"2023-06-23T19:02:43.386722+0000","last_unstale":"2023-06-23T19:02:43.394423+0000","last_undegraded":"2023-06-23T19:02:43.394423+0000","last_fullsized":"2023-06-23T19:02:43.394423+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:52:09.018540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892963+0000","last_change":"2023-06-23T19:02:42.890680+0000","last_active":"2023-06-23T19:02:42.892963+0000","last_peered":"2023-06-23T19:02:42.892963+0000","last_clean":"2023-06-23T19:02:42.892963+0000","last_became_active":"2023-06-23T19:02:42.890295+0000","last_became_peered":"2023-06-23T19:02:42.890295+0000","last_unstale":"2023-06-23T19:02:42.892963+0000","last_undegraded":"2023-06-23T19:02:42.892963+0000","last_fullsized":"2023-06-23T19:02:42.892963+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:01.645618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724213+0000","last_change":"2023-06-23T19:02:43.402338+0000","last_active":"2023-06-23T19:02:44.724213+0000","last_peered":"2023-06-23T19:02:44.724213+0000","last_clean":"2023-06-23T19:02:44.724213+0000","last_became_active":"2023-06-23T19:02:43.402031+0000","last_became_peered":"2023-06-23T19:02:43.402031+0000","last_unstale":"2023-06-23T19:02:44.724213+0000","last_undegraded":"2023-06-23T19:02:44.724213+0000","last_fullsized":"2023-06-23T19:02:44.724213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:38.519908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.401703+0000","last_change":"2023-06-23T19:02:42.887220+0000","last_active":"2023-06-23T19:02:43.401703+0000","last_peered":"2023-06-23T19:02:43.401703+0000","last_clean":"2023-06-23T19:02:43.401703+0000","last_became_active":"2023-06-23T19:02:42.886868+0000","last_became_peered":"2023-06-23T19:02:42.886868+0000","last_unstale":"2023-06-23T19:02:43.401703+0000","last_undegraded":"2023-06-23T19:02:43.401703+0000","last_fullsized":"2023-06-23T19:02:43.401703+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:55.099541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725181+0000","last_change":"2023-06-23T19:02:43.394474+0000","last_active":"2023-06-23T19:02:44.725181+0000","last_peered":"2023-06-23T19:02:44.725181+0000","last_clean":"2023-06-23T19:02:44.725181+0000","last_became_active":"2023-06-23T19:02:43.394113+0000","last_became_peered":"2023-06-23T19:02:43.394113+0000","last_unstale":"2023-06-23T19:02:44.725181+0000","last_undegraded":"2023-06-23T19:02:44.725181+0000","last_fullsized":"2023-06-23T19:02:44.725181+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:04.527287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.888799+0000","last_change":"2023-06-23T19:02:42.884554+0000","last_active":"2023-06-23T19:02:42.888799+0000","last_peered":"2023-06-23T19:02:42.888799+0000","last_clean":"2023-06-23T19:02:42.888799+0000","last_became_active":"2023-06-23T19:02:42.884275+0000","last_became_peered":"2023-06-23T19:02:42.884275+0000","last_unstale":"2023-06-23T19:02:42.888799+0000","last_undegraded":"2023-06-23T19:02:42.888799+0000","last_fullsized":"2023-06-23T19:02:42.888799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:42:01.141611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.876172+0000","last_change":"2023-06-23T19:02:42.876172+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.876172+0000","last_undegraded":"2023-06-23T19:02:42.876172+0000","last_fullsized":"2023-06-23T19:02:42.876172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889314+0000","last_change":"2023-06-23T19:02:42.884561+0000","last_active":"2023-06-23T19:02:42.889314+0000","last_peered":"2023-06-23T19:02:42.889314+0000","last_clean":"2023-06-23T19:02:42.889314+0000","last_became_active":"2023-06-23T19:02:42.884240+0000","last_became_peered":"2023-06-23T19:02:42.884240+0000","last_unstale":"2023-06-23T19:02:42.889314+0000","last_undegraded":"2023-06-23T19:02:42.889314+0000","last_fullsized":"2023-06-23T19:02:42.889314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:01.558584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.880610+0000","last_change":"2023-06-23T19:02:42.880610+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.880610+0000","last_undegraded":"2023-06-23T19:02:42.880610+0000","last_fullsized":"2023-06-23T19:02:42.880610+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.379862+0000","last_change":"2023-06-23T19:02:42.884674+0000","last_active":"2023-06-23T19:02:43.379862+0000","last_peered":"2023-06-23T19:02:43.379862+0000","last_clean":"2023-06-23T19:02:43.379862+0000","last_became_active":"2023-06-23T19:02:42.883763+0000","last_became_peered":"2023-06-23T19:02:42.883763+0000","last_unstale":"2023-06-23T19:02:43.379862+0000","last_undegraded":"2023-06-23T19:02:43.379862+0000","last_fullsized":"2023-06-23T19:02:43.379862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:02:36.921665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-23T19:02:42.864224+0000","last_change":"2023-06-23T19:02:42.864224+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.864224+0000","last_undegraded":"2023-06-23T19:02:42.864224+0000","last_fullsized":"2023-06-23T19:02:42.864224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.371223+0000","last_change":"2023-06-23T19:02:42.889204+0000","last_active":"2023-06-23T19:02:43.371223+0000","last_peered":"2023-06-23T19:02:43.371223+0000","last_clean":"2023-06-23T19:02:43.371223+0000","last_became_active":"2023-06-23T19:02:42.888819+0000","last_became_peered":"2023-06-23T19:02:42.888819+0000","last_unstale":"2023-06-23T19:02:43.371223+0000","last_undegraded":"2023-06-23T19:02:43.371223+0000","last_fullsized":"2023-06-23T19:02:43.371223+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:30:36.052035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394362+0000","last_change":"2023-06-23T19:02:43.383467+0000","last_active":"2023-06-23T19:02:43.394362+0000","last_peered":"2023-06-23T19:02:43.394362+0000","last_clean":"2023-06-23T19:02:43.394362+0000","last_became_active":"2023-06-23T19:02:43.383168+0000","last_became_peered":"2023-06-23T19:02:43.383168+0000","last_unstale":"2023-06-23T19:02:43.394362+0000","last_undegraded":"2023-06-23T19:02:43.394362+0000","last_fullsized":"2023-06-23T19:02:43.394362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:05:15.959248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.889758+0000","last_change":"2023-06-23T19:02:42.887650+0000","last_active":"2023-06-23T19:02:42.889758+0000","last_peered":"2023-06-23T19:02:42.889758+0000","last_clean":"2023-06-23T19:02:42.889758+0000","last_became_active":"2023-06-23T19:02:42.887327+0000","last_became_peered":"2023-06-23T19:02:42.887327+0000","last_unstale":"2023-06-23T19:02:42.889758+0000","last_undegraded":"2023-06-23T19:02:42.889758+0000","last_fullsized":"2023-06-23T19:02:42.889758+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:44.889242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.879590+0000","last_change":"2023-06-23T19:02:42.879590+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.879590+0000","last_undegraded":"2023-06-23T19:02:42.879590+0000","last_fullsized":"2023-06-23T19:02:42.879590+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.372976+0000","last_change":"2023-06-23T19:02:42.889687+0000","last_active":"2023-06-23T19:02:43.372976+0000","last_peered":"2023-06-23T19:02:43.372976+0000","last_clean":"2023-06-23T19:02:43.372976+0000","last_became_active":"2023-06-23T19:02:42.889440+0000","last_became_peered":"2023-06-23T19:02:42.889440+0000","last_unstale":"2023-06-23T19:02:43.372976+0000","last_undegraded":"2023-06-23T19:02:43.372976+0000","last_fullsized":"2023-06-23T19:02:43.372976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:07:59.809093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.883175+0000","last_change":"2023-06-23T19:00:58.992193+0000","last_active":"2023-06-23T19:02:42.883175+0000","last_peered":"2023-06-23T19:02:42.883175+0000","last_clean":"2023-06-23T19:02:42.883175+0000","last_became_active":"2023-06-23T19:00:58.991974+0000","last_became_peered":"2023-06-23T19:00:58.991974+0000","last_unstale":"2023-06-23T19:02:42.883175+0000","last_undegraded":"2023-06-23T19:02:42.883175+0000","last_fullsized":"2023-06-23T19:02:42.883175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:27:37.930240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724922+0000","last_change":"2023-06-23T19:02:43.402921+0000","last_active":"2023-06-23T19:02:44.724922+0000","last_peered":"2023-06-23T19:02:44.724922+0000","last_clean":"2023-06-23T19:02:44.724922+0000","last_became_active":"2023-06-23T19:02:43.402032+0000","last_became_peered":"2023-06-23T19:02:43.402032+0000","last_unstale":"2023-06-23T19:02:44.724922+0000","last_undegraded":"2023-06-23T19:02:44.724922+0000","last_fullsized":"2023-06-23T19:02:44.724922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:00:17.700963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.901939+0000","last_change":"2023-06-23T19:02:42.891573+0000","last_active":"2023-06-23T19:02:42.901939+0000","last_peered":"2023-06-23T19:02:42.901939+0000","last_clean":"2023-06-23T19:02:42.901939+0000","last_became_active":"2023-06-23T19:02:42.891289+0000","last_became_peered":"2023-06-23T19:02:42.891289+0000","last_unstale":"2023-06-23T19:02:42.901939+0000","last_undegraded":"2023-06-23T19:02:42.901939+0000","last_fullsized":"2023-06-23T19:02:42.901939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:17:26.599119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.380034+0000","last_change":"2023-06-23T19:00:58.032255+0000","last_active":"2023-06-23T19:02:43.380034+0000","last_peered":"2023-06-23T19:02:43.380034+0000","last_clean":"2023-06-23T19:02:43.380034+0000","last_became_active":"2023-06-23T19:00:58.031815+0000","last_became_peered":"2023-06-23T19:00:58.031815+0000","last_unstale":"2023-06-23T19:02:43.380034+0000","last_undegraded":"2023-06-23T19:02:43.380034+0000","last_fullsized":"2023-06-23T19:02:43.380034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:00:58.953928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404952+0000","last_change":"2023-06-23T19:02:43.396991+0000","last_active":"2023-06-23T19:02:43.404952+0000","last_peered":"2023-06-23T19:02:43.404952+0000","last_clean":"2023-06-23T19:02:43.404952+0000","last_became_active":"2023-06-23T19:02:43.396725+0000","last_became_peered":"2023-06-23T19:02:43.396725+0000","last_unstale":"2023-06-23T19:02:43.404952+0000","last_undegraded":"2023-06-23T19:02:43.404952+0000","last_fullsized":"2023-06-23T19:02:43.404952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:23.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.895015+0000","last_change":"2023-06-23T19:02:42.893342+0000","last_active":"2023-06-23T19:02:42.895015+0000","last_peered":"2023-06-23T19:02:42.895015+0000","last_clean":"2023-06-23T19:02:42.895015+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:42.895015+0000","last_undegraded":"2023-06-23T19:02:42.895015+0000","last_fullsized":"2023-06-23T19:02:42.895015+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:24:50.998086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-23T19:02:41.869802+0000","last_change":"2023-06-23T19:00:58.810848+0000","last_active":"2023-06-23T19:02:41.869802+0000","last_peered":"2023-06-23T19:02:41.869802+0000","last_clean":"2023-06-23T19:02:41.869802+0000","last_became_active":"2023-06-23T19:00:58.810530+0000","last_became_peered":"2023-06-23T19:00:58.810530+0000","last_unstale":"2023-06-23T19:02:41.869802+0000","last_undegraded":"2023-06-23T19:02:41.869802+0000","last_fullsized":"2023-06-23T19:02:41.869802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:20:36.196696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404159+0000","last_change":"2023-06-23T19:02:43.390188+0000","last_active":"2023-06-23T19:02:43.404159+0000","last_peered":"2023-06-23T19:02:43.404159+0000","last_clean":"2023-06-23T19:02:43.404159+0000","last_became_active":"2023-06-23T19:02:43.389894+0000","last_became_peered":"2023-06-23T19:02:43.389894+0000","last_unstale":"2023-06-23T19:02:43.404159+0000","last_undegraded":"2023-06-23T19:02:43.404159+0000","last_fullsized":"2023-06-23T19:02:43.404159+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:18:40.426963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404937+0000","last_change":"2023-06-23T19:02:42.889466+0000","last_active":"2023-06-23T19:02:43.404937+0000","last_peered":"2023-06-23T19:02:43.404937+0000","last_clean":"2023-06-23T19:02:43.404937+0000","last_became_active":"2023-06-23T19:02:42.889189+0000","last_became_peered":"2023-06-23T19:02:42.889189+0000","last_unstale":"2023-06-23T19:02:43.404937+0000","last_undegraded":"2023-06-23T19:02:43.404937+0000","last_fullsized":"2023-06-23T19:02:43.404937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:54.621572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.377300+0000","last_change":"2023-06-23T19:00:58.032352+0000","last_active":"2023-06-23T19:02:43.377300+0000","last_peered":"2023-06-23T19:02:43.377300+0000","last_clean":"2023-06-23T19:02:43.377300+0000","last_became_active":"2023-06-23T19:00:58.031905+0000","last_became_peered":"2023-06-23T19:00:58.031905+0000","last_unstale":"2023-06-23T19:02:43.377300+0000","last_undegraded":"2023-06-23T19:02:43.377300+0000","last_fullsized":"2023-06-23T19:02:43.377300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:14:56.282366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.878044+0000","last_change":"2023-06-23T19:00:50.002765+0000","last_active":"2023-06-23T19:02:42.878044+0000","last_peered":"2023-06-23T19:02:42.878044+0000","last_clean":"2023-06-23T19:02:42.878044+0000","last_became_active":"2023-06-23T19:00:50.002445+0000","last_became_peered":"2023-06-23T19:00:50.002445+0000","last_unstale":"2023-06-23T19:02:42.878044+0000","last_undegraded":"2023-06-23T19:02:42.878044+0000","last_fullsized":"2023-06-23T19:02:42.878044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_clean_scrub_stamp":"2023-06-23T19:00:48.989242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:36.277808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874940+0000","last_change":"2023-06-23T19:02:42.874940+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874940+0000","last_undegraded":"2023-06-23T19:02:42.874940+0000","last_fullsized":"2023-06-23T19:02:42.874940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.896404+0000","last_change":"2023-06-23T19:02:42.892907+0000","last_active":"2023-06-23T19:02:42.896404+0000","last_peered":"2023-06-23T19:02:42.896404+0000","last_clean":"2023-06-23T19:02:42.896404+0000","last_became_active":"2023-06-23T19:02:42.892670+0000","last_became_peered":"2023-06-23T19:02:42.892670+0000","last_unstale":"2023-06-23T19:02:42.896404+0000","last_undegraded":"2023-06-23T19:02:42.896404+0000","last_fullsized":"2023-06-23T19:02:42.896404+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:18:39.422428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.878177+0000","last_change":"2023-06-23T19:00:58.034045+0000","last_active":"2023-06-23T19:02:42.878177+0000","last_peered":"2023-06-23T19:02:42.878177+0000","last_clean":"2023-06-23T19:02:42.878177+0000","last_became_active":"2023-06-23T19:00:58.033654+0000","last_became_peered":"2023-06-23T19:00:58.033654+0000","last_unstale":"2023-06-23T19:02:42.878177+0000","last_undegraded":"2023-06-23T19:02:42.878177+0000","last_fullsized":"2023-06-23T19:02:42.878177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:00:00.508536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.400804+0000","last_change":"2023-06-23T19:02:43.394471+0000","last_active":"2023-06-23T19:02:43.400804+0000","last_peered":"2023-06-23T19:02:43.400804+0000","last_clean":"2023-06-23T19:02:43.400804+0000","last_became_active":"2023-06-23T19:02:43.394192+0000","last_became_peered":"2023-06-23T19:02:43.394192+0000","last_unstale":"2023-06-23T19:02:43.400804+0000","last_undegraded":"2023-06-23T19:02:43.400804+0000","last_fullsized":"2023-06-23T19:02:43.400804+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:30:39.670564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.893989+0000","last_change":"2023-06-23T19:02:42.891170+0000","last_active":"2023-06-23T19:02:42.893989+0000","last_peered":"2023-06-23T19:02:42.893989+0000","last_clean":"2023-06-23T19:02:42.893989+0000","last_became_active":"2023-06-23T19:02:42.890891+0000","last_became_peered":"2023-06-23T19:02:42.890891+0000","last_unstale":"2023-06-23T19:02:42.893989+0000","last_undegraded":"2023-06-23T19:02:42.893989+0000","last_fullsized":"2023-06-23T19:02:42.893989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:05:14.954713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.878747+0000","last_change":"2023-06-23T19:00:58.992645+0000","last_active":"2023-06-23T19:02:42.878747+0000","last_peered":"2023-06-23T19:02:42.878747+0000","last_clean":"2023-06-23T19:02:42.878747+0000","last_became_active":"2023-06-23T19:00:58.992291+0000","last_became_peered":"2023-06-23T19:00:58.992291+0000","last_unstale":"2023-06-23T19:02:42.878747+0000","last_undegraded":"2023-06-23T19:02:42.878747+0000","last_fullsized":"2023-06-23T19:02:42.878747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:17:46.386176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.875537+0000","last_change":"2023-06-23T19:02:42.875537+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.875537+0000","last_undegraded":"2023-06-23T19:02:42.875537+0000","last_fullsized":"2023-06-23T19:02:42.875537+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.892271+0000","last_change":"2023-06-23T19:02:42.889986+0000","last_active":"2023-06-23T19:02:42.892271+0000","last_peered":"2023-06-23T19:02:42.892271+0000","last_clean":"2023-06-23T19:02:42.892271+0000","last_became_active":"2023-06-23T19:02:42.889346+0000","last_became_peered":"2023-06-23T19:02:42.889346+0000","last_unstale":"2023-06-23T19:02:42.892271+0000","last_undegraded":"2023-06-23T19:02:42.892271+0000","last_fullsized":"2023-06-23T19:02:42.892271+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:32.354763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.883265+0000","last_change":"2023-06-23T19:00:58.034828+0000","last_active":"2023-06-23T19:02:42.883265+0000","last_peered":"2023-06-23T19:02:42.883265+0000","last_clean":"2023-06-23T19:02:42.883265+0000","last_became_active":"2023-06-23T19:00:58.034502+0000","last_became_peered":"2023-06-23T19:00:58.034502+0000","last_unstale":"2023-06-23T19:02:42.883265+0000","last_undegraded":"2023-06-23T19:02:42.883265+0000","last_fullsized":"2023-06-23T19:02:42.883265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:28:51.207968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-06-23T19:02:42.874413+0000","last_change":"2023-06-23T19:02:42.874413+0000","last_active":"2023-06-23T19:02:42.864224+0000","last_peered":"2023-06-23T19:02:42.864224+0000","last_clean":"2023-06-23T19:02:42.864224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-23T19:02:42.874413+0000","last_undegraded":"2023-06-23T19:02:42.874413+0000","last_fullsized":"2023-06-23T19:02:42.874413+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-23T19:02:42.894456+0000","last_change":"2023-06-23T19:02:42.893057+0000","last_active":"2023-06-23T19:02:42.894456+0000","last_peered":"2023-06-23T19:02:42.894456+0000","last_clean":"2023-06-23T19:02:42.894456+0000","last_became_active":"2023-06-23T19:02:42.891406+0000","last_became_peered":"2023-06-23T19:02:42.891406+0000","last_unstale":"2023-06-23T19:02:42.894456+0000","last_undegraded":"2023-06-23T19:02:42.894456+0000","last_fullsized":"2023-06-23T19:02:42.894456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:09:56.709855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725059+0000","last_change":"2023-06-23T19:00:58.035530+0000","last_active":"2023-06-23T19:02:44.725059+0000","last_peered":"2023-06-23T19:02:44.725059+0000","last_clean":"2023-06-23T19:02:44.725059+0000","last_became_active":"2023-06-23T19:00:58.035130+0000","last_became_peered":"2023-06-23T19:00:58.035130+0000","last_unstale":"2023-06-23T19:02:44.725059+0000","last_undegraded":"2023-06-23T19:02:44.725059+0000","last_fullsized":"2023-06-23T19:02:44.725059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:46:47.648237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":800713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.433},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.95099999999999996}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.008}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":210345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.499},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.88}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.92200000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":196915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.375}]},{"osd":1,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.318},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":5.6539999999999999,"5min":5.6539999999999999,"15min":5.6539999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.875},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jun 23 19:01:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.84299999999999997}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":225438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.629},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70099999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":203405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.501}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.83799999999999997}]},{"osd":6,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":9.6329999999999991,"5min":9.6329999999999991,"15min":9.6329999999999991},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.75},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.86199999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":203405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.441}]},{"osd":1,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.751}]}]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":203405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.88300000000000001}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.748},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92400000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":800713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.992,"5min":7.992,"15min":7.992},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":7.9500000000000002,"5min":7.9500000000000002,"15min":7.9500000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":10.835000000000001,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.625},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T19:02:48.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-06-23T19:02:48.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.875866+0000', 'last_change': '2023-06-23T19:02:42.875866+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.875866+0000', 'last_undegraded': '2023-06-23T19:02:42.875866+0000', 'last_fullsized': '2023-06-23T19:02:42.875866+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-23T19:02:48.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-06-23T19:02:48.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.882083+0000', 'last_change': '2023-06-23T19:02:42.882083+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.882083+0000', 'last_undegraded': '2023-06-23T19:02:42.882083+0000', 'last_fullsized': '2023-06-23T19:02:42.882083+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-23T19:02:48.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-06-23T19:02:48.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.875376+0000', 'last_change': '2023-06-23T19:02:42.875376+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.875376+0000', 'last_undegraded': '2023-06-23T19:02:42.875376+0000', 'last_fullsized': '2023-06-23T19:02:42.875376+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-23T19:02:48.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-06-23T19:02:48.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.875598+0000', 'last_change': '2023-06-23T19:02:42.875598+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.875598+0000', 'last_undegraded': '2023-06-23T19:02:42.875598+0000', 'last_fullsized': '2023-06-23T19:02:42.875598+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-23T19:02:48.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-06-23T19:02:48.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-23T19:02:42.864224+0000', 'last_change': '2023-06-23T19:02:42.864224+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.864224+0000', 'last_undegraded': '2023-06-23T19:02:42.864224+0000', 'last_fullsized': '2023-06-23T19:02:42.864224+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-23T19:02:48.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-06-23T19:02:48.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.874398+0000', 'last_change': '2023-06-23T19:02:42.874398+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.874398+0000', 'last_undegraded': '2023-06-23T19:02:42.874398+0000', 'last_fullsized': '2023-06-23T19:02:42.874398+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-23T19:02:48.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-06-23T19:02:48.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.883405+0000', 'last_change': '2023-06-23T19:02:42.883405+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.883405+0000', 'last_undegraded': '2023-06-23T19:02:42.883405+0000', 'last_fullsized': '2023-06-23T19:02:42.883405+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-23T19:02:48.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-06-23T19:02:48.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.884789+0000', 'last_change': '2023-06-23T19:02:42.884789+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.884789+0000', 'last_undegraded': '2023-06-23T19:02:42.884789+0000', 'last_fullsized': '2023-06-23T19:02:42.884789+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-23T19:02:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-06-23T19:02:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-23T19:02:42.864224+0000', 'last_change': '2023-06-23T19:02:42.864224+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.864224+0000', 'last_undegraded': '2023-06-23T19:02:42.864224+0000', 'last_fullsized': '2023-06-23T19:02:42.864224+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-23T19:02:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-06-23T19:02:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.876390+0000', 'last_change': '2023-06-23T19:02:42.876390+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.876390+0000', 'last_undegraded': '2023-06-23T19:02:42.876390+0000', 'last_fullsized': '2023-06-23T19:02:42.876390+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-23T19:02:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-06-23T19:02:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-23T19:02:42.864224+0000', 'last_change': '2023-06-23T19:02:42.864224+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.864224+0000', 'last_undegraded': '2023-06-23T19:02:42.864224+0000', 'last_fullsized': '2023-06-23T19:02:42.864224+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-23T19:02:48.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-06-23T19:02:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.880250+0000', 'last_change': '2023-06-23T19:02:42.880250+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.880250+0000', 'last_undegraded': '2023-06-23T19:02:42.880250+0000', 'last_fullsized': '2023-06-23T19:02:42.880250+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-23T19:02:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-06-23T19:02:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.883638+0000', 'last_change': '2023-06-23T19:02:42.883638+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.883638+0000', 'last_undegraded': '2023-06-23T19:02:42.883638+0000', 'last_fullsized': '2023-06-23T19:02:42.883638+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-23T19:02:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-06-23T19:02:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.876479+0000', 'last_change': '2023-06-23T19:02:42.876479+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.876479+0000', 'last_undegraded': '2023-06-23T19:02:42.876479+0000', 'last_fullsized': '2023-06-23T19:02:42.876479+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-23T19:02:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-06-23T19:02:48.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-23T19:02:42.864224+0000', 'last_change': '2023-06-23T19:02:42.864224+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.864224+0000', 'last_undegraded': '2023-06-23T19:02:42.864224+0000', 'last_fullsized': '2023-06-23T19:02:42.864224+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-23T19:02:48.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-06-23T19:02:48.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.881101+0000', 'last_change': '2023-06-23T19:02:42.881101+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.881101+0000', 'last_undegraded': '2023-06-23T19:02:42.881101+0000', 'last_fullsized': '2023-06-23T19:02:42.881101+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-23T19:02:48.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-06-23T19:02:48.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.882330+0000', 'last_change': '2023-06-23T19:02:42.882330+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.882330+0000', 'last_undegraded': '2023-06-23T19:02:42.882330+0000', 'last_fullsized': '2023-06-23T19:02:42.882330+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-23T19:02:48.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-06-23T19:02:48.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.880391+0000', 'last_change': '2023-06-23T19:02:42.880391+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.880391+0000', 'last_undegraded': '2023-06-23T19:02:42.880391+0000', 'last_fullsized': '2023-06-23T19:02:42.880391+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-23T19:02:48.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-06-23T19:02:48.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.882525+0000', 'last_change': '2023-06-23T19:02:42.882525+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.882525+0000', 'last_undegraded': '2023-06-23T19:02:42.882525+0000', 'last_fullsized': '2023-06-23T19:02:42.882525+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-23T19:02:48.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-06-23T19:02:48.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.875297+0000', 'last_change': '2023-06-23T19:02:42.875297+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.875297+0000', 'last_undegraded': '2023-06-23T19:02:42.875297+0000', 'last_fullsized': '2023-06-23T19:02:42.875297+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-23T19:02:48.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-06-23T19:02:48.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.874979+0000', 'last_change': '2023-06-23T19:02:42.874979+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.874979+0000', 'last_undegraded': '2023-06-23T19:02:42.874979+0000', 'last_fullsized': '2023-06-23T19:02:42.874979+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-23T19:02:48.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-06-23T19:02:48.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.875504+0000', 'last_change': '2023-06-23T19:02:42.875504+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.875504+0000', 'last_undegraded': '2023-06-23T19:02:42.875504+0000', 'last_fullsized': '2023-06-23T19:02:42.875504+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-23T19:02:48.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-06-23T19:02:48.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:41.869925+0000', 'last_change': '2023-06-23T19:02:41.869925+0000', 'last_active': '2023-06-23T19:02:41.859689+0000', 'last_peered': '2023-06-23T19:02:41.859689+0000', 'last_clean': '2023-06-23T19:02:41.859689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:41.869925+0000', 'last_undegraded': '2023-06-23T19:02:41.869925+0000', 'last_fullsized': '2023-06-23T19:02:41.869925+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:41.859689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:41.859689+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:41.859689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-23T19:02:48.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-06-23T19:02:48.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.874376+0000', 'last_change': '2023-06-23T19:02:42.874376+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.874376+0000', 'last_undegraded': '2023-06-23T19:02:42.874376+0000', 'last_fullsized': '2023-06-23T19:02:42.874376+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-23T19:02:48.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-06-23T19:02:48.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.874957+0000', 'last_change': '2023-06-23T19:02:42.874957+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.874957+0000', 'last_undegraded': '2023-06-23T19:02:42.874957+0000', 'last_fullsized': '2023-06-23T19:02:42.874957+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-23T19:02:48.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-06-23T19:02:48.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-23T19:02:42.864224+0000', 'last_change': '2023-06-23T19:02:42.864224+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.864224+0000', 'last_undegraded': '2023-06-23T19:02:42.864224+0000', 'last_fullsized': '2023-06-23T19:02:42.864224+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-23T19:02:48.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-06-23T19:02:48.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:41.870408+0000', 'last_change': '2023-06-23T19:02:41.870408+0000', 'last_active': '2023-06-23T19:02:41.859689+0000', 'last_peered': '2023-06-23T19:02:41.859689+0000', 'last_clean': '2023-06-23T19:02:41.859689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:41.870408+0000', 'last_undegraded': '2023-06-23T19:02:41.870408+0000', 'last_fullsized': '2023-06-23T19:02:41.870408+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:41.859689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:41.859689+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:41.859689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-23T19:02:48.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-06-23T19:02:48.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.876172+0000', 'last_change': '2023-06-23T19:02:42.876172+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.876172+0000', 'last_undegraded': '2023-06-23T19:02:42.876172+0000', 'last_fullsized': '2023-06-23T19:02:42.876172+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-23T19:02:48.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-06-23T19:02:48.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.880610+0000', 'last_change': '2023-06-23T19:02:42.880610+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.880610+0000', 'last_undegraded': '2023-06-23T19:02:42.880610+0000', 'last_fullsized': '2023-06-23T19:02:42.880610+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-23T19:02:48.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-06-23T19:02:48.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-23T19:02:42.864224+0000', 'last_change': '2023-06-23T19:02:42.864224+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.864224+0000', 'last_undegraded': '2023-06-23T19:02:42.864224+0000', 'last_fullsized': '2023-06-23T19:02:42.864224+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-23T19:02:48.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-06-23T19:02:48.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.879590+0000', 'last_change': '2023-06-23T19:02:42.879590+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.879590+0000', 'last_undegraded': '2023-06-23T19:02:42.879590+0000', 'last_fullsized': '2023-06-23T19:02:42.879590+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-23T19:02:48.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-06-23T19:02:48.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.874940+0000', 'last_change': '2023-06-23T19:02:42.874940+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.874940+0000', 'last_undegraded': '2023-06-23T19:02:42.874940+0000', 'last_fullsized': '2023-06-23T19:02:42.874940+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-23T19:02:48.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-06-23T19:02:48.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.875537+0000', 'last_change': '2023-06-23T19:02:42.875537+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.875537+0000', 'last_undegraded': '2023-06-23T19:02:42.875537+0000', 'last_fullsized': '2023-06-23T19:02:42.875537+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-23T19:02:48.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-06-23T19:02:48.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-06-23T19:02:42.874413+0000', 'last_change': '2023-06-23T19:02:42.874413+0000', 'last_active': '2023-06-23T19:02:42.864224+0000', 'last_peered': '2023-06-23T19:02:42.864224+0000', 'last_clean': '2023-06-23T19:02:42.864224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-23T19:02:42.874413+0000', 'last_undegraded': '2023-06-23T19:02:42.874413+0000', 'last_fullsized': '2023-06-23T19:02:42.874413+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'last_clean_scrub_stamp': '2023-06-23T19:02:42.864224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-23T19:02:48.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-23T19:02:48.926 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.923+0000 7f25d53ff700 1 Processor -- start 2023-06-23T19:02:48.927 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.923+0000 7f25d53ff700 1 -- start start 2023-06-23T19:02:48.928 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.924+0000 7f25d53ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f25d015c570 0x7f25d00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.924+0000 7f25d53ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25d00cd660 0x7f25d0160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.924+0000 7f25d53ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f25d0160880 0x7f25d006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.924+0000 7f25d53ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d015d670 con 0x7f25d015c570 2023-06-23T19:02:48.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.924+0000 7f25d53ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d00cdab0 con 0x7f25d0160880 2023-06-23T19:02:48.929 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.924+0000 7f25d53ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d01610a0 con 0x7f25d00cd660 2023-06-23T19:02:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25ceffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f25d015c570 0x7f25d00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25ceffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f25d015c570 0x7f25d00cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55938/0 (socket says 172.21.15.136:55938) 2023-06-23T19:02:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25ceffd700 1 -- 172.21.15.136:0/3836282015 learned_addr learned my addr 172.21.15.136:0/3836282015 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25ce7fc700 1 --2- 172.21.15.136:0/3836282015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25d00cd660 0x7f25d0160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25cf7fe700 1 --2- 172.21.15.136:0/3836282015 >> v2:172.21.15.178:3300/0 conn(0x7f25d0160880 0x7f25d006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25ceffd700 1 -- 172.21.15.136:0/3836282015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25d00cd660 msgr2=0x7f25d0160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25ceffd700 1 --2- 172.21.15.136:0/3836282015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25d00cd660 0x7f25d0160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25ceffd700 1 -- 172.21.15.136:0/3836282015 >> v2:172.21.15.178:3300/0 conn(0x7f25d0160880 msgr2=0x7f25d006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:48.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25ceffd700 1 --2- 172.21.15.136:0/3836282015 >> v2:172.21.15.178:3300/0 conn(0x7f25d0160880 0x7f25d006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.931 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.925+0000 7f25ceffd700 1 -- 172.21.15.136:0/3836282015 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d015da90 con 0x7f25d015c570 2023-06-23T19:02:48.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25ceffd700 1 --2- 172.21.15.136:0/3836282015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 0x7f25d00cd120 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f25d00d06a0 tx=0x7f25c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce983f73a0aed13 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:48.932 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25cdffb700 1 -- 172.21.15.136:0/3836282015 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0011830 con 0x7f25d015c570 2023-06-23T19:02:48.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25cdffb700 1 -- 172.21.15.136:0/3836282015 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0011990 con 0x7f25d015c570 2023-06-23T19:02:48.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25cdffb700 1 -- 172.21.15.136:0/3836282015 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0011d20 con 0x7f25d015c570 2023-06-23T19:02:48.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25d53ff700 1 -- 172.21.15.136:0/3836282015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 msgr2=0x7f25d00cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25d53ff700 1 --2- 172.21.15.136:0/3836282015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 0x7f25d00cd120 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f25d00d06a0 tx=0x7f25c0009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25d53ff700 1 -- 172.21.15.136:0/3836282015 shutdown_connections 2023-06-23T19:02:48.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25d53ff700 1 --2- 172.21.15.136:0/3836282015 >> v2:172.21.15.178:3300/0 conn(0x7f25d0160880 0x7f25d006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.933 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25d53ff700 1 --2- 172.21.15.136:0/3836282015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 0x7f25d00cd120 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25d53ff700 1 --2- 172.21.15.136:0/3836282015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25d00cd660 0x7f25d0160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25d53ff700 1 -- 172.21.15.136:0/3836282015 >> 172.21.15.136:0/3836282015 conn(0x7f25d0071620 msgr2=0x7f25d00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:48.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.926+0000 7f25d53ff700 1 -- 172.21.15.136:0/3836282015 shutdown_connections 2023-06-23T19:02:48.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.927+0000 7f25d53ff700 1 -- 172.21.15.136:0/3836282015 wait complete. 2023-06-23T19:02:48.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.928+0000 7f25d53ff700 1 Processor -- start 2023-06-23T19:02:48.934 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.928+0000 7f25d53ff700 1 -- start start 2023-06-23T19:02:48.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.929+0000 7f25d53ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25d00cd660 0x7f25d00d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.929+0000 7f25d53ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 0x7f25d00d1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.929+0000 7f25d53ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25d0160880 0x7f25d0158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.929+0000 7f25d53ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00c6b00 con 0x7f25d015c570 2023-06-23T19:02:48.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.929+0000 7f25d53ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00c6de0 con 0x7f25d00cd660 2023-06-23T19:02:48.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.929+0000 7f25d53ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00c70c0 con 0x7f25d0160880 2023-06-23T19:02:48.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.929+0000 7f25ce7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 0x7f25d00d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.929+0000 7f25ce7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 0x7f25d00d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55942/0 (socket says 172.21.15.136:55942) 2023-06-23T19:02:48.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.929+0000 7f25ce7fc700 1 -- 172.21.15.136:0/440449566 learned_addr learned my addr 172.21.15.136:0/440449566 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:48.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25ce7fc700 1 -- 172.21.15.136:0/440449566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25d0160880 msgr2=0x7f25d0158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25ce7fc700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25d0160880 0x7f25d0158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25ce7fc700 1 -- 172.21.15.136:0/440449566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25d00cd660 msgr2=0x7f25d00d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25ce7fc700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25d00cd660 0x7f25d00d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25ce7fc700 1 -- 172.21.15.136:0/440449566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0009550 con 0x7f25d015c570 2023-06-23T19:02:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25ce7fc700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 0x7f25d00d1600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f25c400e870 tx=0x7f25c400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25b77fe700 1 -- 172.21.15.136:0/440449566 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400c5c0 con 0x7f25d015c570 2023-06-23T19:02:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25b77fe700 1 -- 172.21.15.136:0/440449566 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c400c720 con 0x7f25d015c570 2023-06-23T19:02:48.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25b77fe700 1 -- 172.21.15.136:0/440449566 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400cab0 con 0x7f25d015c570 2023-06-23T19:02:48.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d00b6fa0 con 0x7f25d015c570 2023-06-23T19:02:48.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.930+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d00c9490 con 0x7f25d015c570 2023-06-23T19:02:48.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.932+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d0073910 con 0x7f25d015c570 2023-06-23T19:02:48.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.932+0000 7f25b77fe700 1 -- 172.21.15.136:0/440449566 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25c400cc10 con 0x7f25d015c570 2023-06-23T19:02:48.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.933+0000 7f25b77fe700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f25bc06ace0 0x7f25bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:48.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.933+0000 7f25b77fe700 1 -- 172.21.15.136:0/440449566 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f25c40893f0 con 0x7f25d015c570 2023-06-23T19:02:48.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.934+0000 7f25ceffd700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f25bc06ace0 0x7f25bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:48.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.934+0000 7f25ceffd700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f25bc06ace0 0x7f25bc06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f25d00c86c0 tx=0x7f25c0010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:48.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:48.938+0000 7f25b77fe700 1 -- 172.21.15.136:0/440449566 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f25c40543f0 con 0x7f25d015c570 2023-06-23T19:02:49.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.216+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f25d00b6c50 con 0x7f25d015c570 2023-06-23T19:02:49.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.217+0000 7f25b77fe700 1 -- 172.21.15.136:0/440449566 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1172 (secure 0 0 0) 0x7f25c4057a10 con 0x7f25d015c570 2023-06-23T19:02:49.221 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:49.221 INFO:teuthology.orchestra.run.smithi136.stdout:{"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":133,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1687546848,"num_in_osds":8,"osd_in_since":1687546839,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":71},{"state_name":"creating+peering","count":28},{"state_name":"unknown","count":6}],"num_pgs":105,"num_pools":4,"num_objects":8,"data_bytes":590438,"bytes_used":225783808,"bytes_avail":772868329472,"bytes_total":773094113280,"unknown_pgs_ratio":0.05714285746216774,"inactive_pgs_ratio":0.26666668057441711,"write_bytes_sec":201,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5358}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-06-23T19:02:10.948944+0000","services":{}},"progress_events":{}} 2023-06-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f25bc06ace0 msgr2=0x7f25bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f25bc06ace0 0x7f25bc06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f25d00c86c0 tx=0x7f25c0010000 comp rx=0 tx=0).stop 2023-06-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 msgr2=0x7f25d00d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 0x7f25d00d1600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f25c400e870 tx=0x7f25c400ec30 comp rx=0 tx=0).stop 2023-06-23T19:02:49.225 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 shutdown_connections 2023-06-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f25bc06ace0 0x7f25bc06d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25d00cd660 0x7f25d00d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25d0160880 0x7f25d0158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 --2- 172.21.15.136:0/440449566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d015c570 0x7f25d00d1600 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 >> 172.21.15.136:0/440449566 conn(0x7f25d0071620 msgr2=0x7f25d00d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 shutdown_connections 2023-06-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.219+0000 7f25d53ff700 1 -- 172.21.15.136:0/440449566 wait complete. 2023-06-23T19:02:49.241 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-23T19:02:49.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T19:02:49.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.433+0000 7f376c9ff700 1 Processor -- start 2023-06-23T19:02:49.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.433+0000 7f376c9ff700 1 -- start start 2023-06-23T19:02:49.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.434+0000 7f376c9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f376815c380 0x7f37680b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:49.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.434+0000 7f376c9ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f37680b4cf0 0x7f37680cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:49.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.434+0000 7f376c9ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37680ced80 con 0x7f37680cf6f0 2023-06-23T19:02:49.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.434+0000 7f376c9ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37680d1760 con 0x7f37680b4cf0 2023-06-23T19:02:49.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.434+0000 7f376c9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680d1480 con 0x7f376815c380 2023-06-23T19:02:49.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.435+0000 7f375ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f37680b4cf0 0x7f37680cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:49.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.435+0000 7f375ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f37680b4cf0 0x7f37680cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55946/0 (socket says 172.21.15.136:55946) 2023-06-23T19:02:49.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.435+0000 7f375ffff700 1 -- 172.21.15.136:0/3205189737 learned_addr learned my addr 172.21.15.136:0/3205189737 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:49.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.435+0000 7f376659c700 1 --2- 172.21.15.136:0/3205189737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f376815c380 0x7f37680b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:49.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.435+0000 7f375ffff700 1 -- 172.21.15.136:0/3205189737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f376815c380 msgr2=0x7f37680b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:49.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.435+0000 7f375ffff700 1 --2- 172.21.15.136:0/3205189737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f376815c380 0x7f37680b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.435+0000 7f375ffff700 1 -- 172.21.15.136:0/3205189737 >> v1:172.21.15.178:6789/0 conn(0x7f37680cf6f0 legacy=0x7f37680d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:49.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.435+0000 7f375ffff700 1 -- 172.21.15.136:0/3205189737 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680cd2b0 con 0x7f37680b4cf0 2023-06-23T19:02:49.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f375ffff700 1 --2- 172.21.15.136:0/3205189737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 0x7f37680cf1b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f37500098f0 tx=0x7f3750009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21119e30930b30bd server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:49.445 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f3765d9b700 1 -- 172.21.15.136:0/3205189737 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375000b8a0 con 0x7f37680b4cf0 2023-06-23T19:02:49.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f3765d9b700 1 -- 172.21.15.136:0/3205189737 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375000ba00 con 0x7f37680b4cf0 2023-06-23T19:02:49.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f3765d9b700 1 -- 172.21.15.136:0/3205189737 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375000bd90 con 0x7f37680b4cf0 2023-06-23T19:02:49.446 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f376c9ff700 1 -- 172.21.15.136:0/3205189737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 msgr2=0x7f37680cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:49.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f376c9ff700 1 --2- 172.21.15.136:0/3205189737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 0x7f37680cf1b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f37500098f0 tx=0x7f3750009c00 comp rx=0 tx=0).stop 2023-06-23T19:02:49.447 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f376c9ff700 1 -- 172.21.15.136:0/3205189737 shutdown_connections 2023-06-23T19:02:49.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f376c9ff700 1 --2- 172.21.15.136:0/3205189737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f376815c380 0x7f37680b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f376c9ff700 1 --2- 172.21.15.136:0/3205189737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 0x7f37680cf1b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.448 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.436+0000 7f376c9ff700 1 -- 172.21.15.136:0/3205189737 >> 172.21.15.136:0/3205189737 conn(0x7f3768071620 msgr2=0x7f37680719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:49.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.437+0000 7f376c9ff700 1 -- 172.21.15.136:0/3205189737 shutdown_connections 2023-06-23T19:02:49.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.437+0000 7f376c9ff700 1 -- 172.21.15.136:0/3205189737 wait complete. 2023-06-23T19:02:49.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.438+0000 7f376c9ff700 1 Processor -- start 2023-06-23T19:02:49.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.438+0000 7f376c9ff700 1 -- start start 2023-06-23T19:02:49.453 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.439+0000 7f376c9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 0x7f37680b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:49.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.439+0000 7f376c9ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37680cf6f0 0x7f37680c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:49.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.439+0000 7f376c9ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f376815c380 0x7f37680ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:49.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.439+0000 7f376c9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37680cb7e0 con 0x7f37680b4cf0 2023-06-23T19:02:49.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.439+0000 7f376c9ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37680ca920 con 0x7f376815c380 2023-06-23T19:02:49.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.439+0000 7f376c9ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680cabd0 con 0x7f37680cf6f0 2023-06-23T19:02:49.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f376659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 0x7f37680b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:49.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f376659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 0x7f37680b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55958/0 (socket says 172.21.15.136:55958) 2023-06-23T19:02:49.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f376659c700 1 -- 172.21.15.136:0/1310910503 learned_addr learned my addr 172.21.15.136:0/1310910503 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:49.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f375ffff700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37680cf6f0 0x7f37680c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:49.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f3766d9d700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f376815c380 0x7f37680ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:49.458 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f376659c700 1 -- 172.21.15.136:0/1310910503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37680cf6f0 msgr2=0x7f37680c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:49.458 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f376659c700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37680cf6f0 0x7f37680c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f376659c700 1 -- 172.21.15.136:0/1310910503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f376815c380 msgr2=0x7f37680ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:49.459 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f376659c700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f376815c380 0x7f37680ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f376659c700 1 -- 172.21.15.136:0/1310910503 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750009550 con 0x7f37680b4cf0 2023-06-23T19:02:49.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f376659c700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 0x7f37680b7f40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f375800d800 tx=0x7f375800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:49.460 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.440+0000 7f375effd700 1 -- 172.21.15.136:0/1310910503 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580125f0 con 0x7f37680b4cf0 2023-06-23T19:02:49.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.441+0000 7f375effd700 1 -- 172.21.15.136:0/1310910503 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758012750 con 0x7f37680b4cf0 2023-06-23T19:02:49.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.441+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37680caeb0 con 0x7f37680b4cf0 2023-06-23T19:02:49.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.441+0000 7f375effd700 1 -- 172.21.15.136:0/1310910503 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758012b00 con 0x7f37680b4cf0 2023-06-23T19:02:49.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.441+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37680cb470 con 0x7f37680b4cf0 2023-06-23T19:02:49.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.442+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3768073910 con 0x7f37680b4cf0 2023-06-23T19:02:49.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.443+0000 7f375effd700 1 -- 172.21.15.136:0/1310910503 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3758012c60 con 0x7f37680b4cf0 2023-06-23T19:02:49.461 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.443+0000 7f375effd700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f374806ace0 0x7f374806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:49.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.443+0000 7f375effd700 1 -- 172.21.15.136:0/1310910503 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3758089a50 con 0x7f37680b4cf0 2023-06-23T19:02:49.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.444+0000 7f375ffff700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f374806ace0 0x7f374806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:49.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.444+0000 7f375ffff700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f374806ace0 0x7f374806d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f37500098f0 tx=0x7f3750008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:49.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.448+0000 7f375effd700 1 -- 172.21.15.136:0/1310910503 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3758054920 con 0x7f37680b4cf0 2023-06-23T19:02:49.644 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.640+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 --> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37680cd870 con 0x7f374806ace0 2023-06-23T19:02:49.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.649+0000 7f375effd700 1 -- 172.21.15.136:0/1310910503 <== mgr.4105 v2:172.21.15.136:6832/2653877961 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311478 (secure 0 0 0) 0x7f375000bb70 con 0x7f374806ace0 2023-06-23T19:02:49.656 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:49.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f374806ace0 msgr2=0x7f374806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:49.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f374806ace0 0x7f374806d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f37500098f0 tx=0x7f3750008030 comp rx=0 tx=0).stop 2023-06-23T19:02:49.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 msgr2=0x7f37680b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:49.659 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 0x7f37680b7f40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f375800d800 tx=0x7f375800dbc0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 shutdown_connections 2023-06-23T19:02:49.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f374806ace0 0x7f374806d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f376815c380 0x7f37680ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37680b4cf0 0x7f37680b7f40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 --2- 172.21.15.136:0/1310910503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37680cf6f0 0x7f37680c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:49.660 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 >> 172.21.15.136:0/1310910503 conn(0x7f3768071620 msgr2=0x7f37680b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:49.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 shutdown_connections 2023-06-23T19:02:49.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:49.653+0000 7f376c9ff700 1 -- 172.21.15.136:0/1310910503 wait complete. 2023-06-23T19:02:49.661 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2023-06-23T19:02:49.675 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-06-23T19:02:48.956890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220720,"kb_used_data":5104,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754000,"statfs":{"total":773094113280,"available":772868096000,"internally_reserved":0,"allocated":5226496,"data_stored":2954642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.088881"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375912+0000","last_change":"2023-06-23T19:02:43.394056+0000","last_active":"2023-06-23T19:02:44.375912+0000","last_peered":"2023-06-23T19:02:44.375912+0000","last_clean":"2023-06-23T19:02:44.375912+0000","last_became_active":"2023-06-23T19:02:43.393754+0000","last_became_peered":"2023-06-23T19:02:43.393754+0000","last_unstale":"2023-06-23T19:02:44.375912+0000","last_undegraded":"2023-06-23T19:02:44.375912+0000","last_fullsized":"2023-06-23T19:02:44.375912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:07:37.481425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.406971+0000","last_change":"2023-06-23T19:02:43.405015+0000","last_active":"2023-06-23T19:02:43.406971+0000","last_peered":"2023-06-23T19:02:43.406971+0000","last_clean":"2023-06-23T19:02:43.406971+0000","last_became_active":"2023-06-23T19:02:43.404718+0000","last_became_peered":"2023-06-23T19:02:43.404718+0000","last_unstale":"2023-06-23T19:02:43.406971+0000","last_undegraded":"2023-06-23T19:02:43.406971+0000","last_fullsized":"2023-06-23T19:02:43.406971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:13:11.771904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374983+0000","last_change":"2023-06-23T19:02:43.391322+0000","last_active":"2023-06-23T19:02:44.374983+0000","last_peered":"2023-06-23T19:02:44.374983+0000","last_clean":"2023-06-23T19:02:44.374983+0000","last_became_active":"2023-06-23T19:02:43.391105+0000","last_became_peered":"2023-06-23T19:02:43.391105+0000","last_unstale":"2023-06-23T19:02:44.374983+0000","last_undegraded":"2023-06-23T19:02:44.374983+0000","last_fullsized":"2023-06-23T19:02:44.374983+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:48.006363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405222+0000","last_change":"2023-06-23T19:02:43.402422+0000","last_active":"2023-06-23T19:02:43.405222+0000","last_peered":"2023-06-23T19:02:43.405222+0000","last_clean":"2023-06-23T19:02:43.405222+0000","last_became_active":"2023-06-23T19:02:43.402157+0000","last_became_peered":"2023-06-23T19:02:43.402157+0000","last_unstale":"2023-06-23T19:02:43.405222+0000","last_undegraded":"2023-06-23T19:02:43.405222+0000","last_fullsized":"2023-06-23T19:02:43.405222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:57:50.309764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.403065+0000","last_change":"2023-06-23T19:02:43.395438+0000","last_active":"2023-06-23T19:02:43.403065+0000","last_peered":"2023-06-23T19:02:43.403065+0000","last_clean":"2023-06-23T19:02:43.403065+0000","last_became_active":"2023-06-23T19:02:43.395153+0000","last_became_peered":"2023-06-23T19:02:43.395153+0000","last_unstale":"2023-06-23T19:02:43.403065+0000","last_undegraded":"2023-06-23T19:02:43.403065+0000","last_fullsized":"2023-06-23T19:02:43.403065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:41:51.912362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398128+0000","last_change":"2023-06-23T19:02:43.395365+0000","last_active":"2023-06-23T19:02:44.398128+0000","last_peered":"2023-06-23T19:02:44.398128+0000","last_clean":"2023-06-23T19:02:44.398128+0000","last_became_active":"2023-06-23T19:02:43.394625+0000","last_became_peered":"2023-06-23T19:02:43.394625+0000","last_unstale":"2023-06-23T19:02:44.398128+0000","last_undegraded":"2023-06-23T19:02:44.398128+0000","last_fullsized":"2023-06-23T19:02:44.398128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:13:45.625003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375399+0000","last_change":"2023-06-23T19:02:43.388810+0000","last_active":"2023-06-23T19:02:44.375399+0000","last_peered":"2023-06-23T19:02:44.375399+0000","last_clean":"2023-06-23T19:02:44.375399+0000","last_became_active":"2023-06-23T19:02:43.386330+0000","last_became_peered":"2023-06-23T19:02:43.386330+0000","last_unstale":"2023-06-23T19:02:44.375399+0000","last_undegraded":"2023-06-23T19:02:44.375399+0000","last_fullsized":"2023-06-23T19:02:44.375399+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:57:06.555441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405254+0000","last_change":"2023-06-23T19:02:43.403369+0000","last_active":"2023-06-23T19:02:43.405254+0000","last_peered":"2023-06-23T19:02:43.405254+0000","last_clean":"2023-06-23T19:02:43.405254+0000","last_became_active":"2023-06-23T19:02:43.403084+0000","last_became_peered":"2023-06-23T19:02:43.403084+0000","last_unstale":"2023-06-23T19:02:43.405254+0000","last_undegraded":"2023-06-23T19:02:43.405254+0000","last_fullsized":"2023-06-23T19:02:43.405254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:07:48.893356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394405+0000","last_change":"2023-06-23T19:02:43.386467+0000","last_active":"2023-06-23T19:02:43.394405+0000","last_peered":"2023-06-23T19:02:43.394405+0000","last_clean":"2023-06-23T19:02:43.394405+0000","last_became_active":"2023-06-23T19:02:43.386192+0000","last_became_peered":"2023-06-23T19:02:43.386192+0000","last_unstale":"2023-06-23T19:02:43.394405+0000","last_undegraded":"2023-06-23T19:02:43.394405+0000","last_fullsized":"2023-06-23T19:02:43.394405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:12.505159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405097+0000","last_change":"2023-06-23T19:02:43.402134+0000","last_active":"2023-06-23T19:02:43.405097+0000","last_peered":"2023-06-23T19:02:43.405097+0000","last_clean":"2023-06-23T19:02:43.405097+0000","last_became_active":"2023-06-23T19:02:43.401870+0000","last_became_peered":"2023-06-23T19:02:43.401870+0000","last_unstale":"2023-06-23T19:02:43.405097+0000","last_undegraded":"2023-06-23T19:02:43.405097+0000","last_fullsized":"2023-06-23T19:02:43.405097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:45.418052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.393949+0000","last_change":"2023-06-23T19:02:43.386081+0000","last_active":"2023-06-23T19:02:43.393949+0000","last_peered":"2023-06-23T19:02:43.393949+0000","last_clean":"2023-06-23T19:02:43.393949+0000","last_became_active":"2023-06-23T19:02:43.385795+0000","last_became_peered":"2023-06-23T19:02:43.385795+0000","last_unstale":"2023-06-23T19:02:43.393949+0000","last_undegraded":"2023-06-23T19:02:43.393949+0000","last_fullsized":"2023-06-23T19:02:43.393949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:58:59.234601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.402361+0000","last_change":"2023-06-23T19:02:43.395109+0000","last_active":"2023-06-23T19:02:43.402361+0000","last_peered":"2023-06-23T19:02:43.402361+0000","last_clean":"2023-06-23T19:02:43.402361+0000","last_became_active":"2023-06-23T19:02:43.394402+0000","last_became_peered":"2023-06-23T19:02:43.394402+0000","last_unstale":"2023-06-23T19:02:43.402361+0000","last_undegraded":"2023-06-23T19:02:43.402361+0000","last_fullsized":"2023-06-23T19:02:43.402361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:57:20.585183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724074+0000","last_change":"2023-06-23T19:02:43.396616+0000","last_active":"2023-06-23T19:02:44.724074+0000","last_peered":"2023-06-23T19:02:44.724074+0000","last_clean":"2023-06-23T19:02:44.724074+0000","last_became_active":"2023-06-23T19:02:43.396367+0000","last_became_peered":"2023-06-23T19:02:43.396367+0000","last_unstale":"2023-06-23T19:02:44.724074+0000","last_undegraded":"2023-06-23T19:02:44.724074+0000","last_fullsized":"2023-06-23T19:02:44.724074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:45.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.393814+0000","last_change":"2023-06-23T19:02:43.383462+0000","last_active":"2023-06-23T19:02:43.393814+0000","last_peered":"2023-06-23T19:02:43.393814+0000","last_clean":"2023-06-23T19:02:43.393814+0000","last_became_active":"2023-06-23T19:02:43.383158+0000","last_became_peered":"2023-06-23T19:02:43.383158+0000","last_unstale":"2023-06-23T19:02:43.393814+0000","last_undegraded":"2023-06-23T19:02:43.393814+0000","last_fullsized":"2023-06-23T19:02:43.393814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:31:01.213549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398107+0000","last_change":"2023-06-23T19:02:43.390211+0000","last_active":"2023-06-23T19:02:44.398107+0000","last_peered":"2023-06-23T19:02:44.398107+0000","last_clean":"2023-06-23T19:02:44.398107+0000","last_became_active":"2023-06-23T19:02:43.389843+0000","last_became_peered":"2023-06-23T19:02:43.389843+0000","last_unstale":"2023-06-23T19:02:44.398107+0000","last_undegraded":"2023-06-23T19:02:44.398107+0000","last_fullsized":"2023-06-23T19:02:44.398107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:54.012998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724048+0000","last_change":"2023-06-23T19:02:43.400056+0000","last_active":"2023-06-23T19:02:44.724048+0000","last_peered":"2023-06-23T19:02:44.724048+0000","last_clean":"2023-06-23T19:02:44.724048+0000","last_became_active":"2023-06-23T19:02:43.399740+0000","last_became_peered":"2023-06-23T19:02:43.399740+0000","last_unstale":"2023-06-23T19:02:44.724048+0000","last_undegraded":"2023-06-23T19:02:44.724048+0000","last_fullsized":"2023-06-23T19:02:44.724048+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:32:56.376089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374989+0000","last_change":"2023-06-23T19:02:43.403902+0000","last_active":"2023-06-23T19:02:44.374989+0000","last_peered":"2023-06-23T19:02:44.374989+0000","last_clean":"2023-06-23T19:02:44.374989+0000","last_became_active":"2023-06-23T19:02:43.402727+0000","last_became_peered":"2023-06-23T19:02:43.402727+0000","last_unstale":"2023-06-23T19:02:44.374989+0000","last_undegraded":"2023-06-23T19:02:44.374989+0000","last_fullsized":"2023-06-23T19:02:44.374989+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:42.025343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375447+0000","last_change":"2023-06-23T19:02:43.407203+0000","last_active":"2023-06-23T19:02:44.375447+0000","last_peered":"2023-06-23T19:02:44.375447+0000","last_clean":"2023-06-23T19:02:44.375447+0000","last_became_active":"2023-06-23T19:02:43.406904+0000","last_became_peered":"2023-06-23T19:02:43.406904+0000","last_unstale":"2023-06-23T19:02:44.375447+0000","last_undegraded":"2023-06-23T19:02:44.375447+0000","last_fullsized":"2023-06-23T19:02:44.375447+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:31:21.914288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725030+0000","last_change":"2023-06-23T19:02:43.400304+0000","last_active":"2023-06-23T19:02:44.725030+0000","last_peered":"2023-06-23T19:02:44.725030+0000","last_clean":"2023-06-23T19:02:44.725030+0000","last_became_active":"2023-06-23T19:02:43.396953+0000","last_became_peered":"2023-06-23T19:02:43.396953+0000","last_unstale":"2023-06-23T19:02:44.725030+0000","last_undegraded":"2023-06-23T19:02:44.725030+0000","last_fullsized":"2023-06-23T19:02:44.725030+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:41.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723626+0000","last_change":"2023-06-23T19:02:43.381816+0000","last_active":"2023-06-23T19:02:44.723626+0000","last_peered":"2023-06-23T19:02:44.723626+0000","last_clean":"2023-06-23T19:02:44.723626+0000","last_became_active":"2023-06-23T19:02:43.381565+0000","last_became_peered":"2023-06-23T19:02:43.381565+0000","last_unstale":"2023-06-23T19:02:44.723626+0000","last_undegraded":"2023-06-23T19:02:44.723626+0000","last_fullsized":"2023-06-23T19:02:44.723626+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:57.666767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398356+0000","last_change":"2023-06-23T19:02:43.402759+0000","last_active":"2023-06-23T19:02:44.398356+0000","last_peered":"2023-06-23T19:02:44.398356+0000","last_clean":"2023-06-23T19:02:44.398356+0000","last_became_active":"2023-06-23T19:02:43.402425+0000","last_became_peered":"2023-06-23T19:02:43.402425+0000","last_unstale":"2023-06-23T19:02:44.398356+0000","last_undegraded":"2023-06-23T19:02:44.398356+0000","last_fullsized":"2023-06-23T19:02:44.398356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:25.908843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405195+0000","last_change":"2023-06-23T19:02:43.402236+0000","last_active":"2023-06-23T19:02:43.405195+0000","last_peered":"2023-06-23T19:02:43.405195+0000","last_clean":"2023-06-23T19:02:43.405195+0000","last_became_active":"2023-06-23T19:02:43.401856+0000","last_became_peered":"2023-06-23T19:02:43.401856+0000","last_unstale":"2023-06-23T19:02:43.405195+0000","last_undegraded":"2023-06-23T19:02:43.405195+0000","last_fullsized":"2023-06-23T19:02:43.405195+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:11:17.204985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723948+0000","last_change":"2023-06-23T19:02:43.404668+0000","last_active":"2023-06-23T19:02:44.723948+0000","last_peered":"2023-06-23T19:02:44.723948+0000","last_clean":"2023-06-23T19:02:44.723948+0000","last_became_active":"2023-06-23T19:02:43.404069+0000","last_became_peered":"2023-06-23T19:02:43.404069+0000","last_unstale":"2023-06-23T19:02:44.723948+0000","last_undegraded":"2023-06-23T19:02:44.723948+0000","last_fullsized":"2023-06-23T19:02:44.723948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:03.176159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724003+0000","last_change":"2023-06-23T19:02:43.395358+0000","last_active":"2023-06-23T19:02:44.724003+0000","last_peered":"2023-06-23T19:02:44.724003+0000","last_clean":"2023-06-23T19:02:44.724003+0000","last_became_active":"2023-06-23T19:02:43.394956+0000","last_became_peered":"2023-06-23T19:02:43.394956+0000","last_unstale":"2023-06-23T19:02:44.724003+0000","last_undegraded":"2023-06-23T19:02:44.724003+0000","last_fullsized":"2023-06-23T19:02:44.724003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:20.784110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725079+0000","last_change":"2023-06-23T19:02:43.395135+0000","last_active":"2023-06-23T19:02:44.725079+0000","last_peered":"2023-06-23T19:02:44.725079+0000","last_clean":"2023-06-23T19:02:44.725079+0000","last_became_active":"2023-06-23T19:02:43.394454+0000","last_became_peered":"2023-06-23T19:02:43.394454+0000","last_unstale":"2023-06-23T19:02:44.725079+0000","last_undegraded":"2023-06-23T19:02:44.725079+0000","last_fullsized":"2023-06-23T19:02:44.725079+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:46:33.411319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723701+0000","last_change":"2023-06-23T19:02:43.396868+0000","last_active":"2023-06-23T19:02:44.723701+0000","last_peered":"2023-06-23T19:02:44.723701+0000","last_clean":"2023-06-23T19:02:44.723701+0000","last_became_active":"2023-06-23T19:02:43.396100+0000","last_became_peered":"2023-06-23T19:02:43.396100+0000","last_unstale":"2023-06-23T19:02:44.723701+0000","last_undegraded":"2023-06-23T19:02:44.723701+0000","last_fullsized":"2023-06-23T19:02:44.723701+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:57:57.250181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375109+0000","last_change":"2023-06-23T19:02:43.402048+0000","last_active":"2023-06-23T19:02:44.375109+0000","last_peered":"2023-06-23T19:02:44.375109+0000","last_clean":"2023-06-23T19:02:44.375109+0000","last_became_active":"2023-06-23T19:02:43.401744+0000","last_became_peered":"2023-06-23T19:02:43.401744+0000","last_unstale":"2023-06-23T19:02:44.375109+0000","last_undegraded":"2023-06-23T19:02:44.375109+0000","last_fullsized":"2023-06-23T19:02:44.375109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:41:35.581792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.402382+0000","last_change":"2023-06-23T19:02:43.395428+0000","last_active":"2023-06-23T19:02:43.402382+0000","last_peered":"2023-06-23T19:02:43.402382+0000","last_clean":"2023-06-23T19:02:43.402382+0000","last_became_active":"2023-06-23T19:02:43.394828+0000","last_became_peered":"2023-06-23T19:02:43.394828+0000","last_unstale":"2023-06-23T19:02:43.402382+0000","last_undegraded":"2023-06-23T19:02:43.402382+0000","last_fullsized":"2023-06-23T19:02:43.402382+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:57:38.773378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724266+0000","last_change":"2023-06-23T19:02:43.390376+0000","last_active":"2023-06-23T19:02:44.724266+0000","last_peered":"2023-06-23T19:02:44.724266+0000","last_clean":"2023-06-23T19:02:44.724266+0000","last_became_active":"2023-06-23T19:02:43.390091+0000","last_became_peered":"2023-06-23T19:02:43.390091+0000","last_unstale":"2023-06-23T19:02:44.724266+0000","last_undegraded":"2023-06-23T19:02:44.724266+0000","last_fullsized":"2023-06-23T19:02:44.724266+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:38:21.075927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374934+0000","last_change":"2023-06-23T19:02:43.396896+0000","last_active":"2023-06-23T19:02:44.374934+0000","last_peered":"2023-06-23T19:02:44.374934+0000","last_clean":"2023-06-23T19:02:44.374934+0000","last_became_active":"2023-06-23T19:02:43.396377+0000","last_became_peered":"2023-06-23T19:02:43.396377+0000","last_unstale":"2023-06-23T19:02:44.374934+0000","last_undegraded":"2023-06-23T19:02:44.374934+0000","last_fullsized":"2023-06-23T19:02:44.374934+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:48.106744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.397950+0000","last_change":"2023-06-23T19:02:43.392988+0000","last_active":"2023-06-23T19:02:44.397950+0000","last_peered":"2023-06-23T19:02:44.397950+0000","last_clean":"2023-06-23T19:02:44.397950+0000","last_became_active":"2023-06-23T19:02:43.392720+0000","last_became_peered":"2023-06-23T19:02:43.392720+0000","last_unstale":"2023-06-23T19:02:44.397950+0000","last_undegraded":"2023-06-23T19:02:44.397950+0000","last_fullsized":"2023-06-23T19:02:44.397950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:48:01.984501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723384+0000","last_change":"2023-06-23T19:02:43.382777+0000","last_active":"2023-06-23T19:02:44.723384+0000","last_peered":"2023-06-23T19:02:44.723384+0000","last_clean":"2023-06-23T19:02:44.723384+0000","last_became_active":"2023-06-23T19:02:43.382533+0000","last_became_peered":"2023-06-23T19:02:43.382533+0000","last_unstale":"2023-06-23T19:02:44.723384+0000","last_undegraded":"2023-06-23T19:02:44.723384+0000","last_fullsized":"2023-06-23T19:02:44.723384+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:44:08.992692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723614+0000","last_change":"2023-06-23T19:02:43.393102+0000","last_active":"2023-06-23T19:02:44.723614+0000","last_peered":"2023-06-23T19:02:44.723614+0000","last_clean":"2023-06-23T19:02:44.723614+0000","last_became_active":"2023-06-23T19:02:43.392800+0000","last_became_peered":"2023-06-23T19:02:43.392800+0000","last_unstale":"2023-06-23T19:02:44.723614+0000","last_undegraded":"2023-06-23T19:02:44.723614+0000","last_fullsized":"2023-06-23T19:02:44.723614+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:41:41.621291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398329+0000","last_change":"2023-06-23T19:02:42.887806+0000","last_active":"2023-06-23T19:02:44.398329+0000","last_peered":"2023-06-23T19:02:44.398329+0000","last_clean":"2023-06-23T19:02:44.398329+0000","last_became_active":"2023-06-23T19:02:42.887517+0000","last_became_peered":"2023-06-23T19:02:42.887517+0000","last_unstale":"2023-06-23T19:02:44.398329+0000","last_undegraded":"2023-06-23T19:02:44.398329+0000","last_fullsized":"2023-06-23T19:02:44.398329+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:03.902410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724889+0000","last_change":"2023-06-23T19:02:43.395362+0000","last_active":"2023-06-23T19:02:44.724889+0000","last_peered":"2023-06-23T19:02:44.724889+0000","last_clean":"2023-06-23T19:02:44.724889+0000","last_became_active":"2023-06-23T19:02:43.394818+0000","last_became_peered":"2023-06-23T19:02:43.394818+0000","last_unstale":"2023-06-23T19:02:44.724889+0000","last_undegraded":"2023-06-23T19:02:44.724889+0000","last_fullsized":"2023-06-23T19:02:44.724889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:04:50.409635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375725+0000","last_change":"2023-06-23T19:02:42.891979+0000","last_active":"2023-06-23T19:02:44.375725+0000","last_peered":"2023-06-23T19:02:44.375725+0000","last_clean":"2023-06-23T19:02:44.375725+0000","last_became_active":"2023-06-23T19:02:42.890688+0000","last_became_peered":"2023-06-23T19:02:42.890688+0000","last_unstale":"2023-06-23T19:02:44.375725+0000","last_undegraded":"2023-06-23T19:02:44.375725+0000","last_fullsized":"2023-06-23T19:02:44.375725+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:58:03.854610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.395814+0000","last_change":"2023-06-23T19:02:43.393361+0000","last_active":"2023-06-23T19:02:43.395814+0000","last_peered":"2023-06-23T19:02:43.395814+0000","last_clean":"2023-06-23T19:02:43.395814+0000","last_became_active":"2023-06-23T19:02:43.393080+0000","last_became_peered":"2023-06-23T19:02:43.393080+0000","last_unstale":"2023-06-23T19:02:43.395814+0000","last_undegraded":"2023-06-23T19:02:43.395814+0000","last_fullsized":"2023-06-23T19:02:43.395814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:09:46.104708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724188+0000","last_change":"2023-06-23T19:02:42.893081+0000","last_active":"2023-06-23T19:02:44.724188+0000","last_peered":"2023-06-23T19:02:44.724188+0000","last_clean":"2023-06-23T19:02:44.724188+0000","last_became_active":"2023-06-23T19:02:42.892723+0000","last_became_peered":"2023-06-23T19:02:42.892723+0000","last_unstale":"2023-06-23T19:02:44.724188+0000","last_undegraded":"2023-06-23T19:02:44.724188+0000","last_fullsized":"2023-06-23T19:02:44.724188+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:25:12.283569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724050+0000","last_change":"2023-06-23T19:02:43.397406+0000","last_active":"2023-06-23T19:02:44.724050+0000","last_peered":"2023-06-23T19:02:44.724050+0000","last_clean":"2023-06-23T19:02:44.724050+0000","last_became_active":"2023-06-23T19:02:43.397058+0000","last_became_peered":"2023-06-23T19:02:43.397058+0000","last_unstale":"2023-06-23T19:02:44.724050+0000","last_undegraded":"2023-06-23T19:02:44.724050+0000","last_fullsized":"2023-06-23T19:02:44.724050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:45.893777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375573+0000","last_change":"2023-06-23T19:02:42.887480+0000","last_active":"2023-06-23T19:02:44.375573+0000","last_peered":"2023-06-23T19:02:44.375573+0000","last_clean":"2023-06-23T19:02:44.375573+0000","last_became_active":"2023-06-23T19:02:42.887193+0000","last_became_peered":"2023-06-23T19:02:42.887193+0000","last_unstale":"2023-06-23T19:02:44.375573+0000","last_undegraded":"2023-06-23T19:02:44.375573+0000","last_fullsized":"2023-06-23T19:02:44.375573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:32.354763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375657+0000","last_change":"2023-06-23T19:02:43.397464+0000","last_active":"2023-06-23T19:02:44.375657+0000","last_peered":"2023-06-23T19:02:44.375657+0000","last_clean":"2023-06-23T19:02:44.375657+0000","last_became_active":"2023-06-23T19:02:43.397199+0000","last_became_peered":"2023-06-23T19:02:43.397199+0000","last_unstale":"2023-06-23T19:02:44.375657+0000","last_undegraded":"2023-06-23T19:02:44.375657+0000","last_fullsized":"2023-06-23T19:02:44.375657+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:58:11.276317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398596+0000","last_change":"2023-06-23T19:02:42.887196+0000","last_active":"2023-06-23T19:02:44.398596+0000","last_peered":"2023-06-23T19:02:44.398596+0000","last_clean":"2023-06-23T19:02:44.398596+0000","last_became_active":"2023-06-23T19:02:42.886915+0000","last_became_peered":"2023-06-23T19:02:42.886915+0000","last_unstale":"2023-06-23T19:02:44.398596+0000","last_undegraded":"2023-06-23T19:02:44.398596+0000","last_fullsized":"2023-06-23T19:02:44.398596+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:18:36.094355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.381832+0000","last_change":"2023-06-23T19:02:43.379396+0000","last_active":"2023-06-23T19:02:43.381832+0000","last_peered":"2023-06-23T19:02:43.381832+0000","last_clean":"2023-06-23T19:02:43.381832+0000","last_became_active":"2023-06-23T19:02:43.379137+0000","last_became_peered":"2023-06-23T19:02:43.379137+0000","last_unstale":"2023-06-23T19:02:43.381832+0000","last_undegraded":"2023-06-23T19:02:43.381832+0000","last_fullsized":"2023-06-23T19:02:43.381832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:45:18.683469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375096+0000","last_change":"2023-06-23T19:02:42.890175+0000","last_active":"2023-06-23T19:02:44.375096+0000","last_peered":"2023-06-23T19:02:44.375096+0000","last_clean":"2023-06-23T19:02:44.375096+0000","last_became_active":"2023-06-23T19:02:42.889717+0000","last_became_peered":"2023-06-23T19:02:42.889717+0000","last_unstale":"2023-06-23T19:02:44.375096+0000","last_undegraded":"2023-06-23T19:02:44.375096+0000","last_fullsized":"2023-06-23T19:02:44.375096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:57:06.989900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.405241+0000","last_change":"2023-06-23T19:02:43.403277+0000","last_active":"2023-06-23T19:02:43.405241+0000","last_peered":"2023-06-23T19:02:43.405241+0000","last_clean":"2023-06-23T19:02:43.405241+0000","last_became_active":"2023-06-23T19:02:43.402771+0000","last_became_peered":"2023-06-23T19:02:43.402771+0000","last_unstale":"2023-06-23T19:02:43.405241+0000","last_undegraded":"2023-06-23T19:02:43.405241+0000","last_fullsized":"2023-06-23T19:02:43.405241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:03:01.052439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.379649+0000","last_change":"2023-06-23T19:02:42.887165+0000","last_active":"2023-06-23T19:02:43.379649+0000","last_peered":"2023-06-23T19:02:43.379649+0000","last_clean":"2023-06-23T19:02:43.379649+0000","last_became_active":"2023-06-23T19:02:42.886870+0000","last_became_peered":"2023-06-23T19:02:42.886870+0000","last_unstale":"2023-06-23T19:02:43.379649+0000","last_undegraded":"2023-06-23T19:02:43.379649+0000","last_fullsized":"2023-06-23T19:02:43.379649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:04:52.545693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724033+0000","last_change":"2023-06-23T19:02:43.404348+0000","last_active":"2023-06-23T19:02:44.724033+0000","last_peered":"2023-06-23T19:02:44.724033+0000","last_clean":"2023-06-23T19:02:44.724033+0000","last_became_active":"2023-06-23T19:02:43.403667+0000","last_became_peered":"2023-06-23T19:02:43.403667+0000","last_unstale":"2023-06-23T19:02:44.724033+0000","last_undegraded":"2023-06-23T19:02:44.724033+0000","last_fullsized":"2023-06-23T19:02:44.724033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:45.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.373226+0000","last_change":"2023-06-23T19:02:42.890898+0000","last_active":"2023-06-23T19:02:43.373226+0000","last_peered":"2023-06-23T19:02:43.373226+0000","last_clean":"2023-06-23T19:02:43.373226+0000","last_became_active":"2023-06-23T19:02:42.890663+0000","last_became_peered":"2023-06-23T19:02:42.890663+0000","last_unstale":"2023-06-23T19:02:43.373226+0000","last_undegraded":"2023-06-23T19:02:43.373226+0000","last_fullsized":"2023-06-23T19:02:43.373226+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:34:16.195266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375650+0000","last_change":"2023-06-23T19:02:43.403661+0000","last_active":"2023-06-23T19:02:44.375650+0000","last_peered":"2023-06-23T19:02:44.375650+0000","last_clean":"2023-06-23T19:02:44.375650+0000","last_became_active":"2023-06-23T19:02:43.401012+0000","last_became_peered":"2023-06-23T19:02:43.401012+0000","last_unstale":"2023-06-23T19:02:44.375650+0000","last_undegraded":"2023-06-23T19:02:44.375650+0000","last_fullsized":"2023-06-23T19:02:44.375650+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:13.671541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375174+0000","last_change":"2023-06-23T19:02:42.888633+0000","last_active":"2023-06-23T19:02:44.375174+0000","last_peered":"2023-06-23T19:02:44.375174+0000","last_clean":"2023-06-23T19:02:44.375174+0000","last_became_active":"2023-06-23T19:02:42.888018+0000","last_became_peered":"2023-06-23T19:02:42.888018+0000","last_unstale":"2023-06-23T19:02:44.375174+0000","last_undegraded":"2023-06-23T19:02:44.375174+0000","last_fullsized":"2023-06-23T19:02:44.375174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:01:10.153048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375912+0000","last_change":"2023-06-23T19:02:43.399949+0000","last_active":"2023-06-23T19:02:44.375912+0000","last_peered":"2023-06-23T19:02:44.375912+0000","last_clean":"2023-06-23T19:02:44.375912+0000","last_became_active":"2023-06-23T19:02:43.399639+0000","last_became_peered":"2023-06-23T19:02:43.399639+0000","last_unstale":"2023-06-23T19:02:44.375912+0000","last_undegraded":"2023-06-23T19:02:44.375912+0000","last_fullsized":"2023-06-23T19:02:44.375912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:32:45.456360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.373732+0000","last_change":"2023-06-23T19:02:42.890196+0000","last_active":"2023-06-23T19:02:43.373732+0000","last_peered":"2023-06-23T19:02:43.373732+0000","last_clean":"2023-06-23T19:02:43.373732+0000","last_became_active":"2023-06-23T19:02:42.889975+0000","last_became_peered":"2023-06-23T19:02:42.889975+0000","last_unstale":"2023-06-23T19:02:43.373732+0000","last_undegraded":"2023-06-23T19:02:43.373732+0000","last_fullsized":"2023-06-23T19:02:43.373732+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:51:45.663216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398474+0000","last_change":"2023-06-23T19:02:43.396802+0000","last_active":"2023-06-23T19:02:44.398474+0000","last_peered":"2023-06-23T19:02:44.398474+0000","last_clean":"2023-06-23T19:02:44.398474+0000","last_became_active":"2023-06-23T19:02:43.395088+0000","last_became_peered":"2023-06-23T19:02:43.395088+0000","last_unstale":"2023-06-23T19:02:44.398474+0000","last_undegraded":"2023-06-23T19:02:44.398474+0000","last_fullsized":"2023-06-23T19:02:44.398474+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:18.762011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375955+0000","last_change":"2023-06-23T19:02:42.891197+0000","last_active":"2023-06-23T19:02:44.375955+0000","last_peered":"2023-06-23T19:02:44.375955+0000","last_clean":"2023-06-23T19:02:44.375955+0000","last_became_active":"2023-06-23T19:02:42.890890+0000","last_became_peered":"2023-06-23T19:02:42.890890+0000","last_unstale":"2023-06-23T19:02:44.375955+0000","last_undegraded":"2023-06-23T19:02:44.375955+0000","last_fullsized":"2023-06-23T19:02:44.375955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:51.016173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375721+0000","last_change":"2023-06-23T19:02:43.398100+0000","last_active":"2023-06-23T19:02:44.375721+0000","last_peered":"2023-06-23T19:02:44.375721+0000","last_clean":"2023-06-23T19:02:44.375721+0000","last_became_active":"2023-06-23T19:02:43.397629+0000","last_became_peered":"2023-06-23T19:02:43.397629+0000","last_unstale":"2023-06-23T19:02:44.375721+0000","last_undegraded":"2023-06-23T19:02:44.375721+0000","last_fullsized":"2023-06-23T19:02:44.375721+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:45:28.343028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723779+0000","last_change":"2023-06-23T19:02:42.886487+0000","last_active":"2023-06-23T19:02:44.723779+0000","last_peered":"2023-06-23T19:02:44.723779+0000","last_clean":"2023-06-23T19:02:44.723779+0000","last_became_active":"2023-06-23T19:02:42.886215+0000","last_became_peered":"2023-06-23T19:02:42.886215+0000","last_unstale":"2023-06-23T19:02:44.723779+0000","last_undegraded":"2023-06-23T19:02:44.723779+0000","last_fullsized":"2023-06-23T19:02:44.723779+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:13:36.100121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724215+0000","last_change":"2023-06-23T19:02:43.398669+0000","last_active":"2023-06-23T19:02:44.724215+0000","last_peered":"2023-06-23T19:02:44.724215+0000","last_clean":"2023-06-23T19:02:44.724215+0000","last_became_active":"2023-06-23T19:02:43.396528+0000","last_became_peered":"2023-06-23T19:02:43.396528+0000","last_unstale":"2023-06-23T19:02:44.724215+0000","last_undegraded":"2023-06-23T19:02:44.724215+0000","last_fullsized":"2023-06-23T19:02:44.724215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:07:50.110076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398492+0000","last_change":"2023-06-23T19:02:42.891024+0000","last_active":"2023-06-23T19:02:44.398492+0000","last_peered":"2023-06-23T19:02:44.398492+0000","last_clean":"2023-06-23T19:02:44.398492+0000","last_became_active":"2023-06-23T19:02:42.890651+0000","last_became_peered":"2023-06-23T19:02:42.890651+0000","last_unstale":"2023-06-23T19:02:44.398492+0000","last_undegraded":"2023-06-23T19:02:44.398492+0000","last_fullsized":"2023-06-23T19:02:44.398492+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:21:24.007492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404133+0000","last_change":"2023-06-23T19:02:43.389803+0000","last_active":"2023-06-23T19:02:43.404133+0000","last_peered":"2023-06-23T19:02:43.404133+0000","last_clean":"2023-06-23T19:02:43.404133+0000","last_became_active":"2023-06-23T19:02:43.389537+0000","last_became_peered":"2023-06-23T19:02:43.389537+0000","last_unstale":"2023-06-23T19:02:43.404133+0000","last_undegraded":"2023-06-23T19:02:43.404133+0000","last_fullsized":"2023-06-23T19:02:43.404133+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:39.499477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375539+0000","last_change":"2023-06-23T19:02:42.886300+0000","last_active":"2023-06-23T19:02:44.375539+0000","last_peered":"2023-06-23T19:02:44.375539+0000","last_clean":"2023-06-23T19:02:44.375539+0000","last_became_active":"2023-06-23T19:02:42.886024+0000","last_became_peered":"2023-06-23T19:02:42.886024+0000","last_unstale":"2023-06-23T19:02:44.375539+0000","last_undegraded":"2023-06-23T19:02:44.375539+0000","last_fullsized":"2023-06-23T19:02:44.375539+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:28.192185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.397888+0000","last_change":"2023-06-23T19:02:43.395514+0000","last_active":"2023-06-23T19:02:44.397888+0000","last_peered":"2023-06-23T19:02:44.397888+0000","last_clean":"2023-06-23T19:02:44.397888+0000","last_became_active":"2023-06-23T19:02:43.395194+0000","last_became_peered":"2023-06-23T19:02:43.395194+0000","last_unstale":"2023-06-23T19:02:44.397888+0000","last_undegraded":"2023-06-23T19:02:44.397888+0000","last_fullsized":"2023-06-23T19:02:44.397888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:36.637146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398038+0000","last_change":"2023-06-23T19:02:42.891524+0000","last_active":"2023-06-23T19:02:44.398038+0000","last_peered":"2023-06-23T19:02:44.398038+0000","last_clean":"2023-06-23T19:02:44.398038+0000","last_became_active":"2023-06-23T19:02:42.891246+0000","last_became_peered":"2023-06-23T19:02:42.891246+0000","last_unstale":"2023-06-23T19:02:44.398038+0000","last_undegraded":"2023-06-23T19:02:44.398038+0000","last_fullsized":"2023-06-23T19:02:44.398038+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:04.274893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375615+0000","last_change":"2023-06-23T19:02:43.398533+0000","last_active":"2023-06-23T19:02:44.375615+0000","last_peered":"2023-06-23T19:02:44.375615+0000","last_clean":"2023-06-23T19:02:44.375615+0000","last_became_active":"2023-06-23T19:02:43.398104+0000","last_became_peered":"2023-06-23T19:02:43.398104+0000","last_unstale":"2023-06-23T19:02:44.375615+0000","last_undegraded":"2023-06-23T19:02:44.375615+0000","last_fullsized":"2023-06-23T19:02:44.375615+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:46:24.850112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.400568+0000","last_change":"2023-06-23T19:02:42.893070+0000","last_active":"2023-06-23T19:02:43.400568+0000","last_peered":"2023-06-23T19:02:43.400568+0000","last_clean":"2023-06-23T19:02:43.400568+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:43.400568+0000","last_undegraded":"2023-06-23T19:02:43.400568+0000","last_fullsized":"2023-06-23T19:02:43.400568+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:31:59.559596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723822+0000","last_change":"2023-06-23T19:02:43.389359+0000","last_active":"2023-06-23T19:02:44.723822+0000","last_peered":"2023-06-23T19:02:44.723822+0000","last_clean":"2023-06-23T19:02:44.723822+0000","last_became_active":"2023-06-23T19:02:43.389110+0000","last_became_peered":"2023-06-23T19:02:43.389110+0000","last_unstale":"2023-06-23T19:02:44.723822+0000","last_undegraded":"2023-06-23T19:02:44.723822+0000","last_fullsized":"2023-06-23T19:02:44.723822+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:03.176159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723990+0000","last_change":"2023-06-23T19:02:42.889068+0000","last_active":"2023-06-23T19:02:44.723990+0000","last_peered":"2023-06-23T19:02:44.723990+0000","last_clean":"2023-06-23T19:02:44.723990+0000","last_became_active":"2023-06-23T19:02:42.888798+0000","last_became_peered":"2023-06-23T19:02:42.888798+0000","last_unstale":"2023-06-23T19:02:44.723990+0000","last_undegraded":"2023-06-23T19:02:44.723990+0000","last_fullsized":"2023-06-23T19:02:44.723990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:19.779575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394423+0000","last_change":"2023-06-23T19:02:43.388207+0000","last_active":"2023-06-23T19:02:43.394423+0000","last_peered":"2023-06-23T19:02:43.394423+0000","last_clean":"2023-06-23T19:02:43.394423+0000","last_became_active":"2023-06-23T19:02:43.386722+0000","last_became_peered":"2023-06-23T19:02:43.386722+0000","last_unstale":"2023-06-23T19:02:43.394423+0000","last_undegraded":"2023-06-23T19:02:43.394423+0000","last_fullsized":"2023-06-23T19:02:43.394423+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:52:09.018540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375561+0000","last_change":"2023-06-23T19:02:42.890680+0000","last_active":"2023-06-23T19:02:44.375561+0000","last_peered":"2023-06-23T19:02:44.375561+0000","last_clean":"2023-06-23T19:02:44.375561+0000","last_became_active":"2023-06-23T19:02:42.890295+0000","last_became_peered":"2023-06-23T19:02:42.890295+0000","last_unstale":"2023-06-23T19:02:44.375561+0000","last_undegraded":"2023-06-23T19:02:44.375561+0000","last_fullsized":"2023-06-23T19:02:44.375561+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:31:13.359536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724213+0000","last_change":"2023-06-23T19:02:43.402338+0000","last_active":"2023-06-23T19:02:44.724213+0000","last_peered":"2023-06-23T19:02:44.724213+0000","last_clean":"2023-06-23T19:02:44.724213+0000","last_became_active":"2023-06-23T19:02:43.402031+0000","last_became_peered":"2023-06-23T19:02:43.402031+0000","last_unstale":"2023-06-23T19:02:44.724213+0000","last_undegraded":"2023-06-23T19:02:44.724213+0000","last_fullsized":"2023-06-23T19:02:44.724213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:38.519908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.401703+0000","last_change":"2023-06-23T19:02:42.887220+0000","last_active":"2023-06-23T19:02:43.401703+0000","last_peered":"2023-06-23T19:02:43.401703+0000","last_clean":"2023-06-23T19:02:43.401703+0000","last_became_active":"2023-06-23T19:02:42.886868+0000","last_became_peered":"2023-06-23T19:02:42.886868+0000","last_unstale":"2023-06-23T19:02:43.401703+0000","last_undegraded":"2023-06-23T19:02:43.401703+0000","last_fullsized":"2023-06-23T19:02:43.401703+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:55.099541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725181+0000","last_change":"2023-06-23T19:02:43.394474+0000","last_active":"2023-06-23T19:02:44.725181+0000","last_peered":"2023-06-23T19:02:44.725181+0000","last_clean":"2023-06-23T19:02:44.725181+0000","last_became_active":"2023-06-23T19:02:43.394113+0000","last_became_peered":"2023-06-23T19:02:43.394113+0000","last_unstale":"2023-06-23T19:02:44.725181+0000","last_undegraded":"2023-06-23T19:02:44.725181+0000","last_fullsized":"2023-06-23T19:02:44.725181+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:04.527287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398469+0000","last_change":"2023-06-23T19:02:42.884554+0000","last_active":"2023-06-23T19:02:44.398469+0000","last_peered":"2023-06-23T19:02:44.398469+0000","last_clean":"2023-06-23T19:02:44.398469+0000","last_became_active":"2023-06-23T19:02:42.884275+0000","last_became_peered":"2023-06-23T19:02:42.884275+0000","last_unstale":"2023-06-23T19:02:44.398469+0000","last_undegraded":"2023-06-23T19:02:44.398469+0000","last_fullsized":"2023-06-23T19:02:44.398469+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:30.000738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398035+0000","last_change":"2023-06-23T19:02:43.396646+0000","last_active":"2023-06-23T19:02:44.398035+0000","last_peered":"2023-06-23T19:02:44.398035+0000","last_clean":"2023-06-23T19:02:44.398035+0000","last_became_active":"2023-06-23T19:02:43.396352+0000","last_became_peered":"2023-06-23T19:02:43.396352+0000","last_unstale":"2023-06-23T19:02:44.398035+0000","last_undegraded":"2023-06-23T19:02:44.398035+0000","last_fullsized":"2023-06-23T19:02:44.398035+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:45.158495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398620+0000","last_change":"2023-06-23T19:02:42.884561+0000","last_active":"2023-06-23T19:02:44.398620+0000","last_peered":"2023-06-23T19:02:44.398620+0000","last_clean":"2023-06-23T19:02:44.398620+0000","last_became_active":"2023-06-23T19:02:42.884240+0000","last_became_peered":"2023-06-23T19:02:42.884240+0000","last_unstale":"2023-06-23T19:02:44.398620+0000","last_undegraded":"2023-06-23T19:02:44.398620+0000","last_fullsized":"2023-06-23T19:02:44.398620+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:37:21.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723586+0000","last_change":"2023-06-23T19:02:43.395618+0000","last_active":"2023-06-23T19:02:44.723586+0000","last_peered":"2023-06-23T19:02:44.723586+0000","last_clean":"2023-06-23T19:02:44.723586+0000","last_became_active":"2023-06-23T19:02:43.395286+0000","last_became_peered":"2023-06-23T19:02:43.395286+0000","last_unstale":"2023-06-23T19:02:44.723586+0000","last_undegraded":"2023-06-23T19:02:44.723586+0000","last_fullsized":"2023-06-23T19:02:44.723586+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:51:46.667751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.379862+0000","last_change":"2023-06-23T19:02:42.884674+0000","last_active":"2023-06-23T19:02:43.379862+0000","last_peered":"2023-06-23T19:02:43.379862+0000","last_clean":"2023-06-23T19:02:43.379862+0000","last_became_active":"2023-06-23T19:02:42.883763+0000","last_became_peered":"2023-06-23T19:02:42.883763+0000","last_unstale":"2023-06-23T19:02:43.379862+0000","last_undegraded":"2023-06-23T19:02:43.379862+0000","last_fullsized":"2023-06-23T19:02:43.379862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:02:36.921665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723672+0000","last_change":"2023-06-23T19:02:43.386350+0000","last_active":"2023-06-23T19:02:44.723672+0000","last_peered":"2023-06-23T19:02:44.723672+0000","last_clean":"2023-06-23T19:02:44.723672+0000","last_became_active":"2023-06-23T19:02:43.386069+0000","last_became_peered":"2023-06-23T19:02:43.386069+0000","last_unstale":"2023-06-23T19:02:44.723672+0000","last_undegraded":"2023-06-23T19:02:44.723672+0000","last_fullsized":"2023-06-23T19:02:44.723672+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:49:35.154198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.371223+0000","last_change":"2023-06-23T19:02:42.889204+0000","last_active":"2023-06-23T19:02:43.371223+0000","last_peered":"2023-06-23T19:02:43.371223+0000","last_clean":"2023-06-23T19:02:43.371223+0000","last_became_active":"2023-06-23T19:02:42.888819+0000","last_became_peered":"2023-06-23T19:02:42.888819+0000","last_unstale":"2023-06-23T19:02:43.371223+0000","last_undegraded":"2023-06-23T19:02:43.371223+0000","last_fullsized":"2023-06-23T19:02:43.371223+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:30:36.052035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.394362+0000","last_change":"2023-06-23T19:02:43.383467+0000","last_active":"2023-06-23T19:02:43.394362+0000","last_peered":"2023-06-23T19:02:43.394362+0000","last_clean":"2023-06-23T19:02:43.394362+0000","last_became_active":"2023-06-23T19:02:43.383168+0000","last_became_peered":"2023-06-23T19:02:43.383168+0000","last_unstale":"2023-06-23T19:02:43.394362+0000","last_undegraded":"2023-06-23T19:02:43.394362+0000","last_fullsized":"2023-06-23T19:02:43.394362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:05:15.959248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375376+0000","last_change":"2023-06-23T19:02:42.887650+0000","last_active":"2023-06-23T19:02:44.375376+0000","last_peered":"2023-06-23T19:02:44.375376+0000","last_clean":"2023-06-23T19:02:44.375376+0000","last_became_active":"2023-06-23T19:02:42.887327+0000","last_became_peered":"2023-06-23T19:02:42.887327+0000","last_unstale":"2023-06-23T19:02:44.375376+0000","last_undegraded":"2023-06-23T19:02:44.375376+0000","last_fullsized":"2023-06-23T19:02:44.375376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:28:10.991929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374769+0000","last_change":"2023-06-23T19:02:43.388968+0000","last_active":"2023-06-23T19:02:44.374769+0000","last_peered":"2023-06-23T19:02:44.374769+0000","last_clean":"2023-06-23T19:02:44.374769+0000","last_became_active":"2023-06-23T19:02:43.388694+0000","last_became_peered":"2023-06-23T19:02:43.388694+0000","last_unstale":"2023-06-23T19:02:44.374769+0000","last_undegraded":"2023-06-23T19:02:44.374769+0000","last_fullsized":"2023-06-23T19:02:44.374769+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:06:29.263480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.372976+0000","last_change":"2023-06-23T19:02:42.889687+0000","last_active":"2023-06-23T19:02:43.372976+0000","last_peered":"2023-06-23T19:02:43.372976+0000","last_clean":"2023-06-23T19:02:43.372976+0000","last_became_active":"2023-06-23T19:02:42.889440+0000","last_became_peered":"2023-06-23T19:02:42.889440+0000","last_unstale":"2023-06-23T19:02:43.372976+0000","last_undegraded":"2023-06-23T19:02:43.372976+0000","last_fullsized":"2023-06-23T19:02:43.372976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:07:59.809093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724155+0000","last_change":"2023-06-23T19:00:58.992193+0000","last_active":"2023-06-23T19:02:44.724155+0000","last_peered":"2023-06-23T19:02:44.724155+0000","last_clean":"2023-06-23T19:02:44.724155+0000","last_became_active":"2023-06-23T19:00:58.991974+0000","last_became_peered":"2023-06-23T19:00:58.991974+0000","last_unstale":"2023-06-23T19:02:44.724155+0000","last_undegraded":"2023-06-23T19:02:44.724155+0000","last_fullsized":"2023-06-23T19:02:44.724155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:00:00.508536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724922+0000","last_change":"2023-06-23T19:02:43.402921+0000","last_active":"2023-06-23T19:02:44.724922+0000","last_peered":"2023-06-23T19:02:44.724922+0000","last_clean":"2023-06-23T19:02:44.724922+0000","last_became_active":"2023-06-23T19:02:43.402032+0000","last_became_peered":"2023-06-23T19:02:43.402032+0000","last_unstale":"2023-06-23T19:02:44.724922+0000","last_undegraded":"2023-06-23T19:02:44.724922+0000","last_fullsized":"2023-06-23T19:02:44.724922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:00:17.700963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398373+0000","last_change":"2023-06-23T19:02:42.891573+0000","last_active":"2023-06-23T19:02:44.398373+0000","last_peered":"2023-06-23T19:02:44.398373+0000","last_clean":"2023-06-23T19:02:44.398373+0000","last_became_active":"2023-06-23T19:02:42.891289+0000","last_became_peered":"2023-06-23T19:02:42.891289+0000","last_unstale":"2023-06-23T19:02:44.398373+0000","last_undegraded":"2023-06-23T19:02:44.398373+0000","last_fullsized":"2023-06-23T19:02:44.398373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:55:37.747872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.380034+0000","last_change":"2023-06-23T19:00:58.032255+0000","last_active":"2023-06-23T19:02:43.380034+0000","last_peered":"2023-06-23T19:02:43.380034+0000","last_clean":"2023-06-23T19:02:43.380034+0000","last_became_active":"2023-06-23T19:00:58.031815+0000","last_became_peered":"2023-06-23T19:00:58.031815+0000","last_unstale":"2023-06-23T19:02:43.380034+0000","last_undegraded":"2023-06-23T19:02:43.380034+0000","last_fullsized":"2023-06-23T19:02:43.380034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:00:58.953928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404952+0000","last_change":"2023-06-23T19:02:43.396991+0000","last_active":"2023-06-23T19:02:43.404952+0000","last_peered":"2023-06-23T19:02:43.404952+0000","last_clean":"2023-06-23T19:02:43.404952+0000","last_became_active":"2023-06-23T19:02:43.396725+0000","last_became_peered":"2023-06-23T19:02:43.396725+0000","last_unstale":"2023-06-23T19:02:43.404952+0000","last_undegraded":"2023-06-23T19:02:43.404952+0000","last_fullsized":"2023-06-23T19:02:43.404952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:23.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375978+0000","last_change":"2023-06-23T19:02:42.893342+0000","last_active":"2023-06-23T19:02:44.375978+0000","last_peered":"2023-06-23T19:02:44.375978+0000","last_clean":"2023-06-23T19:02:44.375978+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:44.375978+0000","last_undegraded":"2023-06-23T19:02:44.375978+0000","last_fullsized":"2023-06-23T19:02:44.375978+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:39:59.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723375+0000","last_change":"2023-06-23T19:00:58.810848+0000","last_active":"2023-06-23T19:02:44.723375+0000","last_peered":"2023-06-23T19:02:44.723375+0000","last_clean":"2023-06-23T19:02:44.723375+0000","last_became_active":"2023-06-23T19:00:58.810530+0000","last_became_peered":"2023-06-23T19:00:58.810530+0000","last_unstale":"2023-06-23T19:02:44.723375+0000","last_undegraded":"2023-06-23T19:02:44.723375+0000","last_fullsized":"2023-06-23T19:02:44.723375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:43.495720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404159+0000","last_change":"2023-06-23T19:02:43.390188+0000","last_active":"2023-06-23T19:02:43.404159+0000","last_peered":"2023-06-23T19:02:43.404159+0000","last_clean":"2023-06-23T19:02:43.404159+0000","last_became_active":"2023-06-23T19:02:43.389894+0000","last_became_peered":"2023-06-23T19:02:43.389894+0000","last_unstale":"2023-06-23T19:02:43.404159+0000","last_undegraded":"2023-06-23T19:02:43.404159+0000","last_fullsized":"2023-06-23T19:02:43.404159+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:18:40.426963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.404937+0000","last_change":"2023-06-23T19:02:42.889466+0000","last_active":"2023-06-23T19:02:43.404937+0000","last_peered":"2023-06-23T19:02:43.404937+0000","last_clean":"2023-06-23T19:02:43.404937+0000","last_became_active":"2023-06-23T19:02:42.889189+0000","last_became_peered":"2023-06-23T19:02:42.889189+0000","last_unstale":"2023-06-23T19:02:43.404937+0000","last_undegraded":"2023-06-23T19:02:43.404937+0000","last_fullsized":"2023-06-23T19:02:43.404937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:54.621572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.377300+0000","last_change":"2023-06-23T19:00:58.032352+0000","last_active":"2023-06-23T19:02:43.377300+0000","last_peered":"2023-06-23T19:02:43.377300+0000","last_clean":"2023-06-23T19:02:43.377300+0000","last_became_active":"2023-06-23T19:00:58.031905+0000","last_became_peered":"2023-06-23T19:00:58.031905+0000","last_unstale":"2023-06-23T19:02:43.377300+0000","last_undegraded":"2023-06-23T19:02:43.377300+0000","last_fullsized":"2023-06-23T19:02:43.377300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:14:56.282366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375571+0000","last_change":"2023-06-23T19:00:50.002765+0000","last_active":"2023-06-23T19:02:44.375571+0000","last_peered":"2023-06-23T19:02:44.375571+0000","last_clean":"2023-06-23T19:02:44.375571+0000","last_became_active":"2023-06-23T19:00:50.002445+0000","last_became_peered":"2023-06-23T19:00:50.002445+0000","last_unstale":"2023-06-23T19:02:44.375571+0000","last_undegraded":"2023-06-23T19:02:44.375571+0000","last_fullsized":"2023-06-23T19:02:44.375571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_clean_scrub_stamp":"2023-06-23T19:00:48.989242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:30:52.195750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375858+0000","last_change":"2023-06-23T19:02:43.389986+0000","last_active":"2023-06-23T19:02:44.375858+0000","last_peered":"2023-06-23T19:02:44.375858+0000","last_clean":"2023-06-23T19:02:44.375858+0000","last_became_active":"2023-06-23T19:02:43.389721+0000","last_became_peered":"2023-06-23T19:02:43.389721+0000","last_unstale":"2023-06-23T19:02:44.375858+0000","last_undegraded":"2023-06-23T19:02:44.375858+0000","last_fullsized":"2023-06-23T19:02:44.375858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:02.650153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724115+0000","last_change":"2023-06-23T19:02:42.892907+0000","last_active":"2023-06-23T19:02:44.724115+0000","last_peered":"2023-06-23T19:02:44.724115+0000","last_clean":"2023-06-23T19:02:44.724115+0000","last_became_active":"2023-06-23T19:02:42.892670+0000","last_became_peered":"2023-06-23T19:02:42.892670+0000","last_unstale":"2023-06-23T19:02:44.724115+0000","last_undegraded":"2023-06-23T19:02:44.724115+0000","last_fullsized":"2023-06-23T19:02:44.724115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:29.148255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375721+0000","last_change":"2023-06-23T19:00:58.034045+0000","last_active":"2023-06-23T19:02:44.375721+0000","last_peered":"2023-06-23T19:02:44.375721+0000","last_clean":"2023-06-23T19:02:44.375721+0000","last_became_active":"2023-06-23T19:00:58.033654+0000","last_became_peered":"2023-06-23T19:00:58.033654+0000","last_unstale":"2023-06-23T19:02:44.375721+0000","last_undegraded":"2023-06-23T19:02:44.375721+0000","last_fullsized":"2023-06-23T19:02:44.375721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:27:46.377670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-23T19:02:43.400804+0000","last_change":"2023-06-23T19:02:43.394471+0000","last_active":"2023-06-23T19:02:43.400804+0000","last_peered":"2023-06-23T19:02:43.400804+0000","last_clean":"2023-06-23T19:02:43.400804+0000","last_became_active":"2023-06-23T19:02:43.394192+0000","last_became_peered":"2023-06-23T19:02:43.394192+0000","last_unstale":"2023-06-23T19:02:43.400804+0000","last_undegraded":"2023-06-23T19:02:43.400804+0000","last_fullsized":"2023-06-23T19:02:43.400804+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:30:39.670564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723888+0000","last_change":"2023-06-23T19:02:42.891170+0000","last_active":"2023-06-23T19:02:44.723888+0000","last_peered":"2023-06-23T19:02:44.723888+0000","last_clean":"2023-06-23T19:02:44.723888+0000","last_became_active":"2023-06-23T19:02:42.890891+0000","last_became_peered":"2023-06-23T19:02:42.890891+0000","last_unstale":"2023-06-23T19:02:44.723888+0000","last_undegraded":"2023-06-23T19:02:44.723888+0000","last_fullsized":"2023-06-23T19:02:44.723888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:52:00.154380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.376068+0000","last_change":"2023-06-23T19:00:58.992645+0000","last_active":"2023-06-23T19:02:44.376068+0000","last_peered":"2023-06-23T19:02:44.376068+0000","last_clean":"2023-06-23T19:02:44.376068+0000","last_became_active":"2023-06-23T19:00:58.992291+0000","last_became_peered":"2023-06-23T19:00:58.992291+0000","last_unstale":"2023-06-23T19:02:44.376068+0000","last_undegraded":"2023-06-23T19:02:44.376068+0000","last_fullsized":"2023-06-23T19:02:44.376068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:08:56.730997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398470+0000","last_change":"2023-06-23T19:02:43.395738+0000","last_active":"2023-06-23T19:02:44.398470+0000","last_peered":"2023-06-23T19:02:44.398470+0000","last_clean":"2023-06-23T19:02:44.398470+0000","last_became_active":"2023-06-23T19:02:43.395399+0000","last_became_peered":"2023-06-23T19:02:43.395399+0000","last_unstale":"2023-06-23T19:02:44.398470+0000","last_undegraded":"2023-06-23T19:02:44.398470+0000","last_fullsized":"2023-06-23T19:02:44.398470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:03:35.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375266+0000","last_change":"2023-06-23T19:02:42.889986+0000","last_active":"2023-06-23T19:02:44.375266+0000","last_peered":"2023-06-23T19:02:44.375266+0000","last_clean":"2023-06-23T19:02:44.375266+0000","last_became_active":"2023-06-23T19:02:42.889346+0000","last_became_peered":"2023-06-23T19:02:42.889346+0000","last_unstale":"2023-06-23T19:02:44.375266+0000","last_undegraded":"2023-06-23T19:02:44.375266+0000","last_fullsized":"2023-06-23T19:02:44.375266+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:51:30.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723746+0000","last_change":"2023-06-23T19:00:58.034828+0000","last_active":"2023-06-23T19:02:44.723746+0000","last_peered":"2023-06-23T19:02:44.723746+0000","last_clean":"2023-06-23T19:02:44.723746+0000","last_became_active":"2023-06-23T19:00:58.034502+0000","last_became_peered":"2023-06-23T19:00:58.034502+0000","last_unstale":"2023-06-23T19:02:44.723746+0000","last_undegraded":"2023-06-23T19:02:44.723746+0000","last_fullsized":"2023-06-23T19:02:44.723746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:31.089889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398191+0000","last_change":"2023-06-23T19:02:43.385089+0000","last_active":"2023-06-23T19:02:44.398191+0000","last_peered":"2023-06-23T19:02:44.398191+0000","last_clean":"2023-06-23T19:02:44.398191+0000","last_became_active":"2023-06-23T19:02:43.384796+0000","last_became_peered":"2023-06-23T19:02:43.384796+0000","last_unstale":"2023-06-23T19:02:44.398191+0000","last_undegraded":"2023-06-23T19:02:44.398191+0000","last_fullsized":"2023-06-23T19:02:44.398191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:57:06.209968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375307+0000","last_change":"2023-06-23T19:02:42.893057+0000","last_active":"2023-06-23T19:02:44.375307+0000","last_peered":"2023-06-23T19:02:44.375307+0000","last_clean":"2023-06-23T19:02:44.375307+0000","last_became_active":"2023-06-23T19:02:42.891406+0000","last_became_peered":"2023-06-23T19:02:42.891406+0000","last_unstale":"2023-06-23T19:02:44.375307+0000","last_undegraded":"2023-06-23T19:02:44.375307+0000","last_fullsized":"2023-06-23T19:02:44.375307+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:29.435118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725059+0000","last_change":"2023-06-23T19:00:58.035530+0000","last_active":"2023-06-23T19:02:44.725059+0000","last_peered":"2023-06-23T19:02:44.725059+0000","last_clean":"2023-06-23T19:02:44.725059+0000","last_became_active":"2023-06-23T19:00:58.035130+0000","last_became_peered":"2023-06-23T19:00:58.035130+0000","last_unstale":"2023-06-23T19:02:44.725059+0000","last_undegraded":"2023-06-23T19:02:44.725059+0000","last_fullsized":"2023-06-23T19:02:44.725059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:46:47.648237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":800713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.433},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.95099999999999996}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.008}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":210345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.499},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.88}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.92200000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":520192,"data_stored":226352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.435}]},{"osd":1,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":5.6539999999999999,"5min":5.6539999999999999,"15min":5.6539999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.90200000000000002}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91700000000000004}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.97099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":225438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.629},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Jun 23 19:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70099999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":224836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.376},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.754},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":9.6329999999999991,"5min":9.6329999999999991,"15min":9.6329999999999991},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.68700000000000006}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":516096,"data_stored":225404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.432}]},{"osd":2,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82499999999999996}]},{"osd":5,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.69999999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":516096,"data_stored":226330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.55100000000000005}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72799999999999998}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.745},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.97499999999999998}]}]},{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1101824,"data_stored":815224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.992,"5min":7.992,"15min":7.992},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.91900000000000004}]},{"osd":1,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":7.9500000000000002,"5min":7.9500000000000002,"15min":7.9500000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":10.835000000000001,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.749}]},{"osd":2,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":0.88200000000000001}]},{"osd":4,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.86199999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T19:02:52.685 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T19:02:52.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.884+0000 7fc65d7ff700 1 Processor -- start 2023-06-23T19:02:52.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.885+0000 7fc65d7ff700 1 -- start start 2023-06-23T19:02:52.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.886+0000 7fc65d7ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc65815a0c0 0x7fc6580cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:52.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.886+0000 7fc65d7ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc6580c8ce0 0x7fc6580ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:52.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.886+0000 7fc65d7ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6580caea0 con 0x7fc658069ef0 2023-06-23T19:02:52.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.886+0000 7fc65d7ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65815a490 con 0x7fc6580c8ce0 2023-06-23T19:02:52.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.886+0000 7fc65d7ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6580ca620 con 0x7fc65815a0c0 2023-06-23T19:02:52.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.886+0000 7fc64ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc6580c8ce0 0x7fc6580ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:52.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.886+0000 7fc64ffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc6580c8ce0 0x7fc6580ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55968/0 (socket says 172.21.15.136:55968) 2023-06-23T19:02:52.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.886+0000 7fc64ffff700 1 -- 172.21.15.136:0/3883665694 learned_addr learned my addr 172.21.15.136:0/3883665694 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:52.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.886+0000 7fc656ffd700 1 --2- 172.21.15.136:0/3883665694 >> v2:172.21.15.178:3300/0 conn(0x7fc65815a0c0 0x7fc6580cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:52.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.887+0000 7fc64ffff700 1 -- 172.21.15.136:0/3883665694 >> v2:172.21.15.178:3300/0 conn(0x7fc65815a0c0 msgr2=0x7fc6580cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:52.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.887+0000 7fc64ffff700 1 --2- 172.21.15.136:0/3883665694 >> v2:172.21.15.178:3300/0 conn(0x7fc65815a0c0 0x7fc6580cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:52.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.887+0000 7fc64ffff700 1 -- 172.21.15.136:0/3883665694 >> v1:172.21.15.178:6789/0 conn(0x7fc658069ef0 legacy=0x7fc65806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:52.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.887+0000 7fc64ffff700 1 -- 172.21.15.136:0/3883665694 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6580c9180 con 0x7fc6580c8ce0 2023-06-23T19:02:52.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.887+0000 7fc656ffd700 1 --2- 172.21.15.136:0/3883665694 >> v2:172.21.15.178:3300/0 conn(0x7fc65815a0c0 0x7fc6580cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:52.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.887+0000 7fc64ffff700 1 --2- 172.21.15.136:0/3883665694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6580c8ce0 0x7fc6580ccb70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc6580671b0 tx=0x7fc640009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958382e183ff9e97 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:52.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.887+0000 7fc6567fc700 1 -- 172.21.15.136:0/3883665694 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000b870 con 0x7fc6580c8ce0 2023-06-23T19:02:52.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.887+0000 7fc6567fc700 1 -- 172.21.15.136:0/3883665694 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64000b9d0 con 0x7fc6580c8ce0 2023-06-23T19:02:52.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.887+0000 7fc6567fc700 1 -- 172.21.15.136:0/3883665694 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000bd60 con 0x7fc6580c8ce0 2023-06-23T19:02:52.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.888+0000 7fc65d7ff700 1 -- 172.21.15.136:0/3883665694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6580c8ce0 msgr2=0x7fc6580ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:52.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.888+0000 7fc65d7ff700 1 --2- 172.21.15.136:0/3883665694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6580c8ce0 0x7fc6580ccb70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc6580671b0 tx=0x7fc640009bd0 comp rx=0 tx=0).stop 2023-06-23T19:02:52.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.888+0000 7fc65d7ff700 1 -- 172.21.15.136:0/3883665694 shutdown_connections 2023-06-23T19:02:52.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.888+0000 7fc65d7ff700 1 --2- 172.21.15.136:0/3883665694 >> v2:172.21.15.178:3300/0 conn(0x7fc65815a0c0 0x7fc6580cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:52.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.888+0000 7fc65d7ff700 1 --2- 172.21.15.136:0/3883665694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6580c8ce0 0x7fc6580ccb70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:52.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.888+0000 7fc65d7ff700 1 -- 172.21.15.136:0/3883665694 >> 172.21.15.136:0/3883665694 conn(0x7fc6580b0ef0 msgr2=0x7fc6580ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:52.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.888+0000 7fc65d7ff700 1 -- 172.21.15.136:0/3883665694 shutdown_connections 2023-06-23T19:02:52.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.888+0000 7fc65d7ff700 1 -- 172.21.15.136:0/3883665694 wait complete. 2023-06-23T19:02:52.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.890+0000 7fc65d7ff700 1 Processor -- start 2023-06-23T19:02:52.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.890+0000 7fc65d7ff700 1 -- start start 2023-06-23T19:02:52.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc65d7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc658069ef0 0x7fc658151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:52.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc65d7ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6580c8ce0 0x7fc6580c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:52.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc65d7ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc65815a0c0 0x7fc6580c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:52.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc65d7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580b1f70 con 0x7fc658069ef0 2023-06-23T19:02:52.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc65d7ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580b2dd0 con 0x7fc6580c8ce0 2023-06-23T19:02:52.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc65d7ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc658151f70 con 0x7fc65815a0c0 2023-06-23T19:02:52.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc656ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc658069ef0 0x7fc658151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:52.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc656ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc658069ef0 0x7fc658151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55984/0 (socket says 172.21.15.136:55984) 2023-06-23T19:02:52.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc656ffd700 1 -- 172.21.15.136:0/2070937301 learned_addr learned my addr 172.21.15.136:0/2070937301 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:52.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc656ffd700 1 -- 172.21.15.136:0/2070937301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc65815a0c0 msgr2=0x7fc6580c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:52.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc656ffd700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc65815a0c0 0x7fc6580c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:52.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc656ffd700 1 -- 172.21.15.136:0/2070937301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6580c8ce0 msgr2=0x7fc6580c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:52.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc64ffff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6580c8ce0 0x7fc6580c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:52.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc656ffd700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6580c8ce0 0x7fc6580c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:52.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc656ffd700 1 -- 172.21.15.136:0/2070937301 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640009550 con 0x7fc658069ef0 2023-06-23T19:02:52.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.891+0000 7fc64ffff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6580c8ce0 0x7fc6580c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:52.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.892+0000 7fc656ffd700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc658069ef0 0x7fc658151a30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc64800e790 tx=0x7fc64800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:52.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.892+0000 7fc64f7fe700 1 -- 172.21.15.136:0/2070937301 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648013610 con 0x7fc658069ef0 2023-06-23T19:02:52.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.892+0000 7fc64f7fe700 1 -- 172.21.15.136:0/2070937301 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc648013770 con 0x7fc658069ef0 2023-06-23T19:02:52.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.892+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6580c6a10 con 0x7fc658069ef0 2023-06-23T19:02:52.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.892+0000 7fc64f7fe700 1 -- 172.21.15.136:0/2070937301 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648013b20 con 0x7fc658069ef0 2023-06-23T19:02:52.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.892+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6580b24a0 con 0x7fc658069ef0 2023-06-23T19:02:52.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.893+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc658073910 con 0x7fc658069ef0 2023-06-23T19:02:52.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.894+0000 7fc64f7fe700 1 -- 172.21.15.136:0/2070937301 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc648013c80 con 0x7fc658069ef0 2023-06-23T19:02:52.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.895+0000 7fc64f7fe700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc63806ace0 0x7fc63806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:52.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.895+0000 7fc64f7fe700 1 -- 172.21.15.136:0/2070937301 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc648089280 con 0x7fc658069ef0 2023-06-23T19:02:52.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.895+0000 7fc64ffff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc63806ace0 0x7fc63806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:52.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.895+0000 7fc64ffff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc63806ace0 0x7fc63806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc6580af930 tx=0x7fc640008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:52.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:52.899+0000 7fc64f7fe700 1 -- 172.21.15.136:0/2070937301 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc648057be0 con 0x7fc658069ef0 2023-06-23T19:02:53.098 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.095+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 --> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6580cabc0 con 0x7fc63806ace0 2023-06-23T19:02:53.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.104+0000 7fc64f7fe700 1 -- 172.21.15.136:0/2070937301 <== mgr.4105 v2:172.21.15.136:6832/2653877961 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311341 (secure 0 0 0) 0x7fc64000b830 con 0x7fc63806ace0 2023-06-23T19:02:53.110 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:53.112 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc63806ace0 msgr2=0x7fc63806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc63806ace0 0x7fc63806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc6580af930 tx=0x7fc640008030 comp rx=0 tx=0).stop 2023-06-23T19:02:53.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc658069ef0 msgr2=0x7fc658151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc658069ef0 0x7fc658151a30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc64800e790 tx=0x7fc64800eb50 comp rx=0 tx=0).stop 2023-06-23T19:02:53.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 shutdown_connections 2023-06-23T19:02:53.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fc63806ace0 0x7fc63806d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc65815a0c0 0x7fc6580c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc658069ef0 0x7fc658151a30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 --2- 172.21.15.136:0/2070937301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6580c8ce0 0x7fc6580c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 >> 172.21.15.136:0/2070937301 conn(0x7fc6580b0ef0 msgr2=0x7fc6580ae260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:53.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 shutdown_connections 2023-06-23T19:02:53.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.108+0000 7fc65d7ff700 1 -- 172.21.15.136:0/2070937301 wait complete. 2023-06-23T19:02:53.114 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2023-06-23T19:02:53.131 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-06-23T19:02:52.958021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220776,"kb_used_data":5160,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753944,"statfs":{"total":773094113280,"available":772868038656,"internally_reserved":0,"allocated":5283840,"data_stored":2983588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.588638"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375912+0000","last_change":"2023-06-23T19:02:43.394056+0000","last_active":"2023-06-23T19:02:44.375912+0000","last_peered":"2023-06-23T19:02:44.375912+0000","last_clean":"2023-06-23T19:02:44.375912+0000","last_became_active":"2023-06-23T19:02:43.393754+0000","last_became_peered":"2023-06-23T19:02:43.393754+0000","last_unstale":"2023-06-23T19:02:44.375912+0000","last_undegraded":"2023-06-23T19:02:44.375912+0000","last_fullsized":"2023-06-23T19:02:44.375912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:07:37.481425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724872+0000","last_change":"2023-06-23T19:02:43.405015+0000","last_active":"2023-06-23T19:02:44.724872+0000","last_peered":"2023-06-23T19:02:44.724872+0000","last_clean":"2023-06-23T19:02:44.724872+0000","last_became_active":"2023-06-23T19:02:43.404718+0000","last_became_peered":"2023-06-23T19:02:43.404718+0000","last_unstale":"2023-06-23T19:02:44.724872+0000","last_undegraded":"2023-06-23T19:02:44.724872+0000","last_fullsized":"2023-06-23T19:02:44.724872+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:02.650153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374983+0000","last_change":"2023-06-23T19:02:43.391322+0000","last_active":"2023-06-23T19:02:44.374983+0000","last_peered":"2023-06-23T19:02:44.374983+0000","last_clean":"2023-06-23T19:02:44.374983+0000","last_became_active":"2023-06-23T19:02:43.391105+0000","last_became_peered":"2023-06-23T19:02:43.391105+0000","last_unstale":"2023-06-23T19:02:44.374983+0000","last_undegraded":"2023-06-23T19:02:44.374983+0000","last_fullsized":"2023-06-23T19:02:44.374983+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:48.006363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375216+0000","last_change":"2023-06-23T19:02:43.402422+0000","last_active":"2023-06-23T19:02:44.375216+0000","last_peered":"2023-06-23T19:02:44.375216+0000","last_clean":"2023-06-23T19:02:44.375216+0000","last_became_active":"2023-06-23T19:02:43.402157+0000","last_became_peered":"2023-06-23T19:02:43.402157+0000","last_unstale":"2023-06-23T19:02:44.375216+0000","last_undegraded":"2023-06-23T19:02:44.375216+0000","last_fullsized":"2023-06-23T19:02:44.375216+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:28:06.575540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724566+0000","last_change":"2023-06-23T19:02:43.395438+0000","last_active":"2023-06-23T19:02:44.724566+0000","last_peered":"2023-06-23T19:02:44.724566+0000","last_clean":"2023-06-23T19:02:44.724566+0000","last_became_active":"2023-06-23T19:02:43.395153+0000","last_became_peered":"2023-06-23T19:02:43.395153+0000","last_unstale":"2023-06-23T19:02:44.724566+0000","last_undegraded":"2023-06-23T19:02:44.724566+0000","last_fullsized":"2023-06-23T19:02:44.724566+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:32:46.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398128+0000","last_change":"2023-06-23T19:02:43.395365+0000","last_active":"2023-06-23T19:02:44.398128+0000","last_peered":"2023-06-23T19:02:44.398128+0000","last_clean":"2023-06-23T19:02:44.398128+0000","last_became_active":"2023-06-23T19:02:43.394625+0000","last_became_peered":"2023-06-23T19:02:43.394625+0000","last_unstale":"2023-06-23T19:02:44.398128+0000","last_undegraded":"2023-06-23T19:02:44.398128+0000","last_fullsized":"2023-06-23T19:02:44.398128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:13:45.625003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375399+0000","last_change":"2023-06-23T19:02:43.388810+0000","last_active":"2023-06-23T19:02:44.375399+0000","last_peered":"2023-06-23T19:02:44.375399+0000","last_clean":"2023-06-23T19:02:44.375399+0000","last_became_active":"2023-06-23T19:02:43.386330+0000","last_became_peered":"2023-06-23T19:02:43.386330+0000","last_unstale":"2023-06-23T19:02:44.375399+0000","last_undegraded":"2023-06-23T19:02:44.375399+0000","last_fullsized":"2023-06-23T19:02:44.375399+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:57:06.555441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374729+0000","last_change":"2023-06-23T19:02:43.403369+0000","last_active":"2023-06-23T19:02:44.374729+0000","last_peered":"2023-06-23T19:02:44.374729+0000","last_clean":"2023-06-23T19:02:44.374729+0000","last_became_active":"2023-06-23T19:02:43.403084+0000","last_became_peered":"2023-06-23T19:02:43.403084+0000","last_unstale":"2023-06-23T19:02:44.374729+0000","last_undegraded":"2023-06-23T19:02:44.374729+0000","last_fullsized":"2023-06-23T19:02:44.374729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:07:16.938492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375441+0000","last_change":"2023-06-23T19:02:43.386467+0000","last_active":"2023-06-23T19:02:44.375441+0000","last_peered":"2023-06-23T19:02:44.375441+0000","last_clean":"2023-06-23T19:02:44.375441+0000","last_became_active":"2023-06-23T19:02:43.386192+0000","last_became_peered":"2023-06-23T19:02:43.386192+0000","last_unstale":"2023-06-23T19:02:44.375441+0000","last_undegraded":"2023-06-23T19:02:44.375441+0000","last_fullsized":"2023-06-23T19:02:44.375441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:30:39.670564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375541+0000","last_change":"2023-06-23T19:02:43.402134+0000","last_active":"2023-06-23T19:02:44.375541+0000","last_peered":"2023-06-23T19:02:44.375541+0000","last_clean":"2023-06-23T19:02:44.375541+0000","last_became_active":"2023-06-23T19:02:43.401870+0000","last_became_peered":"2023-06-23T19:02:43.401870+0000","last_unstale":"2023-06-23T19:02:44.375541+0000","last_undegraded":"2023-06-23T19:02:44.375541+0000","last_fullsized":"2023-06-23T19:02:44.375541+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:16:42.130969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375249+0000","last_change":"2023-06-23T19:02:43.386081+0000","last_active":"2023-06-23T19:02:44.375249+0000","last_peered":"2023-06-23T19:02:44.375249+0000","last_clean":"2023-06-23T19:02:44.375249+0000","last_became_active":"2023-06-23T19:02:43.385795+0000","last_became_peered":"2023-06-23T19:02:43.385795+0000","last_unstale":"2023-06-23T19:02:44.375249+0000","last_undegraded":"2023-06-23T19:02:44.375249+0000","last_fullsized":"2023-06-23T19:02:44.375249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:25:54.349643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724904+0000","last_change":"2023-06-23T19:02:43.395109+0000","last_active":"2023-06-23T19:02:44.724904+0000","last_peered":"2023-06-23T19:02:44.724904+0000","last_clean":"2023-06-23T19:02:44.724904+0000","last_became_active":"2023-06-23T19:02:43.394402+0000","last_became_peered":"2023-06-23T19:02:43.394402+0000","last_unstale":"2023-06-23T19:02:44.724904+0000","last_undegraded":"2023-06-23T19:02:44.724904+0000","last_fullsized":"2023-06-23T19:02:44.724904+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:32:45.456360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724074+0000","last_change":"2023-06-23T19:02:43.396616+0000","last_active":"2023-06-23T19:02:44.724074+0000","last_peered":"2023-06-23T19:02:44.724074+0000","last_clean":"2023-06-23T19:02:44.724074+0000","last_became_active":"2023-06-23T19:02:43.396367+0000","last_became_peered":"2023-06-23T19:02:43.396367+0000","last_unstale":"2023-06-23T19:02:44.724074+0000","last_undegraded":"2023-06-23T19:02:44.724074+0000","last_fullsized":"2023-06-23T19:02:44.724074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:45.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374821+0000","last_change":"2023-06-23T19:02:43.383462+0000","last_active":"2023-06-23T19:02:44.374821+0000","last_peered":"2023-06-23T19:02:44.374821+0000","last_clean":"2023-06-23T19:02:44.374821+0000","last_became_active":"2023-06-23T19:02:43.383158+0000","last_became_peered":"2023-06-23T19:02:43.383158+0000","last_unstale":"2023-06-23T19:02:44.374821+0000","last_undegraded":"2023-06-23T19:02:44.374821+0000","last_fullsized":"2023-06-23T19:02:44.374821+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:30.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398107+0000","last_change":"2023-06-23T19:02:43.390211+0000","last_active":"2023-06-23T19:02:44.398107+0000","last_peered":"2023-06-23T19:02:44.398107+0000","last_clean":"2023-06-23T19:02:44.398107+0000","last_became_active":"2023-06-23T19:02:43.389843+0000","last_became_peered":"2023-06-23T19:02:43.389843+0000","last_unstale":"2023-06-23T19:02:44.398107+0000","last_undegraded":"2023-06-23T19:02:44.398107+0000","last_fullsized":"2023-06-23T19:02:44.398107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:54.012998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724048+0000","last_change":"2023-06-23T19:02:43.400056+0000","last_active":"2023-06-23T19:02:44.724048+0000","last_peered":"2023-06-23T19:02:44.724048+0000","last_clean":"2023-06-23T19:02:44.724048+0000","last_became_active":"2023-06-23T19:02:43.399740+0000","last_became_peered":"2023-06-23T19:02:43.399740+0000","last_unstale":"2023-06-23T19:02:44.724048+0000","last_undegraded":"2023-06-23T19:02:44.724048+0000","last_fullsized":"2023-06-23T19:02:44.724048+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:32:56.376089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374989+0000","last_change":"2023-06-23T19:02:43.403902+0000","last_active":"2023-06-23T19:02:44.374989+0000","last_peered":"2023-06-23T19:02:44.374989+0000","last_clean":"2023-06-23T19:02:44.374989+0000","last_became_active":"2023-06-23T19:02:43.402727+0000","last_became_peered":"2023-06-23T19:02:43.402727+0000","last_unstale":"2023-06-23T19:02:44.374989+0000","last_undegraded":"2023-06-23T19:02:44.374989+0000","last_fullsized":"2023-06-23T19:02:44.374989+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:42.025343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375447+0000","last_change":"2023-06-23T19:02:43.407203+0000","last_active":"2023-06-23T19:02:44.375447+0000","last_peered":"2023-06-23T19:02:44.375447+0000","last_clean":"2023-06-23T19:02:44.375447+0000","last_became_active":"2023-06-23T19:02:43.406904+0000","last_became_peered":"2023-06-23T19:02:43.406904+0000","last_unstale":"2023-06-23T19:02:44.375447+0000","last_undegraded":"2023-06-23T19:02:44.375447+0000","last_fullsized":"2023-06-23T19:02:44.375447+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:31:21.914288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725030+0000","last_change":"2023-06-23T19:02:43.400304+0000","last_active":"2023-06-23T19:02:44.725030+0000","last_peered":"2023-06-23T19:02:44.725030+0000","last_clean":"2023-06-23T19:02:44.725030+0000","last_became_active":"2023-06-23T19:02:43.396953+0000","last_became_peered":"2023-06-23T19:02:43.396953+0000","last_unstale":"2023-06-23T19:02:44.725030+0000","last_undegraded":"2023-06-23T19:02:44.725030+0000","last_fullsized":"2023-06-23T19:02:44.725030+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:16:41.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723626+0000","last_change":"2023-06-23T19:02:43.381816+0000","last_active":"2023-06-23T19:02:44.723626+0000","last_peered":"2023-06-23T19:02:44.723626+0000","last_clean":"2023-06-23T19:02:44.723626+0000","last_became_active":"2023-06-23T19:02:43.381565+0000","last_became_peered":"2023-06-23T19:02:43.381565+0000","last_unstale":"2023-06-23T19:02:44.723626+0000","last_undegraded":"2023-06-23T19:02:44.723626+0000","last_fullsized":"2023-06-23T19:02:44.723626+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:57.666767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398356+0000","last_change":"2023-06-23T19:02:43.402759+0000","last_active":"2023-06-23T19:02:44.398356+0000","last_peered":"2023-06-23T19:02:44.398356+0000","last_clean":"2023-06-23T19:02:44.398356+0000","last_became_active":"2023-06-23T19:02:43.402425+0000","last_became_peered":"2023-06-23T19:02:43.402425+0000","last_unstale":"2023-06-23T19:02:44.398356+0000","last_undegraded":"2023-06-23T19:02:44.398356+0000","last_fullsized":"2023-06-23T19:02:44.398356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:25.908843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374980+0000","last_change":"2023-06-23T19:02:43.402236+0000","last_active":"2023-06-23T19:02:44.374980+0000","last_peered":"2023-06-23T19:02:44.374980+0000","last_clean":"2023-06-23T19:02:44.374980+0000","last_became_active":"2023-06-23T19:02:43.401856+0000","last_became_peered":"2023-06-23T19:02:43.401856+0000","last_unstale":"2023-06-23T19:02:44.374980+0000","last_undegraded":"2023-06-23T19:02:44.374980+0000","last_fullsized":"2023-06-23T19:02:44.374980+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:54.961306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723948+0000","last_change":"2023-06-23T19:02:43.404668+0000","last_active":"2023-06-23T19:02:44.723948+0000","last_peered":"2023-06-23T19:02:44.723948+0000","last_clean":"2023-06-23T19:02:44.723948+0000","last_became_active":"2023-06-23T19:02:43.404069+0000","last_became_peered":"2023-06-23T19:02:43.404069+0000","last_unstale":"2023-06-23T19:02:44.723948+0000","last_undegraded":"2023-06-23T19:02:44.723948+0000","last_fullsized":"2023-06-23T19:02:44.723948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:03.176159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724003+0000","last_change":"2023-06-23T19:02:43.395358+0000","last_active":"2023-06-23T19:02:44.724003+0000","last_peered":"2023-06-23T19:02:44.724003+0000","last_clean":"2023-06-23T19:02:44.724003+0000","last_became_active":"2023-06-23T19:02:43.394956+0000","last_became_peered":"2023-06-23T19:02:43.394956+0000","last_unstale":"2023-06-23T19:02:44.724003+0000","last_undegraded":"2023-06-23T19:02:44.724003+0000","last_fullsized":"2023-06-23T19:02:44.724003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:20.784110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725079+0000","last_change":"2023-06-23T19:02:43.395135+0000","last_active":"2023-06-23T19:02:44.725079+0000","last_peered":"2023-06-23T19:02:44.725079+0000","last_clean":"2023-06-23T19:02:44.725079+0000","last_became_active":"2023-06-23T19:02:43.394454+0000","last_became_peered":"2023-06-23T19:02:43.394454+0000","last_unstale":"2023-06-23T19:02:44.725079+0000","last_undegraded":"2023-06-23T19:02:44.725079+0000","last_fullsized":"2023-06-23T19:02:44.725079+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:46:33.411319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723701+0000","last_change":"2023-06-23T19:02:43.396868+0000","last_active":"2023-06-23T19:02:44.723701+0000","last_peered":"2023-06-23T19:02:44.723701+0000","last_clean":"2023-06-23T19:02:44.723701+0000","last_became_active":"2023-06-23T19:02:43.396100+0000","last_became_peered":"2023-06-23T19:02:43.396100+0000","last_unstale":"2023-06-23T19:02:44.723701+0000","last_undegraded":"2023-06-23T19:02:44.723701+0000","last_fullsized":"2023-06-23T19:02:44.723701+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:57:57.250181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375109+0000","last_change":"2023-06-23T19:02:43.402048+0000","last_active":"2023-06-23T19:02:44.375109+0000","last_peered":"2023-06-23T19:02:44.375109+0000","last_clean":"2023-06-23T19:02:44.375109+0000","last_became_active":"2023-06-23T19:02:43.401744+0000","last_became_peered":"2023-06-23T19:02:43.401744+0000","last_unstale":"2023-06-23T19:02:44.375109+0000","last_undegraded":"2023-06-23T19:02:44.375109+0000","last_fullsized":"2023-06-23T19:02:44.375109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:41:35.581792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724642+0000","last_change":"2023-06-23T19:02:43.395428+0000","last_active":"2023-06-23T19:02:44.724642+0000","last_peered":"2023-06-23T19:02:44.724642+0000","last_clean":"2023-06-23T19:02:44.724642+0000","last_became_active":"2023-06-23T19:02:43.394828+0000","last_became_peered":"2023-06-23T19:02:43.394828+0000","last_unstale":"2023-06-23T19:02:44.724642+0000","last_undegraded":"2023-06-23T19:02:44.724642+0000","last_fullsized":"2023-06-23T19:02:44.724642+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:46:24.850112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724266+0000","last_change":"2023-06-23T19:02:43.390376+0000","last_active":"2023-06-23T19:02:44.724266+0000","last_peered":"2023-06-23T19:02:44.724266+0000","last_clean":"2023-06-23T19:02:44.724266+0000","last_became_active":"2023-06-23T19:02:43.390091+0000","last_became_peered":"2023-06-23T19:02:43.390091+0000","last_unstale":"2023-06-23T19:02:44.724266+0000","last_undegraded":"2023-06-23T19:02:44.724266+0000","last_fullsized":"2023-06-23T19:02:44.724266+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:38:21.075927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374934+0000","last_change":"2023-06-23T19:02:43.396896+0000","last_active":"2023-06-23T19:02:44.374934+0000","last_peered":"2023-06-23T19:02:44.374934+0000","last_clean":"2023-06-23T19:02:44.374934+0000","last_became_active":"2023-06-23T19:02:43.396377+0000","last_became_peered":"2023-06-23T19:02:43.396377+0000","last_unstale":"2023-06-23T19:02:44.374934+0000","last_undegraded":"2023-06-23T19:02:44.374934+0000","last_fullsized":"2023-06-23T19:02:44.374934+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:48.106744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.397950+0000","last_change":"2023-06-23T19:02:43.392988+0000","last_active":"2023-06-23T19:02:44.397950+0000","last_peered":"2023-06-23T19:02:44.397950+0000","last_clean":"2023-06-23T19:02:44.397950+0000","last_became_active":"2023-06-23T19:02:43.392720+0000","last_became_peered":"2023-06-23T19:02:43.392720+0000","last_unstale":"2023-06-23T19:02:44.397950+0000","last_undegraded":"2023-06-23T19:02:44.397950+0000","last_fullsized":"2023-06-23T19:02:44.397950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:48:01.984501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723384+0000","last_change":"2023-06-23T19:02:43.382777+0000","last_active":"2023-06-23T19:02:44.723384+0000","last_peered":"2023-06-23T19:02:44.723384+0000","last_clean":"2023-06-23T19:02:44.723384+0000","last_became_active":"2023-06-23T19:02:43.382533+0000","last_became_peered":"2023-06-23T19:02:43.382533+0000","last_unstale":"2023-06-23T19:02:44.723384+0000","last_undegraded":"2023-06-23T19:02:44.723384+0000","last_fullsized":"2023-06-23T19:02:44.723384+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:44:08.992692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723614+0000","last_change":"2023-06-23T19:02:43.393102+0000","last_active":"2023-06-23T19:02:44.723614+0000","last_peered":"2023-06-23T19:02:44.723614+0000","last_clean":"2023-06-23T19:02:44.723614+0000","last_became_active":"2023-06-23T19:02:43.392800+0000","last_became_peered":"2023-06-23T19:02:43.392800+0000","last_unstale":"2023-06-23T19:02:44.723614+0000","last_undegraded":"2023-06-23T19:02:44.723614+0000","last_fullsized":"2023-06-23T19:02:44.723614+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:41:41.621291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398329+0000","last_change":"2023-06-23T19:02:42.887806+0000","last_active":"2023-06-23T19:02:44.398329+0000","last_peered":"2023-06-23T19:02:44.398329+0000","last_clean":"2023-06-23T19:02:44.398329+0000","last_became_active":"2023-06-23T19:02:42.887517+0000","last_became_peered":"2023-06-23T19:02:42.887517+0000","last_unstale":"2023-06-23T19:02:44.398329+0000","last_undegraded":"2023-06-23T19:02:44.398329+0000","last_fullsized":"2023-06-23T19:02:44.398329+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:03.902410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724889+0000","last_change":"2023-06-23T19:02:43.395362+0000","last_active":"2023-06-23T19:02:44.724889+0000","last_peered":"2023-06-23T19:02:44.724889+0000","last_clean":"2023-06-23T19:02:44.724889+0000","last_became_active":"2023-06-23T19:02:43.394818+0000","last_became_peered":"2023-06-23T19:02:43.394818+0000","last_unstale":"2023-06-23T19:02:44.724889+0000","last_undegraded":"2023-06-23T19:02:44.724889+0000","last_fullsized":"2023-06-23T19:02:44.724889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:04:50.409635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375725+0000","last_change":"2023-06-23T19:02:42.891979+0000","last_active":"2023-06-23T19:02:44.375725+0000","last_peered":"2023-06-23T19:02:44.375725+0000","last_clean":"2023-06-23T19:02:44.375725+0000","last_became_active":"2023-06-23T19:02:42.890688+0000","last_became_peered":"2023-06-23T19:02:42.890688+0000","last_unstale":"2023-06-23T19:02:44.375725+0000","last_undegraded":"2023-06-23T19:02:44.375725+0000","last_fullsized":"2023-06-23T19:02:44.375725+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:58:03.854610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724724+0000","last_change":"2023-06-23T19:02:43.393361+0000","last_active":"2023-06-23T19:02:44.724724+0000","last_peered":"2023-06-23T19:02:44.724724+0000","last_clean":"2023-06-23T19:02:44.724724+0000","last_became_active":"2023-06-23T19:02:43.393080+0000","last_became_peered":"2023-06-23T19:02:43.393080+0000","last_unstale":"2023-06-23T19:02:44.724724+0000","last_undegraded":"2023-06-23T19:02:44.724724+0000","last_fullsized":"2023-06-23T19:02:44.724724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:45:28.343028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724188+0000","last_change":"2023-06-23T19:02:42.893081+0000","last_active":"2023-06-23T19:02:44.724188+0000","last_peered":"2023-06-23T19:02:44.724188+0000","last_clean":"2023-06-23T19:02:44.724188+0000","last_became_active":"2023-06-23T19:02:42.892723+0000","last_became_peered":"2023-06-23T19:02:42.892723+0000","last_unstale":"2023-06-23T19:02:44.724188+0000","last_undegraded":"2023-06-23T19:02:44.724188+0000","last_fullsized":"2023-06-23T19:02:44.724188+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:25:12.283569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724050+0000","last_change":"2023-06-23T19:02:43.397406+0000","last_active":"2023-06-23T19:02:44.724050+0000","last_peered":"2023-06-23T19:02:44.724050+0000","last_clean":"2023-06-23T19:02:44.724050+0000","last_became_active":"2023-06-23T19:02:43.397058+0000","last_became_peered":"2023-06-23T19:02:43.397058+0000","last_unstale":"2023-06-23T19:02:44.724050+0000","last_undegraded":"2023-06-23T19:02:44.724050+0000","last_fullsized":"2023-06-23T19:02:44.724050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:45.893777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375573+0000","last_change":"2023-06-23T19:02:42.887480+0000","last_active":"2023-06-23T19:02:44.375573+0000","last_peered":"2023-06-23T19:02:44.375573+0000","last_clean":"2023-06-23T19:02:44.375573+0000","last_became_active":"2023-06-23T19:02:42.887193+0000","last_became_peered":"2023-06-23T19:02:42.887193+0000","last_unstale":"2023-06-23T19:02:44.375573+0000","last_undegraded":"2023-06-23T19:02:44.375573+0000","last_fullsized":"2023-06-23T19:02:44.375573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:32.354763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375657+0000","last_change":"2023-06-23T19:02:43.397464+0000","last_active":"2023-06-23T19:02:44.375657+0000","last_peered":"2023-06-23T19:02:44.375657+0000","last_clean":"2023-06-23T19:02:44.375657+0000","last_became_active":"2023-06-23T19:02:43.397199+0000","last_became_peered":"2023-06-23T19:02:43.397199+0000","last_unstale":"2023-06-23T19:02:44.375657+0000","last_undegraded":"2023-06-23T19:02:44.375657+0000","last_fullsized":"2023-06-23T19:02:44.375657+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:58:11.276317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398596+0000","last_change":"2023-06-23T19:02:42.887196+0000","last_active":"2023-06-23T19:02:44.398596+0000","last_peered":"2023-06-23T19:02:44.398596+0000","last_clean":"2023-06-23T19:02:44.398596+0000","last_became_active":"2023-06-23T19:02:42.886915+0000","last_became_peered":"2023-06-23T19:02:42.886915+0000","last_unstale":"2023-06-23T19:02:44.398596+0000","last_undegraded":"2023-06-23T19:02:44.398596+0000","last_fullsized":"2023-06-23T19:02:44.398596+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:18:36.094355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374925+0000","last_change":"2023-06-23T19:02:43.379396+0000","last_active":"2023-06-23T19:02:44.374925+0000","last_peered":"2023-06-23T19:02:44.374925+0000","last_clean":"2023-06-23T19:02:44.374925+0000","last_became_active":"2023-06-23T19:02:43.379137+0000","last_became_peered":"2023-06-23T19:02:43.379137+0000","last_unstale":"2023-06-23T19:02:44.374925+0000","last_undegraded":"2023-06-23T19:02:44.374925+0000","last_fullsized":"2023-06-23T19:02:44.374925+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:25:13.288104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375096+0000","last_change":"2023-06-23T19:02:42.890175+0000","last_active":"2023-06-23T19:02:44.375096+0000","last_peered":"2023-06-23T19:02:44.375096+0000","last_clean":"2023-06-23T19:02:44.375096+0000","last_became_active":"2023-06-23T19:02:42.889717+0000","last_became_peered":"2023-06-23T19:02:42.889717+0000","last_unstale":"2023-06-23T19:02:44.375096+0000","last_undegraded":"2023-06-23T19:02:44.375096+0000","last_fullsized":"2023-06-23T19:02:44.375096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:57:06.989900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375012+0000","last_change":"2023-06-23T19:02:43.403277+0000","last_active":"2023-06-23T19:02:44.375012+0000","last_peered":"2023-06-23T19:02:44.375012+0000","last_clean":"2023-06-23T19:02:44.375012+0000","last_became_active":"2023-06-23T19:02:43.402771+0000","last_became_peered":"2023-06-23T19:02:43.402771+0000","last_unstale":"2023-06-23T19:02:44.375012+0000","last_undegraded":"2023-06-23T19:02:44.375012+0000","last_fullsized":"2023-06-23T19:02:44.375012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:19:32.234779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724326+0000","last_change":"2023-06-23T19:02:42.887165+0000","last_active":"2023-06-23T19:02:44.724326+0000","last_peered":"2023-06-23T19:02:44.724326+0000","last_clean":"2023-06-23T19:02:44.724326+0000","last_became_active":"2023-06-23T19:02:42.886870+0000","last_became_peered":"2023-06-23T19:02:42.886870+0000","last_unstale":"2023-06-23T19:02:44.724326+0000","last_undegraded":"2023-06-23T19:02:44.724326+0000","last_fullsized":"2023-06-23T19:02:44.724326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:28:10.991929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724033+0000","last_change":"2023-06-23T19:02:43.404348+0000","last_active":"2023-06-23T19:02:44.724033+0000","last_peered":"2023-06-23T19:02:44.724033+0000","last_clean":"2023-06-23T19:02:44.724033+0000","last_became_active":"2023-06-23T19:02:43.403667+0000","last_became_peered":"2023-06-23T19:02:43.403667+0000","last_unstale":"2023-06-23T19:02:44.724033+0000","last_undegraded":"2023-06-23T19:02:44.724033+0000","last_fullsized":"2023-06-23T19:02:44.724033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:45.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374902+0000","last_change":"2023-06-23T19:02:42.890898+0000","last_active":"2023-06-23T19:02:44.374902+0000","last_peered":"2023-06-23T19:02:44.374902+0000","last_clean":"2023-06-23T19:02:44.374902+0000","last_became_active":"2023-06-23T19:02:42.890663+0000","last_became_peered":"2023-06-23T19:02:42.890663+0000","last_unstale":"2023-06-23T19:02:44.374902+0000","last_undegraded":"2023-06-23T19:02:44.374902+0000","last_fullsized":"2023-06-23T19:02:44.374902+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:45.352604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375650+0000","last_change":"2023-06-23T19:02:43.403661+0000","last_active":"2023-06-23T19:02:44.375650+0000","last_peered":"2023-06-23T19:02:44.375650+0000","last_clean":"2023-06-23T19:02:44.375650+0000","last_became_active":"2023-06-23T19:02:43.401012+0000","last_became_peered":"2023-06-23T19:02:43.401012+0000","last_unstale":"2023-06-23T19:02:44.375650+0000","last_undegraded":"2023-06-23T19:02:44.375650+0000","last_fullsized":"2023-06-23T19:02:44.375650+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:35:13.671541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375174+0000","last_change":"2023-06-23T19:02:42.888633+0000","last_active":"2023-06-23T19:02:44.375174+0000","last_peered":"2023-06-23T19:02:44.375174+0000","last_clean":"2023-06-23T19:02:44.375174+0000","last_became_active":"2023-06-23T19:02:42.888018+0000","last_became_peered":"2023-06-23T19:02:42.888018+0000","last_unstale":"2023-06-23T19:02:44.375174+0000","last_undegraded":"2023-06-23T19:02:44.375174+0000","last_fullsized":"2023-06-23T19:02:44.375174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:01:10.153048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375912+0000","last_change":"2023-06-23T19:02:43.399949+0000","last_active":"2023-06-23T19:02:44.375912+0000","last_peered":"2023-06-23T19:02:44.375912+0000","last_clean":"2023-06-23T19:02:44.375912+0000","last_became_active":"2023-06-23T19:02:43.399639+0000","last_became_peered":"2023-06-23T19:02:43.399639+0000","last_unstale":"2023-06-23T19:02:44.375912+0000","last_undegraded":"2023-06-23T19:02:44.375912+0000","last_fullsized":"2023-06-23T19:02:44.375912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:32:45.456360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375618+0000","last_change":"2023-06-23T19:02:42.890196+0000","last_active":"2023-06-23T19:02:44.375618+0000","last_peered":"2023-06-23T19:02:44.375618+0000","last_clean":"2023-06-23T19:02:44.375618+0000","last_became_active":"2023-06-23T19:02:42.889975+0000","last_became_peered":"2023-06-23T19:02:42.889975+0000","last_unstale":"2023-06-23T19:02:44.375618+0000","last_undegraded":"2023-06-23T19:02:44.375618+0000","last_fullsized":"2023-06-23T19:02:44.375618+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:57:19.580648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398474+0000","last_change":"2023-06-23T19:02:43.396802+0000","last_active":"2023-06-23T19:02:44.398474+0000","last_peered":"2023-06-23T19:02:44.398474+0000","last_clean":"2023-06-23T19:02:44.398474+0000","last_became_active":"2023-06-23T19:02:43.395088+0000","last_became_peered":"2023-06-23T19:02:43.395088+0000","last_unstale":"2023-06-23T19:02:44.398474+0000","last_undegraded":"2023-06-23T19:02:44.398474+0000","last_fullsized":"2023-06-23T19:02:44.398474+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:18.762011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375955+0000","last_change":"2023-06-23T19:02:42.891197+0000","last_active":"2023-06-23T19:02:44.375955+0000","last_peered":"2023-06-23T19:02:44.375955+0000","last_clean":"2023-06-23T19:02:44.375955+0000","last_became_active":"2023-06-23T19:02:42.890890+0000","last_became_peered":"2023-06-23T19:02:42.890890+0000","last_unstale":"2023-06-23T19:02:44.375955+0000","last_undegraded":"2023-06-23T19:02:44.375955+0000","last_fullsized":"2023-06-23T19:02:44.375955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:51.016173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375721+0000","last_change":"2023-06-23T19:02:43.398100+0000","last_active":"2023-06-23T19:02:44.375721+0000","last_peered":"2023-06-23T19:02:44.375721+0000","last_clean":"2023-06-23T19:02:44.375721+0000","last_became_active":"2023-06-23T19:02:43.397629+0000","last_became_peered":"2023-06-23T19:02:43.397629+0000","last_unstale":"2023-06-23T19:02:44.375721+0000","last_undegraded":"2023-06-23T19:02:44.375721+0000","last_fullsized":"2023-06-23T19:02:44.375721+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:45:28.343028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723779+0000","last_change":"2023-06-23T19:02:42.886487+0000","last_active":"2023-06-23T19:02:44.723779+0000","last_peered":"2023-06-23T19:02:44.723779+0000","last_clean":"2023-06-23T19:02:44.723779+0000","last_became_active":"2023-06-23T19:02:42.886215+0000","last_became_peered":"2023-06-23T19:02:42.886215+0000","last_unstale":"2023-06-23T19:02:44.723779+0000","last_undegraded":"2023-06-23T19:02:44.723779+0000","last_fullsized":"2023-06-23T19:02:44.723779+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:13:36.100121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724215+0000","last_change":"2023-06-23T19:02:43.398669+0000","last_active":"2023-06-23T19:02:44.724215+0000","last_peered":"2023-06-23T19:02:44.724215+0000","last_clean":"2023-06-23T19:02:44.724215+0000","last_became_active":"2023-06-23T19:02:43.396528+0000","last_became_peered":"2023-06-23T19:02:43.396528+0000","last_unstale":"2023-06-23T19:02:44.724215+0000","last_undegraded":"2023-06-23T19:02:44.724215+0000","last_fullsized":"2023-06-23T19:02:44.724215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:07:50.110076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398492+0000","last_change":"2023-06-23T19:02:42.891024+0000","last_active":"2023-06-23T19:02:44.398492+0000","last_peered":"2023-06-23T19:02:44.398492+0000","last_clean":"2023-06-23T19:02:44.398492+0000","last_became_active":"2023-06-23T19:02:42.890651+0000","last_became_peered":"2023-06-23T19:02:42.890651+0000","last_unstale":"2023-06-23T19:02:44.398492+0000","last_undegraded":"2023-06-23T19:02:44.398492+0000","last_fullsized":"2023-06-23T19:02:44.398492+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:21:24.007492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375189+0000","last_change":"2023-06-23T19:02:43.389803+0000","last_active":"2023-06-23T19:02:44.375189+0000","last_peered":"2023-06-23T19:02:44.375189+0000","last_clean":"2023-06-23T19:02:44.375189+0000","last_became_active":"2023-06-23T19:02:43.389537+0000","last_became_peered":"2023-06-23T19:02:43.389537+0000","last_unstale":"2023-06-23T19:02:44.375189+0000","last_undegraded":"2023-06-23T19:02:44.375189+0000","last_fullsized":"2023-06-23T19:02:44.375189+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:05:47.962419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375539+0000","last_change":"2023-06-23T19:02:42.886300+0000","last_active":"2023-06-23T19:02:44.375539+0000","last_peered":"2023-06-23T19:02:44.375539+0000","last_clean":"2023-06-23T19:02:44.375539+0000","last_became_active":"2023-06-23T19:02:42.886024+0000","last_became_peered":"2023-06-23T19:02:42.886024+0000","last_unstale":"2023-06-23T19:02:44.375539+0000","last_undegraded":"2023-06-23T19:02:44.375539+0000","last_fullsized":"2023-06-23T19:02:44.375539+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:28.192185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.397888+0000","last_change":"2023-06-23T19:02:43.395514+0000","last_active":"2023-06-23T19:02:44.397888+0000","last_peered":"2023-06-23T19:02:44.397888+0000","last_clean":"2023-06-23T19:02:44.397888+0000","last_became_active":"2023-06-23T19:02:43.395194+0000","last_became_peered":"2023-06-23T19:02:43.395194+0000","last_unstale":"2023-06-23T19:02:44.397888+0000","last_undegraded":"2023-06-23T19:02:44.397888+0000","last_fullsized":"2023-06-23T19:02:44.397888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:59:36.637146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398038+0000","last_change":"2023-06-23T19:02:42.891524+0000","last_active":"2023-06-23T19:02:44.398038+0000","last_peered":"2023-06-23T19:02:44.398038+0000","last_clean":"2023-06-23T19:02:44.398038+0000","last_became_active":"2023-06-23T19:02:42.891246+0000","last_became_peered":"2023-06-23T19:02:42.891246+0000","last_unstale":"2023-06-23T19:02:44.398038+0000","last_undegraded":"2023-06-23T19:02:44.398038+0000","last_fullsized":"2023-06-23T19:02:44.398038+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:04.274893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375615+0000","last_change":"2023-06-23T19:02:43.398533+0000","last_active":"2023-06-23T19:02:44.375615+0000","last_peered":"2023-06-23T19:02:44.375615+0000","last_clean":"2023-06-23T19:02:44.375615+0000","last_became_active":"2023-06-23T19:02:43.398104+0000","last_became_peered":"2023-06-23T19:02:43.398104+0000","last_unstale":"2023-06-23T19:02:44.375615+0000","last_undegraded":"2023-06-23T19:02:44.375615+0000","last_fullsized":"2023-06-23T19:02:44.375615+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:46:24.850112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374998+0000","last_change":"2023-06-23T19:02:42.893070+0000","last_active":"2023-06-23T19:02:44.374998+0000","last_peered":"2023-06-23T19:02:44.374998+0000","last_clean":"2023-06-23T19:02:44.374998+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:44.374998+0000","last_undegraded":"2023-06-23T19:02:44.374998+0000","last_fullsized":"2023-06-23T19:02:44.374998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:24:50.998086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723822+0000","last_change":"2023-06-23T19:02:43.389359+0000","last_active":"2023-06-23T19:02:44.723822+0000","last_peered":"2023-06-23T19:02:44.723822+0000","last_clean":"2023-06-23T19:02:44.723822+0000","last_became_active":"2023-06-23T19:02:43.389110+0000","last_became_peered":"2023-06-23T19:02:43.389110+0000","last_unstale":"2023-06-23T19:02:44.723822+0000","last_undegraded":"2023-06-23T19:02:44.723822+0000","last_fullsized":"2023-06-23T19:02:44.723822+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:36:03.176159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723990+0000","last_change":"2023-06-23T19:02:42.889068+0000","last_active":"2023-06-23T19:02:44.723990+0000","last_peered":"2023-06-23T19:02:44.723990+0000","last_clean":"2023-06-23T19:02:44.723990+0000","last_became_active":"2023-06-23T19:02:42.888798+0000","last_became_peered":"2023-06-23T19:02:42.888798+0000","last_unstale":"2023-06-23T19:02:44.723990+0000","last_undegraded":"2023-06-23T19:02:44.723990+0000","last_fullsized":"2023-06-23T19:02:44.723990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:19.779575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375509+0000","last_change":"2023-06-23T19:02:43.388207+0000","last_active":"2023-06-23T19:02:44.375509+0000","last_peered":"2023-06-23T19:02:44.375509+0000","last_clean":"2023-06-23T19:02:44.375509+0000","last_became_active":"2023-06-23T19:02:43.386722+0000","last_became_peered":"2023-06-23T19:02:43.386722+0000","last_unstale":"2023-06-23T19:02:44.375509+0000","last_undegraded":"2023-06-23T19:02:44.375509+0000","last_fullsized":"2023-06-23T19:02:44.375509+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:41:51.912362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375561+0000","last_change":"2023-06-23T19:02:42.890680+0000","last_active":"2023-06-23T19:02:44.375561+0000","last_peered":"2023-06-23T19:02:44.375561+0000","last_clean":"2023-06-23T19:02:44.375561+0000","last_became_active":"2023-06-23T19:02:42.890295+0000","last_became_peered":"2023-06-23T19:02:42.890295+0000","last_unstale":"2023-06-23T19:02:44.375561+0000","last_undegraded":"2023-06-23T19:02:44.375561+0000","last_fullsized":"2023-06-23T19:02:44.375561+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:31:13.359536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724213+0000","last_change":"2023-06-23T19:02:43.402338+0000","last_active":"2023-06-23T19:02:44.724213+0000","last_peered":"2023-06-23T19:02:44.724213+0000","last_clean":"2023-06-23T19:02:44.724213+0000","last_became_active":"2023-06-23T19:02:43.402031+0000","last_became_peered":"2023-06-23T19:02:43.402031+0000","last_unstale":"2023-06-23T19:02:44.724213+0000","last_undegraded":"2023-06-23T19:02:44.724213+0000","last_fullsized":"2023-06-23T19:02:44.724213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:38.519908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724813+0000","last_change":"2023-06-23T19:02:42.887220+0000","last_active":"2023-06-23T19:02:44.724813+0000","last_peered":"2023-06-23T19:02:44.724813+0000","last_clean":"2023-06-23T19:02:44.724813+0000","last_became_active":"2023-06-23T19:02:42.886868+0000","last_became_peered":"2023-06-23T19:02:42.886868+0000","last_unstale":"2023-06-23T19:02:44.724813+0000","last_undegraded":"2023-06-23T19:02:44.724813+0000","last_fullsized":"2023-06-23T19:02:44.724813+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:29:32.354763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725181+0000","last_change":"2023-06-23T19:02:43.394474+0000","last_active":"2023-06-23T19:02:44.725181+0000","last_peered":"2023-06-23T19:02:44.725181+0000","last_clean":"2023-06-23T19:02:44.725181+0000","last_became_active":"2023-06-23T19:02:43.394113+0000","last_became_peered":"2023-06-23T19:02:43.394113+0000","last_unstale":"2023-06-23T19:02:44.725181+0000","last_undegraded":"2023-06-23T19:02:44.725181+0000","last_fullsized":"2023-06-23T19:02:44.725181+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:04.527287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398469+0000","last_change":"2023-06-23T19:02:42.884554+0000","last_active":"2023-06-23T19:02:44.398469+0000","last_peered":"2023-06-23T19:02:44.398469+0000","last_clean":"2023-06-23T19:02:44.398469+0000","last_became_active":"2023-06-23T19:02:42.884275+0000","last_became_peered":"2023-06-23T19:02:42.884275+0000","last_unstale":"2023-06-23T19:02:44.398469+0000","last_undegraded":"2023-06-23T19:02:44.398469+0000","last_fullsized":"2023-06-23T19:02:44.398469+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:30.000738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398035+0000","last_change":"2023-06-23T19:02:43.396646+0000","last_active":"2023-06-23T19:02:44.398035+0000","last_peered":"2023-06-23T19:02:44.398035+0000","last_clean":"2023-06-23T19:02:44.398035+0000","last_became_active":"2023-06-23T19:02:43.396352+0000","last_became_peered":"2023-06-23T19:02:43.396352+0000","last_unstale":"2023-06-23T19:02:44.398035+0000","last_undegraded":"2023-06-23T19:02:44.398035+0000","last_fullsized":"2023-06-23T19:02:44.398035+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:45.158495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398620+0000","last_change":"2023-06-23T19:02:42.884561+0000","last_active":"2023-06-23T19:02:44.398620+0000","last_peered":"2023-06-23T19:02:44.398620+0000","last_clean":"2023-06-23T19:02:44.398620+0000","last_became_active":"2023-06-23T19:02:42.884240+0000","last_became_peered":"2023-06-23T19:02:42.884240+0000","last_unstale":"2023-06-23T19:02:44.398620+0000","last_undegraded":"2023-06-23T19:02:44.398620+0000","last_fullsized":"2023-06-23T19:02:44.398620+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:37:21.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723586+0000","last_change":"2023-06-23T19:02:43.395618+0000","last_active":"2023-06-23T19:02:44.723586+0000","last_peered":"2023-06-23T19:02:44.723586+0000","last_clean":"2023-06-23T19:02:44.723586+0000","last_became_active":"2023-06-23T19:02:43.395286+0000","last_became_peered":"2023-06-23T19:02:43.395286+0000","last_unstale":"2023-06-23T19:02:44.723586+0000","last_undegraded":"2023-06-23T19:02:44.723586+0000","last_fullsized":"2023-06-23T19:02:44.723586+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:51:46.667751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724361+0000","last_change":"2023-06-23T19:02:42.884674+0000","last_active":"2023-06-23T19:02:44.724361+0000","last_peered":"2023-06-23T19:02:44.724361+0000","last_clean":"2023-06-23T19:02:44.724361+0000","last_became_active":"2023-06-23T19:02:42.883763+0000","last_became_peered":"2023-06-23T19:02:42.883763+0000","last_unstale":"2023-06-23T19:02:44.724361+0000","last_undegraded":"2023-06-23T19:02:44.724361+0000","last_fullsized":"2023-06-23T19:02:44.724361+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:57:05.550906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723672+0000","last_change":"2023-06-23T19:02:43.386350+0000","last_active":"2023-06-23T19:02:44.723672+0000","last_peered":"2023-06-23T19:02:44.723672+0000","last_clean":"2023-06-23T19:02:44.723672+0000","last_became_active":"2023-06-23T19:02:43.386069+0000","last_became_peered":"2023-06-23T19:02:43.386069+0000","last_unstale":"2023-06-23T19:02:44.723672+0000","last_undegraded":"2023-06-23T19:02:44.723672+0000","last_fullsized":"2023-06-23T19:02:44.723672+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:49:35.154198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374822+0000","last_change":"2023-06-23T19:02:42.889204+0000","last_active":"2023-06-23T19:02:44.374822+0000","last_peered":"2023-06-23T19:02:44.374822+0000","last_clean":"2023-06-23T19:02:44.374822+0000","last_became_active":"2023-06-23T19:02:42.888819+0000","last_became_peered":"2023-06-23T19:02:42.888819+0000","last_unstale":"2023-06-23T19:02:44.374822+0000","last_undegraded":"2023-06-23T19:02:44.374822+0000","last_fullsized":"2023-06-23T19:02:44.374822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:44.889242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374786+0000","last_change":"2023-06-23T19:02:43.383467+0000","last_active":"2023-06-23T19:02:44.374786+0000","last_peered":"2023-06-23T19:02:44.374786+0000","last_clean":"2023-06-23T19:02:44.374786+0000","last_became_active":"2023-06-23T19:02:43.383168+0000","last_became_peered":"2023-06-23T19:02:43.383168+0000","last_unstale":"2023-06-23T19:02:44.374786+0000","last_undegraded":"2023-06-23T19:02:44.374786+0000","last_fullsized":"2023-06-23T19:02:44.374786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:52:01.158915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375376+0000","last_change":"2023-06-23T19:02:42.887650+0000","last_active":"2023-06-23T19:02:44.375376+0000","last_peered":"2023-06-23T19:02:44.375376+0000","last_clean":"2023-06-23T19:02:44.375376+0000","last_became_active":"2023-06-23T19:02:42.887327+0000","last_became_peered":"2023-06-23T19:02:42.887327+0000","last_unstale":"2023-06-23T19:02:44.375376+0000","last_undegraded":"2023-06-23T19:02:44.375376+0000","last_fullsized":"2023-06-23T19:02:44.375376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:28:10.991929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.374769+0000","last_change":"2023-06-23T19:02:43.388968+0000","last_active":"2023-06-23T19:02:44.374769+0000","last_peered":"2023-06-23T19:02:44.374769+0000","last_clean":"2023-06-23T19:02:44.374769+0000","last_became_active":"2023-06-23T19:02:43.388694+0000","last_became_peered":"2023-06-23T19:02:43.388694+0000","last_unstale":"2023-06-23T19:02:44.374769+0000","last_undegraded":"2023-06-23T19:02:44.374769+0000","last_fullsized":"2023-06-23T19:02:44.374769+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:06:29.263480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375069+0000","last_change":"2023-06-23T19:02:42.889687+0000","last_active":"2023-06-23T19:02:44.375069+0000","last_peered":"2023-06-23T19:02:44.375069+0000","last_clean":"2023-06-23T19:02:44.375069+0000","last_became_active":"2023-06-23T19:02:42.889440+0000","last_became_peered":"2023-06-23T19:02:42.889440+0000","last_unstale":"2023-06-23T19:02:44.375069+0000","last_undegraded":"2023-06-23T19:02:44.375069+0000","last_fullsized":"2023-06-23T19:02:44.375069+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:09:56.709855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724155+0000","last_change":"2023-06-23T19:00:58.992193+0000","last_active":"2023-06-23T19:02:44.724155+0000","last_peered":"2023-06-23T19:02:44.724155+0000","last_clean":"2023-06-23T19:02:44.724155+0000","last_became_active":"2023-06-23T19:00:58.991974+0000","last_became_peered":"2023-06-23T19:00:58.991974+0000","last_unstale":"2023-06-23T19:02:44.724155+0000","last_undegraded":"2023-06-23T19:02:44.724155+0000","last_fullsized":"2023-06-23T19:02:44.724155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:00:00.508536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724922+0000","last_change":"2023-06-23T19:02:43.402921+0000","last_active":"2023-06-23T19:02:44.724922+0000","last_peered":"2023-06-23T19:02:44.724922+0000","last_clean":"2023-06-23T19:02:44.724922+0000","last_became_active":"2023-06-23T19:02:43.402032+0000","last_became_peered":"2023-06-23T19:02:43.402032+0000","last_unstale":"2023-06-23T19:02:44.724922+0000","last_undegraded":"2023-06-23T19:02:44.724922+0000","last_fullsized":"2023-06-23T19:02:44.724922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:00:17.700963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398373+0000","last_change":"2023-06-23T19:02:42.891573+0000","last_active":"2023-06-23T19:02:44.398373+0000","last_peered":"2023-06-23T19:02:44.398373+0000","last_clean":"2023-06-23T19:02:44.398373+0000","last_became_active":"2023-06-23T19:02:42.891289+0000","last_became_peered":"2023-06-23T19:02:42.891289+0000","last_unstale":"2023-06-23T19:02:44.398373+0000","last_undegraded":"2023-06-23T19:02:44.398373+0000","last_fullsized":"2023-06-23T19:02:44.398373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:55:37.747872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724522+0000","last_change":"2023-06-23T19:00:58.032255+0000","last_active":"2023-06-23T19:02:44.724522+0000","last_peered":"2023-06-23T19:02:44.724522+0000","last_clean":"2023-06-23T19:02:44.724522+0000","last_became_active":"2023-06-23T19:00:58.031815+0000","last_became_peered":"2023-06-23T19:00:58.031815+0000","last_unstale":"2023-06-23T19:02:44.724522+0000","last_undegraded":"2023-06-23T19:02:44.724522+0000","last_fullsized":"2023-06-23T19:02:44.724522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:43.348117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375347+0000","last_change":"2023-06-23T19:02:43.396991+0000","last_active":"2023-06-23T19:02:44.375347+0000","last_peered":"2023-06-23T19:02:44.375347+0000","last_clean":"2023-06-23T19:02:44.375347+0000","last_became_active":"2023-06-23T19:02:43.396725+0000","last_became_peered":"2023-06-23T19:02:43.396725+0000","last_unstale":"2023-06-23T19:02:44.375347+0000","last_undegraded":"2023-06-23T19:02:44.375347+0000","last_fullsized":"2023-06-23T19:02:44.375347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:34:06.311724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375978+0000","last_change":"2023-06-23T19:02:42.893342+0000","last_active":"2023-06-23T19:02:44.375978+0000","last_peered":"2023-06-23T19:02:44.375978+0000","last_clean":"2023-06-23T19:02:44.375978+0000","last_became_active":"2023-06-23T19:02:42.892793+0000","last_became_peered":"2023-06-23T19:02:42.892793+0000","last_unstale":"2023-06-23T19:02:44.375978+0000","last_undegraded":"2023-06-23T19:02:44.375978+0000","last_fullsized":"2023-06-23T19:02:44.375978+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:39:59.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723375+0000","last_change":"2023-06-23T19:00:58.810848+0000","last_active":"2023-06-23T19:02:44.723375+0000","last_peered":"2023-06-23T19:02:44.723375+0000","last_clean":"2023-06-23T19:02:44.723375+0000","last_became_active":"2023-06-23T19:00:58.810530+0000","last_became_peered":"2023-06-23T19:00:58.810530+0000","last_unstale":"2023-06-23T19:02:44.723375+0000","last_undegraded":"2023-06-23T19:02:44.723375+0000","last_fullsized":"2023-06-23T19:02:44.723375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:43.495720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375620+0000","last_change":"2023-06-23T19:02:43.390188+0000","last_active":"2023-06-23T19:02:44.375620+0000","last_peered":"2023-06-23T19:02:44.375620+0000","last_clean":"2023-06-23T19:02:44.375620+0000","last_became_active":"2023-06-23T19:02:43.389894+0000","last_became_peered":"2023-06-23T19:02:43.389894+0000","last_unstale":"2023-06-23T19:02:44.375620+0000","last_undegraded":"2023-06-23T19:02:44.375620+0000","last_fullsized":"2023-06-23T19:02:44.375620+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:09:46.104708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725167+0000","last_change":"2023-06-23T19:02:42.889466+0000","last_active":"2023-06-23T19:02:44.725167+0000","last_peered":"2023-06-23T19:02:44.725167+0000","last_clean":"2023-06-23T19:02:44.725167+0000","last_became_active":"2023-06-23T19:02:42.889189+0000","last_became_peered":"2023-06-23T19:02:42.889189+0000","last_unstale":"2023-06-23T19:02:44.725167+0000","last_undegraded":"2023-06-23T19:02:44.725167+0000","last_fullsized":"2023-06-23T19:02:44.725167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:07:36.476890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724643+0000","last_change":"2023-06-23T19:00:58.032352+0000","last_active":"2023-06-23T19:02:44.724643+0000","last_peered":"2023-06-23T19:02:44.724643+0000","last_clean":"2023-06-23T19:02:44.724643+0000","last_became_active":"2023-06-23T19:00:58.031905+0000","last_became_peered":"2023-06-23T19:00:58.031905+0000","last_unstale":"2023-06-23T19:02:44.724643+0000","last_undegraded":"2023-06-23T19:02:44.724643+0000","last_fullsized":"2023-06-23T19:02:44.724643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:27:46.377670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375571+0000","last_change":"2023-06-23T19:00:50.002765+0000","last_active":"2023-06-23T19:02:44.375571+0000","last_peered":"2023-06-23T19:02:44.375571+0000","last_clean":"2023-06-23T19:02:44.375571+0000","last_became_active":"2023-06-23T19:00:50.002445+0000","last_became_peered":"2023-06-23T19:00:50.002445+0000","last_unstale":"2023-06-23T19:02:44.375571+0000","last_undegraded":"2023-06-23T19:02:44.375571+0000","last_fullsized":"2023-06-23T19:02:44.375571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:48.989242+0000","last_clean_scrub_stamp":"2023-06-23T19:00:48.989242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:30:52.195750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375858+0000","last_change":"2023-06-23T19:02:43.389986+0000","last_active":"2023-06-23T19:02:44.375858+0000","last_peered":"2023-06-23T19:02:44.375858+0000","last_clean":"2023-06-23T19:02:44.375858+0000","last_became_active":"2023-06-23T19:02:43.389721+0000","last_became_peered":"2023-06-23T19:02:43.389721+0000","last_unstale":"2023-06-23T19:02:44.375858+0000","last_undegraded":"2023-06-23T19:02:44.375858+0000","last_fullsized":"2023-06-23T19:02:44.375858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:02.650153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724115+0000","last_change":"2023-06-23T19:02:42.892907+0000","last_active":"2023-06-23T19:02:44.724115+0000","last_peered":"2023-06-23T19:02:44.724115+0000","last_clean":"2023-06-23T19:02:44.724115+0000","last_became_active":"2023-06-23T19:02:42.892670+0000","last_became_peered":"2023-06-23T19:02:42.892670+0000","last_unstale":"2023-06-23T19:02:44.724115+0000","last_undegraded":"2023-06-23T19:02:44.724115+0000","last_fullsized":"2023-06-23T19:02:44.724115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:59:29.148255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375721+0000","last_change":"2023-06-23T19:00:58.034045+0000","last_active":"2023-06-23T19:02:44.375721+0000","last_peered":"2023-06-23T19:02:44.375721+0000","last_clean":"2023-06-23T19:02:44.375721+0000","last_became_active":"2023-06-23T19:00:58.033654+0000","last_became_peered":"2023-06-23T19:00:58.033654+0000","last_unstale":"2023-06-23T19:02:44.375721+0000","last_undegraded":"2023-06-23T19:02:44.375721+0000","last_fullsized":"2023-06-23T19:02:44.375721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:27:46.377670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.724309+0000","last_change":"2023-06-23T19:02:43.394471+0000","last_active":"2023-06-23T19:02:44.724309+0000","last_peered":"2023-06-23T19:02:44.724309+0000","last_clean":"2023-06-23T19:02:44.724309+0000","last_became_active":"2023-06-23T19:02:43.394192+0000","last_became_peered":"2023-06-23T19:02:43.394192+0000","last_unstale":"2023-06-23T19:02:44.724309+0000","last_undegraded":"2023-06-23T19:02:44.724309+0000","last_fullsized":"2023-06-23T19:02:44.724309+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:30.439653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723888+0000","last_change":"2023-06-23T19:02:42.891170+0000","last_active":"2023-06-23T19:02:44.723888+0000","last_peered":"2023-06-23T19:02:44.723888+0000","last_clean":"2023-06-23T19:02:44.723888+0000","last_became_active":"2023-06-23T19:02:42.890891+0000","last_became_peered":"2023-06-23T19:02:42.890891+0000","last_unstale":"2023-06-23T19:02:44.723888+0000","last_undegraded":"2023-06-23T19:02:44.723888+0000","last_fullsized":"2023-06-23T19:02:44.723888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:52:00.154380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.376068+0000","last_change":"2023-06-23T19:00:58.992645+0000","last_active":"2023-06-23T19:02:44.376068+0000","last_peered":"2023-06-23T19:02:44.376068+0000","last_clean":"2023-06-23T19:02:44.376068+0000","last_became_active":"2023-06-23T19:00:58.992291+0000","last_became_peered":"2023-06-23T19:00:58.992291+0000","last_unstale":"2023-06-23T19:02:44.376068+0000","last_undegraded":"2023-06-23T19:02:44.376068+0000","last_fullsized":"2023-06-23T19:02:44.376068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:08:56.730997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398470+0000","last_change":"2023-06-23T19:02:43.395738+0000","last_active":"2023-06-23T19:02:44.398470+0000","last_peered":"2023-06-23T19:02:44.398470+0000","last_clean":"2023-06-23T19:02:44.398470+0000","last_became_active":"2023-06-23T19:02:43.395399+0000","last_became_peered":"2023-06-23T19:02:43.395399+0000","last_unstale":"2023-06-23T19:02:44.398470+0000","last_undegraded":"2023-06-23T19:02:44.398470+0000","last_fullsized":"2023-06-23T19:02:44.398470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:03:35.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375266+0000","last_change":"2023-06-23T19:02:42.889986+0000","last_active":"2023-06-23T19:02:44.375266+0000","last_peered":"2023-06-23T19:02:44.375266+0000","last_clean":"2023-06-23T19:02:44.375266+0000","last_became_active":"2023-06-23T19:02:42.889346+0000","last_became_peered":"2023-06-23T19:02:42.889346+0000","last_unstale":"2023-06-23T19:02:44.375266+0000","last_undegraded":"2023-06-23T19:02:44.375266+0000","last_fullsized":"2023-06-23T19:02:44.375266+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:51:30.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.723746+0000","last_change":"2023-06-23T19:00:58.034828+0000","last_active":"2023-06-23T19:02:44.723746+0000","last_peered":"2023-06-23T19:02:44.723746+0000","last_clean":"2023-06-23T19:02:44.723746+0000","last_became_active":"2023-06-23T19:00:58.034502+0000","last_became_peered":"2023-06-23T19:00:58.034502+0000","last_unstale":"2023-06-23T19:02:44.723746+0000","last_undegraded":"2023-06-23T19:02:44.723746+0000","last_fullsized":"2023-06-23T19:02:44.723746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:31.089889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.398191+0000","last_change":"2023-06-23T19:02:43.385089+0000","last_active":"2023-06-23T19:02:44.398191+0000","last_peered":"2023-06-23T19:02:44.398191+0000","last_clean":"2023-06-23T19:02:44.398191+0000","last_became_active":"2023-06-23T19:02:43.384796+0000","last_became_peered":"2023-06-23T19:02:43.384796+0000","last_unstale":"2023-06-23T19:02:44.398191+0000","last_undegraded":"2023-06-23T19:02:44.398191+0000","last_fullsized":"2023-06-23T19:02:44.398191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:42.864224+0000","last_clean_scrub_stamp":"2023-06-23T19:02:42.864224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:57:06.209968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.375307+0000","last_change":"2023-06-23T19:02:42.893057+0000","last_active":"2023-06-23T19:02:44.375307+0000","last_peered":"2023-06-23T19:02:44.375307+0000","last_clean":"2023-06-23T19:02:44.375307+0000","last_became_active":"2023-06-23T19:02:42.891406+0000","last_became_peered":"2023-06-23T19:02:42.891406+0000","last_unstale":"2023-06-23T19:02:44.375307+0000","last_undegraded":"2023-06-23T19:02:44.375307+0000","last_fullsized":"2023-06-23T19:02:44.375307+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:02:41.859689+0000","last_clean_scrub_stamp":"2023-06-23T19:02:41.859689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:29.435118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-23T19:02:44.725059+0000","last_change":"2023-06-23T19:00:58.035530+0000","last_active":"2023-06-23T19:02:44.725059+0000","last_peered":"2023-06-23T19:02:44.725059+0000","last_clean":"2023-06-23T19:02:44.725059+0000","last_became_active":"2023-06-23T19:00:58.035130+0000","last_became_peered":"2023-06-23T19:00:58.035130+0000","last_unstale":"2023-06-23T19:02:44.725059+0000","last_undegraded":"2023-06-23T19:02:44.725059+0000","last_fullsized":"2023-06-23T19:02:44.725059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T19:00:57.015621+0000","last_clean_scrub_stamp":"2023-06-23T19:00:57.015621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:46:47.648237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476763,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1101824,"data_stored":815168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.252}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.28799999999999998}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.435},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.628}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.61599999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":224836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.65000000000000002}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.63300000000000001}]},{"osd":4,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.94999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":520192,"data_stored":226352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.434},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":5.6539999999999999,"5min":5.6539999999999999,"15min":5.6539999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.503}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.98499999999999999}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Jun 23 19:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.53500000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.879},{"interface":"front","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92700000000000005,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.94299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":225438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Jun 23 19:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.50900000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.85899999999999999,"5min":0.879,"15min":0.879},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90100000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Jun 23 19:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88100000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.628},{"interface":"front","average":{"1min":0.748,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.55800000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Jun 23 19:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.86599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93799999999999994,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.69399999999999995}]},{"osd":4,"last update":"Fri Jun 23 19:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92600000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jun 23 19:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94699999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.70199999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96499999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Jun 23 19:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.51400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96199999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.998,"5min":1.044,"15min":1.044},"last":0.72999999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":224836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.376},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.754},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":9.6329999999999991,"5min":9.6329999999999991,"15min":9.6329999999999991},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Jun 23 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.68700000000000006}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":516096,"data_stored":225404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.432}]},{"osd":2,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82499999999999996}]},{"osd":5,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Jun 23 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.69999999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":516096,"data_stored":226330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.55100000000000005}]},{"osd":2,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72799999999999998}]},{"osd":3,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.745},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Jun 23 19:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.97499999999999998}]}]},{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1101824,"data_stored":815224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.992,"5min":7.992,"15min":7.992},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.91900000000000004}]},{"osd":1,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":7.9500000000000002,"5min":7.9500000000000002,"15min":7.9500000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":10.835000000000001,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.749}]},{"osd":2,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":0.88200000000000001}]},{"osd":4,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.86199999999999999}]},{"osd":6,"last update":"Fri Jun 23 19:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T19:02:53.139 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-23T19:02:53.140 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-23T19:02:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.368+0000 7fe4d19ff700 1 Processor -- start 2023-06-23T19:02:53.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.368+0000 7fe4d19ff700 1 -- start start 2023-06-23T19:02:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.369+0000 7fe4d19ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe4cc0b51d0 0x7fe4cc0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.369+0000 7fe4d19ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc0b5ec0 con 0x7fe4cc0d0a60 2023-06-23T19:02:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.369+0000 7fe4d19ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc0cd9d0 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.369+0000 7fe4d19ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0d0060 con 0x7fe4cc0b51d0 2023-06-23T19:02:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.369+0000 7fe4cb7fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe4cc0b51d0 0x7fe4cc0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.369+0000 7fe4caffd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe4cc0d0a60 0x7fe4cc0d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53728/0 (socket says 172.21.15.136:53728) 2023-06-23T19:02:53.374 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.369+0000 7fe4caffd700 1 -- 172.21.15.136:0/3376987196 learned_addr learned my addr 172.21.15.136:0/3376987196 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:53.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.370+0000 7fe4cb7fe700 1 -- 172.21.15.136:0/3376987196 >> v1:172.21.15.178:6789/0 conn(0x7fe4cc0b5a70 legacy=0x7fe4cc0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.370+0000 7fe4cb7fe700 1 -- 172.21.15.136:0/3376987196 >> v1:172.21.15.136:6789/0 conn(0x7fe4cc0d0a60 legacy=0x7fe4cc0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.370+0000 7fe4cb7fe700 1 -- 172.21.15.136:0/3376987196 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0b5610 con 0x7fe4cc0b51d0 2023-06-23T19:02:53.375 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.370+0000 7fe4ca7fc700 1 -- 172.21.15.136:0/3376987196 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740440940 0 0) 0x7fe4cc0b5ec0 con 0x7fe4cc0d0a60 2023-06-23T19:02:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.370+0000 7fe4cb7fe700 1 --2- 172.21.15.136:0/3376987196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b51d0 0x7fe4cc0cf910 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009d90 tx=0x7fe4c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ada8d7a39930285 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.370+0000 7fe4ca7fc700 1 -- 172.21.15.136:0/3376987196 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400e070 con 0x7fe4cc0b51d0 2023-06-23T19:02:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.370+0000 7fe4ca7fc700 1 -- 172.21.15.136:0/3376987196 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c400bbd0 con 0x7fe4cc0b51d0 2023-06-23T19:02:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.370+0000 7fe4ca7fc700 1 -- 172.21.15.136:0/3376987196 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4012430 con 0x7fe4cc0b51d0 2023-06-23T19:02:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.371+0000 7fe4d19ff700 1 -- 172.21.15.136:0/3376987196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b51d0 msgr2=0x7fe4cc0cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.371+0000 7fe4d19ff700 1 --2- 172.21.15.136:0/3376987196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b51d0 0x7fe4cc0cf910 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009d90 tx=0x7fe4c400b330 comp rx=0 tx=0).stop 2023-06-23T19:02:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.371+0000 7fe4d19ff700 1 -- 172.21.15.136:0/3376987196 shutdown_connections 2023-06-23T19:02:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.371+0000 7fe4d19ff700 1 --2- 172.21.15.136:0/3376987196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b51d0 0x7fe4cc0cf910 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.371+0000 7fe4d19ff700 1 -- 172.21.15.136:0/3376987196 >> 172.21.15.136:0/3376987196 conn(0x7fe4cc071620 msgr2=0x7fe4cc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.371+0000 7fe4d19ff700 1 -- 172.21.15.136:0/3376987196 shutdown_connections 2023-06-23T19:02:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.371+0000 7fe4d19ff700 1 -- 172.21.15.136:0/3376987196 wait complete. 2023-06-23T19:02:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.373+0000 7fe4d19ff700 1 Processor -- start 2023-06-23T19:02:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.373+0000 7fe4d19ff700 1 -- start start 2023-06-23T19:02:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4d19ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc0b51d0 0x7fe4cc15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4d19ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b5a70 0x7fe4cc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4d19ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0d0a60 0x7fe4cc0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4d19ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0ccb80 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4d19ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc15ac40 con 0x7fe4cc0d0a60 2023-06-23T19:02:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4d19ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc15a960 con 0x7fe4cc0b51d0 2023-06-23T19:02:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4c3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b5a70 0x7fe4cc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4c3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b5a70 0x7fe4cc15a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56000/0 (socket says 172.21.15.136:56000) 2023-06-23T19:02:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4c3fff700 1 -- 172.21.15.136:0/2132117484 learned_addr learned my addr 172.21.15.136:0/2132117484 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4c3fff700 1 -- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc0b51d0 msgr2=0x7fe4cc15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4cb7fe700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0d0a60 0x7fe4cc0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4caffd700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc0b51d0 0x7fe4cc15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4c3fff700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc0b51d0 0x7fe4cc15d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4c3fff700 1 -- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0d0a60 msgr2=0x7fe4cc0cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4c3fff700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0d0a60 0x7fe4cc0cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4c3fff700 1 -- 172.21.15.136:0/2132117484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c4009a70 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4cb7fe700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0d0a60 0x7fe4cc0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.374+0000 7fe4caffd700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc0b51d0 0x7fe4cc15d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T19:02:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.375+0000 7fe4c3fff700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b5a70 0x7fe4cc15a2a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400c4e0 tx=0x7fe4b400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:53.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.375+0000 7fe4c8ff9700 1 -- 172.21.15.136:0/2132117484 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40052d0 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.375+0000 7fe4c8ff9700 1 -- 172.21.15.136:0/2132117484 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4005430 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.375+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc0c9e20 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.375+0000 7fe4c8ff9700 1 -- 172.21.15.136:0/2132117484 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40038c0 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.375+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc0ca3e0 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.376+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc04ea20 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.377+0000 7fe4c8ff9700 1 -- 172.21.15.136:0/2132117484 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4b4003a20 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.378+0000 7fe4c8ff9700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4ac06ace0 0x7fe4ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.378+0000 7fe4c8ff9700 1 -- 172.21.15.136:0/2132117484 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe4b4088a80 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.378+0000 7fe4caffd700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4ac06ace0 0x7fe4ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.378+0000 7fe4caffd700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4ac06ace0 0x7fe4ac06d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000f60 tx=0x7fe4bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:53.385 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.382+0000 7fe4c8ff9700 1 -- 172.21.15.136:0/2132117484 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4b4053a80 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.661 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.657+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe4cc0b69a0 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.665 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.662+0000 7fe4c8ff9700 1 -- 172.21.15.136:0/2132117484 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe4b40170b0 con 0x7fe4cc0b5a70 2023-06-23T19:02:53.666 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2023-06-23T19:02:53.666 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCw65Vk9m0xIhAArVabtYN8Q1ol3rPOb8C1Fw== 2023-06-23T19:02:53.666 INFO:teuthology.orchestra.run.smithi136.stdout: caps mds = "allow" 2023-06-23T19:02:53.667 INFO:teuthology.orchestra.run.smithi136.stdout: caps mon = "allow r" 2023-06-23T19:02:53.667 INFO:teuthology.orchestra.run.smithi136.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-06-23T19:02:53.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4ac06ace0 msgr2=0x7fe4ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4ac06ace0 0x7fe4ac06d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000f60 tx=0x7fe4bc009040 comp rx=0 tx=0).stop 2023-06-23T19:02:53.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b5a70 msgr2=0x7fe4cc15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.668 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b5a70 0x7fe4cc15a2a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400c4e0 tx=0x7fe4b400c8a0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 shutdown_connections 2023-06-23T19:02:53.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fe4ac06ace0 0x7fe4ac06d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0d0a60 0x7fe4cc0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc0b51d0 0x7fe4cc15d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 --2- 172.21.15.136:0/2132117484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc0b5a70 0x7fe4cc15a2a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 >> 172.21.15.136:0/2132117484 conn(0x7fe4cc071620 msgr2=0x7fe4cc0b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:53.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.664+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 shutdown_connections 2023-06-23T19:02:53.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.665+0000 7fe4d19ff700 1 -- 172.21.15.136:0/2132117484 wait complete. 2023-06-23T19:02:53.670 INFO:teuthology.orchestra.run.smithi136.stderr:updated caps for client.0 2023-06-23T19:02:53.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.876+0000 7f41865ff700 1 Processor -- start 2023-06-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.876+0000 7f41865ff700 1 -- start start 2023-06-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.877+0000 7f41865ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f41800b5980 0x7f4180166f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.877+0000 7f41865ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800ced80 con 0x7f418015c380 2023-06-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.877+0000 7f41865ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800d1760 con 0x7f41800b4cf0 2023-06-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.877+0000 7f41865ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800b5e00 con 0x7f41800b5980 2023-06-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.877+0000 7f417ffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f418015c380 0x7f41800cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53732/0 (socket says 172.21.15.136:53732) 2023-06-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417ffff700 1 -- 172.21.15.136:0/1253011629 learned_addr learned my addr 172.21.15.136:0/1253011629 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f4184b9c700 1 --2- 172.21.15.136:0/1253011629 >> v2:172.21.15.178:3300/0 conn(0x7f41800b5980 0x7f4180166f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057566497 0 0) 0x7f41800ced80 con 0x7f418015c380 2023-06-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41680035b0 con 0x7f418015c380 2023-06-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1922970480 0 0) 0x7f41680035b0 con 0x7f418015c380 2023-06-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 >> v2:172.21.15.178:3300/0 conn(0x7f41800b5980 msgr2=0x7f4180166f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 --2- 172.21.15.136:0/1253011629 >> v2:172.21.15.178:3300/0 conn(0x7f41800b5980 0x7f4180166f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 >> v1:172.21.15.178:6789/0 conn(0x7f41800b4cf0 legacy=0x7f41800cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800d1480 con 0x7f418015c380 2023-06-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7f4170001670 con 0x7f418015c380 2023-06-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 >> v1:172.21.15.136:6789/0 conn(0x7f418015c380 legacy=0x7f41800cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4168003a50 0x7f4168003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4168004850 0x7f4168004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41680052d0 0x7f416800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800b5e00 con 0x7f4168004850 2023-06-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416800c200 con 0x7f41680052d0 2023-06-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.878+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416800c3c0 con 0x7f4168003a50 2023-06-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f417f7fe700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4168004850 0x7f4168004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f4184b9c700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41680052d0 0x7f416800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f417ffff700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4168003a50 0x7f4168003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f417f7fe700 1 -- 172.21.15.136:0/1253011629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4168003a50 msgr2=0x7f4168003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f417f7fe700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4168003a50 0x7f4168003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f417f7fe700 1 -- 172.21.15.136:0/1253011629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41680052d0 msgr2=0x7f416800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f417f7fe700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41680052d0 0x7f416800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f417f7fe700 1 -- 172.21.15.136:0/1253011629 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41680035b0 con 0x7f4168004850 2023-06-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f4184b9c700 1 -- 172.21.15.136:0/1253011629 reap_dead start 2023-06-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.879+0000 7f417f7fe700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4168004850 0x7f4168004cc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f41800b5160 tx=0x7f4168005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc154660813fe40 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740052d0 con 0x7f4168004850 2023-06-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174005450 con 0x7f4168004850 2023-06-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f417effd700 1 -- 172.21.15.136:0/1253011629 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740038c0 con 0x7f4168004850 2023-06-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f41865ff700 1 -- 172.21.15.136:0/1253011629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4168004850 msgr2=0x7f4168004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f41865ff700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4168004850 0x7f4168004cc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f41800b5160 tx=0x7f4168005880 comp rx=0 tx=0).stop 2023-06-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f41865ff700 1 -- 172.21.15.136:0/1253011629 shutdown_connections 2023-06-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f41865ff700 1 --2- 172.21.15.136:0/1253011629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4168004850 0x7f4168004cc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f41865ff700 1 -- 172.21.15.136:0/1253011629 >> 172.21.15.136:0/1253011629 conn(0x7f4180071620 msgr2=0x7f41800719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f41865ff700 1 -- 172.21.15.136:0/1253011629 shutdown_connections 2023-06-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.880+0000 7f41865ff700 1 -- 172.21.15.136:0/1253011629 wait complete. 2023-06-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.882+0000 7f41865ff700 1 Processor -- start 2023-06-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.882+0000 7f41865ff700 1 -- start start 2023-06-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.883+0000 7f41865ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168004850 0x7f418015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.883+0000 7f41865ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41800b7ff0 0x7f41800b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.883+0000 7f41865ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41800b73b0 0x7f41800cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.883+0000 7f41865ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418015ae00 con 0x7f41800b7ff0 2023-06-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.883+0000 7f41865ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418015a1f0 con 0x7f4168004850 2023-06-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.883+0000 7f41865ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418015a4d0 con 0x7f41800b73b0 2023-06-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.883+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41800b7ff0 0x7f41800b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.883+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41800b7ff0 0x7f41800b6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56022/0 (socket says 172.21.15.136:56022) 2023-06-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.883+0000 7f417f7fe700 1 -- 172.21.15.136:0/2506569307 learned_addr learned my addr 172.21.15.136:0/2506569307 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417ffff700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168004850 0x7f418015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f4184b9c700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41800b73b0 0x7f41800cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417f7fe700 1 -- 172.21.15.136:0/2506569307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41800b73b0 msgr2=0x7f41800cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417f7fe700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41800b73b0 0x7f41800cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417f7fe700 1 -- 172.21.15.136:0/2506569307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168004850 msgr2=0x7f418015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417f7fe700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168004850 0x7f418015b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417f7fe700 1 -- 172.21.15.136:0/2506569307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418015a7b0 con 0x7f41800b7ff0 2023-06-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417f7fe700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41800b7ff0 0x7f41800b6e70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4174005040 tx=0x7f4174001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417cff9700 1 -- 172.21.15.136:0/2506569307 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174001290 con 0x7f41800b7ff0 2023-06-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417cff9700 1 -- 172.21.15.136:0/2506569307 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174007040 con 0x7f41800b7ff0 2023-06-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f417cff9700 1 -- 172.21.15.136:0/2506569307 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740073d0 con 0x7f41800b7ff0 2023-06-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418015aa90 con 0x7f41800b7ff0 2023-06-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.884+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418015b7d0 con 0x7f41800b7ff0 2023-06-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.885+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418015af70 con 0x7f41800b7ff0 2023-06-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.886+0000 7f417cff9700 1 -- 172.21.15.136:0/2506569307 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4174007530 con 0x7f41800b7ff0 2023-06-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.888+0000 7f417cff9700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f416c06ad10 0x7f416c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.888+0000 7f417cff9700 1 -- 172.21.15.136:0/2506569307 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4174089ff0 con 0x7f41800b7ff0 2023-06-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.888+0000 7f417ffff700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f416c06ad10 0x7f416c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.888+0000 7f417ffff700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f416c06ad10 0x7f416c06d1c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4170000c00 tx=0x7f4170009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:53.892+0000 7f417cff9700 1 -- 172.21.15.136:0/2506569307 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4174055190 con 0x7f41800b7ff0 2023-06-23T19:02:54.139 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.135+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4180073910 con 0x7f41800b7ff0 2023-06-23T19:02:54.139 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.135+0000 7f417cff9700 1 -- 172.21.15.136:0/2506569307 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f4174017090 con 0x7f41800b7ff0 2023-06-23T19:02:54.140 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:02:54.140 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3115197879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":3115197879},{"type":"v1","addr":"172.21.15.136:6837","nonce":3115197879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1648844207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1648844207},{"type":"v1","addr":"172.21.15.178:6835","nonce":1648844207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/1238300343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1238300343},{"type":"v1","addr":"172.21.15.136:6836","nonce":1238300343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T19:02:43.363636+0000","modified":"2023-06-23T19:02:46.377337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5358":{"gid":5358,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.178:6834/1813513530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1813513530},{"type":"v1","addr":"172.21.15.178:6834","nonce":1813513530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-23T19:02:54.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f416c06ad10 msgr2=0x7f416c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f416c06ad10 0x7f416c06d1c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4170000c00 tx=0x7f4170009040 comp rx=0 tx=0).stop 2023-06-23T19:02:54.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41800b7ff0 msgr2=0x7f41800b6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41800b7ff0 0x7f41800b6e70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4174005040 tx=0x7f4174001120 comp rx=0 tx=0).stop 2023-06-23T19:02:54.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 shutdown_connections 2023-06-23T19:02:54.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f416c06ad10 0x7f416c06d1c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168004850 0x7f418015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41800b73b0 0x7f41800cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.144 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 --2- 172.21.15.136:0/2506569307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41800b7ff0 0x7f41800b6e70 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.144 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 >> 172.21.15.136:0/2506569307 conn(0x7f4180071620 msgr2=0x7f41800b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:54.144 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 shutdown_connections 2023-06-23T19:02:54.144 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.138+0000 7f41865ff700 1 -- 172.21.15.136:0/2506569307 wait complete. 2023-06-23T19:02:54.145 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 17 2023-06-23T19:02:54.562 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-23T19:02:43.363636+0000', 'modified': '2023-06-23T19:02:46.377337+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5358}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5358': {'gid': 5358, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.178:6834/1813513530', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 1813513530}, {'type': 'v1', 'addr': '172.21.15.178:6834', 'nonce': 1813513530}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-23T19:02:54.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-23T19:02:54.564 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-23T19:02:54.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.756+0000 7f40bb5ff700 1 Processor -- start 2023-06-23T19:02:54.761 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.756+0000 7f40bb5ff700 1 -- start start 2023-06-23T19:02:54.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.757+0000 7f40bb5ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40b4069ef0 0x7f40b406a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.757+0000 7f40bb5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b40c96f0 0x7f40b40c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.757+0000 7f40bb5ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b406e190 con 0x7f40b4158550 2023-06-23T19:02:54.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40bb5ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b406a8d0 con 0x7f40b4069ef0 2023-06-23T19:02:54.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40bb5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40c8ce0 con 0x7f40b40c96f0 2023-06-23T19:02:54.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b9b9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b40c96f0 0x7f40b40c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b8b9a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40b4069ef0 0x7f40b406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b8b9a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40b4069ef0 0x7f40b406a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:42228/0 (socket says 172.21.15.136:42228) 2023-06-23T19:02:54.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b9b9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b40c96f0 0x7f40b40c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:48712/0 (socket says 172.21.15.136:48712) 2023-06-23T19:02:54.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b8b9a700 1 -- 172.21.15.136:0/1464866444 learned_addr learned my addr 172.21.15.136:0/1464866444 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:54.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b939b700 1 --1- 172.21.15.136:0/1464866444 >> v1:172.21.15.178:6789/0 conn(0x7f40b4158550 0x7f40b406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:40120/0 (socket says 172.21.15.136:40120) 2023-06-23T19:02:54.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1464866444 >> v2:172.21.15.178:3300/0 conn(0x7f40b4069ef0 msgr2=0x7f40b406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:54.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/1464866444 >> v2:172.21.15.178:3300/0 conn(0x7f40b4069ef0 0x7f40b406a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1464866444 >> v1:172.21.15.178:6789/0 conn(0x7f40b4158550 legacy=0x7f40b406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1464866444 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b40ccdc0 con 0x7f40b40c96f0 2023-06-23T19:02:54.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.758+0000 7f40b8b9a700 1 --2- 172.21.15.136:0/1464866444 >> v2:172.21.15.178:3300/0 conn(0x7f40b4069ef0 0x7f40b406a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:02:54.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.759+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/1464866444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b40c96f0 0x7f40b40c9b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00aed0 tx=0x7f40ac00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3a16b9d66bd276a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:54.768 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.759+0000 7f40abfff700 1 -- 172.21.15.136:0/1464866444 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00f070 con 0x7f40b40c96f0 2023-06-23T19:02:54.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.759+0000 7f40abfff700 1 -- 172.21.15.136:0/1464866444 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac00a2e0 con 0x7f40b40c96f0 2023-06-23T19:02:54.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.759+0000 7f40abfff700 1 -- 172.21.15.136:0/1464866444 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00cbd0 con 0x7f40b40c96f0 2023-06-23T19:02:54.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.759+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1464866444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b40c96f0 msgr2=0x7f40b40c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.759+0000 7f40bb5ff700 1 --2- 172.21.15.136:0/1464866444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b40c96f0 0x7f40b40c9b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00aed0 tx=0x7f40ac00c330 comp rx=0 tx=0).stop 2023-06-23T19:02:54.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.760+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1464866444 shutdown_connections 2023-06-23T19:02:54.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.760+0000 7f40bb5ff700 1 --2- 172.21.15.136:0/1464866444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b40c96f0 0x7f40b40c9b70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.760+0000 7f40bb5ff700 1 --2- 172.21.15.136:0/1464866444 >> v2:172.21.15.178:3300/0 conn(0x7f40b4069ef0 0x7f40b406a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.760+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1464866444 >> 172.21.15.136:0/1464866444 conn(0x7f40b40b0ef0 msgr2=0x7f40b40ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:54.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.760+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1464866444 shutdown_connections 2023-06-23T19:02:54.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.760+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1464866444 wait complete. 2023-06-23T19:02:54.774 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.762+0000 7f40bb5ff700 1 Processor -- start 2023-06-23T19:02:54.774 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.762+0000 7f40bb5ff700 1 -- start start 2023-06-23T19:02:54.774 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.763+0000 7f40bb5ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b4069ef0 0x7f40b4153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.774 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40bb5ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40b40c96f0 0x7f40b40701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.774 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40bb5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4158550 0x7f40b4070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.774 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40bb5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4154050 con 0x7f40b4158550 2023-06-23T19:02:54.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40bb5ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b415b580 con 0x7f40b40c96f0 2023-06-23T19:02:54.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40bb5ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b415b860 con 0x7f40b4069ef0 2023-06-23T19:02:54.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b9b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4158550 0x7f40b4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b9b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4158550 0x7f40b4070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56030/0 (socket says 172.21.15.136:56030) 2023-06-23T19:02:54.775 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1475811927 learned_addr learned my addr 172.21.15.136:0/1475811927 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:54.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b939b700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b4069ef0 0x7f40b4153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b8b9a700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40b40c96f0 0x7f40b40701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1475811927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b4069ef0 msgr2=0x7f40b4153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b4069ef0 0x7f40b4153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1475811927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40b40c96f0 msgr2=0x7f40b40701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40b40c96f0 0x7f40b40701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.764+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1475811927 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a4009550 con 0x7f40b4158550 2023-06-23T19:02:54.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.765+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4158550 0x7f40b4070720 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c370 tx=0x7f40ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:54.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.765+0000 7f40a9ffb700 1 -- 172.21.15.136:0/1475811927 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac004450 con 0x7f40b4158550 2023-06-23T19:02:54.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.765+0000 7f40a9ffb700 1 -- 172.21.15.136:0/1475811927 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac0045b0 con 0x7f40b4158550 2023-06-23T19:02:54.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.765+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1475811927 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac00ab80 con 0x7f40b4158550 2023-06-23T19:02:54.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.765+0000 7f40a9ffb700 1 -- 172.21.15.136:0/1475811927 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac004960 con 0x7f40b4158550 2023-06-23T19:02:54.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.765+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1475811927 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b41589c0 con 0x7f40b4158550 2023-06-23T19:02:54.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.767+0000 7f40a9ffb700 1 -- 172.21.15.136:0/1475811927 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40ac01c430 con 0x7f40b4158550 2023-06-23T19:02:54.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.768+0000 7f40a9ffb700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f409806ace0 0x7f409806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.768+0000 7f40a9ffb700 1 -- 172.21.15.136:0/1475811927 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f40ac08ab00 con 0x7f40b4158550 2023-06-23T19:02:54.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.768+0000 7f40b939b700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f409806ace0 0x7f409806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.780 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.769+0000 7f40b939b700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f409806ace0 0x7f409806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40b0000f60 tx=0x7f40b0007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:54.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.770+0000 7f40cee6db80 1 Processor -- start 2023-06-23T19:02:54.789 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.770+0000 7f40cee6db80 1 -- start start 2023-06-23T19:02:54.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.771+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859bf360 0x55e9859bf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.771+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859e7190 0x55e9859e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.771+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bcb50 0x55e9859e9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.771+0000 7f40cee6db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9858bfc60 con 0x55e9859bcb50 2023-06-23T19:02:54.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.771+0000 7f40cee6db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9859129f0 con 0x55e9859e7190 2023-06-23T19:02:54.791 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.771+0000 7f40cee6db80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e98590be80 con 0x55e9859bf360 2023-06-23T19:02:54.791 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.771+0000 7f40b9b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bcb50 0x55e9859e9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.791 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.771+0000 7f40b9b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bcb50 0x55e9859e9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56036/0 (socket says 172.21.15.136:56036) 2023-06-23T19:02:54.791 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.771+0000 7f40b9b9c700 1 -- 172.21.15.136:0/3577544109 learned_addr learned my addr 172.21.15.136:0/3577544109 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:54.791 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f40b939b700 1 --2- 172.21.15.136:0/3577544109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859bf360 0x55e9859bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.791 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f40b8b9a700 1 --2- 172.21.15.136:0/3577544109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859e7190 0x55e9859e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f40b9b9c700 1 -- 172.21.15.136:0/3577544109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859bf360 msgr2=0x55e9859bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:54.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/3577544109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859bf360 0x55e9859bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f40b9b9c700 1 -- 172.21.15.136:0/3577544109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859e7190 msgr2=0x55e9859e5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:54.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/3577544109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859e7190 0x55e9859e5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f40b9b9c700 1 -- 172.21.15.136:0/3577544109 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e98578d5e0 con 0x55e9859bcb50 2023-06-23T19:02:54.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/3577544109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bcb50 0x55e9859e9850 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0597d0 tx=0x7f40ac059220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f562d9808405482 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:54.792 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f409effd700 1 -- 172.21.15.136:0/3577544109 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac057be0 con 0x55e9859bcb50 2023-06-23T19:02:54.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f409effd700 1 -- 172.21.15.136:0/3577544109 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac055f50 con 0x55e9859bcb50 2023-06-23T19:02:54.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.772+0000 7f409effd700 1 -- 172.21.15.136:0/3577544109 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac058f50 con 0x55e9859bcb50 2023-06-23T19:02:54.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.773+0000 7f40cee6db80 1 -- 172.21.15.136:0/3577544109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bcb50 msgr2=0x55e9859e9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.773+0000 7f40cee6db80 1 --2- 172.21.15.136:0/3577544109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bcb50 0x55e9859e9850 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0597d0 tx=0x7f40ac059220 comp rx=0 tx=0).stop 2023-06-23T19:02:54.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.773+0000 7f40cee6db80 1 -- 172.21.15.136:0/3577544109 shutdown_connections 2023-06-23T19:02:54.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.773+0000 7f40cee6db80 1 --2- 172.21.15.136:0/3577544109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bcb50 0x55e9859e9850 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.773+0000 7f40cee6db80 1 --2- 172.21.15.136:0/3577544109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859bf360 0x55e9859bf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.793 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.773+0000 7f40cee6db80 1 --2- 172.21.15.136:0/3577544109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859e7190 0x55e9859e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.773+0000 7f40cee6db80 1 -- 172.21.15.136:0/3577544109 >> 172.21.15.136:0/3577544109 conn(0x55e9859affc0 msgr2=0x55e985a045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:54.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.773+0000 7f40cee6db80 1 -- 172.21.15.136:0/3577544109 shutdown_connections 2023-06-23T19:02:54.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.773+0000 7f40cee6db80 1 -- 172.21.15.136:0/3577544109 wait complete. 2023-06-23T19:02:54.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.774+0000 7f40cee6db80 1 -- start start 2023-06-23T19:02:54.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.774+0000 7f40cee6db80 1 Processor -- start 2023-06-23T19:02:54.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e9859e0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.794 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e9859e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 0x55e985a05a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40cee6db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9858aba70 con 0x55e9859bf360 2023-06-23T19:02:54.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40cee6db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9858ab770 con 0x55e9859bcb50 2023-06-23T19:02:54.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40cee6db80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e98578f8d0 con 0x55e9859e7190 2023-06-23T19:02:54.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40cee6db80 10 client.0 _ll_register_callbacks cb 0x55e9858b1210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T19:02:54.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40b8b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e9859e0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40b939b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e9859e0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.795 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40b8b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e9859e0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56050/0 (socket says 172.21.15.136:56050) 2023-06-23T19:02:54.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40b8b9a700 1 -- 172.21.15.136:0/158502956 learned_addr learned my addr 172.21.15.136:0/158502956 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:54.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.776+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 0x55e985a05a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f40b8b9a700 1 -- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 msgr2=0x55e985a05a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:54.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f40b8b9a700 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 0x55e985a05a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f40b8b9a700 1 -- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 msgr2=0x55e9859e0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:54.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f40b8b9a700 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e9859e0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.796 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f40b8b9a700 1 -- 172.21.15.136:0/158502956 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b41589c0 con 0x55e9859bf360 2023-06-23T19:02:54.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f40b8b9a700 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e9859e0b90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f40a4014940 tx=0x7f40a4014c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9358968aecde2a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:54.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f4093fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-06-23T19:02:54.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f4093fff700 1 -- 172.21.15.136:0/158502956 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4004020 con 0x55e9859bf360 2023-06-23T19:02:54.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f40cee6db80 1 -- 172.21.15.136:0/158502956 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9859ad780 con 0x55e9859bf360 2023-06-23T19:02:54.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f4093fff700 1 -- 172.21.15.136:0/158502956 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f40a401a070 con 0x55e9859bf360 2023-06-23T19:02:54.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f4093fff700 1 -- 172.21.15.136:0/158502956 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40a4004180 con 0x55e9859bf360 2023-06-23T19:02:54.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f40cee6db80 10 client.5568 fetch_fsmap learned FSMap version 17 2023-06-23T19:02:54.797 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.777+0000 7f40cee6db80 1 -- 172.21.15.136:0/158502956 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e985739d90 con 0x55e9859bf360 2023-06-23T19:02:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.778+0000 7f4093fff700 1 -- 172.21.15.136:0/158502956 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e9859ad780 con 0x55e9859bf360 2023-06-23T19:02:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.778+0000 7f4093fff700 1 -- 172.21.15.136:0/158502956 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f40a4011030 con 0x55e9859bf360 2023-06-23T19:02:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.778+0000 7f40cee6db80 10 client.5568 fetch_fsmap finished waiting for FSMap version 17 2023-06-23T19:02:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.778+0000 7f40cee6db80 10 client.5568 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-23T19:02:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.778+0000 7f40cee6db80 20 client.5568 populate_metadata read hostname 'smithi136' 2023-06-23T19:02:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.778+0000 7f40cee6db80 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] conn(0x55e985a144d0 0x55e985a211e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.778+0000 7f40cee6db80 4 client.5568 mds_command: new command op to 5358 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.778+0000 7f40cee6db80 1 -- 172.21.15.136:0/158502956 --> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e985904e60 con 0x55e985a144d0 2023-06-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.778+0000 7f40b939b700 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] conn(0x55e985a144d0 0x55e985a211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.779+0000 7f4093fff700 10 client.5568 ms_handle_connect on v2:172.21.15.178:6832/1813513530 2023-06-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.779+0000 7f40b939b700 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] conn(0x55e985a144d0 0x55e985a211e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=566c122848895874 server_cookie=aed04c299f320100 in_seq=0 out_seq=0 2023-06-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f4093fff700 1 -- 172.21.15.136:0/158502956 <== mds.0 v2:172.21.15.178:6832/1813513530 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e985904e60 con 0x55e985a144d0 2023-06-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f4093fff700 10 client.5568 handle_command_reply: tid=0 2023-06-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f40cee6db80 1 client.5568 shutdown 2023-06-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f40cee6db80 1 -- 172.21.15.136:0/158502956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 msgr2=0x55e9859e0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f40cee6db80 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e9859e0b90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f40a4014940 tx=0x7f40a4014c50 comp rx=0 tx=0).stop 2023-06-23T19:02:54.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f40cee6db80 1 -- 172.21.15.136:0/158502956 shutdown_connections 2023-06-23T19:02:54.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f40cee6db80 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] conn(0x55e985a144d0 0x55e985a211e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f40cee6db80 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e9859e0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f40cee6db80 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 0x55e985a05a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f40cee6db80 1 --2- 172.21.15.136:0/158502956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e9859e0b90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.800 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f40cee6db80 1 -- 172.21.15.136:0/158502956 >> 172.21.15.136:0/158502956 conn(0x55e9859affc0 msgr2=0x55e9859e1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:54.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.780+0000 7f4093fff700 0 client.5568 ms_handle_reset on v2:172.21.15.178:6832/1813513530 2023-06-23T19:02:54.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.781+0000 7f40cee6db80 1 -- 172.21.15.136:0/158502956 shutdown_connections 2023-06-23T19:02:54.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.781+0000 7f40cee6db80 1 -- 172.21.15.136:0/158502956 wait complete. 2023-06-23T19:02:54.801 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.781+0000 7f40cee6db80 20 client.5568 trim_cache size 0 max 16384 2023-06-23T19:02:54.803 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.799+0000 7f40cee6db80 1 Processor -- start 2023-06-23T19:02:54.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.799+0000 7f40cee6db80 1 -- start start 2023-06-23T19:02:54.804 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e9859fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859bf360 0x55e9859b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859e7190 0x55e985a06bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40cee6db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9859fc380 con 0x55e9859e7190 2023-06-23T19:02:54.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40cee6db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9859afd80 con 0x55e9859bcb50 2023-06-23T19:02:54.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40cee6db80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9859e6ff0 con 0x55e9859bf360 2023-06-23T19:02:54.805 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40b9b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859e7190 0x55e985a06bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40b9b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859e7190 0x55e985a06bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56066/0 (socket says 172.21.15.136:56066) 2023-06-23T19:02:54.806 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1296249573 learned_addr learned my addr 172.21.15.136:0/1296249573 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:54.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1296249573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859bf360 msgr2=0x55e9859b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:54.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/1296249573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859bf360 0x55e9859b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1296249573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 msgr2=0x55e9859fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:54.807 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40b939b700 1 --2- 172.21.15.136:0/1296249573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e9859fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.800+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/1296249573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e9859fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.801+0000 7f40b9b9c700 1 -- 172.21.15.136:0/1296249573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e985722c10 con 0x55e9859e7190 2023-06-23T19:02:54.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.801+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/1296249573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859e7190 0x55e985a06bb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f40ac061660 tx=0x7f40ac05d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1deef730ef91e785 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:54.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.801+0000 7f409f7fe700 1 -- 172.21.15.136:0/1296249573 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac0560c0 con 0x55e9859e7190 2023-06-23T19:02:54.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.801+0000 7f409f7fe700 1 -- 172.21.15.136:0/1296249573 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac057be0 con 0x55e9859e7190 2023-06-23T19:02:54.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.801+0000 7f409f7fe700 1 -- 172.21.15.136:0/1296249573 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac058f70 con 0x55e9859e7190 2023-06-23T19:02:54.808 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.801+0000 7f40cee6db80 1 -- 172.21.15.136:0/1296249573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859e7190 msgr2=0x55e985a06bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.801+0000 7f40cee6db80 1 --2- 172.21.15.136:0/1296249573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859e7190 0x55e985a06bb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f40ac061660 tx=0x7f40ac05d980 comp rx=0 tx=0).stop 2023-06-23T19:02:54.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.802+0000 7f40cee6db80 1 -- 172.21.15.136:0/1296249573 shutdown_connections 2023-06-23T19:02:54.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.802+0000 7f40cee6db80 1 --2- 172.21.15.136:0/1296249573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e9859fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.802+0000 7f40cee6db80 1 --2- 172.21.15.136:0/1296249573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859e7190 0x55e985a06bb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.809 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.802+0000 7f40cee6db80 1 --2- 172.21.15.136:0/1296249573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859bf360 0x55e9859b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.802+0000 7f40cee6db80 1 -- 172.21.15.136:0/1296249573 >> 172.21.15.136:0/1296249573 conn(0x55e9859affc0 msgr2=0x55e9859e6060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:54.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.802+0000 7f40cee6db80 1 -- 172.21.15.136:0/1296249573 shutdown_connections 2023-06-23T19:02:54.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.802+0000 7f40cee6db80 1 -- 172.21.15.136:0/1296249573 wait complete. 2023-06-23T19:02:54.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.802+0000 7f40cee6db80 1 -- start start 2023-06-23T19:02:54.810 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.802+0000 7f40cee6db80 1 Processor -- start 2023-06-23T19:02:54.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.803+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e985a06980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.813 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.803+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e985a06ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.803+0000 7f40cee6db80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 0x55e9859bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.803+0000 7f40cee6db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e985a6a950 con 0x55e9859bf360 2023-06-23T19:02:54.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.803+0000 7f40cee6db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e985a1db40 con 0x55e9859bcb50 2023-06-23T19:02:54.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.803+0000 7f40cee6db80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9859b1530 con 0x55e9859e7190 2023-06-23T19:02:54.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.803+0000 7f40cee6db80 10 client.0 _ll_register_callbacks cb 0x7f40a4009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T19:02:54.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b8b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e985a06ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.814 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b8b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e985a06ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56072/0 (socket says 172.21.15.136:56072) 2023-06-23T19:02:54.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b8b9a700 1 -- 172.21.15.136:0/4214655678 learned_addr learned my addr 172.21.15.136:0/4214655678 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:54.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b939b700 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e985a06980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b9b9c700 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 0x55e9859bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b8b9a700 1 -- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 msgr2=0x55e9859bcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:54.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b8b9a700 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 0x55e9859bcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.815 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b8b9a700 1 -- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 msgr2=0x55e985a06980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:54.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b8b9a700 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e985a06980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b8b9a700 1 -- 172.21.15.136:0/4214655678 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e98578d5e0 con 0x55e9859bf360 2023-06-23T19:02:54.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b939b700 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e985a06980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:02:54.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f40b8b9a700 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e985a06ec0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f40a4006d30 tx=0x7f40a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcddc36e1322b12 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:54.816 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.804+0000 7f4093fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-06-23T19:02:54.817 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f4093fff700 1 -- 172.21.15.136:0/4214655678 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a402d070 con 0x55e9859bf360 2023-06-23T19:02:54.817 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f4093fff700 1 -- 172.21.15.136:0/4214655678 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f40a4016910 con 0x55e9859bf360 2023-06-23T19:02:54.817 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f40cee6db80 1 -- 172.21.15.136:0/4214655678 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40ac055f50 con 0x55e9859bf360 2023-06-23T19:02:54.817 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f4093fff700 1 -- 172.21.15.136:0/4214655678 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40a4028470 con 0x55e9859bf360 2023-06-23T19:02:54.817 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f40cee6db80 10 client.5574 fetch_fsmap learned FSMap version 17 2023-06-23T19:02:54.817 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f40cee6db80 1 -- 172.21.15.136:0/4214655678 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e985760200 con 0x55e9859bf360 2023-06-23T19:02:54.817 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f4093fff700 1 -- 172.21.15.136:0/4214655678 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac055f50 con 0x55e9859bf360 2023-06-23T19:02:54.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f4093fff700 1 -- 172.21.15.136:0/4214655678 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f40a4030020 con 0x55e9859bf360 2023-06-23T19:02:54.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f40cee6db80 10 client.5574 fetch_fsmap finished waiting for FSMap version 17 2023-06-23T19:02:54.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f40cee6db80 10 client.5574 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-23T19:02:54.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f40cee6db80 20 client.5574 populate_metadata read hostname 'smithi136' 2023-06-23T19:02:54.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f40cee6db80 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] conn(0x55e9859bd670 0x55e985a03dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:54.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f40cee6db80 4 client.5574 mds_command: new command op to 5358 tid=0[{"prefix": "status"}] 2023-06-23T19:02:54.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.805+0000 7f40cee6db80 1 -- 172.21.15.136:0/4214655678 --> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e9858c7000 con 0x55e9859bd670 2023-06-23T19:02:54.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.806+0000 7f40b939b700 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] conn(0x55e9859bd670 0x55e985a03dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:54.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.806+0000 7f4093fff700 10 client.5574 ms_handle_connect on v2:172.21.15.178:6832/1813513530 2023-06-23T19:02:54.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.806+0000 7f40b939b700 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] conn(0x55e9859bd670 0x55e985a03dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=960b15fc8b76f5f0 server_cookie=aa5cb78cb0bcb00d in_seq=0 out_seq=0 2023-06-23T19:02:54.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.806+0000 7f4093fff700 1 -- 172.21.15.136:0/4214655678 <== mds.0 v2:172.21.15.178:6832/1813513530 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e9858c7000 con 0x55e9859bd670 2023-06-23T19:02:54.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.806+0000 7f4093fff700 10 client.5574 handle_command_reply: tid=0 2023-06-23T19:02:54.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.806+0000 7f40cee6db80 1 client.5574 shutdown 2023-06-23T19:02:54.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 -- 172.21.15.136:0/4214655678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 msgr2=0x55e985a06ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e985a06ec0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f40a4006d30 tx=0x7f40a40047c0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 -- 172.21.15.136:0/4214655678 shutdown_connections 2023-06-23T19:02:54.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:6832/1813513530,v1:172.21.15.178:6834/1813513530] conn(0x55e9859bd670 0x55e985a03dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e9859bcb50 0x55e985a06980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e9859e7190 0x55e9859bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f4093fff700 0 client.5574 ms_handle_reset on v2:172.21.15.178:6832/1813513530 2023-06-23T19:02:54.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 --2- 172.21.15.136:0/4214655678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9859bf360 0x55e985a06ec0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 -- 172.21.15.136:0/4214655678 >> 172.21.15.136:0/4214655678 conn(0x55e9859affc0 msgr2=0x55e9859fb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:54.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 -- 172.21.15.136:0/4214655678 shutdown_connections 2023-06-23T19:02:54.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 1 -- 172.21.15.136:0/4214655678 wait complete. 2023-06-23T19:02:54.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40cee6db80 20 client.5574 trim_cache size 0 max 16384 2023-06-23T19:02:54.822 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2023-06-23T19:02:54.822 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "ad363bec-53b9-481a-9d11-1e4839eb0e65", 2023-06-23T19:02:54.822 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 0, 2023-06-23T19:02:54.822 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 5358, 2023-06-23T19:02:54.822 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2023-06-23T19:02:54.822 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2023-06-23T19:02:54.822 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2023-06-23T19:02:54.823 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 11.441009913, 2023-06-23T19:02:54.823 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 17, 2023-06-23T19:02:54.823 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 44, 2023-06-23T19:02:54.823 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 44, 2023-06-23T19:02:54.823 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 20.419222940000001 2023-06-23T19:02:54.823 INFO:teuthology.orchestra.run.smithi136.stdout:} 2023-06-23T19:02:54.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f409806ace0 msgr2=0x7f409806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40bb5ff700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f409806ace0 0x7f409806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40b0000f60 tx=0x7f40b0007ed0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.824 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4158550 msgr2=0x7f40b4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:54.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.807+0000 7f40bb5ff700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4158550 0x7f40b4070720 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c370 tx=0x7f40ac004ad0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.808+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1475811927 shutdown_connections 2023-06-23T19:02:54.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.808+0000 7f40bb5ff700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f409806ace0 0x7f409806d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.808+0000 7f40bb5ff700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4158550 0x7f40b4070720 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.808+0000 7f40bb5ff700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40b4069ef0 0x7f40b4153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.808+0000 7f40bb5ff700 1 --2- 172.21.15.136:0/1475811927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40b40c96f0 0x7f40b40701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:54.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.808+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1475811927 >> 172.21.15.136:0/1475811927 conn(0x7f40b40b0ef0 msgr2=0x7f40b40ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:54.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.808+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1475811927 shutdown_connections 2023-06-23T19:02:54.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:54.808+0000 7f40bb5ff700 1 -- 172.21.15.136:0/1475811927 wait complete. 2023-06-23T19:02:54.830 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.023+0000 7f32b53ff700 1 Processor -- start 2023-06-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.023+0000 7f32b53ff700 1 -- start start 2023-06-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.024+0000 7f32b53ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 0x7f32b00ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.024+0000 7f32b53ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f32b006c2c0 0x7f32b00d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.024+0000 7f32b53ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b00afdb0 con 0x7f32b006ccc0 2023-06-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.024+0000 7f32b53ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b015c6b0 con 0x7f32b006c2c0 2023-06-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.024+0000 7f32b53ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00b0000 con 0x7f32b015c2e0 2023-06-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.024+0000 7f32ae7fc700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f32b006ccc0 0x7f32b015fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55698/0 (socket says 172.21.15.136:55698) 2023-06-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.024+0000 7f32ae7fc700 1 -- 172.21.15.136:0/779884885 learned_addr learned my addr 172.21.15.136:0/779884885 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.024+0000 7f32af7fe700 1 --2- 172.21.15.136:0/779884885 >> v2:172.21.15.136:3300/0 conn(0x7f32b006c2c0 0x7f32b00d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32aeffd700 1 --2- 172.21.15.136:0/779884885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 0x7f32b00ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32adffb700 1 -- 172.21.15.136:0/779884885 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544855982 0 0) 0x7f32b00afdb0 con 0x7f32b006ccc0 2023-06-23T19:02:55.037 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32adffb700 1 -- 172.21.15.136:0/779884885 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32980035b0 con 0x7f32b006ccc0 2023-06-23T19:02:55.037 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32af7fe700 1 -- 172.21.15.136:0/779884885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 msgr2=0x7f32b00ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32af7fe700 1 --2- 172.21.15.136:0/779884885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 0x7f32b00ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32af7fe700 1 -- 172.21.15.136:0/779884885 >> v1:172.21.15.136:6789/0 conn(0x7f32b006ccc0 legacy=0x7f32b015fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32af7fe700 1 -- 172.21.15.136:0/779884885 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b006ba10 con 0x7f32b006c2c0 2023-06-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32af7fe700 1 --2- 172.21.15.136:0/779884885 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006c2c0 0x7f32b00d0840 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009d90 tx=0x7f32a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbc9160aae70b3f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32adffb700 1 -- 172.21.15.136:0/779884885 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800e070 con 0x7f32b006c2c0 2023-06-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32adffb700 1 -- 172.21.15.136:0/779884885 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800bb20 con 0x7f32b006c2c0 2023-06-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.025+0000 7f32adffb700 1 -- 172.21.15.136:0/779884885 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8012430 con 0x7f32b006c2c0 2023-06-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.026+0000 7f32b53ff700 1 -- 172.21.15.136:0/779884885 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006c2c0 msgr2=0x7f32b00d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.026+0000 7f32b53ff700 1 --2- 172.21.15.136:0/779884885 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006c2c0 0x7f32b00d0840 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009d90 tx=0x7f32a800b330 comp rx=0 tx=0).stop 2023-06-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.026+0000 7f32b53ff700 1 -- 172.21.15.136:0/779884885 shutdown_connections 2023-06-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.026+0000 7f32b53ff700 1 --2- 172.21.15.136:0/779884885 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006c2c0 0x7f32b00d0840 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.026+0000 7f32b53ff700 1 --2- 172.21.15.136:0/779884885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 0x7f32b00ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.026+0000 7f32b53ff700 1 -- 172.21.15.136:0/779884885 >> 172.21.15.136:0/779884885 conn(0x7f32b006e530 msgr2=0x7f32b006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.026+0000 7f32b53ff700 1 -- 172.21.15.136:0/779884885 shutdown_connections 2023-06-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.026+0000 7f32b53ff700 1 -- 172.21.15.136:0/779884885 wait complete. 2023-06-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.028+0000 7f32b53ff700 1 Processor -- start 2023-06-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.028+0000 7f32b53ff700 1 -- start start 2023-06-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32b53ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b006c2c0 0x7f32b0149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32b53ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006ccc0 0x7f32b00b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32b53ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 0x7f32b00b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32b53ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b014a190 con 0x7f32b006ccc0 2023-06-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32b53ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c4010 con 0x7f32b006c2c0 2023-06-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32b53ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c4e70 con 0x7f32b015c2e0 2023-06-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32ae7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006ccc0 0x7f32b00b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32ae7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006ccc0 0x7f32b00b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48216/0 (socket says 172.21.15.136:48216) 2023-06-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32ae7fc700 1 -- 172.21.15.136:0/2779382426 learned_addr learned my addr 172.21.15.136:0/2779382426 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32aeffd700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b006c2c0 0x7f32b0149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.029+0000 7f32af7fe700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 0x7f32b00b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32ae7fc700 1 -- 172.21.15.136:0/2779382426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 msgr2=0x7f32b00b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32ae7fc700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 0x7f32b00b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32ae7fc700 1 -- 172.21.15.136:0/2779382426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b006c2c0 msgr2=0x7f32b0149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32ae7fc700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b006c2c0 0x7f32b0149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32ae7fc700 1 -- 172.21.15.136:0/2779382426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a8009a70 con 0x7f32b006ccc0 2023-06-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32ae7fc700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006ccc0 0x7f32b00b58d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c730 tx=0x7f32a400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32977fe700 1 -- 172.21.15.136:0/2779382426 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4005d70 con 0x7f32b006ccc0 2023-06-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32977fe700 1 -- 172.21.15.136:0/2779382426 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a40070d0 con 0x7f32b006ccc0 2023-06-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b00c4260 con 0x7f32b006ccc0 2023-06-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32977fe700 1 -- 172.21.15.136:0/2779382426 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4007440 con 0x7f32b006ccc0 2023-06-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.030+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b00c4820 con 0x7f32b006ccc0 2023-06-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.031+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b0073910 con 0x7f32b006ccc0 2023-06-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.032+0000 7f32977fe700 1 -- 172.21.15.136:0/2779382426 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32a40075a0 con 0x7f32b006ccc0 2023-06-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.033+0000 7f32977fe700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f329c06ace0 0x7f329c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.033+0000 7f32977fe700 1 -- 172.21.15.136:0/2779382426 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f32a4088930 con 0x7f32b006ccc0 2023-06-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.033+0000 7f32aeffd700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f329c06ace0 0x7f329c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.034+0000 7f32aeffd700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f329c06ace0 0x7f329c06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009b40 tx=0x7f32a0009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.037+0000 7f32977fe700 1 -- 172.21.15.136:0/2779382426 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f32a4053940 con 0x7f32b006ccc0 2023-06-23T19:02:55.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.276+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f32b00c4fb0 con 0x7f32b006ccc0 2023-06-23T19:02:55.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.276+0000 7f32977fe700 1 -- 172.21.15.136:0/2779382426 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f32a4056f60 con 0x7f32b006ccc0 2023-06-23T19:02:55.282 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-23T19:02:55.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f329c06ace0 msgr2=0x7f329c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:55.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f329c06ace0 0x7f329c06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009b40 tx=0x7f32a0009210 comp rx=0 tx=0).stop 2023-06-23T19:02:55.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006ccc0 msgr2=0x7f32b00b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:02:55.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006ccc0 0x7f32b00b58d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c730 tx=0x7f32a400ca40 comp rx=0 tx=0).stop 2023-06-23T19:02:55.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 shutdown_connections 2023-06-23T19:02:55.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f329c06ace0 0x7f329c06d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:55.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b006c2c0 0x7f32b0149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:55.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b015c2e0 0x7f32b00b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:55.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 --2- 172.21.15.136:0/2779382426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32b006ccc0 0x7f32b00b58d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:02:55.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.278+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 >> 172.21.15.136:0/2779382426 conn(0x7f32b006e530 msgr2=0x7f32b01571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:02:55.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.279+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 shutdown_connections 2023-06-23T19:02:55.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:02:55.279+0000 7f32b53ff700 1 -- 172.21.15.136:0/2779382426 wait complete. 2023-06-23T19:02:55.301 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-23T19:02:55.302 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T19:02:55.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2023-06-23T19:02:55.302 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-23T19:02:55.303 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-23T19:02:55.303 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-23T19:02:55.303 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-23T19:02:55.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T19:02:55.304 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-23T19:02:55.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:55.305 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2023-06-23T19:02:55.349 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T19:02:55.349 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T19:02:55.349 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T19:02:55.349 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:02:55.350 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-06-23T19:02:55.350 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:02:55.351 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:02:55.352 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2023-06-23T19:02:55.352 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2023-06-23T19:02:55.352 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:02:55.352 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2023-06-23T19:02:55.352 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2023-06-23T19:02:55.353 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T19:02:55.353 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:02:55.354 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T19:02:55.354 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:02:55.354 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-23T19:02:55.355 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 41990sec preferred_lft 41990sec 2023-06-23T19:02:55.355 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::535c:5530:7d0:e32d/64 scope link noprefixroute 2023-06-23T19:02:55.356 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:02:55.356 INFO:teuthology.orchestra.run.smithi136.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-23T19:02:55.356 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 12:28:86:66:82:81 brd ff:ff:ff:ff:ff:ff 2023-06-23T19:02:55.357 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-23T19:02:55.357 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:02:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::3087:eff:fe6b:b7d7/64 scope link 2023-06-23T19:02:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:02:55.358 INFO:teuthology.orchestra.run.smithi136.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-23T19:02:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 3a:2e:88:71:8e:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-23T19:02:55.359 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::382e:88ff:fe71:8ecc/64 scope link 2023-06-23T19:02:55.359 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:02:55.359 INFO:teuthology.orchestra.run.smithi136.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-23T19:02:55.360 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 12:28:86:66:82:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-23T19:02:55.360 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::1028:86ff:fe66:8281/64 scope link 2023-06-23T19:02:55.364 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-06-23T19:02:55.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:55.365 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T19:02:55.455 INFO:teuthology.orchestra.run.smithi136.stdout:1 2023-06-23T19:02:55.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:55.458 DEBUG:teuthology.orchestra.run.smithi136:> route 2023-06-23T19:02:55.504 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2023-06-23T19:02:55.505 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T19:02:55.505 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T19:02:55.505 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T19:02:55.506 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T19:02:55.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:55.506 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-06-23T19:02:55.507 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-06-23T19:02:55.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T19:02:55.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T19:02:55.508 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T19:02:55.508 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-06-23T19:02:55.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:55.716 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-06-23T19:02:55.760 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-23T19:02:55.761 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-23T19:02:55.761 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-23T19:02:55.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:55.762 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2023-06-23T19:02:55.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:02:55.871 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-23T19:02:55.914 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-23T19:02:55.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T19:02:55.915 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-23T19:02:55.997 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-23T19:02:55.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:55.998 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:02:56.141 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:02:56.141 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:02:56.172 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T19:02:56.173 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T19:02:56.173 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-06-23T19:02:56.173 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 0@ad363bec-53b9-481a-9d11-1e4839eb0e65.cephfs=/ 2023-06-23T19:02:56.173 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.136:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-06-23T19:02:56.177 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-23T19:02:56.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:56.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-23T19:02:56.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:56.247 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T19:02:56.354 INFO:teuthology.orchestra.run.smithi136.stdout:client5075 2023-06-23T19:02:56.354 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:02:56.355 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:02:56.399 DEBUG:teuthology.orchestra.run.smithi136:> mktemp -d --suffix=xfstests-dev 2023-06-23T19:02:56.481 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.AfPoID7zOVxfstests-dev 2023-06-23T19:02:56.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:56.482 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.AfPoID7zOVxfstests-dev) 2023-06-23T19:02:56.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:02:56.577 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:02:56.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:56.593 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.AfPoID7zOVxfstests-dev) 2023-06-23T19:02:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:Cloning into '/tmp/tmp.AfPoID7zOVxfstests-dev'... 2023-06-23T19:02:57.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:57.538 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-23T19:02:57.631 DEBUG:teuthology.orchestra.run.smithi136:> mktemp -d --suffix=test 2023-06-23T19:02:57.674 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.4pZPdhEOtdtest 2023-06-23T19:02:57.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:02:57.676 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-23T19:02:57.762 DEBUG:teuthology.orchestra.run.smithi136:> mktemp -d --suffix=scratch 2023-06-23T19:02:57.805 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.FtStipGKalscratch 2023-06-23T19:02:57.806 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-06-23T19:02:57.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-06-23T19:02:58.324 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-06-23T19:02:59.298 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:05:11 ago on Fri 23 Jun 2023 06:57:48 PM UTC. 2023-06-23T19:03:00.638 INFO:teuthology.orchestra.run.smithi136.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-06-23T19:03:00.638 INFO:teuthology.orchestra.run.smithi136.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-06-23T19:03:00.640 INFO:teuthology.orchestra.run.smithi136.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-06-23T19:03:00.640 INFO:teuthology.orchestra.run.smithi136.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-06-23T19:03:00.642 INFO:teuthology.orchestra.run.smithi136.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-06-23T19:03:00.644 INFO:teuthology.orchestra.run.smithi136.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-06-23T19:03:00.646 INFO:teuthology.orchestra.run.smithi136.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-06-23T19:03:00.648 INFO:teuthology.orchestra.run.smithi136.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-06-23T19:03:00.650 INFO:teuthology.orchestra.run.smithi136.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-06-23T19:03:00.651 INFO:teuthology.orchestra.run.smithi136.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-06-23T19:03:00.652 INFO:teuthology.orchestra.run.smithi136.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-06-23T19:03:00.653 INFO:teuthology.orchestra.run.smithi136.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-06-23T19:03:00.655 INFO:teuthology.orchestra.run.smithi136.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-06-23T19:03:00.656 INFO:teuthology.orchestra.run.smithi136.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-06-23T19:03:00.657 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-23T19:03:00.658 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-23T19:03:00.660 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-23T19:03:00.661 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-23T19:03:00.662 INFO:teuthology.orchestra.run.smithi136.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-06-23T19:03:00.663 INFO:teuthology.orchestra.run.smithi136.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-06-23T19:03:00.665 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-06-23T19:03:00.667 INFO:teuthology.orchestra.run.smithi136.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-06-23T19:03:00.672 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-23T19:03:00.797 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2023-06-23T19:03:00.799 INFO:teuthology.orchestra.run.smithi136.stdout:==================================================================================================================== 2023-06-23T19:03:00.799 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2023-06-23T19:03:00.800 INFO:teuthology.orchestra.run.smithi136.stdout:==================================================================================================================== 2023-06-23T19:03:00.800 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2023-06-23T19:03:00.800 INFO:teuthology.orchestra.run.smithi136.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-06-23T19:03:00.800 INFO:teuthology.orchestra.run.smithi136.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-23T19:03:00.800 INFO:teuthology.orchestra.run.smithi136.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-06-23T19:03:00.800 INFO:teuthology.orchestra.run.smithi136.stdout: python2 x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-23T19:03:00.801 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2023-06-23T19:03:00.801 INFO:teuthology.orchestra.run.smithi136.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-06-23T19:03:00.801 INFO:teuthology.orchestra.run.smithi136.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-06-23T19:03:00.801 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2023-06-23T19:03:00.801 INFO:teuthology.orchestra.run.smithi136.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-06-23T19:03:00.801 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-06-23T19:03:00.801 INFO:teuthology.orchestra.run.smithi136.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-06-23T19:03:00.802 INFO:teuthology.orchestra.run.smithi136.stdout: python2-libs x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-06-23T19:03:00.802 INFO:teuthology.orchestra.run.smithi136.stdout: python2-pip-wheel noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 892 k 2023-06-23T19:03:00.802 INFO:teuthology.orchestra.run.smithi136.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-06-23T19:03:00.802 INFO:teuthology.orchestra.run.smithi136.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module+el8.5.0+12203+77770ab7 rhel-8-for-x86_64-appstream-rpms 45 k 2023-06-23T19:03:00.802 INFO:teuthology.orchestra.run.smithi136.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-06-23T19:03:00.802 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2023-06-23T19:03:00.802 INFO:teuthology.orchestra.run.smithi136.stdout: python2-pip noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 1.6 M 2023-06-23T19:03:00.803 INFO:teuthology.orchestra.run.smithi136.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-06-23T19:03:00.803 INFO:teuthology.orchestra.run.smithi136.stdout:Enabling module streams: 2023-06-23T19:03:00.803 INFO:teuthology.orchestra.run.smithi136.stdout: python27 2.7 2023-06-23T19:03:00.803 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:03:00.803 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2023-06-23T19:03:00.803 INFO:teuthology.orchestra.run.smithi136.stdout:==================================================================================================================== 2023-06-23T19:03:00.803 INFO:teuthology.orchestra.run.smithi136.stdout:Install 14 Packages 2023-06-23T19:03:00.803 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 2 Packages 2023-06-23T19:03:00.804 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:03:00.804 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 12 M 2023-06-23T19:03:00.805 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2023-06-23T19:03:01.093 INFO:teuthology.orchestra.run.smithi136.stdout:(1/16): python2-setuptools-wheel-39.0.1-13.modu 1.3 MB/s | 287 kB 00:00 2023-06-23T19:03:01.130 INFO:teuthology.orchestra.run.smithi136.stdout:(2/16): python2-setuptools-39.0.1-13.module+el8 2.6 MB/s | 642 kB 00:00 2023-06-23T19:03:01.172 INFO:teuthology.orchestra.run.smithi136.stdout:(3/16): python2-wheel-wheel-0.31.1-3.module+el8 573 kB/s | 45 kB 00:00 2023-06-23T19:03:01.198 INFO:teuthology.orchestra.run.smithi136.stdout:(4/16): indent-2.2.13-2.el8.x86_64.rpm 596 kB/s | 187 kB 00:00 2023-06-23T19:03:01.223 INFO:teuthology.orchestra.run.smithi136.stdout:(5/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.8 MB/s | 92 kB 00:00 2023-06-23T19:03:01.273 INFO:teuthology.orchestra.run.smithi136.stdout:(6/16): fio-3.19-3.el8.x86_64.rpm 3.7 MB/s | 538 kB 00:00 2023-06-23T19:03:01.298 INFO:teuthology.orchestra.run.smithi136.stdout:(7/16): python2-2.7.18-10.module+el8.6.0+14191+ 1.1 MB/s | 110 kB 00:00 2023-06-23T19:03:01.373 INFO:teuthology.orchestra.run.smithi136.stdout:(8/16): python2-pip-9.0.3-19.module+el8.6.0+130 16 MB/s | 1.6 MB 00:00 2023-06-23T19:03:01.415 INFO:teuthology.orchestra.run.smithi136.stdout:(9/16): python2-pip-wheel-9.0.3-19.module+el8.6 7.5 MB/s | 892 kB 00:00 2023-06-23T19:03:01.440 INFO:teuthology.orchestra.run.smithi136.stdout:(10/16): dump-0.4-0.36.b46.el8.x86_64.rpm 2.4 MB/s | 164 kB 00:00 2023-06-23T19:03:01.466 INFO:teuthology.orchestra.run.smithi136.stdout:(11/16): rmt-1.5.3-13.el8.x86_64.rpm 1.0 MB/s | 51 kB 00:00 2023-06-23T19:03:01.491 INFO:teuthology.orchestra.run.smithi136.stdout:(12/16): daxctl-libs-71.1-3.el8.x86_64.rpm 831 kB/s | 42 kB 00:00 2023-06-23T19:03:01.516 INFO:teuthology.orchestra.run.smithi136.stdout:(13/16): ndctl-libs-71.1-3.el8.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-06-23T19:03:01.575 INFO:teuthology.orchestra.run.smithi136.stdout:(14/16): sqlite-3.26.0-16.el8_6.x86_64.rpm 7.8 MB/s | 668 kB 00:00 2023-06-23T19:03:01.608 INFO:teuthology.orchestra.run.smithi136.stdout:(15/16): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2023-06-23T19:03:01.701 INFO:teuthology.orchestra.run.smithi136.stdout:(16/16): python2-libs-2.7.18-10.module+el8.6.0+ 13 MB/s | 6.0 MB 00:00 2023-06-23T19:03:01.702 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2023-06-23T19:03:01.702 INFO:teuthology.orchestra.run.smithi136.stdout:Total 13 MB/s | 12 MB 00:00 2023-06-23T19:03:02.097 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2023-06-23T19:03:02.142 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2023-06-23T19:03:02.142 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2023-06-23T19:03:02.396 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2023-06-23T19:03:02.402 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2023-06-23T19:03:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2023-06-23T19:03:03.352 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 1/18 2023-06-23T19:03:03.504 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 2/18 2023-06-23T19:03:03.590 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 2/18 2023-06-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 3/18 2023-06-23T19:03:03.851 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 3/18 2023-06-23T19:03:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-23T19:03:04.114 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/18 2023-06-23T19:03:04.458 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 6/18 2023-06-23T19:03:04.758 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 7/18 2023-06-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 8/18 2023-06-23T19:03:05.786 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-06-23T19:03:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-06-23T19:03:07.375 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-06-23T19:03:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 11/18 2023-06-23T19:03:08.062 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-06-23T19:03:08.329 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fio-3.19-3.el8.x86_64 13/18 2023-06-23T19:03:08.524 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 14/18 2023-06-23T19:03:08.688 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 15/18 2023-06-23T19:03:08.895 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : indent-2.2.13-2.el8.x86_64 16/18 2023-06-23T19:03:09.071 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 17/18 2023-06-23T19:03:09.227 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-23T19:03:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-23T19:03:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/18 2023-06-23T19:03:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 2/18 2023-06-23T19:03:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 3/18 2023-06-23T19:03:09.657 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 4/18 2023-06-23T19:03:09.657 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fio-3.19-3.el8.x86_64 5/18 2023-06-23T19:03:09.657 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 6/18 2023-06-23T19:03:09.657 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 7/18 2023-06-23T19:03:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 8/18 2023-06-23T19:03:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-06-23T19:03:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 10/18 2023-06-23T19:03:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/18 2023-06-23T19:03:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 12/18 2023-06-23T19:03:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 13/18 2023-06-23T19:03:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 14/18 2023-06-23T19:03:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 15/18 2023-06-23T19:03:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 16/18 2023-06-23T19:03:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 17/18 2023-06-23T19:03:11.164 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-23T19:03:11.164 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:05:23 ago on Fri 23 Jun 2023 06:57:48 PM UTC. 2023-06-23T19:03:14.287 INFO:teuthology.orchestra.run.smithi136.stdout:Installed products updated. 2023-06-23T19:03:14.488 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:03:14.488 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2023-06-23T19:03:14.488 INFO:teuthology.orchestra.run.smithi136.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-06-23T19:03:14.488 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2023-06-23T19:03:14.488 INFO:teuthology.orchestra.run.smithi136.stdout: daxctl-libs-71.1-3.el8.x86_64 2023-06-23T19:03:14.489 INFO:teuthology.orchestra.run.smithi136.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-06-23T19:03:14.489 INFO:teuthology.orchestra.run.smithi136.stdout: fio-3.19-3.el8.x86_64 2023-06-23T19:03:14.489 INFO:teuthology.orchestra.run.smithi136.stdout: indent-2.2.13-2.el8.x86_64 2023-06-23T19:03:14.489 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-06-23T19:03:14.489 INFO:teuthology.orchestra.run.smithi136.stdout: ndctl-libs-71.1-3.el8.x86_64 2023-06-23T19:03:14.489 INFO:teuthology.orchestra.run.smithi136.stdout: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-06-23T19:03:14.489 INFO:teuthology.orchestra.run.smithi136.stdout: python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-06-23T19:03:14.490 INFO:teuthology.orchestra.run.smithi136.stdout: python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-06-23T19:03:14.490 INFO:teuthology.orchestra.run.smithi136.stdout: python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-06-23T19:03:14.490 INFO:teuthology.orchestra.run.smithi136.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-06-23T19:03:14.490 INFO:teuthology.orchestra.run.smithi136.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-06-23T19:03:14.490 INFO:teuthology.orchestra.run.smithi136.stdout: python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+12203+77770ab7.noarch 2023-06-23T19:03:14.490 INFO:teuthology.orchestra.run.smithi136.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-06-23T19:03:14.490 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:03:14.490 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2023-06-23T19:03:14.700 DEBUG:teuthology.orchestra.run.smithi136:> sudo useradd -m fsgqa 2023-06-23T19:03:14.770 INFO:teuthology.orchestra.run.smithi136.stderr:useradd: user 'fsgqa' already exists 2023-06-23T19:03:14.773 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-23T19:03:14.774 DEBUG:teuthology.orchestra.run.smithi136:> sudo groupadd fsgqa 2023-06-23T19:03:14.841 INFO:teuthology.orchestra.run.smithi136.stderr:groupadd: group 'fsgqa' already exists 2023-06-23T19:03:14.842 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-23T19:03:14.843 DEBUG:teuthology.orchestra.run.smithi136:> sudo useradd fsgqa2 2023-06-23T19:03:16.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo useradd 123456-fsgqa 2023-06-23T19:03:19.691 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-23T19:03:19.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.899+0000 7fee28bff700 1 Processor -- start 2023-06-23T19:03:19.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.899+0000 7fee28bff700 1 -- start start 2023-06-23T19:03:19.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.900+0000 7fee28bff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee24158550 0x7fee2406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:19.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.900+0000 7fee28bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2406a600 0x7fee240c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:19.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.900+0000 7fee28bff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2406e190 con 0x7fee2406d5a0 2023-06-23T19:03:19.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.900+0000 7fee28bff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee240c8ce0 con 0x7fee24158550 2023-06-23T19:03:19.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.900+0000 7fee28bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee240ccdc0 con 0x7fee2406a600 2023-06-23T19:03:19.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee1bfff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fee2406d5a0 0x7fee24069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:45478/0 (socket says 172.21.15.136:45478) 2023-06-23T19:03:19.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee1bfff700 1 -- 172.21.15.136:0/2567695776 learned_addr learned my addr 172.21.15.136:0/2567695776 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:03:19.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee22d9d700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2406a600 0x7fee240c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:19.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee2259c700 1 --2- 172.21.15.136:0/2567695776 >> v2:172.21.15.178:3300/0 conn(0x7fee24158550 0x7fee2406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:19.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789851663 0 0) 0x7fee2406e190 con 0x7fee2406d5a0 2023-06-23T19:03:19.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee100035b0 con 0x7fee2406d5a0 2023-06-23T19:03:19.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2653294842 0 0) 0x7fee100035b0 con 0x7fee2406d5a0 2023-06-23T19:03:19.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2406a600 msgr2=0x7fee240c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:03:19.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2406a600 0x7fee240c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:19.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 >> v2:172.21.15.178:3300/0 conn(0x7fee24158550 msgr2=0x7fee2406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:03:19.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 --2- 172.21.15.136:0/2567695776 >> v2:172.21.15.178:3300/0 conn(0x7fee24158550 0x7fee2406d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:19.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2406dbd0 con 0x7fee2406d5a0 2023-06-23T19:03:19.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fee0c001670 con 0x7fee2406d5a0 2023-06-23T19:03:19.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 >> v1:172.21.15.136:6789/0 conn(0x7fee2406d5a0 legacy=0x7fee24069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:19.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.901+0000 7fee21d9b700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee10003a00 0x7fee10003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:19.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee21d9b700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10004430 0x7fee100048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:19.909 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee21d9b700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2406a600 0x7fee10004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:19.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240c8ce0 con 0x7fee10003a00 2023-06-23T19:03:19.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240ccdc0 con 0x7fee10004430 2023-06-23T19:03:19.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1000ba10 con 0x7fee2406a600 2023-06-23T19:03:19.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee2259c700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee10003a00 0x7fee10003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:19.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee1bfff700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10004430 0x7fee100048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:19.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee22d9d700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2406a600 0x7fee10004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:19.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee2259c700 1 -- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2406a600 msgr2=0x7fee10004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:03:19.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee2259c700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2406a600 0x7fee10004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:19.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee2259c700 1 -- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10004430 msgr2=0x7fee100048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:03:19.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee2259c700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10004430 0x7fee100048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:19.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee2259c700 1 -- 172.21.15.136:0/2567695776 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee100035b0 con 0x7fee10003a00 2023-06-23T19:03:19.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.902+0000 7fee2259c700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee10003a00 0x7fee10003e10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fee14009fc0 tx=0x7fee10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26b9733417c25a8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:03:19.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400ec30 con 0x7fee10003a00 2023-06-23T19:03:19.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1400f040 con 0x7fee10003a00 2023-06-23T19:03:19.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee21d9b700 1 -- 172.21.15.136:0/2567695776 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14014480 con 0x7fee10003a00 2023-06-23T19:03:19.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee28bff700 1 -- 172.21.15.136:0/2567695776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee10003a00 msgr2=0x7fee10003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:19.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee28bff700 1 --2- 172.21.15.136:0/2567695776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee10003a00 0x7fee10003e10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fee14009fc0 tx=0x7fee10005880 comp rx=0 tx=0).stop 2023-06-23T19:03:19.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee22d9d700 1 -- 172.21.15.136:0/2567695776 reap_dead start 2023-06-23T19:03:19.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee28bff700 1 -- 172.21.15.136:0/2567695776 shutdown_connections 2023-06-23T19:03:19.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee28bff700 1 -- 172.21.15.136:0/2567695776 >> 172.21.15.136:0/2567695776 conn(0x7fee240b0ef0 msgr2=0x7fee240ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:03:19.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee28bff700 1 -- 172.21.15.136:0/2567695776 shutdown_connections 2023-06-23T19:03:19.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.903+0000 7fee28bff700 1 -- 172.21.15.136:0/2567695776 wait complete. 2023-06-23T19:03:19.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.906+0000 7fee28bff700 1 Processor -- start 2023-06-23T19:03:19.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.906+0000 7fee28bff700 1 -- start start 2023-06-23T19:03:19.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.907+0000 7fee28bff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10003a00 0x7fee2414a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:19.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.907+0000 7fee28bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2414a740 0x7fee2414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:19.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.907+0000 7fee28bff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2414f040 0x7fee24156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:19.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.907+0000 7fee28bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee241546e0 con 0x7fee2414a740 2023-06-23T19:03:19.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.907+0000 7fee28bff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee24154980 con 0x7fee2414f040 2023-06-23T19:03:19.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.907+0000 7fee28bff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee24154c60 con 0x7fee10003a00 2023-06-23T19:03:19.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2414a740 0x7fee2414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:19.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2414a740 0x7fee2414eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47718/0 (socket says 172.21.15.136:47718) 2023-06-23T19:03:19.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1bfff700 1 -- 172.21.15.136:0/1170016439 learned_addr learned my addr 172.21.15.136:0/1170016439 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:03:19.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee2259c700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10003a00 0x7fee2414a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:19.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee22d9d700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2414f040 0x7fee24156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:19.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1bfff700 1 -- 172.21.15.136:0/1170016439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10003a00 msgr2=0x7fee2414a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:19.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1bfff700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10003a00 0x7fee2414a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:19.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1bfff700 1 -- 172.21.15.136:0/1170016439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2414f040 msgr2=0x7fee24156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:19.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1bfff700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2414f040 0x7fee24156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:19.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1bfff700 1 -- 172.21.15.136:0/1170016439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee24154f40 con 0x7fee2414a740 2023-06-23T19:03:19.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1bfff700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2414a740 0x7fee2414eb00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fee0c007290 tx=0x7fee0c007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:03:19.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1affd700 1 -- 172.21.15.136:0/1170016439 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c001450 con 0x7fee2414a740 2023-06-23T19:03:19.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee1affd700 1 -- 172.21.15.136:0/1170016439 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c00f850 con 0x7fee2414a740 2023-06-23T19:03:19.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.908+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee24155220 con 0x7fee2414a740 2023-06-23T19:03:19.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.909+0000 7fee1affd700 1 -- 172.21.15.136:0/1170016439 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00fc00 con 0x7fee2414a740 2023-06-23T19:03:19.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.909+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee24155740 con 0x7fee2414a740 2023-06-23T19:03:19.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.910+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee24073910 con 0x7fee2414a740 2023-06-23T19:03:19.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.910+0000 7fee1affd700 1 -- 172.21.15.136:0/1170016439 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee0c00fd60 con 0x7fee2414a740 2023-06-23T19:03:19.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.911+0000 7fee1affd700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee0406ace0 0x7fee0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:19.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.911+0000 7fee1affd700 1 -- 172.21.15.136:0/1170016439 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fee0c089630 con 0x7fee2414a740 2023-06-23T19:03:19.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.912+0000 7fee2259c700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee0406ace0 0x7fee0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:19.919 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.912+0000 7fee2259c700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee0406ace0 0x7fee0406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee14000f80 tx=0x7fee14013000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:03:19.920 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:19.916+0000 7fee1affd700 1 -- 172.21.15.136:0/1170016439 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fee0c054590 con 0x7fee2414a740 2023-06-23T19:03:20.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.203+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fee240aea40 con 0x7fee2414a740 2023-06-23T19:03:20.207 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.204+0000 7fee1affd700 1 -- 172.21.15.136:0/1170016439 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7fee0c057bb0 con 0x7fee2414a740 2023-06-23T19:03:20.208 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:03:20.208 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","modified":"2023-06-23T18:59:58.494097Z","created":"2023-06-23T18:59:58.494097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-23T19:03:20.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee0406ace0 msgr2=0x7fee0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:20.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee0406ace0 0x7fee0406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee14000f80 tx=0x7fee14013000 comp rx=0 tx=0).stop 2023-06-23T19:03:20.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2414a740 msgr2=0x7fee2414eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:20.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2414a740 0x7fee2414eb00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fee0c007290 tx=0x7fee0c007650 comp rx=0 tx=0).stop 2023-06-23T19:03:20.210 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 shutdown_connections 2023-06-23T19:03:20.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fee0406ace0 0x7fee0406d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2414f040 0x7fee24156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10003a00 0x7fee2414a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 --2- 172.21.15.136:0/1170016439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2414a740 0x7fee2414eb00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 >> 172.21.15.136:0/1170016439 conn(0x7fee240b0ef0 msgr2=0x7fee240b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:03:20.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 shutdown_connections 2023-06-23T19:03:20.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.206+0000 7fee28bff700 1 -- 172.21.15.136:0/1170016439 wait complete. 2023-06-23T19:03:20.212 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2023-06-23T19:03:20.229 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-23T19:03:20.423 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.419+0000 7f601a3ff700 1 Processor -- start 2023-06-23T19:03:20.423 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.419+0000 7f601a3ff700 1 -- start start 2023-06-23T19:03:20.424 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.420+0000 7f601a3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f601415c8f0 0x7f60141598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:20.424 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f601a3ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f60140b14a0 0x7f60140b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:20.424 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f601a3ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60140cad90 con 0x7f60140c8ca0 2023-06-23T19:03:20.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f601a3ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60140b4350 con 0x7f60140b14a0 2023-06-23T19:03:20.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f601a3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60140b4070 con 0x7f601415c8f0 2023-06-23T19:03:20.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f601899c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f60140c8ca0 0x7f60140cb220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:45494/0 (socket says 172.21.15.136:45494) 2023-06-23T19:03:20.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f601899c700 1 -- 172.21.15.136:0/2966289105 learned_addr learned my addr 172.21.15.136:0/2966289105 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-23T19:03:20.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f600bfff700 1 --2- 172.21.15.136:0/2966289105 >> v2:172.21.15.178:3300/0 conn(0x7f60140b14a0 0x7f60140b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:20.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f6013fff700 1 --2- 172.21.15.136:0/2966289105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f601415c8f0 0x7f60141598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:20.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f60137fe700 1 -- 172.21.15.136:0/2966289105 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260671956 0 0) 0x7f60140cad90 con 0x7f60140c8ca0 2023-06-23T19:03:20.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.421+0000 7f60137fe700 1 -- 172.21.15.136:0/2966289105 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60000035b0 con 0x7f60140c8ca0 2023-06-23T19:03:20.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f60137fe700 1 -- 172.21.15.136:0/2966289105 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2770177376 0 0) 0x7f60000035b0 con 0x7f60140c8ca0 2023-06-23T19:03:20.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f600bfff700 1 -- 172.21.15.136:0/2966289105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f601415c8f0 msgr2=0x7f60141598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:03:20.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f600bfff700 1 --2- 172.21.15.136:0/2966289105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f601415c8f0 0x7f60141598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f600bfff700 1 -- 172.21.15.136:0/2966289105 >> v1:172.21.15.136:6789/0 conn(0x7f60140c8ca0 legacy=0x7f60140cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:20.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f600bfff700 1 -- 172.21.15.136:0/2966289105 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140ca740 con 0x7f60140b14a0 2023-06-23T19:03:20.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f6013fff700 1 --2- 172.21.15.136:0/2966289105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f601415c8f0 0x7f60141598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T19:03:20.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f600bfff700 1 --2- 172.21.15.136:0/2966289105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60140b14a0 0x7f60140b3820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009840 tx=0x7f5ffc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca115339c69bdae1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:03:20.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f60137fe700 1 -- 172.21.15.136:0/2966289105 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c0019f0 con 0x7f60140b14a0 2023-06-23T19:03:20.428 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f60137fe700 1 -- 172.21.15.136:0/2966289105 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc004030 con 0x7f60140b14a0 2023-06-23T19:03:20.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.422+0000 7f60137fe700 1 -- 172.21.15.136:0/2966289105 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0043c0 con 0x7f60140b14a0 2023-06-23T19:03:20.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.423+0000 7f601a3ff700 1 -- 172.21.15.136:0/2966289105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60140b14a0 msgr2=0x7f60140b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:20.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.423+0000 7f601a3ff700 1 --2- 172.21.15.136:0/2966289105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60140b14a0 0x7f60140b3820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009840 tx=0x7f5ffc009b50 comp rx=0 tx=0).stop 2023-06-23T19:03:20.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.423+0000 7f601a3ff700 1 -- 172.21.15.136:0/2966289105 shutdown_connections 2023-06-23T19:03:20.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.423+0000 7f601a3ff700 1 --2- 172.21.15.136:0/2966289105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f601415c8f0 0x7f60141598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.423+0000 7f601a3ff700 1 --2- 172.21.15.136:0/2966289105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60140b14a0 0x7f60140b3820 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.429 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.423+0000 7f601a3ff700 1 -- 172.21.15.136:0/2966289105 >> 172.21.15.136:0/2966289105 conn(0x7f6014069ef0 msgr2=0x7f601406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:03:20.430 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.423+0000 7f601a3ff700 1 -- 172.21.15.136:0/2966289105 shutdown_connections 2023-06-23T19:03:20.430 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.423+0000 7f601a3ff700 1 -- 172.21.15.136:0/2966289105 wait complete. 2023-06-23T19:03:20.432 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.425+0000 7f601a3ff700 1 Processor -- start 2023-06-23T19:03:20.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.425+0000 7f601a3ff700 1 -- start start 2023-06-23T19:03:20.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f601a3ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60140b14a0 0x7f6014158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:20.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f601a3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60140c8ca0 0x7f6014157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:20.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f601a3ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f601415c8f0 0x7f60141582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:20.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f601a3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601415adc0 con 0x7f60140c8ca0 2023-06-23T19:03:20.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f601a3ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6014164eb0 con 0x7f601415c8f0 2023-06-23T19:03:20.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f601a3ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6014159f60 con 0x7f60140b14a0 2023-06-23T19:03:20.433 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f600bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60140c8ca0 0x7f6014157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:20.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f600bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60140c8ca0 0x7f6014157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47728/0 (socket says 172.21.15.136:47728) 2023-06-23T19:03:20.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f600bfff700 1 -- 172.21.15.136:0/3426274095 learned_addr learned my addr 172.21.15.136:0/3426274095 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-23T19:03:20.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f6013fff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60140b14a0 0x7f6014158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:20.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f601899c700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f601415c8f0 0x7f60141582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:20.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f600bfff700 1 -- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60140b14a0 msgr2=0x7f6014158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:20.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f600bfff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60140b14a0 0x7f6014158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f600bfff700 1 -- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f601415c8f0 msgr2=0x7f60141582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:20.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f600bfff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f601415c8f0 0x7f60141582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.427+0000 7f600bfff700 1 -- 172.21.15.136:0/3426274095 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040094a0 con 0x7f60140c8ca0 2023-06-23T19:03:20.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.428+0000 7f6013fff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60140b14a0 0x7f6014158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:03:20.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.428+0000 7f601899c700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f601415c8f0 0x7f60141582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:03:20.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.428+0000 7f600bfff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60140c8ca0 0x7f6014157d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00a010 tx=0x7f5ffc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:03:20.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.428+0000 7f60117fa700 1 -- 172.21.15.136:0/3426274095 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc003e10 con 0x7f60140c8ca0 2023-06-23T19:03:20.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.428+0000 7f60117fa700 1 -- 172.21.15.136:0/3426274095 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc01f070 con 0x7f60140c8ca0 2023-06-23T19:03:20.435 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.428+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc0094a0 con 0x7f60140c8ca0 2023-06-23T19:03:20.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.428+0000 7f60117fa700 1 -- 172.21.15.136:0/3426274095 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc011870 con 0x7f60140c8ca0 2023-06-23T19:03:20.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.428+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601415a2f0 con 0x7f60140c8ca0 2023-06-23T19:03:20.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.429+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6014165020 con 0x7f60140c8ca0 2023-06-23T19:03:20.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.430+0000 7f60117fa700 1 -- 172.21.15.136:0/3426274095 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ffc0119d0 con 0x7f60140c8ca0 2023-06-23T19:03:20.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.431+0000 7f60117fa700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5ff406ace0 0x7f5ff406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:03:20.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.431+0000 7f60117fa700 1 -- 172.21.15.136:0/3426274095 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5ffc021070 con 0x7f60140c8ca0 2023-06-23T19:03:20.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.431+0000 7f6013fff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5ff406ace0 0x7f5ff406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:03:20.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.432+0000 7f6013fff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5ff406ace0 0x7f5ff406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6004009d20 tx=0x7f6004008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:03:20.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.435+0000 7f60117fa700 1 -- 172.21.15.136:0/3426274095 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6014165020 con 0x7f60140c8ca0 2023-06-23T19:03:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.710+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f6014165020 con 0x7f60140c8ca0 2023-06-23T19:03:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.710+0000 7f60117fa700 1 -- 172.21.15.136:0/3426274095 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f6014165020 con 0x7f60140c8ca0 2023-06-23T19:03:20.714 INFO:teuthology.orchestra.run.smithi136.stdout:[client.admin] 2023-06-23T19:03:20.714 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== 2023-06-23T19:03:20.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.712+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5ff406ace0 msgr2=0x7f5ff406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:20.716 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.712+0000 7f601a3ff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5ff406ace0 0x7f5ff406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6004009d20 tx=0x7f6004008040 comp rx=0 tx=0).stop 2023-06-23T19:03:20.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.712+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60140c8ca0 msgr2=0x7f6014157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:03:20.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.712+0000 7f601a3ff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60140c8ca0 0x7f6014157d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00a010 tx=0x7f5ffc004750 comp rx=0 tx=0).stop 2023-06-23T19:03:20.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.712+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 shutdown_connections 2023-06-23T19:03:20.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.712+0000 7f601a3ff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f5ff406ace0 0x7f5ff406d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.712+0000 7f601a3ff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f601415c8f0 0x7f60141582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.712+0000 7f601a3ff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60140b14a0 0x7f6014158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.713+0000 7f601a3ff700 1 --2- 172.21.15.136:0/3426274095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60140c8ca0 0x7f6014157d60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:03:20.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.713+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 >> 172.21.15.136:0/3426274095 conn(0x7f6014069ef0 msgr2=0x7f60140b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:03:20.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.713+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 shutdown_connections 2023-06-23T19:03:20.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-23T19:03:20.713+0000 7f601a3ff700 1 -- 172.21.15.136:0/3426274095 wait complete. 2023-06-23T19:03:20.734 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:03:20.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/tmp/tmp.AfPoID7zOVxfstests-dev/local.config 2023-06-23T19:03:20.802 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.136:6789:/test export TEST_DIR=/tmp/tmp.4pZPdhEOtdtest export SCRATCH_DEV=172.21.15.136:6789:/scratch export SCRATCH_MNT=/tmp/tmp.FtStipGKalscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg==" 2023-06-23T19:03:20.803 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-23T19:03:20.804 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/tmp/tmp.AfPoID7zOVxfstests-dev/ceph.exclude 2023-06-23T19:03:20.909 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo make) 2023-06-23T19:03:21.063 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize -cfi 2023-06-23T19:03:21.563 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-23T19:03:21.564 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file './config.guess' 2023-06-23T19:03:21.573 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file './config.sub' 2023-06-23T19:03:21.583 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file './install-sh' 2023-06-23T19:03:21.594 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file './ltmain.sh' 2023-06-23T19:03:21.655 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-23T19:03:21.656 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-23T19:03:21.668 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-23T19:03:21.681 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-23T19:03:21.693 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-23T19:03:21.706 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-23T19:03:21.722 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-23T19:03:21.725 INFO:teuthology.orchestra.run.smithi136.stdout:cp include/install-sh . 2023-06-23T19:03:21.728 INFO:teuthology.orchestra.run.smithi136.stdout:aclocal -I m4 2023-06-23T19:03:22.982 INFO:teuthology.orchestra.run.smithi136.stdout:autoheader 2023-06-23T19:03:23.339 INFO:teuthology.orchestra.run.smithi136.stdout:autoconf 2023-06-23T19:03:23.552 INFO:teuthology.orchestra.run.smithi136.stdout:./configure \ 2023-06-23T19:03:23.552 INFO:teuthology.orchestra.run.smithi136.stdout: --libexecdir=/usr/lib \ 2023-06-23T19:03:23.552 INFO:teuthology.orchestra.run.smithi136.stdout: --exec_prefix=/var/lib 2023-06-23T19:03:24.170 INFO:teuthology.orchestra.run.smithi136.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-23T19:03:24.171 INFO:teuthology.orchestra.run.smithi136.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-23T19:03:24.175 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to print strings... printf 2023-06-23T19:03:24.175 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc... gcc 2023-06-23T19:03:24.409 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether the C compiler works... yes 2023-06-23T19:03:24.410 INFO:teuthology.orchestra.run.smithi136.stdout:checking for C compiler default output file name... a.out 2023-06-23T19:03:24.460 INFO:teuthology.orchestra.run.smithi136.stdout:checking for suffix of executables... 2023-06-23T19:03:24.553 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether we are cross compiling... no 2023-06-23T19:03:24.590 INFO:teuthology.orchestra.run.smithi136.stdout:checking for suffix of object files... o 2023-06-23T19:03:24.624 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether we are using the GNU C compiler... yes 2023-06-23T19:03:24.658 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether gcc accepts -g... yes 2023-06-23T19:03:24.707 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-23T19:03:24.715 INFO:teuthology.orchestra.run.smithi136.stdout:checking for a sed that does not truncate output... /bin/sed 2023-06-23T19:03:24.720 INFO:teuthology.orchestra.run.smithi136.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-06-23T19:03:24.723 INFO:teuthology.orchestra.run.smithi136.stdout:checking for egrep... /bin/grep -E 2023-06-23T19:03:24.726 INFO:teuthology.orchestra.run.smithi136.stdout:checking for fgrep... /bin/grep -F 2023-06-23T19:03:24.734 INFO:teuthology.orchestra.run.smithi136.stdout:checking for ld used by gcc... /bin/ld 2023-06-23T19:03:24.739 INFO:teuthology.orchestra.run.smithi136.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-06-23T19:03:24.749 INFO:teuthology.orchestra.run.smithi136.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-06-23T19:03:24.788 INFO:teuthology.orchestra.run.smithi136.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-06-23T19:03:24.789 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether ln -s works... yes 2023-06-23T19:03:24.805 INFO:teuthology.orchestra.run.smithi136.stdout:checking the maximum length of command line arguments... 1572864 2023-06-23T19:03:24.812 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-23T19:03:24.812 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-23T19:03:24.812 INFO:teuthology.orchestra.run.smithi136.stdout:checking for /bin/ld option to reload object files... -r 2023-06-23T19:03:24.812 INFO:teuthology.orchestra.run.smithi136.stdout:checking for objdump... objdump 2023-06-23T19:03:24.813 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to recognize dependent libraries... pass_all 2023-06-23T19:03:24.813 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dlltool... no 2023-06-23T19:03:24.814 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-23T19:03:24.814 INFO:teuthology.orchestra.run.smithi136.stdout:checking for ar... ar 2023-06-23T19:03:24.882 INFO:teuthology.orchestra.run.smithi136.stdout:checking for archiver @FILE support... @ 2023-06-23T19:03:24.882 INFO:teuthology.orchestra.run.smithi136.stdout:checking for strip... strip 2023-06-23T19:03:24.883 INFO:teuthology.orchestra.run.smithi136.stdout:checking for ranlib... ranlib 2023-06-23T19:03:24.883 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gawk... gawk 2023-06-23T19:03:24.993 INFO:teuthology.orchestra.run.smithi136.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-06-23T19:03:24.996 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sysroot... no 2023-06-23T19:03:25.004 INFO:teuthology.orchestra.run.smithi136.stdout:checking for a working dd... /bin/dd 2023-06-23T19:03:25.012 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-06-23T19:03:25.040 INFO:teuthology.orchestra.run.smithi136.stdout:checking for mt... no 2023-06-23T19:03:25.046 INFO:teuthology.orchestra.run.smithi136.stdout:checking if : is a manifest tool... no 2023-06-23T19:03:25.101 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to run the C preprocessor... gcc -E 2023-06-23T19:03:25.322 INFO:teuthology.orchestra.run.smithi136.stdout:checking for ANSI C header files... yes 2023-06-23T19:03:25.365 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/types.h... yes 2023-06-23T19:03:25.421 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/stat.h... yes 2023-06-23T19:03:25.473 INFO:teuthology.orchestra.run.smithi136.stdout:checking for stdlib.h... yes 2023-06-23T19:03:25.526 INFO:teuthology.orchestra.run.smithi136.stdout:checking for string.h... yes 2023-06-23T19:03:25.580 INFO:teuthology.orchestra.run.smithi136.stdout:checking for memory.h... yes 2023-06-23T19:03:25.634 INFO:teuthology.orchestra.run.smithi136.stdout:checking for strings.h... yes 2023-06-23T19:03:25.690 INFO:teuthology.orchestra.run.smithi136.stdout:checking for inttypes.h... yes 2023-06-23T19:03:25.744 INFO:teuthology.orchestra.run.smithi136.stdout:checking for stdint.h... yes 2023-06-23T19:03:25.803 INFO:teuthology.orchestra.run.smithi136.stdout:checking for unistd.h... yes 2023-06-23T19:03:25.855 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dlfcn.h... yes 2023-06-23T19:03:25.863 INFO:teuthology.orchestra.run.smithi136.stdout:checking for objdir... .libs 2023-06-23T19:03:25.999 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-23T19:03:26.000 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-23T19:03:26.039 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-23T19:03:26.079 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc static flag -static works... no 2023-06-23T19:03:26.137 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc supports -c -o file.o... yes 2023-06-23T19:03:26.137 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-23T19:03:26.148 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-23T19:03:26.197 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether -lc should be explicitly linked in... no 2023-06-23T19:03:26.290 INFO:teuthology.orchestra.run.smithi136.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-23T19:03:26.290 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to hardcode library paths into programs... immediate 2023-06-23T19:03:26.296 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether stripping libraries is possible... yes 2023-06-23T19:03:26.296 INFO:teuthology.orchestra.run.smithi136.stdout:checking if libtool supports shared libraries... yes 2023-06-23T19:03:26.296 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether to build shared libraries... yes 2023-06-23T19:03:26.296 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether to build static libraries... yes 2023-06-23T19:03:26.308 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc... (cached) gcc 2023-06-23T19:03:26.347 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-23T19:03:26.348 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-23T19:03:26.348 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-23T19:03:26.349 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gmake... /usr/bin/gmake 2023-06-23T19:03:26.349 INFO:teuthology.orchestra.run.smithi136.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-06-23T19:03:26.351 INFO:teuthology.orchestra.run.smithi136.stdout:checking for tar... /bin/tar 2023-06-23T19:03:26.352 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gzip... /bin/gzip 2023-06-23T19:03:26.364 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether gcc -MM is supported... yes 2023-06-23T19:03:26.367 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sort... /bin/sort 2023-06-23T19:03:26.367 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether ln -s works... yes 2023-06-23T19:03:26.367 INFO:teuthology.orchestra.run.smithi136.stdout:checking for rpm... /bin/rpm 2023-06-23T19:03:26.374 INFO:teuthology.orchestra.run.smithi136.stdout:checking for rpmbuild... no 2023-06-23T19:03:26.428 INFO:teuthology.orchestra.run.smithi136.stdout:checking assert.h usability... yes 2023-06-23T19:03:26.444 INFO:teuthology.orchestra.run.smithi136.stdout:checking assert.h presence... yes 2023-06-23T19:03:26.445 INFO:teuthology.orchestra.run.smithi136.stdout:checking for assert.h... yes 2023-06-23T19:03:26.502 INFO:teuthology.orchestra.run.smithi136.stdout:checking bstring.h usability... no 2023-06-23T19:03:26.527 INFO:teuthology.orchestra.run.smithi136.stdout:checking bstring.h presence... no 2023-06-23T19:03:26.527 INFO:teuthology.orchestra.run.smithi136.stdout:checking for bstring.h... no 2023-06-23T19:03:26.576 INFO:teuthology.orchestra.run.smithi136.stdout:checking libgen.h usability... yes 2023-06-23T19:03:26.592 INFO:teuthology.orchestra.run.smithi136.stdout:checking libgen.h presence... yes 2023-06-23T19:03:26.592 INFO:teuthology.orchestra.run.smithi136.stdout:checking for libgen.h... yes 2023-06-23T19:03:26.651 INFO:teuthology.orchestra.run.smithi136.stdout:checking dirent.h usability... yes 2023-06-23T19:03:26.668 INFO:teuthology.orchestra.run.smithi136.stdout:checking dirent.h presence... yes 2023-06-23T19:03:26.668 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dirent.h... yes 2023-06-23T19:03:26.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:26.682 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:26.754 INFO:teuthology.orchestra.run.smithi136.stdout:checking errno.h usability... yes 2023-06-23T19:03:26.771 INFO:teuthology.orchestra.run.smithi136.stdout:checking errno.h presence... yes 2023-06-23T19:03:26.771 INFO:teuthology.orchestra.run.smithi136.stdout:checking for errno.h... yes 2023-06-23T19:03:26.828 INFO:teuthology.orchestra.run.smithi136.stdout:checking malloc.h usability... yes 2023-06-23T19:03:26.846 INFO:teuthology.orchestra.run.smithi136.stdout:checking malloc.h presence... yes 2023-06-23T19:03:26.846 INFO:teuthology.orchestra.run.smithi136.stdout:checking for malloc.h... yes 2023-06-23T19:03:26.904 INFO:teuthology.orchestra.run.smithi136.stdout:checking uuid.h usability... no 2023-06-23T19:03:26.928 INFO:teuthology.orchestra.run.smithi136.stdout:checking uuid.h presence... no 2023-06-23T19:03:26.929 INFO:teuthology.orchestra.run.smithi136.stdout:checking for uuid.h... no 2023-06-23T19:03:26.981 INFO:teuthology.orchestra.run.smithi136.stdout:checking uuid/uuid.h usability... yes 2023-06-23T19:03:27.000 INFO:teuthology.orchestra.run.smithi136.stdout:checking uuid/uuid.h presence... yes 2023-06-23T19:03:27.001 INFO:teuthology.orchestra.run.smithi136.stdout:checking for uuid/uuid.h... yes 2023-06-23T19:03:27.059 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/uuid.h usability... no 2023-06-23T19:03:27.082 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/uuid.h presence... no 2023-06-23T19:03:27.083 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/uuid.h... no 2023-06-23T19:03:27.133 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/file.h usability... yes 2023-06-23T19:03:27.150 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/file.h presence... yes 2023-06-23T19:03:27.151 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/file.h... yes 2023-06-23T19:03:27.208 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fcntl.h usability... yes 2023-06-23T19:03:27.226 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fcntl.h presence... yes 2023-06-23T19:03:27.226 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/fcntl.h... yes 2023-06-23T19:03:27.282 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/syssgi.h usability... no 2023-06-23T19:03:27.307 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/syssgi.h presence... no 2023-06-23T19:03:27.307 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/syssgi.h... no 2023-06-23T19:03:27.379 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/param.h usability... yes 2023-06-23T19:03:27.401 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/param.h presence... yes 2023-06-23T19:03:27.401 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/param.h... yes 2023-06-23T19:03:27.415 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/stat.h... (cached) yes 2023-06-23T19:03:27.479 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/statvfs.h usability... yes 2023-06-23T19:03:27.496 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/statvfs.h presence... yes 2023-06-23T19:03:27.496 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/statvfs.h... yes 2023-06-23T19:03:27.553 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/time.h usability... yes 2023-06-23T19:03:27.570 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/time.h presence... yes 2023-06-23T19:03:27.570 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/time.h... yes 2023-06-23T19:03:27.631 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/ioctl.h usability... yes 2023-06-23T19:03:27.647 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/ioctl.h presence... yes 2023-06-23T19:03:27.648 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/ioctl.h... yes 2023-06-23T19:03:27.708 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/wait.h usability... yes 2023-06-23T19:03:27.728 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/wait.h presence... yes 2023-06-23T19:03:27.729 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/wait.h... yes 2023-06-23T19:03:27.743 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/types.h... (cached) yes 2023-06-23T19:03:27.758 INFO:teuthology.orchestra.run.smithi136.stdout:checking for strings.h... (cached) yes 2023-06-23T19:03:27.815 INFO:teuthology.orchestra.run.smithi136.stdout:checking err.h usability... yes 2023-06-23T19:03:27.838 INFO:teuthology.orchestra.run.smithi136.stdout:checking err.h presence... yes 2023-06-23T19:03:27.838 INFO:teuthology.orchestra.run.smithi136.stdout:checking for err.h... yes 2023-06-23T19:03:27.890 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/falloc.h usability... yes 2023-06-23T19:03:27.905 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/falloc.h presence... yes 2023-06-23T19:03:27.906 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/falloc.h... yes 2023-06-23T19:03:27.962 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-23T19:03:27.987 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-23T19:03:27.987 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-23T19:03:28.036 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-23T19:03:28.061 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-23T19:03:28.062 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-23T19:03:28.110 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfs/platform_defs.h usability... no 2023-06-23T19:03:28.135 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfs/platform_defs.h presence... no 2023-06-23T19:03:28.135 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/platform_defs.h... no 2023-06-23T19:03:28.184 INFO:teuthology.orchestra.run.smithi136.stdout:checking btrfs/ioctl.h usability... no 2023-06-23T19:03:28.209 INFO:teuthology.orchestra.run.smithi136.stdout:checking btrfs/ioctl.h presence... no 2023-06-23T19:03:28.209 INFO:teuthology.orchestra.run.smithi136.stdout:checking for btrfs/ioctl.h... no 2023-06-23T19:03:28.258 INFO:teuthology.orchestra.run.smithi136.stdout:checking cifs/ioctl.h usability... no 2023-06-23T19:03:28.283 INFO:teuthology.orchestra.run.smithi136.stdout:checking cifs/ioctl.h presence... no 2023-06-23T19:03:28.283 INFO:teuthology.orchestra.run.smithi136.stdout:checking for cifs/ioctl.h... no 2023-06-23T19:03:28.333 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/mman.h usability... yes 2023-06-23T19:03:28.350 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/mman.h presence... yes 2023-06-23T19:03:28.350 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/mman.h... yes 2023-06-23T19:03:28.388 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/xfs_log_format.h... no 2023-06-23T19:03:28.455 INFO:teuthology.orchestra.run.smithi136.stdout:checking for uuid_compare... no 2023-06-23T19:03:28.512 INFO:teuthology.orchestra.run.smithi136.stdout:checking for uuid_compare in -luuid... yes 2023-06-23T19:03:28.594 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/xfs.h... yes 2023-06-23T19:03:28.626 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/libxfs.h... no 2023-06-23T19:03:28.666 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-23T19:03:28.718 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/xqm.h... yes 2023-06-23T19:03:28.797 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-23T19:03:28.842 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfs/handle.h usability... yes 2023-06-23T19:03:28.858 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfs/handle.h presence... yes 2023-06-23T19:03:28.858 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/handle.h... yes 2023-06-23T19:03:28.934 INFO:teuthology.orchestra.run.smithi136.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-23T19:03:28.985 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/acl.h usability... yes 2023-06-23T19:03:29.004 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/acl.h presence... yes 2023-06-23T19:03:29.004 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/acl.h... yes 2023-06-23T19:03:29.056 INFO:teuthology.orchestra.run.smithi136.stdout:checking acl/libacl.h usability... yes 2023-06-23T19:03:29.075 INFO:teuthology.orchestra.run.smithi136.stdout:checking acl/libacl.h presence... yes 2023-06-23T19:03:29.075 INFO:teuthology.orchestra.run.smithi136.stdout:checking for acl/libacl.h... yes 2023-06-23T19:03:29.135 INFO:teuthology.orchestra.run.smithi136.stdout:checking for acl_init in -lacl... yes 2023-06-23T19:03:29.180 INFO:teuthology.orchestra.run.smithi136.stdout:checking gdbm-ndbm.h usability... no 2023-06-23T19:03:29.205 INFO:teuthology.orchestra.run.smithi136.stdout:checking gdbm-ndbm.h presence... no 2023-06-23T19:03:29.206 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gdbm-ndbm.h... no 2023-06-23T19:03:29.248 INFO:teuthology.orchestra.run.smithi136.stdout:checking gdbm/ndbm.h usability... no 2023-06-23T19:03:29.272 INFO:teuthology.orchestra.run.smithi136.stdout:checking gdbm/ndbm.h presence... no 2023-06-23T19:03:29.272 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gdbm/ndbm.h... no 2023-06-23T19:03:29.315 INFO:teuthology.orchestra.run.smithi136.stdout:checking ndbm.h usability... no 2023-06-23T19:03:29.339 INFO:teuthology.orchestra.run.smithi136.stdout:checking ndbm.h presence... no 2023-06-23T19:03:29.340 INFO:teuthology.orchestra.run.smithi136.stdout:checking for ndbm.h... no 2023-06-23T19:03:29.386 INFO:teuthology.orchestra.run.smithi136.stdout:checking libaio.h usability... yes 2023-06-23T19:03:29.408 INFO:teuthology.orchestra.run.smithi136.stdout:checking libaio.h presence... yes 2023-06-23T19:03:29.408 INFO:teuthology.orchestra.run.smithi136.stdout:checking for libaio.h... yes 2023-06-23T19:03:29.453 INFO:teuthology.orchestra.run.smithi136.stdout:checking liburing.h usability... no 2023-06-23T19:03:29.478 INFO:teuthology.orchestra.run.smithi136.stdout:checking liburing.h presence... no 2023-06-23T19:03:29.478 INFO:teuthology.orchestra.run.smithi136.stdout:checking for liburing.h... no 2023-06-23T19:03:29.520 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/capability.h usability... no 2023-06-23T19:03:29.544 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/capability.h presence... no 2023-06-23T19:03:29.545 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/capability.h... no 2023-06-23T19:03:29.588 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/fiemap.h usability... yes 2023-06-23T19:03:29.605 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/fiemap.h presence... yes 2023-06-23T19:03:29.605 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/fiemap.h... yes 2023-06-23T19:03:29.666 INFO:teuthology.orchestra.run.smithi136.stdout:checking for fallocate... yes 2023-06-23T19:03:29.726 INFO:teuthology.orchestra.run.smithi136.stdout:checking for open_by_handle_at... yes 2023-06-23T19:03:29.772 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/prctl.h usability... yes 2023-06-23T19:03:29.789 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/prctl.h presence... yes 2023-06-23T19:03:29.790 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/prctl.h... yes 2023-06-23T19:03:29.855 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/fs.h usability... yes 2023-06-23T19:03:29.874 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/fs.h presence... yes 2023-06-23T19:03:29.874 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/fs.h... yes 2023-06-23T19:03:29.918 INFO:teuthology.orchestra.run.smithi136.stdout:checking btrfsutil.h usability... no 2023-06-23T19:03:29.943 INFO:teuthology.orchestra.run.smithi136.stdout:checking btrfsutil.h presence... no 2023-06-23T19:03:29.943 INFO:teuthology.orchestra.run.smithi136.stdout:checking for btrfsutil.h... no 2023-06-23T19:03:30.005 INFO:teuthology.orchestra.run.smithi136.stdout:checking for copy_file_range... yes 2023-06-23T19:03:30.069 INFO:teuthology.orchestra.run.smithi136.stdout:checking for SEEK_DATA... yes 2023-06-23T19:03:30.149 INFO:teuthology.orchestra.run.smithi136.stdout:checking for BMV_OF_SHARED... yes 2023-06-23T19:03:30.213 INFO:teuthology.orchestra.run.smithi136.stdout:checking for nftw... yes 2023-06-23T19:03:30.275 INFO:teuthology.orchestra.run.smithi136.stdout:checking for RLIMIT_NOFILE... yes 2023-06-23T19:03:30.314 INFO:teuthology.orchestra.run.smithi136.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-23T19:03:30.375 INFO:teuthology.orchestra.run.smithi136.stdout:checking for renameat2... yes 2023-06-23T19:03:30.436 INFO:teuthology.orchestra.run.smithi136.stdout:checking for reallocarray... yes 2023-06-23T19:03:30.469 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct mount_attr... no 2023-06-23T19:03:30.551 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-23T19:03:30.625 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-23T19:03:30.698 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-23T19:03:30.772 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-23T19:03:30.845 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-23T19:03:30.920 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-23T19:03:30.995 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-23T19:03:31.049 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/btrfs.h usability... yes 2023-06-23T19:03:31.066 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/btrfs.h presence... yes 2023-06-23T19:03:31.066 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/btrfs.h... yes 2023-06-23T19:03:31.138 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-23T19:03:31.155 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-23T19:03:31.156 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/btrfs_tree.h... yes 2023-06-23T19:03:31.230 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-23T19:03:31.282 INFO:teuthology.orchestra.run.smithi136.stdout:configure: creating ./config.status 2023-06-23T19:03:32.185 INFO:teuthology.orchestra.run.smithi136.stdout:config.status: creating include/builddefs 2023-06-23T19:03:32.214 INFO:teuthology.orchestra.run.smithi136.stdout:config.status: creating include/config.h 2023-06-23T19:03:32.236 INFO:teuthology.orchestra.run.smithi136.stdout:config.status: executing libtool commands 2023-06-23T19:03:32.316 INFO:teuthology.orchestra.run.smithi136.stdout:Building include 2023-06-23T19:03:32.323 INFO:teuthology.orchestra.run.smithi136.stdout:Building lib 2023-06-23T19:03:32.329 INFO:teuthology.orchestra.run.smithi136.stdout: [LTDEP] 2023-06-23T19:03:32.538 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dataascii.lo 2023-06-23T19:03:32.740 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] databin.lo 2023-06-23T19:03:32.974 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] datapid.lo 2023-06-23T19:03:33.163 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] file_lock.lo 2023-06-23T19:03:33.398 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] forker.lo 2023-06-23T19:03:33.616 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] pattern.lo 2023-06-23T19:03:33.818 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] open_flags.lo 2023-06-23T19:03:34.047 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] random_range.lo 2023-06-23T19:03:34.352 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] string_to_tokens.lo 2023-06-23T19:03:34.539 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] str_to_bytes.lo 2023-06-23T19:03:34.754 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] tlibio.lo 2023-06-23T19:03:35.075 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] write_log.lo 2023-06-23T19:03:35.398 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] random.lo 2023-06-23T19:03:35.606 INFO:teuthology.orchestra.run.smithi136.stdout: [LD] 2023-06-23T19:03:35.728 INFO:teuthology.orchestra.run.smithi136.stdout:Building ltp 2023-06-23T19:03:35.735 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2023-06-23T19:03:35.943 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] doio 2023-06-23T19:03:36.684 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fsstress 2023-06-23T19:03:38.064 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fsx 2023-06-23T19:03:39.017 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] growfiles 2023-06-23T19:03:39.620 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] iogen 2023-06-23T19:03:40.070 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-stress 2023-06-23T19:03:40.583 INFO:teuthology.orchestra.run.smithi136.stdout:Building src 2023-06-23T19:03:40.592 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2023-06-23T19:03:42.995 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2023-06-23T19:03:43.045 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2023-06-23T19:03:43.061 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2023-06-23T19:03:43.399 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2023-06-23T19:03:43.439 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dirstress 2023-06-23T19:03:43.778 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fill 2023-06-23T19:03:44.031 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fill2 2023-06-23T19:03:44.365 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] getpagesize 2023-06-23T19:03:44.599 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] holes 2023-06-23T19:03:44.894 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] lstat64 2023-06-23T19:03:45.180 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] nametest 2023-06-23T19:03:45.522 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] permname 2023-06-23T19:03:45.822 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] randholes 2023-06-23T19:03:46.170 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] runas 2023-06-23T19:03:46.448 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] truncfile 2023-06-23T19:03:46.728 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] usemem 2023-06-23T19:03:46.979 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mmapcat 2023-06-23T19:03:47.228 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] append_reader 2023-06-23T19:03:47.481 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] append_writer 2023-06-23T19:03:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dirperf 2023-06-23T19:03:48.054 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] metaperf 2023-06-23T19:03:48.403 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] devzero 2023-06-23T19:03:48.681 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] feature 2023-06-23T19:03:48.997 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] alloc 2023-06-23T19:03:49.309 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fault 2023-06-23T19:03:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fstest 2023-06-23T19:03:49.912 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_access_root 2023-06-23T19:03:50.167 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] godown 2023-06-23T19:03:50.463 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] resvtest 2023-06-23T19:03:50.748 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] writemod 2023-06-23T19:03:50.993 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] writev_on_pagefault 2023-06-23T19:03:51.251 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] makeextents 2023-06-23T19:03:51.534 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] itrash 2023-06-23T19:03:51.788 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] rename 2023-06-23T19:03:52.027 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] multi_open_unlink 2023-06-23T19:03:52.291 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] unwritten_sync 2023-06-23T19:03:52.573 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] genhashnames 2023-06-23T19:03:52.858 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_holes 2023-06-23T19:03:53.105 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_writev 2023-06-23T19:03:53.351 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_truncate_cmtime 2023-06-23T19:03:53.609 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dirhash_collide 2023-06-23T19:03:53.890 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_rename_overwrite 2023-06-23T19:03:54.133 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] holetest 2023-06-23T19:03:54.449 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_truncate_self 2023-06-23T19:03:54.688 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] af_unix 2023-06-23T19:03:54.943 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_stale_pmd 2023-06-23T19:03:55.197 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_cow_race 2023-06-23T19:03:55.464 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_fallocate 2023-06-23T19:03:55.714 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fsync-err 2023-06-23T19:03:55.998 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_write_ro 2023-06-23T19:03:56.248 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-23T19:03:56.507 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-23T19:03:56.761 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_ofd_locks 2023-06-23T19:03:56.857 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:56.862 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_collision 2023-06-23T19:03:57.361 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mmap-write-concurrent 2023-06-23T19:03:57.629 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_get_file_time 2023-06-23T19:03:57.876 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_create_short_dirs 2023-06-23T19:03:58.142 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_create_long_dirs 2023-06-23T19:03:58.405 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_enospc 2023-06-23T19:03:58.689 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_writev_overlap 2023-06-23T19:03:58.958 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] checkpoint_journal 2023-06-23T19:03:59.213 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mmap-rw-fault 2023-06-23T19:03:59.491 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] allocstale 2023-06-23T19:03:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_cow_memory_failure 2023-06-23T19:04:00.031 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fake-dump-rootino 2023-06-23T19:04:00.282 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dio-buf-fault 2023-06-23T19:04:00.535 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] xfsctl 2023-06-23T19:04:00.824 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] bstat 2023-06-23T19:04:01.129 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mtab 2023-06-23T19:04:01.412 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] getdevicesize 2023-06-23T19:04:01.652 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] preallo_rw_pattern_reader 2023-06-23T19:04:01.913 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] preallo_rw_pattern_writer 2023-06-23T19:04:02.176 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] ftrunc 2023-06-23T19:04:02.424 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] trunc 2023-06-23T19:04:02.685 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fs_perms 2023-06-23T19:04:02.950 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] testx 2023-06-23T19:04:03.180 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] looptest 2023-06-23T19:04:03.475 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] locktest 2023-06-23T19:04:03.878 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] unwritten_mmap 2023-06-23T19:04:04.146 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] bulkstat_unlink_test 2023-06-23T19:04:04.448 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] deduperace 2023-06-23T19:04:04.741 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] bulkstat_unlink_test_modified 2023-06-23T19:04:05.040 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_dir_offset 2023-06-23T19:04:05.288 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_futimens 2023-06-23T19:04:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_immutable 2023-06-23T19:04:06.225 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] stale_handle 2023-06-23T19:04:06.496 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] pwrite_mmap_blocked 2023-06-23T19:04:06.751 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_dir_offset2 2023-06-23T19:04:07.044 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] seek_sanity_test 2023-06-23T19:04:07.550 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] seek_copy_test 2023-06-23T19:04:07.826 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_readdir_1 2023-06-23T19:04:08.074 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_readdir_2 2023-06-23T19:04:08.326 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fsync-tester 2023-06-23T19:04:08.672 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] nsexec 2023-06-23T19:04:08.947 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] cloner 2023-06-23T19:04:09.228 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] renameat2 2023-06-23T19:04:09.496 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_getcwd 2023-06-23T19:04:09.754 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] e4compact 2023-06-23T19:04:10.057 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] test-nextquota 2023-06-23T19:04:10.329 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] punch-alternating 2023-06-23T19:04:10.605 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-23T19:04:10.873 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] listxattr 2023-06-23T19:04:11.123 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dio-interleaved 2023-06-23T19:04:11.384 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_dir_type 2023-06-23T19:04:11.642 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dio-invalidate-cache 2023-06-23T19:04:11.945 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] stat_test 2023-06-23T19:04:12.337 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_encrypted_d_revalidate 2023-06-23T19:04:12.603 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] attr_replace_test 2023-06-23T19:04:12.868 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] swapon 2023-06-23T19:04:13.134 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mkswap 2023-06-23T19:04:13.386 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_attr_corruption 2023-06-23T19:04:13.636 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_open_tmpfiles 2023-06-23T19:04:13.917 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fscrypt-crypt-util 2023-06-23T19:04:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] bulkstat_null_ocount 2023-06-23T19:04:14.897 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] splice-test 2023-06-23T19:04:15.179 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] chprojid_fail 2023-06-23T19:04:15.445 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] detached_mounts_propagation 2023-06-23T19:04:15.731 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] ext4_resize 2023-06-23T19:04:15.980 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_readdir_3 2023-06-23T19:04:16.275 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] splice2pipe 2023-06-23T19:04:16.538 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] uuid_ioctl 2023-06-23T19:04:16.794 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fiemap-tester 2023-06-23T19:04:17.159 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_stripealign 2023-06-23T19:04:17.415 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] open_by_handle 2023-06-23T19:04:17.766 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_dio 2023-06-23T19:04:18.032 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] xfsfind 2023-06-23T19:04:18.328 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fssum 2023-06-23T19:04:18.854 INFO:teuthology.orchestra.run.smithi136.stdout:Building log-writes 2023-06-23T19:04:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] replay-log 2023-06-23T19:04:19.280 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2023-06-23T19:04:19.286 INFO:teuthology.orchestra.run.smithi136.stdout:Building aio-dio-regress 2023-06-23T19:04:19.298 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-23T19:04:19.578 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-fcntl-race 2023-06-23T19:04:19.845 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-subblock-eof-read 2023-06-23T19:04:20.094 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-append-write-read-race 2023-06-23T19:04:20.373 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-invalidate-readahead 2023-06-23T19:04:20.642 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-write-verify 2023-06-23T19:04:20.937 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-23T19:04:21.176 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-last-ref-held-by-io 2023-06-23T19:04:21.454 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-cycle-write 2023-06-23T19:04:21.741 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-extend-stat 2023-06-23T19:04:22.013 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-23T19:04:22.249 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-hole-filling-race 2023-06-23T19:04:22.503 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-invalidate-failure 2023-06-23T19:04:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aiodio_sparse2 2023-06-23T19:04:23.088 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aiocp 2023-06-23T19:04:23.414 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-cow-race 2023-06-23T19:04:23.672 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-eof-race 2023-06-23T19:04:23.960 INFO:teuthology.orchestra.run.smithi136.stdout:Building vfs 2023-06-23T19:04:23.970 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] vfstest 2023-06-23T19:04:25.963 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mount-idmapped 2023-06-23T19:04:26.448 INFO:teuthology.orchestra.run.smithi136.stdout:Building m4 2023-06-23T19:04:26.455 INFO:teuthology.orchestra.run.smithi136.stdout:Building common 2023-06-23T19:04:26.462 INFO:teuthology.orchestra.run.smithi136.stdout:Building tests 2023-06-23T19:04:26.472 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2023-06-23T19:04:26.483 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/perf/group.list 2023-06-23T19:04:26.512 INFO:teuthology.orchestra.run.smithi136.stdout:Building ext4 2023-06-23T19:04:26.522 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/ext4/group.list 2023-06-23T19:04:26.616 INFO:teuthology.orchestra.run.smithi136.stdout:Building ocfs2 2023-06-23T19:04:26.626 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/ocfs2/group.list 2023-06-23T19:04:26.659 INFO:teuthology.orchestra.run.smithi136.stdout:Building overlay 2023-06-23T19:04:26.673 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/overlay/group.list 2023-06-23T19:04:26.765 INFO:teuthology.orchestra.run.smithi136.stdout:Building cifs 2023-06-23T19:04:26.775 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/cifs/group.list 2023-06-23T19:04:26.806 INFO:teuthology.orchestra.run.smithi136.stdout:Building generic 2023-06-23T19:04:26.818 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/generic/group.list 2023-06-23T19:04:27.004 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:27.010 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:27.064 INFO:teuthology.orchestra.run.smithi136.stdout:Building shared 2023-06-23T19:04:27.074 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/shared/group.list 2023-06-23T19:04:27.118 INFO:teuthology.orchestra.run.smithi136.stdout:Building nfs 2023-06-23T19:04:27.127 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/nfs/group.list 2023-06-23T19:04:27.165 INFO:teuthology.orchestra.run.smithi136.stdout:Building f2fs 2023-06-23T19:04:27.174 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/f2fs/group.list 2023-06-23T19:04:27.218 INFO:teuthology.orchestra.run.smithi136.stdout:Building udf 2023-06-23T19:04:27.228 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/udf/group.list 2023-06-23T19:04:27.257 INFO:teuthology.orchestra.run.smithi136.stdout:Building ceph 2023-06-23T19:04:27.267 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/ceph/group.list 2023-06-23T19:04:27.303 INFO:teuthology.orchestra.run.smithi136.stdout:Building xfs 2023-06-23T19:04:27.315 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/xfs/group.list 2023-06-23T19:04:27.563 INFO:teuthology.orchestra.run.smithi136.stdout:Building btrfs 2023-06-23T19:04:27.574 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/btrfs/group.list 2023-06-23T19:04:27.719 INFO:teuthology.orchestra.run.smithi136.stdout:Building tmpfs 2023-06-23T19:04:27.729 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/tmpfs/group.list 2023-06-23T19:04:27.763 INFO:teuthology.orchestra.run.smithi136.stdout:Building selftest 2023-06-23T19:04:27.773 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/selftest/group.list 2023-06-23T19:04:27.808 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo make install) 2023-06-23T19:04:27.939 INFO:teuthology.orchestra.run.smithi136.stdout:Building include 2023-06-23T19:04:27.946 INFO:teuthology.orchestra.run.smithi136.stdout:Building lib 2023-06-23T19:04:27.954 INFO:teuthology.orchestra.run.smithi136.stdout:Building ltp 2023-06-23T19:04:27.962 INFO:teuthology.orchestra.run.smithi136.stdout:Building src 2023-06-23T19:04:28.024 INFO:teuthology.orchestra.run.smithi136.stdout:Building log-writes 2023-06-23T19:04:28.031 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2023-06-23T19:04:28.039 INFO:teuthology.orchestra.run.smithi136.stdout:Building aio-dio-regress 2023-06-23T19:04:28.047 INFO:teuthology.orchestra.run.smithi136.stdout:Building vfs 2023-06-23T19:04:28.055 INFO:teuthology.orchestra.run.smithi136.stdout:Building m4 2023-06-23T19:04:28.062 INFO:teuthology.orchestra.run.smithi136.stdout:Building common 2023-06-23T19:04:28.069 INFO:teuthology.orchestra.run.smithi136.stdout:Building tests 2023-06-23T19:04:28.079 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2023-06-23T19:04:28.089 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/perf/group.list 2023-06-23T19:04:28.119 INFO:teuthology.orchestra.run.smithi136.stdout:Building ext4 2023-06-23T19:04:28.129 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/ext4/group.list 2023-06-23T19:04:28.222 INFO:teuthology.orchestra.run.smithi136.stdout:Building ocfs2 2023-06-23T19:04:28.232 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/ocfs2/group.list 2023-06-23T19:04:28.266 INFO:teuthology.orchestra.run.smithi136.stdout:Building overlay 2023-06-23T19:04:28.276 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/overlay/group.list 2023-06-23T19:04:28.372 INFO:teuthology.orchestra.run.smithi136.stdout:Building cifs 2023-06-23T19:04:28.381 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/cifs/group.list 2023-06-23T19:04:28.413 INFO:teuthology.orchestra.run.smithi136.stdout:Building generic 2023-06-23T19:04:28.424 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/generic/group.list 2023-06-23T19:04:28.662 INFO:teuthology.orchestra.run.smithi136.stdout:Building shared 2023-06-23T19:04:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/shared/group.list 2023-06-23T19:04:28.715 INFO:teuthology.orchestra.run.smithi136.stdout:Building nfs 2023-06-23T19:04:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/nfs/group.list 2023-06-23T19:04:28.762 INFO:teuthology.orchestra.run.smithi136.stdout:Building f2fs 2023-06-23T19:04:28.772 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/f2fs/group.list 2023-06-23T19:04:28.815 INFO:teuthology.orchestra.run.smithi136.stdout:Building udf 2023-06-23T19:04:28.826 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/udf/group.list 2023-06-23T19:04:28.856 INFO:teuthology.orchestra.run.smithi136.stdout:Building ceph 2023-06-23T19:04:28.864 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/ceph/group.list 2023-06-23T19:04:28.901 INFO:teuthology.orchestra.run.smithi136.stdout:Building xfs 2023-06-23T19:04:28.913 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/xfs/group.list 2023-06-23T19:04:29.154 INFO:teuthology.orchestra.run.smithi136.stdout:Building btrfs 2023-06-23T19:04:29.164 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/btrfs/group.list 2023-06-23T19:04:29.311 INFO:teuthology.orchestra.run.smithi136.stdout:Building tmpfs 2023-06-23T19:04:29.319 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/tmpfs/group.list 2023-06-23T19:04:29.352 INFO:teuthology.orchestra.run.smithi136.stdout:Building selftest 2023-06-23T19:04:29.363 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.AfPoID7zOVxfstests-dev/tests/selftest/group.list 2023-06-23T19:04:29.393 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-06-23T19:04:29.396 INFO:teuthology.orchestra.run.smithi136.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-23T19:04:29.396 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-06-23T19:04:29.399 INFO:teuthology.orchestra.run.smithi136.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-23T19:04:29.399 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-06-23T19:04:29.403 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-23T19:04:29.427 INFO:teuthology.orchestra.run.smithi136.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-23T19:04:29.607 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-23T19:04:29.632 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-06-23T19:04:29.662 INFO:teuthology.orchestra.run.smithi136.stdout:Building log-writes 2023-06-23T19:04:29.669 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2023-06-23T19:04:29.676 INFO:teuthology.orchestra.run.smithi136.stdout:Building aio-dio-regress 2023-06-23T19:04:29.684 INFO:teuthology.orchestra.run.smithi136.stdout:Building vfs 2023-06-23T19:04:29.690 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake -C log-writes install 2023-06-23T19:04:29.692 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-23T19:04:29.716 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-23T19:04:29.741 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake -C perf install 2023-06-23T19:04:29.744 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-23T19:04:29.767 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-23T19:04:29.831 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-06-23T19:04:29.834 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-23T19:04:29.858 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-23T19:04:30.010 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake -C vfs install 2023-06-23T19:04:30.012 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-23T19:04:30.036 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-23T19:04:30.070 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-23T19:04:30.094 INFO:teuthology.orchestra.run.smithi136.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-23T19:04:33.160 INFO:teuthology.orchestra.run.smithi136.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-23T19:04:33.388 INFO:teuthology.orchestra.run.smithi136.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-23T19:04:33.442 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-06-23T19:04:33.445 INFO:teuthology.orchestra.run.smithi136.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-23T19:04:33.445 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-06-23T19:04:33.447 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-23T19:04:33.472 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-23T19:04:33.849 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-06-23T19:04:33.854 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/btrfs/ install 2023-06-23T19:04:33.857 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-23T19:04:33.879 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-23T19:04:36.180 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-23T19:04:36.204 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 057.out 175.out 186.out 240.out 069.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 177.out 194.out 234.out 249.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 264.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 209.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 250.out 191.out 281.out 046.out 051.out 244.out 219.out 119.out 019.out 128.out 232.out 248.out 162.out 147.out 197.out 196.out 242.out 004.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 233.out 066.out 029.out 229.out 103.out 254.out 111.out 011.out 243.out 275.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 118.out 287.out 067.out 010.out 238.out 138.out 095.out 184.out 160.out 190.out 291.out 081.out 024.out 071.out 061.out 047.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 003.out 211.out 158.out 085.out 146.out 188.out 104.out 089.out 086.out 279.out 225.out 174.out 156.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 053.out 164.out 239.out 241.out 002.out 178.out 141.out 214.out 114.out 074.out 056.out 012.out 041.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 091.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 131.out 213.out 113.out 013.out 031.out 182.out 272.out 078.out 173.out 259.out 210.out 132.out 037.out 093.out 235.out 127.out 230.out 166.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 245.out 145.out 159.out 122.out 076.out 022.out 006.out 284.out 299.out 224.out 154.out 276.out 149.out 064.out 218.out 018.out 168.out 007.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 268.out 253.out 255.out 090.out 221.out 087.out 212.out 112.out 256.out 021.out 247.out 028.out 107.out /var/lib/xfstests/tests/btrfs 2023-06-23T19:04:38.508 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/ceph/ install 2023-06-23T19:04:38.511 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-23T19:04:38.534 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-23T19:04:38.589 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-23T19:04:38.614 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-23T19:04:38.669 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/cifs/ install 2023-06-23T19:04:38.673 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-23T19:04:38.695 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-23T19:04:38.719 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-23T19:04:38.743 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-23T19:04:38.767 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/ext4/ install 2023-06-23T19:04:38.770 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-23T19:04:38.794 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-23T19:04:39.346 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-23T19:04:39.370 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-06-23T19:04:39.946 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/f2fs/ install 2023-06-23T19:04:39.949 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-23T19:04:39.972 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-23T19:04:40.004 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-23T19:04:40.028 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-23T19:04:40.060 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/generic/ install 2023-06-23T19:04:40.066 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-23T19:04:40.090 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 /var/lib/xfstests/tests/generic 2023-06-23T19:04:45.875 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-23T19:04:45.900 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 476.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 342.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-06-23T19:04:51.716 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/nfs/ install 2023-06-23T19:04:51.719 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-23T19:04:51.743 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-23T19:04:51.767 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-23T19:04:51.790 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-23T19:04:51.815 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/ocfs2/ install 2023-06-23T19:04:51.817 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-23T19:04:51.841 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-23T19:04:51.865 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-23T19:04:51.889 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-23T19:04:51.914 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/overlay/ install 2023-06-23T19:04:51.917 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-23T19:04:51.941 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-23T19:04:52.712 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-23T19:04:52.736 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 065.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 035.out 108.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 103.out 033.out 066.out 040.out 056.out 075.out /var/lib/xfstests/tests/overlay 2023-06-23T19:04:53.511 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/perf/ install 2023-06-23T19:04:53.514 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-23T19:04:53.538 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-23T19:04:53.561 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-23T19:04:53.585 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-23T19:04:53.609 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/selftest/ install 2023-06-23T19:04:53.615 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-23T19:04:53.636 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-23T19:04:53.699 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-23T19:04:53.723 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-23T19:04:53.786 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/shared/ install 2023-06-23T19:04:53.788 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-23T19:04:53.813 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-23T19:04:53.852 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-23T19:04:53.877 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-23T19:04:53.916 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/tmpfs/ install 2023-06-23T19:04:53.919 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-23T19:04:53.943 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-23T19:04:53.967 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-23T19:04:53.991 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-23T19:04:54.015 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/udf/ install 2023-06-23T19:04:54.018 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-23T19:04:54.041 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-23T19:04:54.065 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-23T19:04:54.089 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-23T19:04:54.113 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AfPoID7zOVxfstests-dev/tests/xfs/ install 2023-06-23T19:04:54.119 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-23T19:04:54.142 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-23T19:04:57.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:57.114 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:59.589 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-23T19:04:59.613 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 040.out 304.out 349.out 457.out 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 746.out 110.out 468.out 018.out 593.out 571.out 567.out 592.out 282.out 267.out 728.out 178.out 799.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 247.out 273.out 474.out 109.out 595.out 506.out 732.out 268.out 035.out 113.out 532.out 591.out 281.out 471.out 723.out 519.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 503.out 526.out 329.out 165.out 229.out 103.out 129.out 371.out 234.out 738.out 078.out 718.out 143.out 716.out 161.out 516.out 416.out 116.out 043.out 155.out 338.out 067.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 017.out 542.out 211.out 783.out 485.out 442.out 099.out 177.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 758.out 278.out 058.out 741.out 384.out 773.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 755.out 364.out 209.out 441.out 440.out 157.out 740.out 356.out 197.out 341.out 187.out 094.out 241.out 501.out 089.out 540.out 365.out 514.out 414.out 314.out 214.out 381.out 056.out 041.out 340.out 793.out 358.out 572.out 568.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 265.out 508.out 408.out 308.out 208.out 737.out 204.out 535.out 104.out 733.out 544.out 059.out 249.out 335.out 142.out 235.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 316.out 169.out 579.out 297.out 393.out 333.out 476.out 087.out 199.out 739.out 068.out 233.out 752.out 736.out 443.out 086.out 053.out 749.out 279.out 276.out 711.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 458.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 186.out 452.out 069.out 252.out 585.out 751.out 724.out 206.out 190.out 794.out 348.out 184.out 435.out 466.out 248.out 725.out 785.out 482.out 750.out 525.out 496.out 325.out 176.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 430.out 583.out 305.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 465.out 395.out 515.out 415.out 389.out 315.out 215.out 115.out 015.out 027.out 250.out 344.out 046.out 051.out 536.out 254.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 005.out 036.out 198.out 008.out 390.out 405.out 588.out 205.out 105.out 367.out 291.out 437.out 719.out 323.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 766.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 232.out 478.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 492.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 044.out 014.out 362.out 387.out 594.out 438.out 721.out 289.out 574.out 284.out 548.out 299.out 419.out 521.out 581.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 345.out 126.out 025.out 121.out 447.out 761.out 580.out 013.out 347.out 275.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 747.out 558.out 162.out 147.out 288.out 050.out 396.out 576.out 350.out 354.out 298.out 301.out 360.out 543.out 261.out 734.out 045.out 292.out 255.out 729.out 378.out 346.out 048.out 062.out 529.out 231.out 343.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 484.out 491.out 767.out 016.out 488.out 731.out 782.out 374.out 285.out 127.out 328.out 260.out 359.out 531.out 376.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 024.out 513.out 131.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 454.out 259.out 449.out 327.out 330.out 777.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 003.out 355.out 386.out 560.out 055.out 245.out 243.out 522.out 787.out 745.out 422.out 394.out 159.out 539.out 524.out 122.out 022.out 424.out 779.out 490.out 795.out 353.out 423.out 134.out 154.out 764.out 271.out 518.out 418.out 318.out 077.out 218.out 118.out 757.out 377.out 172.out 034.out 079.out 469.out 054.out 049.out 765.out 021.out 002.out 456.out 180.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 195.out 283.out 554.out 397.out 185.out 373.out 720.out 481.out 196.out 520.out 242.out 026.out 420.out 188.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 429.out 417.out 317.out 217.out 117.out 475.out 072.out 778.out 097.out 038.out 084.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 257.out 194.out 170.out 133.out 286.out 756.out 175.out 545.out 714.out 559.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 081.out 083.out 800.out 064.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 446.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 009.out 391.out 004.out 557.out 453.out 236.out 566.out 582.out 735.out 383.out 085.out 334.out 504.out 404.out 776.out /var/lib/xfstests/tests/xfs 2023-06-23T19:05:05.136 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-23T19:05:05.160 INFO:teuthology.orchestra.run.smithi136.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-23T19:05:05.184 INFO:teuthology.orchestra.run.smithi136.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-23T19:05:05.208 INFO:teuthology.orchestra.run.smithi136.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-23T19:05:05.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:05:05.236 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec ls tests/generic) 2023-06-23T19:05:05.283 INFO:teuthology.orchestra.run.smithi136.stdout:001 2023-06-23T19:05:05.283 INFO:teuthology.orchestra.run.smithi136.stdout:001.out 2023-06-23T19:05:05.283 INFO:teuthology.orchestra.run.smithi136.stdout:002 2023-06-23T19:05:05.284 INFO:teuthology.orchestra.run.smithi136.stdout:002.out 2023-06-23T19:05:05.284 INFO:teuthology.orchestra.run.smithi136.stdout:003 2023-06-23T19:05:05.284 INFO:teuthology.orchestra.run.smithi136.stdout:003.out 2023-06-23T19:05:05.284 INFO:teuthology.orchestra.run.smithi136.stdout:004 2023-06-23T19:05:05.285 INFO:teuthology.orchestra.run.smithi136.stdout:004.out 2023-06-23T19:05:05.285 INFO:teuthology.orchestra.run.smithi136.stdout:005 2023-06-23T19:05:05.285 INFO:teuthology.orchestra.run.smithi136.stdout:005.out 2023-06-23T19:05:05.286 INFO:teuthology.orchestra.run.smithi136.stdout:006 2023-06-23T19:05:05.286 INFO:teuthology.orchestra.run.smithi136.stdout:006.out 2023-06-23T19:05:05.286 INFO:teuthology.orchestra.run.smithi136.stdout:007 2023-06-23T19:05:05.286 INFO:teuthology.orchestra.run.smithi136.stdout:007.out 2023-06-23T19:05:05.287 INFO:teuthology.orchestra.run.smithi136.stdout:008 2023-06-23T19:05:05.287 INFO:teuthology.orchestra.run.smithi136.stdout:008.out 2023-06-23T19:05:05.287 INFO:teuthology.orchestra.run.smithi136.stdout:009 2023-06-23T19:05:05.287 INFO:teuthology.orchestra.run.smithi136.stdout:009.out 2023-06-23T19:05:05.288 INFO:teuthology.orchestra.run.smithi136.stdout:010 2023-06-23T19:05:05.288 INFO:teuthology.orchestra.run.smithi136.stdout:010.out 2023-06-23T19:05:05.288 INFO:teuthology.orchestra.run.smithi136.stdout:011 2023-06-23T19:05:05.288 INFO:teuthology.orchestra.run.smithi136.stdout:011.out 2023-06-23T19:05:05.289 INFO:teuthology.orchestra.run.smithi136.stdout:012 2023-06-23T19:05:05.289 INFO:teuthology.orchestra.run.smithi136.stdout:012.out 2023-06-23T19:05:05.289 INFO:teuthology.orchestra.run.smithi136.stdout:013 2023-06-23T19:05:05.289 INFO:teuthology.orchestra.run.smithi136.stdout:013.out 2023-06-23T19:05:05.290 INFO:teuthology.orchestra.run.smithi136.stdout:014 2023-06-23T19:05:05.290 INFO:teuthology.orchestra.run.smithi136.stdout:014.out 2023-06-23T19:05:05.291 INFO:teuthology.orchestra.run.smithi136.stdout:015 2023-06-23T19:05:05.291 INFO:teuthology.orchestra.run.smithi136.stdout:015.out 2023-06-23T19:05:05.292 INFO:teuthology.orchestra.run.smithi136.stdout:016 2023-06-23T19:05:05.292 INFO:teuthology.orchestra.run.smithi136.stdout:016.out 2023-06-23T19:05:05.292 INFO:teuthology.orchestra.run.smithi136.stdout:017 2023-06-23T19:05:05.292 INFO:teuthology.orchestra.run.smithi136.stdout:017.out 2023-06-23T19:05:05.293 INFO:teuthology.orchestra.run.smithi136.stdout:018 2023-06-23T19:05:05.293 INFO:teuthology.orchestra.run.smithi136.stdout:018.out 2023-06-23T19:05:05.293 INFO:teuthology.orchestra.run.smithi136.stdout:019 2023-06-23T19:05:05.294 INFO:teuthology.orchestra.run.smithi136.stdout:019.out 2023-06-23T19:05:05.294 INFO:teuthology.orchestra.run.smithi136.stdout:020 2023-06-23T19:05:05.294 INFO:teuthology.orchestra.run.smithi136.stdout:020.out 2023-06-23T19:05:05.295 INFO:teuthology.orchestra.run.smithi136.stdout:021 2023-06-23T19:05:05.295 INFO:teuthology.orchestra.run.smithi136.stdout:021.out 2023-06-23T19:05:05.295 INFO:teuthology.orchestra.run.smithi136.stdout:022 2023-06-23T19:05:05.296 INFO:teuthology.orchestra.run.smithi136.stdout:022.out 2023-06-23T19:05:05.296 INFO:teuthology.orchestra.run.smithi136.stdout:023 2023-06-23T19:05:05.296 INFO:teuthology.orchestra.run.smithi136.stdout:023.out 2023-06-23T19:05:05.296 INFO:teuthology.orchestra.run.smithi136.stdout:024 2023-06-23T19:05:05.297 INFO:teuthology.orchestra.run.smithi136.stdout:024.out 2023-06-23T19:05:05.297 INFO:teuthology.orchestra.run.smithi136.stdout:025 2023-06-23T19:05:05.297 INFO:teuthology.orchestra.run.smithi136.stdout:025.out 2023-06-23T19:05:05.297 INFO:teuthology.orchestra.run.smithi136.stdout:026 2023-06-23T19:05:05.298 INFO:teuthology.orchestra.run.smithi136.stdout:026.out 2023-06-23T19:05:05.298 INFO:teuthology.orchestra.run.smithi136.stdout:027 2023-06-23T19:05:05.298 INFO:teuthology.orchestra.run.smithi136.stdout:027.out 2023-06-23T19:05:05.298 INFO:teuthology.orchestra.run.smithi136.stdout:028 2023-06-23T19:05:05.299 INFO:teuthology.orchestra.run.smithi136.stdout:028.out 2023-06-23T19:05:05.299 INFO:teuthology.orchestra.run.smithi136.stdout:029 2023-06-23T19:05:05.299 INFO:teuthology.orchestra.run.smithi136.stdout:029.out 2023-06-23T19:05:05.299 INFO:teuthology.orchestra.run.smithi136.stdout:030 2023-06-23T19:05:05.299 INFO:teuthology.orchestra.run.smithi136.stdout:030.out 2023-06-23T19:05:05.299 INFO:teuthology.orchestra.run.smithi136.stdout:031 2023-06-23T19:05:05.299 INFO:teuthology.orchestra.run.smithi136.stdout:031.out 2023-06-23T19:05:05.299 INFO:teuthology.orchestra.run.smithi136.stdout:032 2023-06-23T19:05:05.300 INFO:teuthology.orchestra.run.smithi136.stdout:032.out 2023-06-23T19:05:05.300 INFO:teuthology.orchestra.run.smithi136.stdout:033 2023-06-23T19:05:05.300 INFO:teuthology.orchestra.run.smithi136.stdout:033.out 2023-06-23T19:05:05.300 INFO:teuthology.orchestra.run.smithi136.stdout:034 2023-06-23T19:05:05.300 INFO:teuthology.orchestra.run.smithi136.stdout:034.out 2023-06-23T19:05:05.300 INFO:teuthology.orchestra.run.smithi136.stdout:035 2023-06-23T19:05:05.300 INFO:teuthology.orchestra.run.smithi136.stdout:035.cfg 2023-06-23T19:05:05.301 INFO:teuthology.orchestra.run.smithi136.stdout:035.out.default 2023-06-23T19:05:05.301 INFO:teuthology.orchestra.run.smithi136.stdout:035.out.nfs 2023-06-23T19:05:05.301 INFO:teuthology.orchestra.run.smithi136.stdout:036 2023-06-23T19:05:05.301 INFO:teuthology.orchestra.run.smithi136.stdout:036.out 2023-06-23T19:05:05.302 INFO:teuthology.orchestra.run.smithi136.stdout:037 2023-06-23T19:05:05.302 INFO:teuthology.orchestra.run.smithi136.stdout:037.out 2023-06-23T19:05:05.302 INFO:teuthology.orchestra.run.smithi136.stdout:038 2023-06-23T19:05:05.302 INFO:teuthology.orchestra.run.smithi136.stdout:038.out 2023-06-23T19:05:05.303 INFO:teuthology.orchestra.run.smithi136.stdout:039 2023-06-23T19:05:05.304 INFO:teuthology.orchestra.run.smithi136.stdout:039.out 2023-06-23T19:05:05.304 INFO:teuthology.orchestra.run.smithi136.stdout:040 2023-06-23T19:05:05.304 INFO:teuthology.orchestra.run.smithi136.stdout:040.out 2023-06-23T19:05:05.305 INFO:teuthology.orchestra.run.smithi136.stdout:041 2023-06-23T19:05:05.305 INFO:teuthology.orchestra.run.smithi136.stdout:041.out 2023-06-23T19:05:05.305 INFO:teuthology.orchestra.run.smithi136.stdout:042 2023-06-23T19:05:05.306 INFO:teuthology.orchestra.run.smithi136.stdout:042.out 2023-06-23T19:05:05.306 INFO:teuthology.orchestra.run.smithi136.stdout:043 2023-06-23T19:05:05.307 INFO:teuthology.orchestra.run.smithi136.stdout:043.out 2023-06-23T19:05:05.307 INFO:teuthology.orchestra.run.smithi136.stdout:044 2023-06-23T19:05:05.307 INFO:teuthology.orchestra.run.smithi136.stdout:044.out 2023-06-23T19:05:05.307 INFO:teuthology.orchestra.run.smithi136.stdout:045 2023-06-23T19:05:05.308 INFO:teuthology.orchestra.run.smithi136.stdout:045.out 2023-06-23T19:05:05.309 INFO:teuthology.orchestra.run.smithi136.stdout:046 2023-06-23T19:05:05.309 INFO:teuthology.orchestra.run.smithi136.stdout:046.out 2023-06-23T19:05:05.309 INFO:teuthology.orchestra.run.smithi136.stdout:047 2023-06-23T19:05:05.309 INFO:teuthology.orchestra.run.smithi136.stdout:047.out 2023-06-23T19:05:05.310 INFO:teuthology.orchestra.run.smithi136.stdout:048 2023-06-23T19:05:05.310 INFO:teuthology.orchestra.run.smithi136.stdout:048.out 2023-06-23T19:05:05.310 INFO:teuthology.orchestra.run.smithi136.stdout:049 2023-06-23T19:05:05.310 INFO:teuthology.orchestra.run.smithi136.stdout:049.out 2023-06-23T19:05:05.310 INFO:teuthology.orchestra.run.smithi136.stdout:050 2023-06-23T19:05:05.311 INFO:teuthology.orchestra.run.smithi136.stdout:050.cfg 2023-06-23T19:05:05.311 INFO:teuthology.orchestra.run.smithi136.stdout:050.out.default 2023-06-23T19:05:05.311 INFO:teuthology.orchestra.run.smithi136.stdout:050.out.nojournal 2023-06-23T19:05:05.311 INFO:teuthology.orchestra.run.smithi136.stdout:050.out.xfsquota 2023-06-23T19:05:05.311 INFO:teuthology.orchestra.run.smithi136.stdout:051 2023-06-23T19:05:05.311 INFO:teuthology.orchestra.run.smithi136.stdout:051.out 2023-06-23T19:05:05.311 INFO:teuthology.orchestra.run.smithi136.stdout:052 2023-06-23T19:05:05.311 INFO:teuthology.orchestra.run.smithi136.stdout:052.out 2023-06-23T19:05:05.312 INFO:teuthology.orchestra.run.smithi136.stdout:053 2023-06-23T19:05:05.312 INFO:teuthology.orchestra.run.smithi136.stdout:053.out 2023-06-23T19:05:05.312 INFO:teuthology.orchestra.run.smithi136.stdout:054 2023-06-23T19:05:05.312 INFO:teuthology.orchestra.run.smithi136.stdout:054.out 2023-06-23T19:05:05.312 INFO:teuthology.orchestra.run.smithi136.stdout:055 2023-06-23T19:05:05.312 INFO:teuthology.orchestra.run.smithi136.stdout:055.out 2023-06-23T19:05:05.313 INFO:teuthology.orchestra.run.smithi136.stdout:056 2023-06-23T19:05:05.313 INFO:teuthology.orchestra.run.smithi136.stdout:056.out 2023-06-23T19:05:05.313 INFO:teuthology.orchestra.run.smithi136.stdout:057 2023-06-23T19:05:05.313 INFO:teuthology.orchestra.run.smithi136.stdout:057.out 2023-06-23T19:05:05.313 INFO:teuthology.orchestra.run.smithi136.stdout:058 2023-06-23T19:05:05.313 INFO:teuthology.orchestra.run.smithi136.stdout:058.out 2023-06-23T19:05:05.314 INFO:teuthology.orchestra.run.smithi136.stdout:059 2023-06-23T19:05:05.314 INFO:teuthology.orchestra.run.smithi136.stdout:059.out 2023-06-23T19:05:05.314 INFO:teuthology.orchestra.run.smithi136.stdout:060 2023-06-23T19:05:05.314 INFO:teuthology.orchestra.run.smithi136.stdout:060.out 2023-06-23T19:05:05.314 INFO:teuthology.orchestra.run.smithi136.stdout:061 2023-06-23T19:05:05.314 INFO:teuthology.orchestra.run.smithi136.stdout:061.out 2023-06-23T19:05:05.314 INFO:teuthology.orchestra.run.smithi136.stdout:062 2023-06-23T19:05:05.315 INFO:teuthology.orchestra.run.smithi136.stdout:062.out 2023-06-23T19:05:05.315 INFO:teuthology.orchestra.run.smithi136.stdout:063 2023-06-23T19:05:05.315 INFO:teuthology.orchestra.run.smithi136.stdout:063.out 2023-06-23T19:05:05.315 INFO:teuthology.orchestra.run.smithi136.stdout:064 2023-06-23T19:05:05.315 INFO:teuthology.orchestra.run.smithi136.stdout:064.out 2023-06-23T19:05:05.315 INFO:teuthology.orchestra.run.smithi136.stdout:065 2023-06-23T19:05:05.315 INFO:teuthology.orchestra.run.smithi136.stdout:065.out 2023-06-23T19:05:05.316 INFO:teuthology.orchestra.run.smithi136.stdout:066 2023-06-23T19:05:05.316 INFO:teuthology.orchestra.run.smithi136.stdout:066.out 2023-06-23T19:05:05.316 INFO:teuthology.orchestra.run.smithi136.stdout:067 2023-06-23T19:05:05.316 INFO:teuthology.orchestra.run.smithi136.stdout:067.out 2023-06-23T19:05:05.316 INFO:teuthology.orchestra.run.smithi136.stdout:068 2023-06-23T19:05:05.316 INFO:teuthology.orchestra.run.smithi136.stdout:068.out 2023-06-23T19:05:05.317 INFO:teuthology.orchestra.run.smithi136.stdout:069 2023-06-23T19:05:05.317 INFO:teuthology.orchestra.run.smithi136.stdout:069.out 2023-06-23T19:05:05.317 INFO:teuthology.orchestra.run.smithi136.stdout:070 2023-06-23T19:05:05.317 INFO:teuthology.orchestra.run.smithi136.stdout:070.out 2023-06-23T19:05:05.318 INFO:teuthology.orchestra.run.smithi136.stdout:071 2023-06-23T19:05:05.318 INFO:teuthology.orchestra.run.smithi136.stdout:071.out 2023-06-23T19:05:05.318 INFO:teuthology.orchestra.run.smithi136.stdout:072 2023-06-23T19:05:05.318 INFO:teuthology.orchestra.run.smithi136.stdout:072.out 2023-06-23T19:05:05.319 INFO:teuthology.orchestra.run.smithi136.stdout:073 2023-06-23T19:05:05.319 INFO:teuthology.orchestra.run.smithi136.stdout:073.out 2023-06-23T19:05:05.319 INFO:teuthology.orchestra.run.smithi136.stdout:074 2023-06-23T19:05:05.320 INFO:teuthology.orchestra.run.smithi136.stdout:074.out 2023-06-23T19:05:05.320 INFO:teuthology.orchestra.run.smithi136.stdout:075 2023-06-23T19:05:05.320 INFO:teuthology.orchestra.run.smithi136.stdout:075.out 2023-06-23T19:05:05.320 INFO:teuthology.orchestra.run.smithi136.stdout:076 2023-06-23T19:05:05.320 INFO:teuthology.orchestra.run.smithi136.stdout:076.out 2023-06-23T19:05:05.320 INFO:teuthology.orchestra.run.smithi136.stdout:077 2023-06-23T19:05:05.321 INFO:teuthology.orchestra.run.smithi136.stdout:077.out 2023-06-23T19:05:05.321 INFO:teuthology.orchestra.run.smithi136.stdout:078 2023-06-23T19:05:05.321 INFO:teuthology.orchestra.run.smithi136.stdout:078.out 2023-06-23T19:05:05.321 INFO:teuthology.orchestra.run.smithi136.stdout:079 2023-06-23T19:05:05.321 INFO:teuthology.orchestra.run.smithi136.stdout:079.out 2023-06-23T19:05:05.321 INFO:teuthology.orchestra.run.smithi136.stdout:080 2023-06-23T19:05:05.321 INFO:teuthology.orchestra.run.smithi136.stdout:080.out 2023-06-23T19:05:05.322 INFO:teuthology.orchestra.run.smithi136.stdout:081 2023-06-23T19:05:05.322 INFO:teuthology.orchestra.run.smithi136.stdout:081.out 2023-06-23T19:05:05.322 INFO:teuthology.orchestra.run.smithi136.stdout:082 2023-06-23T19:05:05.322 INFO:teuthology.orchestra.run.smithi136.stdout:082.out 2023-06-23T19:05:05.322 INFO:teuthology.orchestra.run.smithi136.stdout:083 2023-06-23T19:05:05.323 INFO:teuthology.orchestra.run.smithi136.stdout:083.out 2023-06-23T19:05:05.323 INFO:teuthology.orchestra.run.smithi136.stdout:084 2023-06-23T19:05:05.323 INFO:teuthology.orchestra.run.smithi136.stdout:084.out 2023-06-23T19:05:05.323 INFO:teuthology.orchestra.run.smithi136.stdout:085 2023-06-23T19:05:05.323 INFO:teuthology.orchestra.run.smithi136.stdout:085.out 2023-06-23T19:05:05.323 INFO:teuthology.orchestra.run.smithi136.stdout:086 2023-06-23T19:05:05.324 INFO:teuthology.orchestra.run.smithi136.stdout:086.out 2023-06-23T19:05:05.324 INFO:teuthology.orchestra.run.smithi136.stdout:087 2023-06-23T19:05:05.324 INFO:teuthology.orchestra.run.smithi136.stdout:087.out 2023-06-23T19:05:05.324 INFO:teuthology.orchestra.run.smithi136.stdout:088 2023-06-23T19:05:05.324 INFO:teuthology.orchestra.run.smithi136.stdout:088.out 2023-06-23T19:05:05.324 INFO:teuthology.orchestra.run.smithi136.stdout:089 2023-06-23T19:05:05.325 INFO:teuthology.orchestra.run.smithi136.stdout:089.out 2023-06-23T19:05:05.325 INFO:teuthology.orchestra.run.smithi136.stdout:090 2023-06-23T19:05:05.325 INFO:teuthology.orchestra.run.smithi136.stdout:090.out 2023-06-23T19:05:05.325 INFO:teuthology.orchestra.run.smithi136.stdout:091 2023-06-23T19:05:05.325 INFO:teuthology.orchestra.run.smithi136.stdout:091.out 2023-06-23T19:05:05.325 INFO:teuthology.orchestra.run.smithi136.stdout:092 2023-06-23T19:05:05.325 INFO:teuthology.orchestra.run.smithi136.stdout:092.out 2023-06-23T19:05:05.326 INFO:teuthology.orchestra.run.smithi136.stdout:093 2023-06-23T19:05:05.326 INFO:teuthology.orchestra.run.smithi136.stdout:093.out 2023-06-23T19:05:05.326 INFO:teuthology.orchestra.run.smithi136.stdout:094 2023-06-23T19:05:05.326 INFO:teuthology.orchestra.run.smithi136.stdout:094.out 2023-06-23T19:05:05.326 INFO:teuthology.orchestra.run.smithi136.stdout:095 2023-06-23T19:05:05.326 INFO:teuthology.orchestra.run.smithi136.stdout:095.out 2023-06-23T19:05:05.327 INFO:teuthology.orchestra.run.smithi136.stdout:096 2023-06-23T19:05:05.327 INFO:teuthology.orchestra.run.smithi136.stdout:096.out 2023-06-23T19:05:05.327 INFO:teuthology.orchestra.run.smithi136.stdout:097 2023-06-23T19:05:05.327 INFO:teuthology.orchestra.run.smithi136.stdout:097.out 2023-06-23T19:05:05.327 INFO:teuthology.orchestra.run.smithi136.stdout:098 2023-06-23T19:05:05.328 INFO:teuthology.orchestra.run.smithi136.stdout:098.out 2023-06-23T19:05:05.328 INFO:teuthology.orchestra.run.smithi136.stdout:099 2023-06-23T19:05:05.328 INFO:teuthology.orchestra.run.smithi136.stdout:099.out 2023-06-23T19:05:05.329 INFO:teuthology.orchestra.run.smithi136.stdout:100 2023-06-23T19:05:05.329 INFO:teuthology.orchestra.run.smithi136.stdout:100.out 2023-06-23T19:05:05.329 INFO:teuthology.orchestra.run.smithi136.stdout:101 2023-06-23T19:05:05.329 INFO:teuthology.orchestra.run.smithi136.stdout:101.out 2023-06-23T19:05:05.330 INFO:teuthology.orchestra.run.smithi136.stdout:102 2023-06-23T19:05:05.330 INFO:teuthology.orchestra.run.smithi136.stdout:102.out 2023-06-23T19:05:05.330 INFO:teuthology.orchestra.run.smithi136.stdout:103 2023-06-23T19:05:05.331 INFO:teuthology.orchestra.run.smithi136.stdout:103.out 2023-06-23T19:05:05.331 INFO:teuthology.orchestra.run.smithi136.stdout:104 2023-06-23T19:05:05.331 INFO:teuthology.orchestra.run.smithi136.stdout:104.out 2023-06-23T19:05:05.331 INFO:teuthology.orchestra.run.smithi136.stdout:105 2023-06-23T19:05:05.331 INFO:teuthology.orchestra.run.smithi136.stdout:105.out 2023-06-23T19:05:05.331 INFO:teuthology.orchestra.run.smithi136.stdout:106 2023-06-23T19:05:05.331 INFO:teuthology.orchestra.run.smithi136.stdout:106.out 2023-06-23T19:05:05.332 INFO:teuthology.orchestra.run.smithi136.stdout:107 2023-06-23T19:05:05.332 INFO:teuthology.orchestra.run.smithi136.stdout:107.out 2023-06-23T19:05:05.332 INFO:teuthology.orchestra.run.smithi136.stdout:108 2023-06-23T19:05:05.332 INFO:teuthology.orchestra.run.smithi136.stdout:108.out 2023-06-23T19:05:05.332 INFO:teuthology.orchestra.run.smithi136.stdout:109 2023-06-23T19:05:05.332 INFO:teuthology.orchestra.run.smithi136.stdout:109.out 2023-06-23T19:05:05.332 INFO:teuthology.orchestra.run.smithi136.stdout:110 2023-06-23T19:05:05.333 INFO:teuthology.orchestra.run.smithi136.stdout:110.out 2023-06-23T19:05:05.333 INFO:teuthology.orchestra.run.smithi136.stdout:111 2023-06-23T19:05:05.333 INFO:teuthology.orchestra.run.smithi136.stdout:111.out 2023-06-23T19:05:05.333 INFO:teuthology.orchestra.run.smithi136.stdout:112 2023-06-23T19:05:05.333 INFO:teuthology.orchestra.run.smithi136.stdout:112.out 2023-06-23T19:05:05.333 INFO:teuthology.orchestra.run.smithi136.stdout:113 2023-06-23T19:05:05.333 INFO:teuthology.orchestra.run.smithi136.stdout:113.out 2023-06-23T19:05:05.333 INFO:teuthology.orchestra.run.smithi136.stdout:114 2023-06-23T19:05:05.334 INFO:teuthology.orchestra.run.smithi136.stdout:114.out 2023-06-23T19:05:05.334 INFO:teuthology.orchestra.run.smithi136.stdout:115 2023-06-23T19:05:05.334 INFO:teuthology.orchestra.run.smithi136.stdout:115.out 2023-06-23T19:05:05.334 INFO:teuthology.orchestra.run.smithi136.stdout:116 2023-06-23T19:05:05.334 INFO:teuthology.orchestra.run.smithi136.stdout:116.out 2023-06-23T19:05:05.334 INFO:teuthology.orchestra.run.smithi136.stdout:117 2023-06-23T19:05:05.334 INFO:teuthology.orchestra.run.smithi136.stdout:117.out 2023-06-23T19:05:05.334 INFO:teuthology.orchestra.run.smithi136.stdout:118 2023-06-23T19:05:05.335 INFO:teuthology.orchestra.run.smithi136.stdout:118.out 2023-06-23T19:05:05.335 INFO:teuthology.orchestra.run.smithi136.stdout:119 2023-06-23T19:05:05.335 INFO:teuthology.orchestra.run.smithi136.stdout:119.out 2023-06-23T19:05:05.335 INFO:teuthology.orchestra.run.smithi136.stdout:120 2023-06-23T19:05:05.335 INFO:teuthology.orchestra.run.smithi136.stdout:120.out 2023-06-23T19:05:05.335 INFO:teuthology.orchestra.run.smithi136.stdout:121 2023-06-23T19:05:05.335 INFO:teuthology.orchestra.run.smithi136.stdout:121.out 2023-06-23T19:05:05.335 INFO:teuthology.orchestra.run.smithi136.stdout:122 2023-06-23T19:05:05.336 INFO:teuthology.orchestra.run.smithi136.stdout:122.out 2023-06-23T19:05:05.336 INFO:teuthology.orchestra.run.smithi136.stdout:123 2023-06-23T19:05:05.336 INFO:teuthology.orchestra.run.smithi136.stdout:123.out 2023-06-23T19:05:05.336 INFO:teuthology.orchestra.run.smithi136.stdout:124 2023-06-23T19:05:05.336 INFO:teuthology.orchestra.run.smithi136.stdout:124.out 2023-06-23T19:05:05.336 INFO:teuthology.orchestra.run.smithi136.stdout:125 2023-06-23T19:05:05.336 INFO:teuthology.orchestra.run.smithi136.stdout:125.out 2023-06-23T19:05:05.336 INFO:teuthology.orchestra.run.smithi136.stdout:126 2023-06-23T19:05:05.337 INFO:teuthology.orchestra.run.smithi136.stdout:126.out 2023-06-23T19:05:05.337 INFO:teuthology.orchestra.run.smithi136.stdout:127 2023-06-23T19:05:05.337 INFO:teuthology.orchestra.run.smithi136.stdout:127.out 2023-06-23T19:05:05.337 INFO:teuthology.orchestra.run.smithi136.stdout:128 2023-06-23T19:05:05.337 INFO:teuthology.orchestra.run.smithi136.stdout:128.out 2023-06-23T19:05:05.337 INFO:teuthology.orchestra.run.smithi136.stdout:129 2023-06-23T19:05:05.337 INFO:teuthology.orchestra.run.smithi136.stdout:129.out 2023-06-23T19:05:05.338 INFO:teuthology.orchestra.run.smithi136.stdout:130 2023-06-23T19:05:05.338 INFO:teuthology.orchestra.run.smithi136.stdout:130.out 2023-06-23T19:05:05.338 INFO:teuthology.orchestra.run.smithi136.stdout:131 2023-06-23T19:05:05.338 INFO:teuthology.orchestra.run.smithi136.stdout:131.out 2023-06-23T19:05:05.338 INFO:teuthology.orchestra.run.smithi136.stdout:132 2023-06-23T19:05:05.338 INFO:teuthology.orchestra.run.smithi136.stdout:132.out 2023-06-23T19:05:05.338 INFO:teuthology.orchestra.run.smithi136.stdout:133 2023-06-23T19:05:05.338 INFO:teuthology.orchestra.run.smithi136.stdout:133.out 2023-06-23T19:05:05.339 INFO:teuthology.orchestra.run.smithi136.stdout:134 2023-06-23T19:05:05.339 INFO:teuthology.orchestra.run.smithi136.stdout:134.out 2023-06-23T19:05:05.339 INFO:teuthology.orchestra.run.smithi136.stdout:135 2023-06-23T19:05:05.339 INFO:teuthology.orchestra.run.smithi136.stdout:135.out 2023-06-23T19:05:05.339 INFO:teuthology.orchestra.run.smithi136.stdout:136 2023-06-23T19:05:05.339 INFO:teuthology.orchestra.run.smithi136.stdout:136.out 2023-06-23T19:05:05.339 INFO:teuthology.orchestra.run.smithi136.stdout:137 2023-06-23T19:05:05.339 INFO:teuthology.orchestra.run.smithi136.stdout:137.out 2023-06-23T19:05:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:138 2023-06-23T19:05:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:138.out 2023-06-23T19:05:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:139 2023-06-23T19:05:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:139.out 2023-06-23T19:05:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:140 2023-06-23T19:05:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:140.out 2023-06-23T19:05:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:141 2023-06-23T19:05:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:141.out 2023-06-23T19:05:05.341 INFO:teuthology.orchestra.run.smithi136.stdout:142 2023-06-23T19:05:05.341 INFO:teuthology.orchestra.run.smithi136.stdout:142.out 2023-06-23T19:05:05.341 INFO:teuthology.orchestra.run.smithi136.stdout:143 2023-06-23T19:05:05.341 INFO:teuthology.orchestra.run.smithi136.stdout:143.out 2023-06-23T19:05:05.341 INFO:teuthology.orchestra.run.smithi136.stdout:144 2023-06-23T19:05:05.341 INFO:teuthology.orchestra.run.smithi136.stdout:144.out 2023-06-23T19:05:05.342 INFO:teuthology.orchestra.run.smithi136.stdout:145 2023-06-23T19:05:05.342 INFO:teuthology.orchestra.run.smithi136.stdout:145.out 2023-06-23T19:05:05.342 INFO:teuthology.orchestra.run.smithi136.stdout:146 2023-06-23T19:05:05.342 INFO:teuthology.orchestra.run.smithi136.stdout:146.out 2023-06-23T19:05:05.342 INFO:teuthology.orchestra.run.smithi136.stdout:147 2023-06-23T19:05:05.342 INFO:teuthology.orchestra.run.smithi136.stdout:147.out 2023-06-23T19:05:05.342 INFO:teuthology.orchestra.run.smithi136.stdout:148 2023-06-23T19:05:05.342 INFO:teuthology.orchestra.run.smithi136.stdout:148.out 2023-06-23T19:05:05.343 INFO:teuthology.orchestra.run.smithi136.stdout:149 2023-06-23T19:05:05.343 INFO:teuthology.orchestra.run.smithi136.stdout:149.out 2023-06-23T19:05:05.343 INFO:teuthology.orchestra.run.smithi136.stdout:150 2023-06-23T19:05:05.343 INFO:teuthology.orchestra.run.smithi136.stdout:150.out 2023-06-23T19:05:05.343 INFO:teuthology.orchestra.run.smithi136.stdout:151 2023-06-23T19:05:05.343 INFO:teuthology.orchestra.run.smithi136.stdout:151.out 2023-06-23T19:05:05.343 INFO:teuthology.orchestra.run.smithi136.stdout:152 2023-06-23T19:05:05.344 INFO:teuthology.orchestra.run.smithi136.stdout:152.out 2023-06-23T19:05:05.344 INFO:teuthology.orchestra.run.smithi136.stdout:153 2023-06-23T19:05:05.344 INFO:teuthology.orchestra.run.smithi136.stdout:153.out 2023-06-23T19:05:05.344 INFO:teuthology.orchestra.run.smithi136.stdout:154 2023-06-23T19:05:05.344 INFO:teuthology.orchestra.run.smithi136.stdout:154.out 2023-06-23T19:05:05.344 INFO:teuthology.orchestra.run.smithi136.stdout:155 2023-06-23T19:05:05.344 INFO:teuthology.orchestra.run.smithi136.stdout:155.out 2023-06-23T19:05:05.344 INFO:teuthology.orchestra.run.smithi136.stdout:156 2023-06-23T19:05:05.345 INFO:teuthology.orchestra.run.smithi136.stdout:156.out 2023-06-23T19:05:05.345 INFO:teuthology.orchestra.run.smithi136.stdout:157 2023-06-23T19:05:05.345 INFO:teuthology.orchestra.run.smithi136.stdout:157.out 2023-06-23T19:05:05.345 INFO:teuthology.orchestra.run.smithi136.stdout:158 2023-06-23T19:05:05.345 INFO:teuthology.orchestra.run.smithi136.stdout:158.out 2023-06-23T19:05:05.345 INFO:teuthology.orchestra.run.smithi136.stdout:159 2023-06-23T19:05:05.345 INFO:teuthology.orchestra.run.smithi136.stdout:159.out 2023-06-23T19:05:05.345 INFO:teuthology.orchestra.run.smithi136.stdout:160 2023-06-23T19:05:05.346 INFO:teuthology.orchestra.run.smithi136.stdout:160.out 2023-06-23T19:05:05.346 INFO:teuthology.orchestra.run.smithi136.stdout:161 2023-06-23T19:05:05.346 INFO:teuthology.orchestra.run.smithi136.stdout:161.out 2023-06-23T19:05:05.346 INFO:teuthology.orchestra.run.smithi136.stdout:162 2023-06-23T19:05:05.346 INFO:teuthology.orchestra.run.smithi136.stdout:162.out 2023-06-23T19:05:05.346 INFO:teuthology.orchestra.run.smithi136.stdout:163 2023-06-23T19:05:05.346 INFO:teuthology.orchestra.run.smithi136.stdout:163.out 2023-06-23T19:05:05.346 INFO:teuthology.orchestra.run.smithi136.stdout:164 2023-06-23T19:05:05.347 INFO:teuthology.orchestra.run.smithi136.stdout:164.out 2023-06-23T19:05:05.347 INFO:teuthology.orchestra.run.smithi136.stdout:165 2023-06-23T19:05:05.347 INFO:teuthology.orchestra.run.smithi136.stdout:165.out 2023-06-23T19:05:05.347 INFO:teuthology.orchestra.run.smithi136.stdout:166 2023-06-23T19:05:05.347 INFO:teuthology.orchestra.run.smithi136.stdout:166.out 2023-06-23T19:05:05.347 INFO:teuthology.orchestra.run.smithi136.stdout:167 2023-06-23T19:05:05.347 INFO:teuthology.orchestra.run.smithi136.stdout:167.out 2023-06-23T19:05:05.347 INFO:teuthology.orchestra.run.smithi136.stdout:168 2023-06-23T19:05:05.348 INFO:teuthology.orchestra.run.smithi136.stdout:168.out 2023-06-23T19:05:05.348 INFO:teuthology.orchestra.run.smithi136.stdout:169 2023-06-23T19:05:05.348 INFO:teuthology.orchestra.run.smithi136.stdout:169.out 2023-06-23T19:05:05.348 INFO:teuthology.orchestra.run.smithi136.stdout:170 2023-06-23T19:05:05.348 INFO:teuthology.orchestra.run.smithi136.stdout:170.out 2023-06-23T19:05:05.348 INFO:teuthology.orchestra.run.smithi136.stdout:171 2023-06-23T19:05:05.348 INFO:teuthology.orchestra.run.smithi136.stdout:171.out 2023-06-23T19:05:05.348 INFO:teuthology.orchestra.run.smithi136.stdout:172 2023-06-23T19:05:05.349 INFO:teuthology.orchestra.run.smithi136.stdout:172.out 2023-06-23T19:05:05.349 INFO:teuthology.orchestra.run.smithi136.stdout:173 2023-06-23T19:05:05.349 INFO:teuthology.orchestra.run.smithi136.stdout:173.out 2023-06-23T19:05:05.349 INFO:teuthology.orchestra.run.smithi136.stdout:174 2023-06-23T19:05:05.349 INFO:teuthology.orchestra.run.smithi136.stdout:174.out 2023-06-23T19:05:05.349 INFO:teuthology.orchestra.run.smithi136.stdout:175 2023-06-23T19:05:05.349 INFO:teuthology.orchestra.run.smithi136.stdout:175.out 2023-06-23T19:05:05.349 INFO:teuthology.orchestra.run.smithi136.stdout:176 2023-06-23T19:05:05.350 INFO:teuthology.orchestra.run.smithi136.stdout:176.out 2023-06-23T19:05:05.350 INFO:teuthology.orchestra.run.smithi136.stdout:177 2023-06-23T19:05:05.350 INFO:teuthology.orchestra.run.smithi136.stdout:177.out 2023-06-23T19:05:05.350 INFO:teuthology.orchestra.run.smithi136.stdout:178 2023-06-23T19:05:05.350 INFO:teuthology.orchestra.run.smithi136.stdout:178.out 2023-06-23T19:05:05.350 INFO:teuthology.orchestra.run.smithi136.stdout:179 2023-06-23T19:05:05.350 INFO:teuthology.orchestra.run.smithi136.stdout:179.out 2023-06-23T19:05:05.350 INFO:teuthology.orchestra.run.smithi136.stdout:180 2023-06-23T19:05:05.351 INFO:teuthology.orchestra.run.smithi136.stdout:180.out 2023-06-23T19:05:05.351 INFO:teuthology.orchestra.run.smithi136.stdout:181 2023-06-23T19:05:05.351 INFO:teuthology.orchestra.run.smithi136.stdout:181.out 2023-06-23T19:05:05.351 INFO:teuthology.orchestra.run.smithi136.stdout:182 2023-06-23T19:05:05.351 INFO:teuthology.orchestra.run.smithi136.stdout:182.out 2023-06-23T19:05:05.351 INFO:teuthology.orchestra.run.smithi136.stdout:183 2023-06-23T19:05:05.351 INFO:teuthology.orchestra.run.smithi136.stdout:183.out 2023-06-23T19:05:05.351 INFO:teuthology.orchestra.run.smithi136.stdout:184 2023-06-23T19:05:05.352 INFO:teuthology.orchestra.run.smithi136.stdout:184.out 2023-06-23T19:05:05.352 INFO:teuthology.orchestra.run.smithi136.stdout:185 2023-06-23T19:05:05.352 INFO:teuthology.orchestra.run.smithi136.stdout:185.out 2023-06-23T19:05:05.352 INFO:teuthology.orchestra.run.smithi136.stdout:186 2023-06-23T19:05:05.352 INFO:teuthology.orchestra.run.smithi136.stdout:186.out 2023-06-23T19:05:05.352 INFO:teuthology.orchestra.run.smithi136.stdout:187 2023-06-23T19:05:05.352 INFO:teuthology.orchestra.run.smithi136.stdout:187.out 2023-06-23T19:05:05.352 INFO:teuthology.orchestra.run.smithi136.stdout:188 2023-06-23T19:05:05.353 INFO:teuthology.orchestra.run.smithi136.stdout:188.out 2023-06-23T19:05:05.353 INFO:teuthology.orchestra.run.smithi136.stdout:189 2023-06-23T19:05:05.353 INFO:teuthology.orchestra.run.smithi136.stdout:189.out 2023-06-23T19:05:05.353 INFO:teuthology.orchestra.run.smithi136.stdout:190 2023-06-23T19:05:05.353 INFO:teuthology.orchestra.run.smithi136.stdout:190.out 2023-06-23T19:05:05.353 INFO:teuthology.orchestra.run.smithi136.stdout:191 2023-06-23T19:05:05.353 INFO:teuthology.orchestra.run.smithi136.stdout:191.out 2023-06-23T19:05:05.353 INFO:teuthology.orchestra.run.smithi136.stdout:192 2023-06-23T19:05:05.354 INFO:teuthology.orchestra.run.smithi136.stdout:192.out 2023-06-23T19:05:05.354 INFO:teuthology.orchestra.run.smithi136.stdout:193 2023-06-23T19:05:05.354 INFO:teuthology.orchestra.run.smithi136.stdout:193.out 2023-06-23T19:05:05.354 INFO:teuthology.orchestra.run.smithi136.stdout:194 2023-06-23T19:05:05.354 INFO:teuthology.orchestra.run.smithi136.stdout:194.out 2023-06-23T19:05:05.354 INFO:teuthology.orchestra.run.smithi136.stdout:195 2023-06-23T19:05:05.354 INFO:teuthology.orchestra.run.smithi136.stdout:195.out 2023-06-23T19:05:05.354 INFO:teuthology.orchestra.run.smithi136.stdout:196 2023-06-23T19:05:05.355 INFO:teuthology.orchestra.run.smithi136.stdout:196.out 2023-06-23T19:05:05.355 INFO:teuthology.orchestra.run.smithi136.stdout:197 2023-06-23T19:05:05.355 INFO:teuthology.orchestra.run.smithi136.stdout:197.out 2023-06-23T19:05:05.355 INFO:teuthology.orchestra.run.smithi136.stdout:198 2023-06-23T19:05:05.355 INFO:teuthology.orchestra.run.smithi136.stdout:198.out 2023-06-23T19:05:05.355 INFO:teuthology.orchestra.run.smithi136.stdout:199 2023-06-23T19:05:05.355 INFO:teuthology.orchestra.run.smithi136.stdout:199.out 2023-06-23T19:05:05.355 INFO:teuthology.orchestra.run.smithi136.stdout:200 2023-06-23T19:05:05.356 INFO:teuthology.orchestra.run.smithi136.stdout:200.out 2023-06-23T19:05:05.356 INFO:teuthology.orchestra.run.smithi136.stdout:201 2023-06-23T19:05:05.356 INFO:teuthology.orchestra.run.smithi136.stdout:201.out 2023-06-23T19:05:05.356 INFO:teuthology.orchestra.run.smithi136.stdout:202 2023-06-23T19:05:05.356 INFO:teuthology.orchestra.run.smithi136.stdout:202.out 2023-06-23T19:05:05.356 INFO:teuthology.orchestra.run.smithi136.stdout:203 2023-06-23T19:05:05.356 INFO:teuthology.orchestra.run.smithi136.stdout:203.out 2023-06-23T19:05:05.356 INFO:teuthology.orchestra.run.smithi136.stdout:204 2023-06-23T19:05:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:204.out 2023-06-23T19:05:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:205 2023-06-23T19:05:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:205.out 2023-06-23T19:05:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:206 2023-06-23T19:05:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:206.out 2023-06-23T19:05:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:207 2023-06-23T19:05:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:207.out 2023-06-23T19:05:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:208 2023-06-23T19:05:05.358 INFO:teuthology.orchestra.run.smithi136.stdout:208.out 2023-06-23T19:05:05.358 INFO:teuthology.orchestra.run.smithi136.stdout:209 2023-06-23T19:05:05.358 INFO:teuthology.orchestra.run.smithi136.stdout:209.out 2023-06-23T19:05:05.358 INFO:teuthology.orchestra.run.smithi136.stdout:210 2023-06-23T19:05:05.358 INFO:teuthology.orchestra.run.smithi136.stdout:210.out 2023-06-23T19:05:05.358 INFO:teuthology.orchestra.run.smithi136.stdout:211 2023-06-23T19:05:05.358 INFO:teuthology.orchestra.run.smithi136.stdout:211.out 2023-06-23T19:05:05.359 INFO:teuthology.orchestra.run.smithi136.stdout:212 2023-06-23T19:05:05.359 INFO:teuthology.orchestra.run.smithi136.stdout:212.out 2023-06-23T19:05:05.359 INFO:teuthology.orchestra.run.smithi136.stdout:213 2023-06-23T19:05:05.359 INFO:teuthology.orchestra.run.smithi136.stdout:213.out 2023-06-23T19:05:05.359 INFO:teuthology.orchestra.run.smithi136.stdout:214 2023-06-23T19:05:05.359 INFO:teuthology.orchestra.run.smithi136.stdout:214.out 2023-06-23T19:05:05.359 INFO:teuthology.orchestra.run.smithi136.stdout:215 2023-06-23T19:05:05.359 INFO:teuthology.orchestra.run.smithi136.stdout:215.out 2023-06-23T19:05:05.360 INFO:teuthology.orchestra.run.smithi136.stdout:216 2023-06-23T19:05:05.360 INFO:teuthology.orchestra.run.smithi136.stdout:216.out 2023-06-23T19:05:05.360 INFO:teuthology.orchestra.run.smithi136.stdout:217 2023-06-23T19:05:05.360 INFO:teuthology.orchestra.run.smithi136.stdout:217.out 2023-06-23T19:05:05.360 INFO:teuthology.orchestra.run.smithi136.stdout:218 2023-06-23T19:05:05.360 INFO:teuthology.orchestra.run.smithi136.stdout:218.out 2023-06-23T19:05:05.360 INFO:teuthology.orchestra.run.smithi136.stdout:219 2023-06-23T19:05:05.360 INFO:teuthology.orchestra.run.smithi136.stdout:219.out 2023-06-23T19:05:05.361 INFO:teuthology.orchestra.run.smithi136.stdout:220 2023-06-23T19:05:05.361 INFO:teuthology.orchestra.run.smithi136.stdout:220.out 2023-06-23T19:05:05.361 INFO:teuthology.orchestra.run.smithi136.stdout:221 2023-06-23T19:05:05.361 INFO:teuthology.orchestra.run.smithi136.stdout:221.out 2023-06-23T19:05:05.361 INFO:teuthology.orchestra.run.smithi136.stdout:222 2023-06-23T19:05:05.362 INFO:teuthology.orchestra.run.smithi136.stdout:222.out 2023-06-23T19:05:05.362 INFO:teuthology.orchestra.run.smithi136.stdout:223 2023-06-23T19:05:05.362 INFO:teuthology.orchestra.run.smithi136.stdout:223.out 2023-06-23T19:05:05.362 INFO:teuthology.orchestra.run.smithi136.stdout:224 2023-06-23T19:05:05.362 INFO:teuthology.orchestra.run.smithi136.stdout:224.out 2023-06-23T19:05:05.362 INFO:teuthology.orchestra.run.smithi136.stdout:225 2023-06-23T19:05:05.362 INFO:teuthology.orchestra.run.smithi136.stdout:225.out 2023-06-23T19:05:05.362 INFO:teuthology.orchestra.run.smithi136.stdout:226 2023-06-23T19:05:05.363 INFO:teuthology.orchestra.run.smithi136.stdout:226.out 2023-06-23T19:05:05.363 INFO:teuthology.orchestra.run.smithi136.stdout:227 2023-06-23T19:05:05.363 INFO:teuthology.orchestra.run.smithi136.stdout:227.out 2023-06-23T19:05:05.363 INFO:teuthology.orchestra.run.smithi136.stdout:228 2023-06-23T19:05:05.363 INFO:teuthology.orchestra.run.smithi136.stdout:228.out 2023-06-23T19:05:05.363 INFO:teuthology.orchestra.run.smithi136.stdout:229 2023-06-23T19:05:05.363 INFO:teuthology.orchestra.run.smithi136.stdout:229.out 2023-06-23T19:05:05.364 INFO:teuthology.orchestra.run.smithi136.stdout:230 2023-06-23T19:05:05.364 INFO:teuthology.orchestra.run.smithi136.stdout:230.out 2023-06-23T19:05:05.364 INFO:teuthology.orchestra.run.smithi136.stdout:231 2023-06-23T19:05:05.364 INFO:teuthology.orchestra.run.smithi136.stdout:231.out 2023-06-23T19:05:05.364 INFO:teuthology.orchestra.run.smithi136.stdout:232 2023-06-23T19:05:05.365 INFO:teuthology.orchestra.run.smithi136.stdout:232.out 2023-06-23T19:05:05.365 INFO:teuthology.orchestra.run.smithi136.stdout:233 2023-06-23T19:05:05.365 INFO:teuthology.orchestra.run.smithi136.stdout:233.out 2023-06-23T19:05:05.365 INFO:teuthology.orchestra.run.smithi136.stdout:234 2023-06-23T19:05:05.365 INFO:teuthology.orchestra.run.smithi136.stdout:234.out 2023-06-23T19:05:05.365 INFO:teuthology.orchestra.run.smithi136.stdout:235 2023-06-23T19:05:05.365 INFO:teuthology.orchestra.run.smithi136.stdout:235.out 2023-06-23T19:05:05.365 INFO:teuthology.orchestra.run.smithi136.stdout:236 2023-06-23T19:05:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:236.out 2023-06-23T19:05:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:237 2023-06-23T19:05:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:237.out 2023-06-23T19:05:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:238 2023-06-23T19:05:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:238.out 2023-06-23T19:05:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:239 2023-06-23T19:05:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:239.out 2023-06-23T19:05:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:240 2023-06-23T19:05:05.367 INFO:teuthology.orchestra.run.smithi136.stdout:240.out 2023-06-23T19:05:05.367 INFO:teuthology.orchestra.run.smithi136.stdout:241 2023-06-23T19:05:05.367 INFO:teuthology.orchestra.run.smithi136.stdout:241.out 2023-06-23T19:05:05.367 INFO:teuthology.orchestra.run.smithi136.stdout:242 2023-06-23T19:05:05.367 INFO:teuthology.orchestra.run.smithi136.stdout:242.out 2023-06-23T19:05:05.367 INFO:teuthology.orchestra.run.smithi136.stdout:243 2023-06-23T19:05:05.367 INFO:teuthology.orchestra.run.smithi136.stdout:243.out 2023-06-23T19:05:05.367 INFO:teuthology.orchestra.run.smithi136.stdout:244 2023-06-23T19:05:05.368 INFO:teuthology.orchestra.run.smithi136.stdout:244.out 2023-06-23T19:05:05.368 INFO:teuthology.orchestra.run.smithi136.stdout:245 2023-06-23T19:05:05.368 INFO:teuthology.orchestra.run.smithi136.stdout:245.out 2023-06-23T19:05:05.368 INFO:teuthology.orchestra.run.smithi136.stdout:246 2023-06-23T19:05:05.368 INFO:teuthology.orchestra.run.smithi136.stdout:246.out 2023-06-23T19:05:05.368 INFO:teuthology.orchestra.run.smithi136.stdout:247 2023-06-23T19:05:05.368 INFO:teuthology.orchestra.run.smithi136.stdout:247.out 2023-06-23T19:05:05.368 INFO:teuthology.orchestra.run.smithi136.stdout:248 2023-06-23T19:05:05.369 INFO:teuthology.orchestra.run.smithi136.stdout:248.out 2023-06-23T19:05:05.369 INFO:teuthology.orchestra.run.smithi136.stdout:249 2023-06-23T19:05:05.369 INFO:teuthology.orchestra.run.smithi136.stdout:249.out 2023-06-23T19:05:05.369 INFO:teuthology.orchestra.run.smithi136.stdout:250 2023-06-23T19:05:05.369 INFO:teuthology.orchestra.run.smithi136.stdout:250.out 2023-06-23T19:05:05.369 INFO:teuthology.orchestra.run.smithi136.stdout:251 2023-06-23T19:05:05.369 INFO:teuthology.orchestra.run.smithi136.stdout:251.out 2023-06-23T19:05:05.369 INFO:teuthology.orchestra.run.smithi136.stdout:252 2023-06-23T19:05:05.370 INFO:teuthology.orchestra.run.smithi136.stdout:252.out 2023-06-23T19:05:05.370 INFO:teuthology.orchestra.run.smithi136.stdout:253 2023-06-23T19:05:05.370 INFO:teuthology.orchestra.run.smithi136.stdout:253.out 2023-06-23T19:05:05.370 INFO:teuthology.orchestra.run.smithi136.stdout:254 2023-06-23T19:05:05.370 INFO:teuthology.orchestra.run.smithi136.stdout:254.out 2023-06-23T19:05:05.370 INFO:teuthology.orchestra.run.smithi136.stdout:255 2023-06-23T19:05:05.370 INFO:teuthology.orchestra.run.smithi136.stdout:255.out 2023-06-23T19:05:05.370 INFO:teuthology.orchestra.run.smithi136.stdout:256 2023-06-23T19:05:05.371 INFO:teuthology.orchestra.run.smithi136.stdout:256.out 2023-06-23T19:05:05.371 INFO:teuthology.orchestra.run.smithi136.stdout:257 2023-06-23T19:05:05.371 INFO:teuthology.orchestra.run.smithi136.stdout:257.out 2023-06-23T19:05:05.371 INFO:teuthology.orchestra.run.smithi136.stdout:258 2023-06-23T19:05:05.371 INFO:teuthology.orchestra.run.smithi136.stdout:258.out 2023-06-23T19:05:05.371 INFO:teuthology.orchestra.run.smithi136.stdout:259 2023-06-23T19:05:05.371 INFO:teuthology.orchestra.run.smithi136.stdout:259.out 2023-06-23T19:05:05.371 INFO:teuthology.orchestra.run.smithi136.stdout:260 2023-06-23T19:05:05.372 INFO:teuthology.orchestra.run.smithi136.stdout:260.out 2023-06-23T19:05:05.372 INFO:teuthology.orchestra.run.smithi136.stdout:261 2023-06-23T19:05:05.372 INFO:teuthology.orchestra.run.smithi136.stdout:261.out 2023-06-23T19:05:05.372 INFO:teuthology.orchestra.run.smithi136.stdout:262 2023-06-23T19:05:05.372 INFO:teuthology.orchestra.run.smithi136.stdout:262.out 2023-06-23T19:05:05.372 INFO:teuthology.orchestra.run.smithi136.stdout:263 2023-06-23T19:05:05.372 INFO:teuthology.orchestra.run.smithi136.stdout:263.out 2023-06-23T19:05:05.373 INFO:teuthology.orchestra.run.smithi136.stdout:264 2023-06-23T19:05:05.373 INFO:teuthology.orchestra.run.smithi136.stdout:264.out 2023-06-23T19:05:05.373 INFO:teuthology.orchestra.run.smithi136.stdout:265 2023-06-23T19:05:05.373 INFO:teuthology.orchestra.run.smithi136.stdout:265.out 2023-06-23T19:05:05.373 INFO:teuthology.orchestra.run.smithi136.stdout:266 2023-06-23T19:05:05.373 INFO:teuthology.orchestra.run.smithi136.stdout:266.out 2023-06-23T19:05:05.373 INFO:teuthology.orchestra.run.smithi136.stdout:267 2023-06-23T19:05:05.373 INFO:teuthology.orchestra.run.smithi136.stdout:267.out 2023-06-23T19:05:05.374 INFO:teuthology.orchestra.run.smithi136.stdout:268 2023-06-23T19:05:05.374 INFO:teuthology.orchestra.run.smithi136.stdout:268.out 2023-06-23T19:05:05.374 INFO:teuthology.orchestra.run.smithi136.stdout:269 2023-06-23T19:05:05.374 INFO:teuthology.orchestra.run.smithi136.stdout:269.out 2023-06-23T19:05:05.374 INFO:teuthology.orchestra.run.smithi136.stdout:270 2023-06-23T19:05:05.374 INFO:teuthology.orchestra.run.smithi136.stdout:270.out 2023-06-23T19:05:05.374 INFO:teuthology.orchestra.run.smithi136.stdout:271 2023-06-23T19:05:05.374 INFO:teuthology.orchestra.run.smithi136.stdout:271.out 2023-06-23T19:05:05.375 INFO:teuthology.orchestra.run.smithi136.stdout:272 2023-06-23T19:05:05.375 INFO:teuthology.orchestra.run.smithi136.stdout:272.out 2023-06-23T19:05:05.375 INFO:teuthology.orchestra.run.smithi136.stdout:273 2023-06-23T19:05:05.375 INFO:teuthology.orchestra.run.smithi136.stdout:273.out 2023-06-23T19:05:05.375 INFO:teuthology.orchestra.run.smithi136.stdout:274 2023-06-23T19:05:05.375 INFO:teuthology.orchestra.run.smithi136.stdout:274.out 2023-06-23T19:05:05.375 INFO:teuthology.orchestra.run.smithi136.stdout:275 2023-06-23T19:05:05.375 INFO:teuthology.orchestra.run.smithi136.stdout:275.out 2023-06-23T19:05:05.376 INFO:teuthology.orchestra.run.smithi136.stdout:276 2023-06-23T19:05:05.376 INFO:teuthology.orchestra.run.smithi136.stdout:276.out 2023-06-23T19:05:05.376 INFO:teuthology.orchestra.run.smithi136.stdout:277 2023-06-23T19:05:05.376 INFO:teuthology.orchestra.run.smithi136.stdout:277.out 2023-06-23T19:05:05.376 INFO:teuthology.orchestra.run.smithi136.stdout:278 2023-06-23T19:05:05.376 INFO:teuthology.orchestra.run.smithi136.stdout:278.out 2023-06-23T19:05:05.376 INFO:teuthology.orchestra.run.smithi136.stdout:279 2023-06-23T19:05:05.376 INFO:teuthology.orchestra.run.smithi136.stdout:279.out 2023-06-23T19:05:05.377 INFO:teuthology.orchestra.run.smithi136.stdout:280 2023-06-23T19:05:05.377 INFO:teuthology.orchestra.run.smithi136.stdout:280.out 2023-06-23T19:05:05.377 INFO:teuthology.orchestra.run.smithi136.stdout:281 2023-06-23T19:05:05.377 INFO:teuthology.orchestra.run.smithi136.stdout:281.out 2023-06-23T19:05:05.377 INFO:teuthology.orchestra.run.smithi136.stdout:282 2023-06-23T19:05:05.377 INFO:teuthology.orchestra.run.smithi136.stdout:282.out 2023-06-23T19:05:05.377 INFO:teuthology.orchestra.run.smithi136.stdout:283 2023-06-23T19:05:05.377 INFO:teuthology.orchestra.run.smithi136.stdout:283.out 2023-06-23T19:05:05.378 INFO:teuthology.orchestra.run.smithi136.stdout:284 2023-06-23T19:05:05.378 INFO:teuthology.orchestra.run.smithi136.stdout:284.out 2023-06-23T19:05:05.378 INFO:teuthology.orchestra.run.smithi136.stdout:285 2023-06-23T19:05:05.378 INFO:teuthology.orchestra.run.smithi136.stdout:285.out 2023-06-23T19:05:05.378 INFO:teuthology.orchestra.run.smithi136.stdout:286 2023-06-23T19:05:05.378 INFO:teuthology.orchestra.run.smithi136.stdout:286.out 2023-06-23T19:05:05.378 INFO:teuthology.orchestra.run.smithi136.stdout:287 2023-06-23T19:05:05.378 INFO:teuthology.orchestra.run.smithi136.stdout:287.out 2023-06-23T19:05:05.379 INFO:teuthology.orchestra.run.smithi136.stdout:288 2023-06-23T19:05:05.379 INFO:teuthology.orchestra.run.smithi136.stdout:288.out 2023-06-23T19:05:05.379 INFO:teuthology.orchestra.run.smithi136.stdout:289 2023-06-23T19:05:05.379 INFO:teuthology.orchestra.run.smithi136.stdout:289.out 2023-06-23T19:05:05.379 INFO:teuthology.orchestra.run.smithi136.stdout:290 2023-06-23T19:05:05.379 INFO:teuthology.orchestra.run.smithi136.stdout:290.out 2023-06-23T19:05:05.379 INFO:teuthology.orchestra.run.smithi136.stdout:291 2023-06-23T19:05:05.379 INFO:teuthology.orchestra.run.smithi136.stdout:291.out 2023-06-23T19:05:05.380 INFO:teuthology.orchestra.run.smithi136.stdout:292 2023-06-23T19:05:05.380 INFO:teuthology.orchestra.run.smithi136.stdout:292.out 2023-06-23T19:05:05.380 INFO:teuthology.orchestra.run.smithi136.stdout:293 2023-06-23T19:05:05.380 INFO:teuthology.orchestra.run.smithi136.stdout:293.out 2023-06-23T19:05:05.380 INFO:teuthology.orchestra.run.smithi136.stdout:294 2023-06-23T19:05:05.380 INFO:teuthology.orchestra.run.smithi136.stdout:294.out 2023-06-23T19:05:05.380 INFO:teuthology.orchestra.run.smithi136.stdout:295 2023-06-23T19:05:05.380 INFO:teuthology.orchestra.run.smithi136.stdout:295.out 2023-06-23T19:05:05.381 INFO:teuthology.orchestra.run.smithi136.stdout:296 2023-06-23T19:05:05.381 INFO:teuthology.orchestra.run.smithi136.stdout:296.out 2023-06-23T19:05:05.381 INFO:teuthology.orchestra.run.smithi136.stdout:297 2023-06-23T19:05:05.381 INFO:teuthology.orchestra.run.smithi136.stdout:297.out 2023-06-23T19:05:05.381 INFO:teuthology.orchestra.run.smithi136.stdout:298 2023-06-23T19:05:05.381 INFO:teuthology.orchestra.run.smithi136.stdout:298.out 2023-06-23T19:05:05.381 INFO:teuthology.orchestra.run.smithi136.stdout:299 2023-06-23T19:05:05.381 INFO:teuthology.orchestra.run.smithi136.stdout:299.out 2023-06-23T19:05:05.382 INFO:teuthology.orchestra.run.smithi136.stdout:300 2023-06-23T19:05:05.382 INFO:teuthology.orchestra.run.smithi136.stdout:300.out 2023-06-23T19:05:05.382 INFO:teuthology.orchestra.run.smithi136.stdout:301 2023-06-23T19:05:05.382 INFO:teuthology.orchestra.run.smithi136.stdout:301.out 2023-06-23T19:05:05.382 INFO:teuthology.orchestra.run.smithi136.stdout:302 2023-06-23T19:05:05.382 INFO:teuthology.orchestra.run.smithi136.stdout:302.out 2023-06-23T19:05:05.382 INFO:teuthology.orchestra.run.smithi136.stdout:303 2023-06-23T19:05:05.382 INFO:teuthology.orchestra.run.smithi136.stdout:303.out 2023-06-23T19:05:05.383 INFO:teuthology.orchestra.run.smithi136.stdout:304 2023-06-23T19:05:05.383 INFO:teuthology.orchestra.run.smithi136.stdout:304.out 2023-06-23T19:05:05.383 INFO:teuthology.orchestra.run.smithi136.stdout:305 2023-06-23T19:05:05.383 INFO:teuthology.orchestra.run.smithi136.stdout:305.out 2023-06-23T19:05:05.383 INFO:teuthology.orchestra.run.smithi136.stdout:306 2023-06-23T19:05:05.383 INFO:teuthology.orchestra.run.smithi136.stdout:306.out 2023-06-23T19:05:05.383 INFO:teuthology.orchestra.run.smithi136.stdout:307 2023-06-23T19:05:05.383 INFO:teuthology.orchestra.run.smithi136.stdout:307.out 2023-06-23T19:05:05.384 INFO:teuthology.orchestra.run.smithi136.stdout:308 2023-06-23T19:05:05.384 INFO:teuthology.orchestra.run.smithi136.stdout:308.out 2023-06-23T19:05:05.384 INFO:teuthology.orchestra.run.smithi136.stdout:309 2023-06-23T19:05:05.384 INFO:teuthology.orchestra.run.smithi136.stdout:309.out 2023-06-23T19:05:05.384 INFO:teuthology.orchestra.run.smithi136.stdout:310 2023-06-23T19:05:05.384 INFO:teuthology.orchestra.run.smithi136.stdout:310.out 2023-06-23T19:05:05.384 INFO:teuthology.orchestra.run.smithi136.stdout:311 2023-06-23T19:05:05.384 INFO:teuthology.orchestra.run.smithi136.stdout:311.out 2023-06-23T19:05:05.385 INFO:teuthology.orchestra.run.smithi136.stdout:312 2023-06-23T19:05:05.385 INFO:teuthology.orchestra.run.smithi136.stdout:312.out 2023-06-23T19:05:05.385 INFO:teuthology.orchestra.run.smithi136.stdout:313 2023-06-23T19:05:05.385 INFO:teuthology.orchestra.run.smithi136.stdout:313.out 2023-06-23T19:05:05.385 INFO:teuthology.orchestra.run.smithi136.stdout:314 2023-06-23T19:05:05.385 INFO:teuthology.orchestra.run.smithi136.stdout:314.out 2023-06-23T19:05:05.385 INFO:teuthology.orchestra.run.smithi136.stdout:315 2023-06-23T19:05:05.385 INFO:teuthology.orchestra.run.smithi136.stdout:315.out 2023-06-23T19:05:05.386 INFO:teuthology.orchestra.run.smithi136.stdout:316 2023-06-23T19:05:05.386 INFO:teuthology.orchestra.run.smithi136.stdout:316.out 2023-06-23T19:05:05.386 INFO:teuthology.orchestra.run.smithi136.stdout:317 2023-06-23T19:05:05.386 INFO:teuthology.orchestra.run.smithi136.stdout:317.out 2023-06-23T19:05:05.386 INFO:teuthology.orchestra.run.smithi136.stdout:318 2023-06-23T19:05:05.386 INFO:teuthology.orchestra.run.smithi136.stdout:318.out 2023-06-23T19:05:05.386 INFO:teuthology.orchestra.run.smithi136.stdout:319 2023-06-23T19:05:05.386 INFO:teuthology.orchestra.run.smithi136.stdout:319.out 2023-06-23T19:05:05.387 INFO:teuthology.orchestra.run.smithi136.stdout:320 2023-06-23T19:05:05.387 INFO:teuthology.orchestra.run.smithi136.stdout:320.out 2023-06-23T19:05:05.387 INFO:teuthology.orchestra.run.smithi136.stdout:321 2023-06-23T19:05:05.387 INFO:teuthology.orchestra.run.smithi136.stdout:321.out 2023-06-23T19:05:05.387 INFO:teuthology.orchestra.run.smithi136.stdout:322 2023-06-23T19:05:05.387 INFO:teuthology.orchestra.run.smithi136.stdout:322.out 2023-06-23T19:05:05.387 INFO:teuthology.orchestra.run.smithi136.stdout:323 2023-06-23T19:05:05.387 INFO:teuthology.orchestra.run.smithi136.stdout:323.out 2023-06-23T19:05:05.388 INFO:teuthology.orchestra.run.smithi136.stdout:324 2023-06-23T19:05:05.388 INFO:teuthology.orchestra.run.smithi136.stdout:324.out 2023-06-23T19:05:05.388 INFO:teuthology.orchestra.run.smithi136.stdout:325 2023-06-23T19:05:05.388 INFO:teuthology.orchestra.run.smithi136.stdout:325.out 2023-06-23T19:05:05.388 INFO:teuthology.orchestra.run.smithi136.stdout:326 2023-06-23T19:05:05.388 INFO:teuthology.orchestra.run.smithi136.stdout:326.out 2023-06-23T19:05:05.388 INFO:teuthology.orchestra.run.smithi136.stdout:327 2023-06-23T19:05:05.388 INFO:teuthology.orchestra.run.smithi136.stdout:327.out 2023-06-23T19:05:05.389 INFO:teuthology.orchestra.run.smithi136.stdout:328 2023-06-23T19:05:05.389 INFO:teuthology.orchestra.run.smithi136.stdout:328.out 2023-06-23T19:05:05.389 INFO:teuthology.orchestra.run.smithi136.stdout:329 2023-06-23T19:05:05.389 INFO:teuthology.orchestra.run.smithi136.stdout:329.out 2023-06-23T19:05:05.389 INFO:teuthology.orchestra.run.smithi136.stdout:330 2023-06-23T19:05:05.389 INFO:teuthology.orchestra.run.smithi136.stdout:330.out 2023-06-23T19:05:05.389 INFO:teuthology.orchestra.run.smithi136.stdout:331 2023-06-23T19:05:05.389 INFO:teuthology.orchestra.run.smithi136.stdout:331.out 2023-06-23T19:05:05.390 INFO:teuthology.orchestra.run.smithi136.stdout:332 2023-06-23T19:05:05.390 INFO:teuthology.orchestra.run.smithi136.stdout:332.out 2023-06-23T19:05:05.390 INFO:teuthology.orchestra.run.smithi136.stdout:333 2023-06-23T19:05:05.390 INFO:teuthology.orchestra.run.smithi136.stdout:333.out 2023-06-23T19:05:05.390 INFO:teuthology.orchestra.run.smithi136.stdout:334 2023-06-23T19:05:05.390 INFO:teuthology.orchestra.run.smithi136.stdout:334.out 2023-06-23T19:05:05.390 INFO:teuthology.orchestra.run.smithi136.stdout:335 2023-06-23T19:05:05.390 INFO:teuthology.orchestra.run.smithi136.stdout:335.out 2023-06-23T19:05:05.391 INFO:teuthology.orchestra.run.smithi136.stdout:336 2023-06-23T19:05:05.391 INFO:teuthology.orchestra.run.smithi136.stdout:336.out 2023-06-23T19:05:05.391 INFO:teuthology.orchestra.run.smithi136.stdout:337 2023-06-23T19:05:05.391 INFO:teuthology.orchestra.run.smithi136.stdout:337.out 2023-06-23T19:05:05.391 INFO:teuthology.orchestra.run.smithi136.stdout:338 2023-06-23T19:05:05.391 INFO:teuthology.orchestra.run.smithi136.stdout:338.out 2023-06-23T19:05:05.391 INFO:teuthology.orchestra.run.smithi136.stdout:339 2023-06-23T19:05:05.391 INFO:teuthology.orchestra.run.smithi136.stdout:339.out 2023-06-23T19:05:05.392 INFO:teuthology.orchestra.run.smithi136.stdout:340 2023-06-23T19:05:05.392 INFO:teuthology.orchestra.run.smithi136.stdout:340.out 2023-06-23T19:05:05.392 INFO:teuthology.orchestra.run.smithi136.stdout:341 2023-06-23T19:05:05.392 INFO:teuthology.orchestra.run.smithi136.stdout:341.out 2023-06-23T19:05:05.392 INFO:teuthology.orchestra.run.smithi136.stdout:342 2023-06-23T19:05:05.392 INFO:teuthology.orchestra.run.smithi136.stdout:342.out 2023-06-23T19:05:05.392 INFO:teuthology.orchestra.run.smithi136.stdout:343 2023-06-23T19:05:05.392 INFO:teuthology.orchestra.run.smithi136.stdout:343.out 2023-06-23T19:05:05.393 INFO:teuthology.orchestra.run.smithi136.stdout:344 2023-06-23T19:05:05.393 INFO:teuthology.orchestra.run.smithi136.stdout:344.out 2023-06-23T19:05:05.393 INFO:teuthology.orchestra.run.smithi136.stdout:345 2023-06-23T19:05:05.393 INFO:teuthology.orchestra.run.smithi136.stdout:345.out 2023-06-23T19:05:05.393 INFO:teuthology.orchestra.run.smithi136.stdout:346 2023-06-23T19:05:05.393 INFO:teuthology.orchestra.run.smithi136.stdout:346.out 2023-06-23T19:05:05.393 INFO:teuthology.orchestra.run.smithi136.stdout:347 2023-06-23T19:05:05.393 INFO:teuthology.orchestra.run.smithi136.stdout:347.out 2023-06-23T19:05:05.394 INFO:teuthology.orchestra.run.smithi136.stdout:348 2023-06-23T19:05:05.394 INFO:teuthology.orchestra.run.smithi136.stdout:348.out 2023-06-23T19:05:05.394 INFO:teuthology.orchestra.run.smithi136.stdout:349 2023-06-23T19:05:05.394 INFO:teuthology.orchestra.run.smithi136.stdout:349.out 2023-06-23T19:05:05.394 INFO:teuthology.orchestra.run.smithi136.stdout:350 2023-06-23T19:05:05.394 INFO:teuthology.orchestra.run.smithi136.stdout:350.out 2023-06-23T19:05:05.394 INFO:teuthology.orchestra.run.smithi136.stdout:351 2023-06-23T19:05:05.394 INFO:teuthology.orchestra.run.smithi136.stdout:351.out 2023-06-23T19:05:05.395 INFO:teuthology.orchestra.run.smithi136.stdout:352 2023-06-23T19:05:05.395 INFO:teuthology.orchestra.run.smithi136.stdout:352.out 2023-06-23T19:05:05.395 INFO:teuthology.orchestra.run.smithi136.stdout:353 2023-06-23T19:05:05.395 INFO:teuthology.orchestra.run.smithi136.stdout:353.out 2023-06-23T19:05:05.395 INFO:teuthology.orchestra.run.smithi136.stdout:354 2023-06-23T19:05:05.395 INFO:teuthology.orchestra.run.smithi136.stdout:354.out 2023-06-23T19:05:05.395 INFO:teuthology.orchestra.run.smithi136.stdout:355 2023-06-23T19:05:05.395 INFO:teuthology.orchestra.run.smithi136.stdout:355.out 2023-06-23T19:05:05.396 INFO:teuthology.orchestra.run.smithi136.stdout:356 2023-06-23T19:05:05.396 INFO:teuthology.orchestra.run.smithi136.stdout:356.out 2023-06-23T19:05:05.396 INFO:teuthology.orchestra.run.smithi136.stdout:357 2023-06-23T19:05:05.396 INFO:teuthology.orchestra.run.smithi136.stdout:357.out 2023-06-23T19:05:05.396 INFO:teuthology.orchestra.run.smithi136.stdout:358 2023-06-23T19:05:05.396 INFO:teuthology.orchestra.run.smithi136.stdout:358.out 2023-06-23T19:05:05.396 INFO:teuthology.orchestra.run.smithi136.stdout:359 2023-06-23T19:05:05.396 INFO:teuthology.orchestra.run.smithi136.stdout:359.out 2023-06-23T19:05:05.397 INFO:teuthology.orchestra.run.smithi136.stdout:360 2023-06-23T19:05:05.397 INFO:teuthology.orchestra.run.smithi136.stdout:360.out 2023-06-23T19:05:05.397 INFO:teuthology.orchestra.run.smithi136.stdout:361 2023-06-23T19:05:05.397 INFO:teuthology.orchestra.run.smithi136.stdout:361.out 2023-06-23T19:05:05.397 INFO:teuthology.orchestra.run.smithi136.stdout:362 2023-06-23T19:05:05.397 INFO:teuthology.orchestra.run.smithi136.stdout:362.out 2023-06-23T19:05:05.397 INFO:teuthology.orchestra.run.smithi136.stdout:363 2023-06-23T19:05:05.397 INFO:teuthology.orchestra.run.smithi136.stdout:363.out 2023-06-23T19:05:05.398 INFO:teuthology.orchestra.run.smithi136.stdout:364 2023-06-23T19:05:05.398 INFO:teuthology.orchestra.run.smithi136.stdout:364.out 2023-06-23T19:05:05.398 INFO:teuthology.orchestra.run.smithi136.stdout:365 2023-06-23T19:05:05.398 INFO:teuthology.orchestra.run.smithi136.stdout:365.out 2023-06-23T19:05:05.398 INFO:teuthology.orchestra.run.smithi136.stdout:366 2023-06-23T19:05:05.398 INFO:teuthology.orchestra.run.smithi136.stdout:366.out 2023-06-23T19:05:05.398 INFO:teuthology.orchestra.run.smithi136.stdout:367 2023-06-23T19:05:05.398 INFO:teuthology.orchestra.run.smithi136.stdout:367.out 2023-06-23T19:05:05.399 INFO:teuthology.orchestra.run.smithi136.stdout:368 2023-06-23T19:05:05.399 INFO:teuthology.orchestra.run.smithi136.stdout:368.out 2023-06-23T19:05:05.399 INFO:teuthology.orchestra.run.smithi136.stdout:369 2023-06-23T19:05:05.399 INFO:teuthology.orchestra.run.smithi136.stdout:369.out 2023-06-23T19:05:05.399 INFO:teuthology.orchestra.run.smithi136.stdout:370 2023-06-23T19:05:05.399 INFO:teuthology.orchestra.run.smithi136.stdout:370.out 2023-06-23T19:05:05.399 INFO:teuthology.orchestra.run.smithi136.stdout:371 2023-06-23T19:05:05.399 INFO:teuthology.orchestra.run.smithi136.stdout:371.out 2023-06-23T19:05:05.400 INFO:teuthology.orchestra.run.smithi136.stdout:372 2023-06-23T19:05:05.400 INFO:teuthology.orchestra.run.smithi136.stdout:372.out 2023-06-23T19:05:05.400 INFO:teuthology.orchestra.run.smithi136.stdout:373 2023-06-23T19:05:05.400 INFO:teuthology.orchestra.run.smithi136.stdout:373.out 2023-06-23T19:05:05.400 INFO:teuthology.orchestra.run.smithi136.stdout:374 2023-06-23T19:05:05.400 INFO:teuthology.orchestra.run.smithi136.stdout:374.out 2023-06-23T19:05:05.400 INFO:teuthology.orchestra.run.smithi136.stdout:375 2023-06-23T19:05:05.400 INFO:teuthology.orchestra.run.smithi136.stdout:375.out 2023-06-23T19:05:05.401 INFO:teuthology.orchestra.run.smithi136.stdout:376 2023-06-23T19:05:05.401 INFO:teuthology.orchestra.run.smithi136.stdout:376.out 2023-06-23T19:05:05.401 INFO:teuthology.orchestra.run.smithi136.stdout:377 2023-06-23T19:05:05.401 INFO:teuthology.orchestra.run.smithi136.stdout:377.out 2023-06-23T19:05:05.401 INFO:teuthology.orchestra.run.smithi136.stdout:378 2023-06-23T19:05:05.401 INFO:teuthology.orchestra.run.smithi136.stdout:378.out 2023-06-23T19:05:05.401 INFO:teuthology.orchestra.run.smithi136.stdout:379 2023-06-23T19:05:05.401 INFO:teuthology.orchestra.run.smithi136.stdout:379.out 2023-06-23T19:05:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:380 2023-06-23T19:05:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:380.out 2023-06-23T19:05:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:381 2023-06-23T19:05:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:381.out 2023-06-23T19:05:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:382 2023-06-23T19:05:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:382.out 2023-06-23T19:05:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:383 2023-06-23T19:05:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:383.out 2023-06-23T19:05:05.403 INFO:teuthology.orchestra.run.smithi136.stdout:384 2023-06-23T19:05:05.403 INFO:teuthology.orchestra.run.smithi136.stdout:384.out 2023-06-23T19:05:05.403 INFO:teuthology.orchestra.run.smithi136.stdout:385 2023-06-23T19:05:05.403 INFO:teuthology.orchestra.run.smithi136.stdout:385.out 2023-06-23T19:05:05.403 INFO:teuthology.orchestra.run.smithi136.stdout:386 2023-06-23T19:05:05.403 INFO:teuthology.orchestra.run.smithi136.stdout:386.out 2023-06-23T19:05:05.403 INFO:teuthology.orchestra.run.smithi136.stdout:387 2023-06-23T19:05:05.403 INFO:teuthology.orchestra.run.smithi136.stdout:387.out 2023-06-23T19:05:05.404 INFO:teuthology.orchestra.run.smithi136.stdout:388 2023-06-23T19:05:05.404 INFO:teuthology.orchestra.run.smithi136.stdout:388.out 2023-06-23T19:05:05.404 INFO:teuthology.orchestra.run.smithi136.stdout:389 2023-06-23T19:05:05.404 INFO:teuthology.orchestra.run.smithi136.stdout:389.out 2023-06-23T19:05:05.404 INFO:teuthology.orchestra.run.smithi136.stdout:390 2023-06-23T19:05:05.404 INFO:teuthology.orchestra.run.smithi136.stdout:390.out 2023-06-23T19:05:05.404 INFO:teuthology.orchestra.run.smithi136.stdout:391 2023-06-23T19:05:05.405 INFO:teuthology.orchestra.run.smithi136.stdout:391.out 2023-06-23T19:05:05.405 INFO:teuthology.orchestra.run.smithi136.stdout:392 2023-06-23T19:05:05.405 INFO:teuthology.orchestra.run.smithi136.stdout:392.out 2023-06-23T19:05:05.405 INFO:teuthology.orchestra.run.smithi136.stdout:393 2023-06-23T19:05:05.405 INFO:teuthology.orchestra.run.smithi136.stdout:393.out 2023-06-23T19:05:05.405 INFO:teuthology.orchestra.run.smithi136.stdout:394 2023-06-23T19:05:05.405 INFO:teuthology.orchestra.run.smithi136.stdout:394.out 2023-06-23T19:05:05.405 INFO:teuthology.orchestra.run.smithi136.stdout:395 2023-06-23T19:05:05.405 INFO:teuthology.orchestra.run.smithi136.stdout:395.out 2023-06-23T19:05:05.406 INFO:teuthology.orchestra.run.smithi136.stdout:396 2023-06-23T19:05:05.406 INFO:teuthology.orchestra.run.smithi136.stdout:396.out 2023-06-23T19:05:05.406 INFO:teuthology.orchestra.run.smithi136.stdout:397 2023-06-23T19:05:05.406 INFO:teuthology.orchestra.run.smithi136.stdout:397.out 2023-06-23T19:05:05.406 INFO:teuthology.orchestra.run.smithi136.stdout:398 2023-06-23T19:05:05.406 INFO:teuthology.orchestra.run.smithi136.stdout:398.out 2023-06-23T19:05:05.406 INFO:teuthology.orchestra.run.smithi136.stdout:399 2023-06-23T19:05:05.406 INFO:teuthology.orchestra.run.smithi136.stdout:399.out 2023-06-23T19:05:05.407 INFO:teuthology.orchestra.run.smithi136.stdout:400 2023-06-23T19:05:05.407 INFO:teuthology.orchestra.run.smithi136.stdout:400.out 2023-06-23T19:05:05.407 INFO:teuthology.orchestra.run.smithi136.stdout:401 2023-06-23T19:05:05.407 INFO:teuthology.orchestra.run.smithi136.stdout:401.out 2023-06-23T19:05:05.407 INFO:teuthology.orchestra.run.smithi136.stdout:402 2023-06-23T19:05:05.407 INFO:teuthology.orchestra.run.smithi136.stdout:402.out 2023-06-23T19:05:05.407 INFO:teuthology.orchestra.run.smithi136.stdout:403 2023-06-23T19:05:05.407 INFO:teuthology.orchestra.run.smithi136.stdout:403.out 2023-06-23T19:05:05.408 INFO:teuthology.orchestra.run.smithi136.stdout:404 2023-06-23T19:05:05.408 INFO:teuthology.orchestra.run.smithi136.stdout:404.out 2023-06-23T19:05:05.408 INFO:teuthology.orchestra.run.smithi136.stdout:405 2023-06-23T19:05:05.408 INFO:teuthology.orchestra.run.smithi136.stdout:405.out 2023-06-23T19:05:05.408 INFO:teuthology.orchestra.run.smithi136.stdout:406 2023-06-23T19:05:05.408 INFO:teuthology.orchestra.run.smithi136.stdout:406.out 2023-06-23T19:05:05.408 INFO:teuthology.orchestra.run.smithi136.stdout:407 2023-06-23T19:05:05.409 INFO:teuthology.orchestra.run.smithi136.stdout:407.out 2023-06-23T19:05:05.409 INFO:teuthology.orchestra.run.smithi136.stdout:408 2023-06-23T19:05:05.409 INFO:teuthology.orchestra.run.smithi136.stdout:408.out 2023-06-23T19:05:05.409 INFO:teuthology.orchestra.run.smithi136.stdout:409 2023-06-23T19:05:05.409 INFO:teuthology.orchestra.run.smithi136.stdout:409.out 2023-06-23T19:05:05.409 INFO:teuthology.orchestra.run.smithi136.stdout:410 2023-06-23T19:05:05.409 INFO:teuthology.orchestra.run.smithi136.stdout:410.out 2023-06-23T19:05:05.409 INFO:teuthology.orchestra.run.smithi136.stdout:411 2023-06-23T19:05:05.410 INFO:teuthology.orchestra.run.smithi136.stdout:411.out 2023-06-23T19:05:05.410 INFO:teuthology.orchestra.run.smithi136.stdout:412 2023-06-23T19:05:05.410 INFO:teuthology.orchestra.run.smithi136.stdout:412.out 2023-06-23T19:05:05.410 INFO:teuthology.orchestra.run.smithi136.stdout:413 2023-06-23T19:05:05.410 INFO:teuthology.orchestra.run.smithi136.stdout:413.out 2023-06-23T19:05:05.410 INFO:teuthology.orchestra.run.smithi136.stdout:414 2023-06-23T19:05:05.410 INFO:teuthology.orchestra.run.smithi136.stdout:414.out 2023-06-23T19:05:05.410 INFO:teuthology.orchestra.run.smithi136.stdout:415 2023-06-23T19:05:05.411 INFO:teuthology.orchestra.run.smithi136.stdout:415.out 2023-06-23T19:05:05.411 INFO:teuthology.orchestra.run.smithi136.stdout:416 2023-06-23T19:05:05.411 INFO:teuthology.orchestra.run.smithi136.stdout:416.out 2023-06-23T19:05:05.411 INFO:teuthology.orchestra.run.smithi136.stdout:417 2023-06-23T19:05:05.411 INFO:teuthology.orchestra.run.smithi136.stdout:417.out 2023-06-23T19:05:05.411 INFO:teuthology.orchestra.run.smithi136.stdout:418 2023-06-23T19:05:05.411 INFO:teuthology.orchestra.run.smithi136.stdout:418.out 2023-06-23T19:05:05.411 INFO:teuthology.orchestra.run.smithi136.stdout:419 2023-06-23T19:05:05.412 INFO:teuthology.orchestra.run.smithi136.stdout:419.out 2023-06-23T19:05:05.412 INFO:teuthology.orchestra.run.smithi136.stdout:420 2023-06-23T19:05:05.412 INFO:teuthology.orchestra.run.smithi136.stdout:420.out 2023-06-23T19:05:05.412 INFO:teuthology.orchestra.run.smithi136.stdout:421 2023-06-23T19:05:05.412 INFO:teuthology.orchestra.run.smithi136.stdout:421.out 2023-06-23T19:05:05.412 INFO:teuthology.orchestra.run.smithi136.stdout:422 2023-06-23T19:05:05.412 INFO:teuthology.orchestra.run.smithi136.stdout:422.out 2023-06-23T19:05:05.412 INFO:teuthology.orchestra.run.smithi136.stdout:423 2023-06-23T19:05:05.413 INFO:teuthology.orchestra.run.smithi136.stdout:423.out 2023-06-23T19:05:05.413 INFO:teuthology.orchestra.run.smithi136.stdout:424 2023-06-23T19:05:05.413 INFO:teuthology.orchestra.run.smithi136.stdout:424.out 2023-06-23T19:05:05.413 INFO:teuthology.orchestra.run.smithi136.stdout:425 2023-06-23T19:05:05.413 INFO:teuthology.orchestra.run.smithi136.stdout:425.out 2023-06-23T19:05:05.413 INFO:teuthology.orchestra.run.smithi136.stdout:426 2023-06-23T19:05:05.413 INFO:teuthology.orchestra.run.smithi136.stdout:426.out 2023-06-23T19:05:05.413 INFO:teuthology.orchestra.run.smithi136.stdout:427 2023-06-23T19:05:05.414 INFO:teuthology.orchestra.run.smithi136.stdout:427.out 2023-06-23T19:05:05.414 INFO:teuthology.orchestra.run.smithi136.stdout:428 2023-06-23T19:05:05.414 INFO:teuthology.orchestra.run.smithi136.stdout:428.out 2023-06-23T19:05:05.414 INFO:teuthology.orchestra.run.smithi136.stdout:429 2023-06-23T19:05:05.414 INFO:teuthology.orchestra.run.smithi136.stdout:429.out 2023-06-23T19:05:05.414 INFO:teuthology.orchestra.run.smithi136.stdout:430 2023-06-23T19:05:05.414 INFO:teuthology.orchestra.run.smithi136.stdout:430.out 2023-06-23T19:05:05.414 INFO:teuthology.orchestra.run.smithi136.stdout:431 2023-06-23T19:05:05.415 INFO:teuthology.orchestra.run.smithi136.stdout:431.out 2023-06-23T19:05:05.415 INFO:teuthology.orchestra.run.smithi136.stdout:432 2023-06-23T19:05:05.415 INFO:teuthology.orchestra.run.smithi136.stdout:432.out 2023-06-23T19:05:05.415 INFO:teuthology.orchestra.run.smithi136.stdout:433 2023-06-23T19:05:05.415 INFO:teuthology.orchestra.run.smithi136.stdout:433.out 2023-06-23T19:05:05.415 INFO:teuthology.orchestra.run.smithi136.stdout:434 2023-06-23T19:05:05.415 INFO:teuthology.orchestra.run.smithi136.stdout:434.out 2023-06-23T19:05:05.415 INFO:teuthology.orchestra.run.smithi136.stdout:435 2023-06-23T19:05:05.416 INFO:teuthology.orchestra.run.smithi136.stdout:435.out 2023-06-23T19:05:05.416 INFO:teuthology.orchestra.run.smithi136.stdout:436 2023-06-23T19:05:05.416 INFO:teuthology.orchestra.run.smithi136.stdout:436.out 2023-06-23T19:05:05.416 INFO:teuthology.orchestra.run.smithi136.stdout:437 2023-06-23T19:05:05.416 INFO:teuthology.orchestra.run.smithi136.stdout:437.out 2023-06-23T19:05:05.416 INFO:teuthology.orchestra.run.smithi136.stdout:438 2023-06-23T19:05:05.416 INFO:teuthology.orchestra.run.smithi136.stdout:438.out 2023-06-23T19:05:05.416 INFO:teuthology.orchestra.run.smithi136.stdout:439 2023-06-23T19:05:05.417 INFO:teuthology.orchestra.run.smithi136.stdout:439.out 2023-06-23T19:05:05.417 INFO:teuthology.orchestra.run.smithi136.stdout:440 2023-06-23T19:05:05.417 INFO:teuthology.orchestra.run.smithi136.stdout:440.out 2023-06-23T19:05:05.417 INFO:teuthology.orchestra.run.smithi136.stdout:441 2023-06-23T19:05:05.417 INFO:teuthology.orchestra.run.smithi136.stdout:441.out 2023-06-23T19:05:05.417 INFO:teuthology.orchestra.run.smithi136.stdout:442 2023-06-23T19:05:05.417 INFO:teuthology.orchestra.run.smithi136.stdout:442.out 2023-06-23T19:05:05.417 INFO:teuthology.orchestra.run.smithi136.stdout:443 2023-06-23T19:05:05.418 INFO:teuthology.orchestra.run.smithi136.stdout:443.out 2023-06-23T19:05:05.418 INFO:teuthology.orchestra.run.smithi136.stdout:444 2023-06-23T19:05:05.418 INFO:teuthology.orchestra.run.smithi136.stdout:444.out 2023-06-23T19:05:05.418 INFO:teuthology.orchestra.run.smithi136.stdout:445 2023-06-23T19:05:05.418 INFO:teuthology.orchestra.run.smithi136.stdout:445.out 2023-06-23T19:05:05.418 INFO:teuthology.orchestra.run.smithi136.stdout:446 2023-06-23T19:05:05.418 INFO:teuthology.orchestra.run.smithi136.stdout:446.out 2023-06-23T19:05:05.418 INFO:teuthology.orchestra.run.smithi136.stdout:447 2023-06-23T19:05:05.419 INFO:teuthology.orchestra.run.smithi136.stdout:447.out 2023-06-23T19:05:05.419 INFO:teuthology.orchestra.run.smithi136.stdout:448 2023-06-23T19:05:05.419 INFO:teuthology.orchestra.run.smithi136.stdout:448.out 2023-06-23T19:05:05.419 INFO:teuthology.orchestra.run.smithi136.stdout:449 2023-06-23T19:05:05.419 INFO:teuthology.orchestra.run.smithi136.stdout:449.out 2023-06-23T19:05:05.419 INFO:teuthology.orchestra.run.smithi136.stdout:450 2023-06-23T19:05:05.419 INFO:teuthology.orchestra.run.smithi136.stdout:450.out 2023-06-23T19:05:05.419 INFO:teuthology.orchestra.run.smithi136.stdout:451 2023-06-23T19:05:05.420 INFO:teuthology.orchestra.run.smithi136.stdout:451.out 2023-06-23T19:05:05.420 INFO:teuthology.orchestra.run.smithi136.stdout:452 2023-06-23T19:05:05.420 INFO:teuthology.orchestra.run.smithi136.stdout:452.out 2023-06-23T19:05:05.420 INFO:teuthology.orchestra.run.smithi136.stdout:453 2023-06-23T19:05:05.420 INFO:teuthology.orchestra.run.smithi136.stdout:453.out 2023-06-23T19:05:05.420 INFO:teuthology.orchestra.run.smithi136.stdout:454 2023-06-23T19:05:05.420 INFO:teuthology.orchestra.run.smithi136.stdout:454.out 2023-06-23T19:05:05.420 INFO:teuthology.orchestra.run.smithi136.stdout:455 2023-06-23T19:05:05.421 INFO:teuthology.orchestra.run.smithi136.stdout:455.out 2023-06-23T19:05:05.421 INFO:teuthology.orchestra.run.smithi136.stdout:456 2023-06-23T19:05:05.421 INFO:teuthology.orchestra.run.smithi136.stdout:456.out 2023-06-23T19:05:05.421 INFO:teuthology.orchestra.run.smithi136.stdout:457 2023-06-23T19:05:05.421 INFO:teuthology.orchestra.run.smithi136.stdout:457.out 2023-06-23T19:05:05.421 INFO:teuthology.orchestra.run.smithi136.stdout:458 2023-06-23T19:05:05.421 INFO:teuthology.orchestra.run.smithi136.stdout:458.out 2023-06-23T19:05:05.421 INFO:teuthology.orchestra.run.smithi136.stdout:459 2023-06-23T19:05:05.422 INFO:teuthology.orchestra.run.smithi136.stdout:459.out 2023-06-23T19:05:05.422 INFO:teuthology.orchestra.run.smithi136.stdout:460 2023-06-23T19:05:05.422 INFO:teuthology.orchestra.run.smithi136.stdout:460.out 2023-06-23T19:05:05.422 INFO:teuthology.orchestra.run.smithi136.stdout:461 2023-06-23T19:05:05.422 INFO:teuthology.orchestra.run.smithi136.stdout:461.out 2023-06-23T19:05:05.422 INFO:teuthology.orchestra.run.smithi136.stdout:462 2023-06-23T19:05:05.422 INFO:teuthology.orchestra.run.smithi136.stdout:462.out 2023-06-23T19:05:05.422 INFO:teuthology.orchestra.run.smithi136.stdout:463 2023-06-23T19:05:05.423 INFO:teuthology.orchestra.run.smithi136.stdout:463.out 2023-06-23T19:05:05.423 INFO:teuthology.orchestra.run.smithi136.stdout:464 2023-06-23T19:05:05.423 INFO:teuthology.orchestra.run.smithi136.stdout:464.out 2023-06-23T19:05:05.423 INFO:teuthology.orchestra.run.smithi136.stdout:465 2023-06-23T19:05:05.423 INFO:teuthology.orchestra.run.smithi136.stdout:465.out 2023-06-23T19:05:05.423 INFO:teuthology.orchestra.run.smithi136.stdout:466 2023-06-23T19:05:05.423 INFO:teuthology.orchestra.run.smithi136.stdout:466.out 2023-06-23T19:05:05.423 INFO:teuthology.orchestra.run.smithi136.stdout:467 2023-06-23T19:05:05.424 INFO:teuthology.orchestra.run.smithi136.stdout:467.out 2023-06-23T19:05:05.424 INFO:teuthology.orchestra.run.smithi136.stdout:468 2023-06-23T19:05:05.424 INFO:teuthology.orchestra.run.smithi136.stdout:468.out 2023-06-23T19:05:05.424 INFO:teuthology.orchestra.run.smithi136.stdout:469 2023-06-23T19:05:05.424 INFO:teuthology.orchestra.run.smithi136.stdout:469.out 2023-06-23T19:05:05.424 INFO:teuthology.orchestra.run.smithi136.stdout:470 2023-06-23T19:05:05.424 INFO:teuthology.orchestra.run.smithi136.stdout:470.out 2023-06-23T19:05:05.424 INFO:teuthology.orchestra.run.smithi136.stdout:471 2023-06-23T19:05:05.425 INFO:teuthology.orchestra.run.smithi136.stdout:471.out 2023-06-23T19:05:05.425 INFO:teuthology.orchestra.run.smithi136.stdout:472 2023-06-23T19:05:05.425 INFO:teuthology.orchestra.run.smithi136.stdout:472.out 2023-06-23T19:05:05.425 INFO:teuthology.orchestra.run.smithi136.stdout:473 2023-06-23T19:05:05.425 INFO:teuthology.orchestra.run.smithi136.stdout:473.out 2023-06-23T19:05:05.425 INFO:teuthology.orchestra.run.smithi136.stdout:474 2023-06-23T19:05:05.425 INFO:teuthology.orchestra.run.smithi136.stdout:474.out 2023-06-23T19:05:05.425 INFO:teuthology.orchestra.run.smithi136.stdout:475 2023-06-23T19:05:05.426 INFO:teuthology.orchestra.run.smithi136.stdout:475.out 2023-06-23T19:05:05.426 INFO:teuthology.orchestra.run.smithi136.stdout:476 2023-06-23T19:05:05.426 INFO:teuthology.orchestra.run.smithi136.stdout:476.out 2023-06-23T19:05:05.426 INFO:teuthology.orchestra.run.smithi136.stdout:477 2023-06-23T19:05:05.426 INFO:teuthology.orchestra.run.smithi136.stdout:477.out 2023-06-23T19:05:05.426 INFO:teuthology.orchestra.run.smithi136.stdout:478 2023-06-23T19:05:05.426 INFO:teuthology.orchestra.run.smithi136.stdout:478.out 2023-06-23T19:05:05.426 INFO:teuthology.orchestra.run.smithi136.stdout:479 2023-06-23T19:05:05.427 INFO:teuthology.orchestra.run.smithi136.stdout:479.out 2023-06-23T19:05:05.427 INFO:teuthology.orchestra.run.smithi136.stdout:480 2023-06-23T19:05:05.427 INFO:teuthology.orchestra.run.smithi136.stdout:480.out 2023-06-23T19:05:05.427 INFO:teuthology.orchestra.run.smithi136.stdout:481 2023-06-23T19:05:05.427 INFO:teuthology.orchestra.run.smithi136.stdout:481.out 2023-06-23T19:05:05.427 INFO:teuthology.orchestra.run.smithi136.stdout:482 2023-06-23T19:05:05.427 INFO:teuthology.orchestra.run.smithi136.stdout:482.out 2023-06-23T19:05:05.427 INFO:teuthology.orchestra.run.smithi136.stdout:483 2023-06-23T19:05:05.428 INFO:teuthology.orchestra.run.smithi136.stdout:483.out 2023-06-23T19:05:05.428 INFO:teuthology.orchestra.run.smithi136.stdout:484 2023-06-23T19:05:05.428 INFO:teuthology.orchestra.run.smithi136.stdout:484.out 2023-06-23T19:05:05.428 INFO:teuthology.orchestra.run.smithi136.stdout:485 2023-06-23T19:05:05.428 INFO:teuthology.orchestra.run.smithi136.stdout:485.out 2023-06-23T19:05:05.428 INFO:teuthology.orchestra.run.smithi136.stdout:486 2023-06-23T19:05:05.428 INFO:teuthology.orchestra.run.smithi136.stdout:486.out 2023-06-23T19:05:05.428 INFO:teuthology.orchestra.run.smithi136.stdout:487 2023-06-23T19:05:05.429 INFO:teuthology.orchestra.run.smithi136.stdout:487.out 2023-06-23T19:05:05.429 INFO:teuthology.orchestra.run.smithi136.stdout:488 2023-06-23T19:05:05.429 INFO:teuthology.orchestra.run.smithi136.stdout:488.out 2023-06-23T19:05:05.429 INFO:teuthology.orchestra.run.smithi136.stdout:489 2023-06-23T19:05:05.429 INFO:teuthology.orchestra.run.smithi136.stdout:489.out 2023-06-23T19:05:05.429 INFO:teuthology.orchestra.run.smithi136.stdout:490 2023-06-23T19:05:05.429 INFO:teuthology.orchestra.run.smithi136.stdout:490.out 2023-06-23T19:05:05.429 INFO:teuthology.orchestra.run.smithi136.stdout:491 2023-06-23T19:05:05.430 INFO:teuthology.orchestra.run.smithi136.stdout:491.out 2023-06-23T19:05:05.430 INFO:teuthology.orchestra.run.smithi136.stdout:492 2023-06-23T19:05:05.430 INFO:teuthology.orchestra.run.smithi136.stdout:492.out 2023-06-23T19:05:05.430 INFO:teuthology.orchestra.run.smithi136.stdout:493 2023-06-23T19:05:05.430 INFO:teuthology.orchestra.run.smithi136.stdout:493.out 2023-06-23T19:05:05.430 INFO:teuthology.orchestra.run.smithi136.stdout:494 2023-06-23T19:05:05.430 INFO:teuthology.orchestra.run.smithi136.stdout:494.out 2023-06-23T19:05:05.430 INFO:teuthology.orchestra.run.smithi136.stdout:495 2023-06-23T19:05:05.431 INFO:teuthology.orchestra.run.smithi136.stdout:495.out 2023-06-23T19:05:05.431 INFO:teuthology.orchestra.run.smithi136.stdout:496 2023-06-23T19:05:05.431 INFO:teuthology.orchestra.run.smithi136.stdout:496.out 2023-06-23T19:05:05.431 INFO:teuthology.orchestra.run.smithi136.stdout:497 2023-06-23T19:05:05.431 INFO:teuthology.orchestra.run.smithi136.stdout:497.out 2023-06-23T19:05:05.431 INFO:teuthology.orchestra.run.smithi136.stdout:498 2023-06-23T19:05:05.431 INFO:teuthology.orchestra.run.smithi136.stdout:498.out 2023-06-23T19:05:05.431 INFO:teuthology.orchestra.run.smithi136.stdout:499 2023-06-23T19:05:05.432 INFO:teuthology.orchestra.run.smithi136.stdout:499.out 2023-06-23T19:05:05.432 INFO:teuthology.orchestra.run.smithi136.stdout:500 2023-06-23T19:05:05.432 INFO:teuthology.orchestra.run.smithi136.stdout:500.out 2023-06-23T19:05:05.432 INFO:teuthology.orchestra.run.smithi136.stdout:501 2023-06-23T19:05:05.432 INFO:teuthology.orchestra.run.smithi136.stdout:501.out 2023-06-23T19:05:05.432 INFO:teuthology.orchestra.run.smithi136.stdout:502 2023-06-23T19:05:05.432 INFO:teuthology.orchestra.run.smithi136.stdout:502.out 2023-06-23T19:05:05.432 INFO:teuthology.orchestra.run.smithi136.stdout:503 2023-06-23T19:05:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:503.out 2023-06-23T19:05:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:504 2023-06-23T19:05:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:504.out 2023-06-23T19:05:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:505 2023-06-23T19:05:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:505.out 2023-06-23T19:05:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:506 2023-06-23T19:05:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:506.out 2023-06-23T19:05:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:507 2023-06-23T19:05:05.434 INFO:teuthology.orchestra.run.smithi136.stdout:507.out 2023-06-23T19:05:05.434 INFO:teuthology.orchestra.run.smithi136.stdout:508 2023-06-23T19:05:05.434 INFO:teuthology.orchestra.run.smithi136.stdout:508.out 2023-06-23T19:05:05.434 INFO:teuthology.orchestra.run.smithi136.stdout:509 2023-06-23T19:05:05.434 INFO:teuthology.orchestra.run.smithi136.stdout:509.out 2023-06-23T19:05:05.434 INFO:teuthology.orchestra.run.smithi136.stdout:510 2023-06-23T19:05:05.434 INFO:teuthology.orchestra.run.smithi136.stdout:510.out 2023-06-23T19:05:05.434 INFO:teuthology.orchestra.run.smithi136.stdout:511 2023-06-23T19:05:05.435 INFO:teuthology.orchestra.run.smithi136.stdout:511.out 2023-06-23T19:05:05.435 INFO:teuthology.orchestra.run.smithi136.stdout:512 2023-06-23T19:05:05.435 INFO:teuthology.orchestra.run.smithi136.stdout:512.out 2023-06-23T19:05:05.435 INFO:teuthology.orchestra.run.smithi136.stdout:513 2023-06-23T19:05:05.435 INFO:teuthology.orchestra.run.smithi136.stdout:513.out 2023-06-23T19:05:05.435 INFO:teuthology.orchestra.run.smithi136.stdout:514 2023-06-23T19:05:05.435 INFO:teuthology.orchestra.run.smithi136.stdout:514.out 2023-06-23T19:05:05.435 INFO:teuthology.orchestra.run.smithi136.stdout:515 2023-06-23T19:05:05.436 INFO:teuthology.orchestra.run.smithi136.stdout:515.out 2023-06-23T19:05:05.436 INFO:teuthology.orchestra.run.smithi136.stdout:516 2023-06-23T19:05:05.436 INFO:teuthology.orchestra.run.smithi136.stdout:516.out 2023-06-23T19:05:05.436 INFO:teuthology.orchestra.run.smithi136.stdout:517 2023-06-23T19:05:05.436 INFO:teuthology.orchestra.run.smithi136.stdout:517.out 2023-06-23T19:05:05.436 INFO:teuthology.orchestra.run.smithi136.stdout:518 2023-06-23T19:05:05.436 INFO:teuthology.orchestra.run.smithi136.stdout:518.out 2023-06-23T19:05:05.436 INFO:teuthology.orchestra.run.smithi136.stdout:519 2023-06-23T19:05:05.437 INFO:teuthology.orchestra.run.smithi136.stdout:519.out 2023-06-23T19:05:05.437 INFO:teuthology.orchestra.run.smithi136.stdout:520 2023-06-23T19:05:05.437 INFO:teuthology.orchestra.run.smithi136.stdout:520.out 2023-06-23T19:05:05.437 INFO:teuthology.orchestra.run.smithi136.stdout:521 2023-06-23T19:05:05.437 INFO:teuthology.orchestra.run.smithi136.stdout:521.out 2023-06-23T19:05:05.437 INFO:teuthology.orchestra.run.smithi136.stdout:522 2023-06-23T19:05:05.437 INFO:teuthology.orchestra.run.smithi136.stdout:522.out 2023-06-23T19:05:05.437 INFO:teuthology.orchestra.run.smithi136.stdout:523 2023-06-23T19:05:05.438 INFO:teuthology.orchestra.run.smithi136.stdout:523.out 2023-06-23T19:05:05.438 INFO:teuthology.orchestra.run.smithi136.stdout:524 2023-06-23T19:05:05.438 INFO:teuthology.orchestra.run.smithi136.stdout:524.out 2023-06-23T19:05:05.438 INFO:teuthology.orchestra.run.smithi136.stdout:525 2023-06-23T19:05:05.438 INFO:teuthology.orchestra.run.smithi136.stdout:525.out 2023-06-23T19:05:05.438 INFO:teuthology.orchestra.run.smithi136.stdout:526 2023-06-23T19:05:05.438 INFO:teuthology.orchestra.run.smithi136.stdout:526.out 2023-06-23T19:05:05.438 INFO:teuthology.orchestra.run.smithi136.stdout:527 2023-06-23T19:05:05.439 INFO:teuthology.orchestra.run.smithi136.stdout:527.out 2023-06-23T19:05:05.439 INFO:teuthology.orchestra.run.smithi136.stdout:528 2023-06-23T19:05:05.439 INFO:teuthology.orchestra.run.smithi136.stdout:528.out 2023-06-23T19:05:05.439 INFO:teuthology.orchestra.run.smithi136.stdout:529 2023-06-23T19:05:05.439 INFO:teuthology.orchestra.run.smithi136.stdout:529.out 2023-06-23T19:05:05.439 INFO:teuthology.orchestra.run.smithi136.stdout:530 2023-06-23T19:05:05.439 INFO:teuthology.orchestra.run.smithi136.stdout:530.out 2023-06-23T19:05:05.439 INFO:teuthology.orchestra.run.smithi136.stdout:531 2023-06-23T19:05:05.440 INFO:teuthology.orchestra.run.smithi136.stdout:531.out 2023-06-23T19:05:05.440 INFO:teuthology.orchestra.run.smithi136.stdout:532 2023-06-23T19:05:05.440 INFO:teuthology.orchestra.run.smithi136.stdout:532.out 2023-06-23T19:05:05.440 INFO:teuthology.orchestra.run.smithi136.stdout:533 2023-06-23T19:05:05.440 INFO:teuthology.orchestra.run.smithi136.stdout:533.out 2023-06-23T19:05:05.440 INFO:teuthology.orchestra.run.smithi136.stdout:534 2023-06-23T19:05:05.440 INFO:teuthology.orchestra.run.smithi136.stdout:534.out 2023-06-23T19:05:05.440 INFO:teuthology.orchestra.run.smithi136.stdout:535 2023-06-23T19:05:05.441 INFO:teuthology.orchestra.run.smithi136.stdout:535.out 2023-06-23T19:05:05.441 INFO:teuthology.orchestra.run.smithi136.stdout:536 2023-06-23T19:05:05.441 INFO:teuthology.orchestra.run.smithi136.stdout:536.out 2023-06-23T19:05:05.441 INFO:teuthology.orchestra.run.smithi136.stdout:537 2023-06-23T19:05:05.441 INFO:teuthology.orchestra.run.smithi136.stdout:537.out 2023-06-23T19:05:05.441 INFO:teuthology.orchestra.run.smithi136.stdout:538 2023-06-23T19:05:05.441 INFO:teuthology.orchestra.run.smithi136.stdout:538.out 2023-06-23T19:05:05.441 INFO:teuthology.orchestra.run.smithi136.stdout:539 2023-06-23T19:05:05.442 INFO:teuthology.orchestra.run.smithi136.stdout:539.out 2023-06-23T19:05:05.442 INFO:teuthology.orchestra.run.smithi136.stdout:540 2023-06-23T19:05:05.442 INFO:teuthology.orchestra.run.smithi136.stdout:540.out 2023-06-23T19:05:05.442 INFO:teuthology.orchestra.run.smithi136.stdout:541 2023-06-23T19:05:05.442 INFO:teuthology.orchestra.run.smithi136.stdout:541.out 2023-06-23T19:05:05.442 INFO:teuthology.orchestra.run.smithi136.stdout:542 2023-06-23T19:05:05.442 INFO:teuthology.orchestra.run.smithi136.stdout:542.out 2023-06-23T19:05:05.442 INFO:teuthology.orchestra.run.smithi136.stdout:543 2023-06-23T19:05:05.443 INFO:teuthology.orchestra.run.smithi136.stdout:543.out 2023-06-23T19:05:05.443 INFO:teuthology.orchestra.run.smithi136.stdout:544 2023-06-23T19:05:05.443 INFO:teuthology.orchestra.run.smithi136.stdout:544.out 2023-06-23T19:05:05.443 INFO:teuthology.orchestra.run.smithi136.stdout:545 2023-06-23T19:05:05.443 INFO:teuthology.orchestra.run.smithi136.stdout:545.out 2023-06-23T19:05:05.443 INFO:teuthology.orchestra.run.smithi136.stdout:546 2023-06-23T19:05:05.443 INFO:teuthology.orchestra.run.smithi136.stdout:546.out 2023-06-23T19:05:05.443 INFO:teuthology.orchestra.run.smithi136.stdout:547 2023-06-23T19:05:05.444 INFO:teuthology.orchestra.run.smithi136.stdout:547.out 2023-06-23T19:05:05.444 INFO:teuthology.orchestra.run.smithi136.stdout:548 2023-06-23T19:05:05.444 INFO:teuthology.orchestra.run.smithi136.stdout:548.out 2023-06-23T19:05:05.444 INFO:teuthology.orchestra.run.smithi136.stdout:549 2023-06-23T19:05:05.444 INFO:teuthology.orchestra.run.smithi136.stdout:549.out 2023-06-23T19:05:05.444 INFO:teuthology.orchestra.run.smithi136.stdout:550 2023-06-23T19:05:05.444 INFO:teuthology.orchestra.run.smithi136.stdout:550.out 2023-06-23T19:05:05.444 INFO:teuthology.orchestra.run.smithi136.stdout:551 2023-06-23T19:05:05.445 INFO:teuthology.orchestra.run.smithi136.stdout:551.out 2023-06-23T19:05:05.445 INFO:teuthology.orchestra.run.smithi136.stdout:552 2023-06-23T19:05:05.445 INFO:teuthology.orchestra.run.smithi136.stdout:552.out 2023-06-23T19:05:05.445 INFO:teuthology.orchestra.run.smithi136.stdout:553 2023-06-23T19:05:05.445 INFO:teuthology.orchestra.run.smithi136.stdout:553.out 2023-06-23T19:05:05.445 INFO:teuthology.orchestra.run.smithi136.stdout:554 2023-06-23T19:05:05.445 INFO:teuthology.orchestra.run.smithi136.stdout:554.out 2023-06-23T19:05:05.445 INFO:teuthology.orchestra.run.smithi136.stdout:555 2023-06-23T19:05:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:555.out 2023-06-23T19:05:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:556 2023-06-23T19:05:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:556.out 2023-06-23T19:05:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:557 2023-06-23T19:05:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:557.out 2023-06-23T19:05:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:558 2023-06-23T19:05:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:558.out 2023-06-23T19:05:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:559 2023-06-23T19:05:05.447 INFO:teuthology.orchestra.run.smithi136.stdout:559.out 2023-06-23T19:05:05.447 INFO:teuthology.orchestra.run.smithi136.stdout:560 2023-06-23T19:05:05.447 INFO:teuthology.orchestra.run.smithi136.stdout:560.out 2023-06-23T19:05:05.447 INFO:teuthology.orchestra.run.smithi136.stdout:561 2023-06-23T19:05:05.447 INFO:teuthology.orchestra.run.smithi136.stdout:561.out 2023-06-23T19:05:05.447 INFO:teuthology.orchestra.run.smithi136.stdout:562 2023-06-23T19:05:05.447 INFO:teuthology.orchestra.run.smithi136.stdout:562.out 2023-06-23T19:05:05.447 INFO:teuthology.orchestra.run.smithi136.stdout:563 2023-06-23T19:05:05.448 INFO:teuthology.orchestra.run.smithi136.stdout:563.out 2023-06-23T19:05:05.448 INFO:teuthology.orchestra.run.smithi136.stdout:564 2023-06-23T19:05:05.448 INFO:teuthology.orchestra.run.smithi136.stdout:564.out 2023-06-23T19:05:05.448 INFO:teuthology.orchestra.run.smithi136.stdout:565 2023-06-23T19:05:05.448 INFO:teuthology.orchestra.run.smithi136.stdout:565.out 2023-06-23T19:05:05.448 INFO:teuthology.orchestra.run.smithi136.stdout:566 2023-06-23T19:05:05.448 INFO:teuthology.orchestra.run.smithi136.stdout:566.out 2023-06-23T19:05:05.448 INFO:teuthology.orchestra.run.smithi136.stdout:567 2023-06-23T19:05:05.449 INFO:teuthology.orchestra.run.smithi136.stdout:567.out 2023-06-23T19:05:05.449 INFO:teuthology.orchestra.run.smithi136.stdout:568 2023-06-23T19:05:05.449 INFO:teuthology.orchestra.run.smithi136.stdout:568.out 2023-06-23T19:05:05.449 INFO:teuthology.orchestra.run.smithi136.stdout:569 2023-06-23T19:05:05.449 INFO:teuthology.orchestra.run.smithi136.stdout:569.out 2023-06-23T19:05:05.449 INFO:teuthology.orchestra.run.smithi136.stdout:570 2023-06-23T19:05:05.449 INFO:teuthology.orchestra.run.smithi136.stdout:570.out 2023-06-23T19:05:05.449 INFO:teuthology.orchestra.run.smithi136.stdout:571 2023-06-23T19:05:05.450 INFO:teuthology.orchestra.run.smithi136.stdout:571.out 2023-06-23T19:05:05.450 INFO:teuthology.orchestra.run.smithi136.stdout:572 2023-06-23T19:05:05.450 INFO:teuthology.orchestra.run.smithi136.stdout:572.out 2023-06-23T19:05:05.450 INFO:teuthology.orchestra.run.smithi136.stdout:573 2023-06-23T19:05:05.450 INFO:teuthology.orchestra.run.smithi136.stdout:573.out 2023-06-23T19:05:05.450 INFO:teuthology.orchestra.run.smithi136.stdout:574 2023-06-23T19:05:05.450 INFO:teuthology.orchestra.run.smithi136.stdout:574.out 2023-06-23T19:05:05.450 INFO:teuthology.orchestra.run.smithi136.stdout:575 2023-06-23T19:05:05.451 INFO:teuthology.orchestra.run.smithi136.stdout:575.out 2023-06-23T19:05:05.451 INFO:teuthology.orchestra.run.smithi136.stdout:576 2023-06-23T19:05:05.451 INFO:teuthology.orchestra.run.smithi136.stdout:576.out 2023-06-23T19:05:05.451 INFO:teuthology.orchestra.run.smithi136.stdout:577 2023-06-23T19:05:05.451 INFO:teuthology.orchestra.run.smithi136.stdout:577.out 2023-06-23T19:05:05.451 INFO:teuthology.orchestra.run.smithi136.stdout:578 2023-06-23T19:05:05.451 INFO:teuthology.orchestra.run.smithi136.stdout:578.out 2023-06-23T19:05:05.451 INFO:teuthology.orchestra.run.smithi136.stdout:579 2023-06-23T19:05:05.451 INFO:teuthology.orchestra.run.smithi136.stdout:579.out 2023-06-23T19:05:05.452 INFO:teuthology.orchestra.run.smithi136.stdout:580 2023-06-23T19:05:05.452 INFO:teuthology.orchestra.run.smithi136.stdout:580.out 2023-06-23T19:05:05.452 INFO:teuthology.orchestra.run.smithi136.stdout:581 2023-06-23T19:05:05.452 INFO:teuthology.orchestra.run.smithi136.stdout:581.out 2023-06-23T19:05:05.452 INFO:teuthology.orchestra.run.smithi136.stdout:582 2023-06-23T19:05:05.452 INFO:teuthology.orchestra.run.smithi136.stdout:582.out 2023-06-23T19:05:05.452 INFO:teuthology.orchestra.run.smithi136.stdout:583 2023-06-23T19:05:05.452 INFO:teuthology.orchestra.run.smithi136.stdout:583.out 2023-06-23T19:05:05.453 INFO:teuthology.orchestra.run.smithi136.stdout:584 2023-06-23T19:05:05.453 INFO:teuthology.orchestra.run.smithi136.stdout:584.out 2023-06-23T19:05:05.453 INFO:teuthology.orchestra.run.smithi136.stdout:585 2023-06-23T19:05:05.453 INFO:teuthology.orchestra.run.smithi136.stdout:585.out 2023-06-23T19:05:05.453 INFO:teuthology.orchestra.run.smithi136.stdout:586 2023-06-23T19:05:05.453 INFO:teuthology.orchestra.run.smithi136.stdout:586.out 2023-06-23T19:05:05.453 INFO:teuthology.orchestra.run.smithi136.stdout:587 2023-06-23T19:05:05.453 INFO:teuthology.orchestra.run.smithi136.stdout:587.out 2023-06-23T19:05:05.454 INFO:teuthology.orchestra.run.smithi136.stdout:588 2023-06-23T19:05:05.454 INFO:teuthology.orchestra.run.smithi136.stdout:588.out 2023-06-23T19:05:05.454 INFO:teuthology.orchestra.run.smithi136.stdout:589 2023-06-23T19:05:05.454 INFO:teuthology.orchestra.run.smithi136.stdout:589.out 2023-06-23T19:05:05.454 INFO:teuthology.orchestra.run.smithi136.stdout:590 2023-06-23T19:05:05.454 INFO:teuthology.orchestra.run.smithi136.stdout:590.out 2023-06-23T19:05:05.454 INFO:teuthology.orchestra.run.smithi136.stdout:591 2023-06-23T19:05:05.454 INFO:teuthology.orchestra.run.smithi136.stdout:591.out 2023-06-23T19:05:05.455 INFO:teuthology.orchestra.run.smithi136.stdout:592 2023-06-23T19:05:05.455 INFO:teuthology.orchestra.run.smithi136.stdout:592.out 2023-06-23T19:05:05.455 INFO:teuthology.orchestra.run.smithi136.stdout:593 2023-06-23T19:05:05.455 INFO:teuthology.orchestra.run.smithi136.stdout:593.out 2023-06-23T19:05:05.455 INFO:teuthology.orchestra.run.smithi136.stdout:594 2023-06-23T19:05:05.455 INFO:teuthology.orchestra.run.smithi136.stdout:594.out 2023-06-23T19:05:05.455 INFO:teuthology.orchestra.run.smithi136.stdout:595 2023-06-23T19:05:05.455 INFO:teuthology.orchestra.run.smithi136.stdout:595.out 2023-06-23T19:05:05.456 INFO:teuthology.orchestra.run.smithi136.stdout:596 2023-06-23T19:05:05.456 INFO:teuthology.orchestra.run.smithi136.stdout:596.out 2023-06-23T19:05:05.456 INFO:teuthology.orchestra.run.smithi136.stdout:597 2023-06-23T19:05:05.456 INFO:teuthology.orchestra.run.smithi136.stdout:597.out 2023-06-23T19:05:05.456 INFO:teuthology.orchestra.run.smithi136.stdout:598 2023-06-23T19:05:05.456 INFO:teuthology.orchestra.run.smithi136.stdout:598.out 2023-06-23T19:05:05.456 INFO:teuthology.orchestra.run.smithi136.stdout:599 2023-06-23T19:05:05.456 INFO:teuthology.orchestra.run.smithi136.stdout:599.out 2023-06-23T19:05:05.457 INFO:teuthology.orchestra.run.smithi136.stdout:600 2023-06-23T19:05:05.457 INFO:teuthology.orchestra.run.smithi136.stdout:600.out 2023-06-23T19:05:05.457 INFO:teuthology.orchestra.run.smithi136.stdout:601 2023-06-23T19:05:05.457 INFO:teuthology.orchestra.run.smithi136.stdout:601.out 2023-06-23T19:05:05.457 INFO:teuthology.orchestra.run.smithi136.stdout:602 2023-06-23T19:05:05.457 INFO:teuthology.orchestra.run.smithi136.stdout:602.out 2023-06-23T19:05:05.457 INFO:teuthology.orchestra.run.smithi136.stdout:603 2023-06-23T19:05:05.457 INFO:teuthology.orchestra.run.smithi136.stdout:603.out 2023-06-23T19:05:05.458 INFO:teuthology.orchestra.run.smithi136.stdout:604 2023-06-23T19:05:05.458 INFO:teuthology.orchestra.run.smithi136.stdout:604.out 2023-06-23T19:05:05.458 INFO:teuthology.orchestra.run.smithi136.stdout:605 2023-06-23T19:05:05.458 INFO:teuthology.orchestra.run.smithi136.stdout:605.out 2023-06-23T19:05:05.458 INFO:teuthology.orchestra.run.smithi136.stdout:606 2023-06-23T19:05:05.458 INFO:teuthology.orchestra.run.smithi136.stdout:606.out 2023-06-23T19:05:05.458 INFO:teuthology.orchestra.run.smithi136.stdout:607 2023-06-23T19:05:05.458 INFO:teuthology.orchestra.run.smithi136.stdout:607.out 2023-06-23T19:05:05.459 INFO:teuthology.orchestra.run.smithi136.stdout:608 2023-06-23T19:05:05.459 INFO:teuthology.orchestra.run.smithi136.stdout:608.out 2023-06-23T19:05:05.459 INFO:teuthology.orchestra.run.smithi136.stdout:609 2023-06-23T19:05:05.459 INFO:teuthology.orchestra.run.smithi136.stdout:609.out 2023-06-23T19:05:05.459 INFO:teuthology.orchestra.run.smithi136.stdout:610 2023-06-23T19:05:05.459 INFO:teuthology.orchestra.run.smithi136.stdout:610.out 2023-06-23T19:05:05.459 INFO:teuthology.orchestra.run.smithi136.stdout:611 2023-06-23T19:05:05.459 INFO:teuthology.orchestra.run.smithi136.stdout:611.out 2023-06-23T19:05:05.460 INFO:teuthology.orchestra.run.smithi136.stdout:612 2023-06-23T19:05:05.460 INFO:teuthology.orchestra.run.smithi136.stdout:612.out 2023-06-23T19:05:05.460 INFO:teuthology.orchestra.run.smithi136.stdout:613 2023-06-23T19:05:05.460 INFO:teuthology.orchestra.run.smithi136.stdout:613.out 2023-06-23T19:05:05.460 INFO:teuthology.orchestra.run.smithi136.stdout:614 2023-06-23T19:05:05.460 INFO:teuthology.orchestra.run.smithi136.stdout:614.out 2023-06-23T19:05:05.460 INFO:teuthology.orchestra.run.smithi136.stdout:615 2023-06-23T19:05:05.461 INFO:teuthology.orchestra.run.smithi136.stdout:615.out 2023-06-23T19:05:05.461 INFO:teuthology.orchestra.run.smithi136.stdout:616 2023-06-23T19:05:05.461 INFO:teuthology.orchestra.run.smithi136.stdout:616.out 2023-06-23T19:05:05.461 INFO:teuthology.orchestra.run.smithi136.stdout:617 2023-06-23T19:05:05.461 INFO:teuthology.orchestra.run.smithi136.stdout:617.out 2023-06-23T19:05:05.461 INFO:teuthology.orchestra.run.smithi136.stdout:618 2023-06-23T19:05:05.462 INFO:teuthology.orchestra.run.smithi136.stdout:618.out 2023-06-23T19:05:05.462 INFO:teuthology.orchestra.run.smithi136.stdout:619 2023-06-23T19:05:05.462 INFO:teuthology.orchestra.run.smithi136.stdout:619.out 2023-06-23T19:05:05.462 INFO:teuthology.orchestra.run.smithi136.stdout:620 2023-06-23T19:05:05.462 INFO:teuthology.orchestra.run.smithi136.stdout:620.out 2023-06-23T19:05:05.462 INFO:teuthology.orchestra.run.smithi136.stdout:621 2023-06-23T19:05:05.462 INFO:teuthology.orchestra.run.smithi136.stdout:621.out 2023-06-23T19:05:05.462 INFO:teuthology.orchestra.run.smithi136.stdout:622 2023-06-23T19:05:05.463 INFO:teuthology.orchestra.run.smithi136.stdout:622.out 2023-06-23T19:05:05.463 INFO:teuthology.orchestra.run.smithi136.stdout:623 2023-06-23T19:05:05.463 INFO:teuthology.orchestra.run.smithi136.stdout:623.out 2023-06-23T19:05:05.463 INFO:teuthology.orchestra.run.smithi136.stdout:624 2023-06-23T19:05:05.463 INFO:teuthology.orchestra.run.smithi136.stdout:624.out 2023-06-23T19:05:05.463 INFO:teuthology.orchestra.run.smithi136.stdout:625 2023-06-23T19:05:05.463 INFO:teuthology.orchestra.run.smithi136.stdout:625.out 2023-06-23T19:05:05.463 INFO:teuthology.orchestra.run.smithi136.stdout:626 2023-06-23T19:05:05.464 INFO:teuthology.orchestra.run.smithi136.stdout:626.out 2023-06-23T19:05:05.464 INFO:teuthology.orchestra.run.smithi136.stdout:627 2023-06-23T19:05:05.464 INFO:teuthology.orchestra.run.smithi136.stdout:627.out 2023-06-23T19:05:05.464 INFO:teuthology.orchestra.run.smithi136.stdout:628 2023-06-23T19:05:05.464 INFO:teuthology.orchestra.run.smithi136.stdout:628.out 2023-06-23T19:05:05.464 INFO:teuthology.orchestra.run.smithi136.stdout:629 2023-06-23T19:05:05.464 INFO:teuthology.orchestra.run.smithi136.stdout:629.out 2023-06-23T19:05:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:630 2023-06-23T19:05:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:630.out 2023-06-23T19:05:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:631 2023-06-23T19:05:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:631.out 2023-06-23T19:05:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:632 2023-06-23T19:05:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:632.out 2023-06-23T19:05:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:633 2023-06-23T19:05:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:633.out 2023-06-23T19:05:05.466 INFO:teuthology.orchestra.run.smithi136.stdout:634 2023-06-23T19:05:05.466 INFO:teuthology.orchestra.run.smithi136.stdout:634.out 2023-06-23T19:05:05.466 INFO:teuthology.orchestra.run.smithi136.stdout:635 2023-06-23T19:05:05.466 INFO:teuthology.orchestra.run.smithi136.stdout:635.out 2023-06-23T19:05:05.466 INFO:teuthology.orchestra.run.smithi136.stdout:636 2023-06-23T19:05:05.466 INFO:teuthology.orchestra.run.smithi136.stdout:636.out 2023-06-23T19:05:05.466 INFO:teuthology.orchestra.run.smithi136.stdout:637 2023-06-23T19:05:05.466 INFO:teuthology.orchestra.run.smithi136.stdout:637.out 2023-06-23T19:05:05.467 INFO:teuthology.orchestra.run.smithi136.stdout:638 2023-06-23T19:05:05.467 INFO:teuthology.orchestra.run.smithi136.stdout:638.out 2023-06-23T19:05:05.467 INFO:teuthology.orchestra.run.smithi136.stdout:639 2023-06-23T19:05:05.467 INFO:teuthology.orchestra.run.smithi136.stdout:639.out 2023-06-23T19:05:05.467 INFO:teuthology.orchestra.run.smithi136.stdout:640 2023-06-23T19:05:05.467 INFO:teuthology.orchestra.run.smithi136.stdout:640.out 2023-06-23T19:05:05.467 INFO:teuthology.orchestra.run.smithi136.stdout:641 2023-06-23T19:05:05.467 INFO:teuthology.orchestra.run.smithi136.stdout:641.out 2023-06-23T19:05:05.468 INFO:teuthology.orchestra.run.smithi136.stdout:642 2023-06-23T19:05:05.468 INFO:teuthology.orchestra.run.smithi136.stdout:642.out 2023-06-23T19:05:05.468 INFO:teuthology.orchestra.run.smithi136.stdout:643 2023-06-23T19:05:05.468 INFO:teuthology.orchestra.run.smithi136.stdout:643.out 2023-06-23T19:05:05.468 INFO:teuthology.orchestra.run.smithi136.stdout:644 2023-06-23T19:05:05.468 INFO:teuthology.orchestra.run.smithi136.stdout:644.out 2023-06-23T19:05:05.468 INFO:teuthology.orchestra.run.smithi136.stdout:645 2023-06-23T19:05:05.468 INFO:teuthology.orchestra.run.smithi136.stdout:645.out 2023-06-23T19:05:05.469 INFO:teuthology.orchestra.run.smithi136.stdout:646 2023-06-23T19:05:05.469 INFO:teuthology.orchestra.run.smithi136.stdout:646.out 2023-06-23T19:05:05.469 INFO:teuthology.orchestra.run.smithi136.stdout:647 2023-06-23T19:05:05.469 INFO:teuthology.orchestra.run.smithi136.stdout:647.out 2023-06-23T19:05:05.469 INFO:teuthology.orchestra.run.smithi136.stdout:648 2023-06-23T19:05:05.469 INFO:teuthology.orchestra.run.smithi136.stdout:648.out 2023-06-23T19:05:05.469 INFO:teuthology.orchestra.run.smithi136.stdout:649 2023-06-23T19:05:05.469 INFO:teuthology.orchestra.run.smithi136.stdout:649.out 2023-06-23T19:05:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:650 2023-06-23T19:05:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:650.out 2023-06-23T19:05:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:651 2023-06-23T19:05:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:651.out 2023-06-23T19:05:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:652 2023-06-23T19:05:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:652.out 2023-06-23T19:05:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:653 2023-06-23T19:05:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:653.out 2023-06-23T19:05:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:654 2023-06-23T19:05:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:654.out 2023-06-23T19:05:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:655 2023-06-23T19:05:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:655.out 2023-06-23T19:05:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:656 2023-06-23T19:05:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:656.out 2023-06-23T19:05:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:657 2023-06-23T19:05:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:657.out 2023-06-23T19:05:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:658 2023-06-23T19:05:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:658.out 2023-06-23T19:05:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:659 2023-06-23T19:05:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:659.out 2023-06-23T19:05:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:660 2023-06-23T19:05:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:660.out 2023-06-23T19:05:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:661 2023-06-23T19:05:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:661.out 2023-06-23T19:05:05.473 INFO:teuthology.orchestra.run.smithi136.stdout:662 2023-06-23T19:05:05.473 INFO:teuthology.orchestra.run.smithi136.stdout:662.out 2023-06-23T19:05:05.473 INFO:teuthology.orchestra.run.smithi136.stdout:663 2023-06-23T19:05:05.473 INFO:teuthology.orchestra.run.smithi136.stdout:663.out 2023-06-23T19:05:05.473 INFO:teuthology.orchestra.run.smithi136.stdout:664 2023-06-23T19:05:05.473 INFO:teuthology.orchestra.run.smithi136.stdout:664.out 2023-06-23T19:05:05.473 INFO:teuthology.orchestra.run.smithi136.stdout:665 2023-06-23T19:05:05.473 INFO:teuthology.orchestra.run.smithi136.stdout:665.out 2023-06-23T19:05:05.474 INFO:teuthology.orchestra.run.smithi136.stdout:666 2023-06-23T19:05:05.474 INFO:teuthology.orchestra.run.smithi136.stdout:666.out 2023-06-23T19:05:05.474 INFO:teuthology.orchestra.run.smithi136.stdout:667 2023-06-23T19:05:05.474 INFO:teuthology.orchestra.run.smithi136.stdout:667.out 2023-06-23T19:05:05.474 INFO:teuthology.orchestra.run.smithi136.stdout:668 2023-06-23T19:05:05.474 INFO:teuthology.orchestra.run.smithi136.stdout:668.out 2023-06-23T19:05:05.474 INFO:teuthology.orchestra.run.smithi136.stdout:669 2023-06-23T19:05:05.474 INFO:teuthology.orchestra.run.smithi136.stdout:669.out 2023-06-23T19:05:05.475 INFO:teuthology.orchestra.run.smithi136.stdout:670 2023-06-23T19:05:05.475 INFO:teuthology.orchestra.run.smithi136.stdout:670.out 2023-06-23T19:05:05.475 INFO:teuthology.orchestra.run.smithi136.stdout:671 2023-06-23T19:05:05.475 INFO:teuthology.orchestra.run.smithi136.stdout:671.out 2023-06-23T19:05:05.475 INFO:teuthology.orchestra.run.smithi136.stdout:672 2023-06-23T19:05:05.475 INFO:teuthology.orchestra.run.smithi136.stdout:672.out 2023-06-23T19:05:05.475 INFO:teuthology.orchestra.run.smithi136.stdout:673 2023-06-23T19:05:05.475 INFO:teuthology.orchestra.run.smithi136.stdout:673.out 2023-06-23T19:05:05.476 INFO:teuthology.orchestra.run.smithi136.stdout:674 2023-06-23T19:05:05.476 INFO:teuthology.orchestra.run.smithi136.stdout:674.out 2023-06-23T19:05:05.476 INFO:teuthology.orchestra.run.smithi136.stdout:675 2023-06-23T19:05:05.476 INFO:teuthology.orchestra.run.smithi136.stdout:675.out 2023-06-23T19:05:05.476 INFO:teuthology.orchestra.run.smithi136.stdout:676 2023-06-23T19:05:05.476 INFO:teuthology.orchestra.run.smithi136.stdout:676.out 2023-06-23T19:05:05.476 INFO:teuthology.orchestra.run.smithi136.stdout:677 2023-06-23T19:05:05.476 INFO:teuthology.orchestra.run.smithi136.stdout:677.out 2023-06-23T19:05:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:678 2023-06-23T19:05:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:678.out 2023-06-23T19:05:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:679 2023-06-23T19:05:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:679.out 2023-06-23T19:05:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:680 2023-06-23T19:05:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:680.out 2023-06-23T19:05:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:681 2023-06-23T19:05:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:681.out 2023-06-23T19:05:05.478 INFO:teuthology.orchestra.run.smithi136.stdout:682 2023-06-23T19:05:05.478 INFO:teuthology.orchestra.run.smithi136.stdout:682.out 2023-06-23T19:05:05.478 INFO:teuthology.orchestra.run.smithi136.stdout:683 2023-06-23T19:05:05.478 INFO:teuthology.orchestra.run.smithi136.stdout:683.out 2023-06-23T19:05:05.478 INFO:teuthology.orchestra.run.smithi136.stdout:684 2023-06-23T19:05:05.478 INFO:teuthology.orchestra.run.smithi136.stdout:684.out 2023-06-23T19:05:05.478 INFO:teuthology.orchestra.run.smithi136.stdout:685 2023-06-23T19:05:05.478 INFO:teuthology.orchestra.run.smithi136.stdout:685.out 2023-06-23T19:05:05.479 INFO:teuthology.orchestra.run.smithi136.stdout:686 2023-06-23T19:05:05.479 INFO:teuthology.orchestra.run.smithi136.stdout:686.out 2023-06-23T19:05:05.479 INFO:teuthology.orchestra.run.smithi136.stdout:687 2023-06-23T19:05:05.479 INFO:teuthology.orchestra.run.smithi136.stdout:687.out 2023-06-23T19:05:05.479 INFO:teuthology.orchestra.run.smithi136.stdout:688 2023-06-23T19:05:05.479 INFO:teuthology.orchestra.run.smithi136.stdout:688.out 2023-06-23T19:05:05.479 INFO:teuthology.orchestra.run.smithi136.stdout:689 2023-06-23T19:05:05.479 INFO:teuthology.orchestra.run.smithi136.stdout:689.out 2023-06-23T19:05:05.480 INFO:teuthology.orchestra.run.smithi136.stdout:690 2023-06-23T19:05:05.480 INFO:teuthology.orchestra.run.smithi136.stdout:690.out 2023-06-23T19:05:05.480 INFO:teuthology.orchestra.run.smithi136.stdout:691 2023-06-23T19:05:05.480 INFO:teuthology.orchestra.run.smithi136.stdout:691.out 2023-06-23T19:05:05.480 INFO:teuthology.orchestra.run.smithi136.stdout:692 2023-06-23T19:05:05.480 INFO:teuthology.orchestra.run.smithi136.stdout:692.out 2023-06-23T19:05:05.480 INFO:teuthology.orchestra.run.smithi136.stdout:693 2023-06-23T19:05:05.480 INFO:teuthology.orchestra.run.smithi136.stdout:693.out 2023-06-23T19:05:05.481 INFO:teuthology.orchestra.run.smithi136.stdout:694 2023-06-23T19:05:05.481 INFO:teuthology.orchestra.run.smithi136.stdout:694.out 2023-06-23T19:05:05.481 INFO:teuthology.orchestra.run.smithi136.stdout:695 2023-06-23T19:05:05.481 INFO:teuthology.orchestra.run.smithi136.stdout:695.out 2023-06-23T19:05:05.481 INFO:teuthology.orchestra.run.smithi136.stdout:696 2023-06-23T19:05:05.481 INFO:teuthology.orchestra.run.smithi136.stdout:696.out 2023-06-23T19:05:05.481 INFO:teuthology.orchestra.run.smithi136.stdout:697 2023-06-23T19:05:05.481 INFO:teuthology.orchestra.run.smithi136.stdout:697.out 2023-06-23T19:05:05.482 INFO:teuthology.orchestra.run.smithi136.stdout:698 2023-06-23T19:05:05.482 INFO:teuthology.orchestra.run.smithi136.stdout:698.out 2023-06-23T19:05:05.482 INFO:teuthology.orchestra.run.smithi136.stdout:699 2023-06-23T19:05:05.482 INFO:teuthology.orchestra.run.smithi136.stdout:699.out 2023-06-23T19:05:05.482 INFO:teuthology.orchestra.run.smithi136.stdout:700 2023-06-23T19:05:05.482 INFO:teuthology.orchestra.run.smithi136.stdout:700.out 2023-06-23T19:05:05.482 INFO:teuthology.orchestra.run.smithi136.stdout:701 2023-06-23T19:05:05.482 INFO:teuthology.orchestra.run.smithi136.stdout:701.out 2023-06-23T19:05:05.483 INFO:teuthology.orchestra.run.smithi136.stdout:702 2023-06-23T19:05:05.483 INFO:teuthology.orchestra.run.smithi136.stdout:702.out 2023-06-23T19:05:05.483 INFO:teuthology.orchestra.run.smithi136.stdout:703 2023-06-23T19:05:05.483 INFO:teuthology.orchestra.run.smithi136.stdout:703.out 2023-06-23T19:05:05.483 INFO:teuthology.orchestra.run.smithi136.stdout:704 2023-06-23T19:05:05.483 INFO:teuthology.orchestra.run.smithi136.stdout:704.out 2023-06-23T19:05:05.483 INFO:teuthology.orchestra.run.smithi136.stdout:705 2023-06-23T19:05:05.483 INFO:teuthology.orchestra.run.smithi136.stdout:705.out 2023-06-23T19:05:05.484 INFO:teuthology.orchestra.run.smithi136.stdout:706 2023-06-23T19:05:05.484 INFO:teuthology.orchestra.run.smithi136.stdout:706.out 2023-06-23T19:05:05.484 INFO:teuthology.orchestra.run.smithi136.stdout:707 2023-06-23T19:05:05.484 INFO:teuthology.orchestra.run.smithi136.stdout:707.out 2023-06-23T19:05:05.484 INFO:teuthology.orchestra.run.smithi136.stdout:708 2023-06-23T19:05:05.484 INFO:teuthology.orchestra.run.smithi136.stdout:708.out 2023-06-23T19:05:05.484 INFO:teuthology.orchestra.run.smithi136.stdout:709 2023-06-23T19:05:05.484 INFO:teuthology.orchestra.run.smithi136.stdout:709.out 2023-06-23T19:05:05.485 INFO:teuthology.orchestra.run.smithi136.stdout:710 2023-06-23T19:05:05.485 INFO:teuthology.orchestra.run.smithi136.stdout:710.out 2023-06-23T19:05:05.485 INFO:teuthology.orchestra.run.smithi136.stdout:711 2023-06-23T19:05:05.485 INFO:teuthology.orchestra.run.smithi136.stdout:711.out 2023-06-23T19:05:05.485 INFO:teuthology.orchestra.run.smithi136.stdout:712 2023-06-23T19:05:05.485 INFO:teuthology.orchestra.run.smithi136.stdout:712.out 2023-06-23T19:05:05.485 INFO:teuthology.orchestra.run.smithi136.stdout:713 2023-06-23T19:05:05.485 INFO:teuthology.orchestra.run.smithi136.stdout:713.out 2023-06-23T19:05:05.486 INFO:teuthology.orchestra.run.smithi136.stdout:714 2023-06-23T19:05:05.486 INFO:teuthology.orchestra.run.smithi136.stdout:714.out 2023-06-23T19:05:05.486 INFO:teuthology.orchestra.run.smithi136.stdout:715 2023-06-23T19:05:05.486 INFO:teuthology.orchestra.run.smithi136.stdout:715.out 2023-06-23T19:05:05.486 INFO:teuthology.orchestra.run.smithi136.stdout:716 2023-06-23T19:05:05.486 INFO:teuthology.orchestra.run.smithi136.stdout:716.out 2023-06-23T19:05:05.486 INFO:teuthology.orchestra.run.smithi136.stdout:717 2023-06-23T19:05:05.486 INFO:teuthology.orchestra.run.smithi136.stdout:717.out 2023-06-23T19:05:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:718 2023-06-23T19:05:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:718.out 2023-06-23T19:05:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:719 2023-06-23T19:05:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:719.out 2023-06-23T19:05:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:720 2023-06-23T19:05:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:720.out 2023-06-23T19:05:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:721 2023-06-23T19:05:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:721.out 2023-06-23T19:05:05.488 INFO:teuthology.orchestra.run.smithi136.stdout:722 2023-06-23T19:05:05.488 INFO:teuthology.orchestra.run.smithi136.stdout:722.out 2023-06-23T19:05:05.488 INFO:teuthology.orchestra.run.smithi136.stdout:723 2023-06-23T19:05:05.488 INFO:teuthology.orchestra.run.smithi136.stdout:723.out 2023-06-23T19:05:05.488 INFO:teuthology.orchestra.run.smithi136.stdout:724 2023-06-23T19:05:05.488 INFO:teuthology.orchestra.run.smithi136.stdout:724.out 2023-06-23T19:05:05.488 INFO:teuthology.orchestra.run.smithi136.stdout:725 2023-06-23T19:05:05.488 INFO:teuthology.orchestra.run.smithi136.stdout:725.out 2023-06-23T19:05:05.489 INFO:teuthology.orchestra.run.smithi136.stdout:726 2023-06-23T19:05:05.489 INFO:teuthology.orchestra.run.smithi136.stdout:726.out 2023-06-23T19:05:05.489 INFO:teuthology.orchestra.run.smithi136.stdout:727 2023-06-23T19:05:05.489 INFO:teuthology.orchestra.run.smithi136.stdout:727.out 2023-06-23T19:05:05.489 INFO:teuthology.orchestra.run.smithi136.stdout:728 2023-06-23T19:05:05.489 INFO:teuthology.orchestra.run.smithi136.stdout:728.out 2023-06-23T19:05:05.489 INFO:teuthology.orchestra.run.smithi136.stdout:group.list 2023-06-23T19:05:05.489 INFO:teuthology.orchestra.run.smithi136.stdout:Makefile 2023-06-23T19:05:05.490 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-23T19:05:05.969 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:05:05.982 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:05:05.983 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:05:05.985 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:05:05.986 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:13.809 INFO:teuthology.orchestra.run.smithi136.stdout:generic/001 7s 2023-06-23T19:05:13.822 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/001 2023-06-23T19:05:13.823 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:05:13.828 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:13.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:05:13.985 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-23T19:05:14.436 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:05:14.448 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:05:14.450 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:05:14.452 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:05:14.452 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:15.348 INFO:teuthology.orchestra.run.smithi136.stdout:generic/002 1s 2023-06-23T19:05:15.361 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/002 2023-06-23T19:05:15.361 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:05:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:15.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:05:15.447 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-23T19:05:15.894 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:05:15.907 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:05:15.908 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:05:15.911 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:05:15.911 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:16.408 INFO:teuthology.orchestra.run.smithi136.stdout:generic/003 [not run] atime not maintained by ceph 2023-06-23T19:05:16.418 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/003 2023-06-23T19:05:16.418 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/003 2023-06-23T19:05:16.418 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:05:16.424 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:16.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:05:16.465 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-23T19:05:16.909 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:05:16.922 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:05:16.923 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:05:16.925 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:05:16.926 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:17.430 INFO:teuthology.orchestra.run.smithi136.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-23T19:05:17.440 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/004 2023-06-23T19:05:17.441 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/004 2023-06-23T19:05:17.441 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:05:17.447 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:17.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:05:17.482 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-23T19:05:17.935 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:05:17.948 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:05:17.949 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:05:17.952 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:05:17.952 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:18.784 INFO:teuthology.orchestra.run.smithi136.stdout:generic/005 0s 2023-06-23T19:05:18.796 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/005 2023-06-23T19:05:18.797 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:05:18.803 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:18.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:05:18.909 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-23T19:05:19.361 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:05:19.374 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:05:19.375 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:05:19.377 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:05:19.378 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:27.238 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:05:27.243 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:05:42.659 INFO:teuthology.orchestra.run.smithi136.stdout:generic/006 23s 2023-06-23T19:05:42.672 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/006 2023-06-23T19:05:42.673 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:05:42.678 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:42.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:05:42.742 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-23T19:05:43.305 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:05:43.320 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:05:43.321 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:05:43.322 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:05:43.322 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:05:57.442 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:05:57.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:28.283 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:28.288 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:32.253 INFO:teuthology.orchestra.run.smithi136.stdout:generic/007 49s 2023-06-23T19:06:32.663 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/007 2023-06-23T19:06:32.663 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:06:32.669 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:06:32.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:06:32.743 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-23T19:06:33.296 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:06:33.309 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:06:33.309 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:06:33.314 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:06:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:06:33.909 INFO:teuthology.orchestra.run.smithi136.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-23T19:06:33.919 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/008 2023-06-23T19:06:33.919 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/008 2023-06-23T19:06:33.919 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:06:33.925 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:06:33.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:06:33.973 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-23T19:06:34.429 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:06:34.442 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:06:34.443 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:06:34.445 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:06:34.446 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:06:35.053 INFO:teuthology.orchestra.run.smithi136.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-23T19:06:35.063 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/009 2023-06-23T19:06:35.063 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/009 2023-06-23T19:06:35.063 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:06:35.069 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:06:35.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:06:35.110 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-23T19:06:35.565 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:06:35.577 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:06:35.578 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:06:35.581 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:06:35.581 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:06:36.061 INFO:teuthology.orchestra.run.smithi136.stdout:generic/010 [not run] /tmp/tmp.AfPoID7zOVxfstests-dev/src/dbtest not built 2023-06-23T19:06:36.071 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/010 2023-06-23T19:06:36.072 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/010 2023-06-23T19:06:36.072 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:06:36.077 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:06:36.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:06:36.115 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-23T19:06:36.570 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:06:36.583 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:06:36.584 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:06:36.587 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:06:36.587 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:06:58.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:58.434 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:07.112 INFO:teuthology.orchestra.run.smithi136.stdout:generic/011 31s 2023-06-23T19:07:07.125 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/011 2023-06-23T19:07:07.125 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:07:07.130 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:07:07.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:07:07.394 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-23T19:07:07.851 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:07:07.860 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:07:07.862 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:07:07.864 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:07:07.865 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:07:08.552 INFO:teuthology.orchestra.run.smithi136.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:07:08.562 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/012 2023-06-23T19:07:08.563 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/012 2023-06-23T19:07:08.563 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:07:08.568 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:07:08.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:07:08.651 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-23T19:07:09.116 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:07:09.128 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:07:09.129 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:07:09.133 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:07:09.133 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:07:28.579 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:28.585 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:59.719 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:59.727 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:08:15.323 INFO:teuthology.orchestra.run.smithi136.stdout:generic/013 66s 2023-06-23T19:08:15.341 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/013 2023-06-23T19:08:15.341 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:08:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:08:15.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:08:15.424 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-23T19:08:16.112 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:08:16.129 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:08:16.131 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:08:16.135 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:08:16.136 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:08:29.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:08:29.882 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:00.784 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:00.789 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:30.985 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:30.992 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:01.173 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:01.178 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:32.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:32.313 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:03.860 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:03.870 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:34.048 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:34.063 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:04.238 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:04.256 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:34.461 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:34.470 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:54.887 INFO:teuthology.orchestra.run.smithi136.stdout:generic/014 278s 2023-06-23T19:12:54.908 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/014 2023-06-23T19:12:54.909 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:12:54.921 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:12:55.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:12:55.014 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-23T19:12:55.707 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:12:55.734 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:12:55.736 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:12:55.739 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:12:55.739 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:12:56.536 INFO:teuthology.orchestra.run.smithi136.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T19:12:56.551 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/015 2023-06-23T19:12:56.551 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/015 2023-06-23T19:12:56.551 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:12:56.558 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:12:56.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:12:56.623 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-23T19:12:57.372 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:12:57.397 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:12:57.398 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:12:57.401 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:12:57.401 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:12:58.532 INFO:teuthology.orchestra.run.smithi136.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:12:58.548 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/016 2023-06-23T19:12:58.548 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/016 2023-06-23T19:12:58.548 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:12:58.557 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:12:58.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:12:58.817 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-23T19:12:59.607 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:12:59.625 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:12:59.627 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:12:59.630 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:12:59.630 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:00.422 INFO:teuthology.orchestra.run.smithi136.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-23T19:13:00.437 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/017 2023-06-23T19:13:00.437 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/017 2023-06-23T19:13:00.437 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:13:00.445 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:00.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:13:00.510 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-23T19:13:01.187 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:13:01.204 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:13:01.206 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:13:01.210 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:13:01.210 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:02.183 INFO:teuthology.orchestra.run.smithi136.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-23T19:13:02.218 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/018 2023-06-23T19:13:02.219 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/018 2023-06-23T19:13:02.219 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:13:02.232 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:02.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:13:02.280 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-23T19:13:02.944 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:13:02.961 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:13:02.962 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:13:02.968 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:13:02.968 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:03.699 INFO:teuthology.orchestra.run.smithi136.stdout:generic/019 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:13:03.713 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/019 2023-06-23T19:13:03.713 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/019 2023-06-23T19:13:03.713 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:13:03.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:03.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:13:03.772 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-23T19:13:04.467 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:13:04.485 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:13:04.486 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:13:04.490 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:13:04.490 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:04.637 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:04.646 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:12.963 INFO:teuthology.orchestra.run.smithi136.stdout:generic/020 8s 2023-06-23T19:13:12.985 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/020 2023-06-23T19:13:12.985 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:13:13.000 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:13.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:13:13.421 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-23T19:13:14.155 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:13:14.179 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:13:14.181 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:13:14.184 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:13:14.184 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:15.201 INFO:teuthology.orchestra.run.smithi136.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:13:15.217 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/021 2023-06-23T19:13:15.217 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/021 2023-06-23T19:13:15.218 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:13:15.227 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:15.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:13:15.555 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-23T19:13:16.263 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:13:16.286 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:13:16.288 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:13:16.292 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:13:16.292 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:17.296 INFO:teuthology.orchestra.run.smithi136.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:13:17.311 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/022 2023-06-23T19:13:17.311 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/022 2023-06-23T19:13:17.311 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:13:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:17.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:13:17.628 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-23T19:13:18.349 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:13:18.373 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:13:18.375 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:13:18.379 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:13:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:13:34.786 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:34.793 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:59.832 INFO:teuthology.orchestra.run.smithi136.stdout:generic/023 41s 2023-06-23T19:13:59.846 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/023 2023-06-23T19:13:59.846 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:13:59.852 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:00.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:00.118 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-23T19:14:00.638 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:00.651 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:00.652 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:00.654 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:00.655 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:01.166 INFO:teuthology.orchestra.run.smithi136.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-23T19:14:01.176 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/024 2023-06-23T19:14:01.176 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/024 2023-06-23T19:14:01.177 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:01.182 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:01.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:01.504 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-23T19:14:01.975 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:01.987 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:01.988 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:01.991 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:01.991 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:02.512 INFO:teuthology.orchestra.run.smithi136.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-23T19:14:02.522 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/025 2023-06-23T19:14:02.522 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/025 2023-06-23T19:14:02.522 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:02.528 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:02.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:02.856 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-23T19:14:03.320 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:03.348 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:03.349 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:03.349 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:03.349 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:03.970 INFO:teuthology.orchestra.run.smithi136.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-23T19:14:03.980 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/026 2023-06-23T19:14:03.980 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/026 2023-06-23T19:14:03.980 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:04.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:04.031 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-23T19:14:04.481 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:04.494 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:04.495 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:04.497 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:04.498 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:04.984 INFO:teuthology.orchestra.run.smithi136.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T19:14:04.993 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/027 2023-06-23T19:14:04.994 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/027 2023-06-23T19:14:04.994 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:05.000 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:05.015 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:05.019 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:05.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:05.037 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-23T19:14:05.524 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:05.536 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:05.537 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:05.540 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:11.060 INFO:teuthology.orchestra.run.smithi136.stdout:generic/028 6s 2023-06-23T19:14:11.073 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/028 2023-06-23T19:14:11.073 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:11.079 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:11.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:11.120 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-23T19:14:11.571 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:11.584 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:11.585 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:11.587 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:11.587 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:13.020 INFO:teuthology.orchestra.run.smithi136.stdout:generic/029 2s 2023-06-23T19:14:13.033 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/029 2023-06-23T19:14:13.033 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:13.038 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:13.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:13.059 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-23T19:14:13.512 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:13.525 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:13.526 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:13.528 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:13.529 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:15.001 INFO:teuthology.orchestra.run.smithi136.stdout:generic/030 1s 2023-06-23T19:14:15.014 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/030 2023-06-23T19:14:15.014 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:15.020 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:15.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:15.041 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-23T19:14:15.493 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:15.506 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:15.507 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:15.509 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:15.510 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:16.156 INFO:teuthology.orchestra.run.smithi136.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-23T19:14:16.166 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/031 2023-06-23T19:14:16.167 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/031 2023-06-23T19:14:16.167 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:16.172 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:16.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:16.217 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-23T19:14:16.677 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:16.689 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:16.690 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:16.693 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:16.693 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:17.205 INFO:teuthology.orchestra.run.smithi136.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:14:17.215 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/032 2023-06-23T19:14:17.215 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/032 2023-06-23T19:14:17.216 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:17.221 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:17.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:17.272 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-23T19:14:17.718 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:17.730 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:17.731 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:17.734 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:17.734 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:18.374 INFO:teuthology.orchestra.run.smithi136.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-23T19:14:18.384 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/033 2023-06-23T19:14:18.385 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/033 2023-06-23T19:14:18.385 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:18.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:18.432 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-23T19:14:18.896 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:18.909 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:18.910 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:18.912 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:19.443 INFO:teuthology.orchestra.run.smithi136.stdout:generic/034 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:14:19.453 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/034 2023-06-23T19:14:19.453 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/034 2023-06-23T19:14:19.453 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:19.459 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:19.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:19.497 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-23T19:14:19.953 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:19.966 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:19.966 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:19.969 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:19.969 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:20.551 INFO:teuthology.orchestra.run.smithi136.stdout:generic/035 0s 2023-06-23T19:14:20.563 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/035 2023-06-23T19:14:20.564 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:20.570 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:20.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:20.830 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-23T19:14:21.348 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:21.361 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:21.362 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:21.364 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:21.365 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:31.996 INFO:teuthology.orchestra.run.smithi136.stdout:generic/036 10s 2023-06-23T19:14:32.009 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/036 2023-06-23T19:14:32.009 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:32.015 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:32.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:32.285 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-23T19:14:32.813 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:32.825 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:32.826 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:32.829 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:32.829 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:35.160 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:35.165 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:40.003 INFO:teuthology.orchestra.run.smithi136.stdout:generic/037 6s 2023-06-23T19:14:40.016 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/037 2023-06-23T19:14:40.016 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:40.022 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:40.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:40.043 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-23T19:14:40.491 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:40.504 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:40.505 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:40.507 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:40.508 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:41.021 INFO:teuthology.orchestra.run.smithi136.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:14:41.031 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/038 2023-06-23T19:14:41.031 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/038 2023-06-23T19:14:41.032 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:41.037 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:41.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:41.076 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-23T19:14:41.531 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:41.544 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:41.545 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:41.547 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:41.547 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:42.098 INFO:teuthology.orchestra.run.smithi136.stdout:generic/039 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:14:42.108 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/039 2023-06-23T19:14:42.108 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/039 2023-06-23T19:14:42.108 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:42.114 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:42.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:42.157 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-23T19:14:42.609 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:42.622 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:42.623 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:42.626 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:42.626 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:43.173 INFO:teuthology.orchestra.run.smithi136.stdout:generic/040 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:14:43.183 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/040 2023-06-23T19:14:43.183 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/040 2023-06-23T19:14:43.183 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:43.189 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:43.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:43.231 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-23T19:14:43.681 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:43.694 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:43.695 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:43.697 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:43.698 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:44.244 INFO:teuthology.orchestra.run.smithi136.stdout:generic/041 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:14:44.253 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/041 2023-06-23T19:14:44.254 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/041 2023-06-23T19:14:44.254 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:44.259 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:44.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:44.301 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-23T19:14:44.754 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:44.767 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:44.768 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:44.770 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:44.771 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:45.419 INFO:teuthology.orchestra.run.smithi136.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-23T19:14:45.440 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/042 2023-06-23T19:14:45.441 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/042 2023-06-23T19:14:45.441 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:45.446 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:45.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:45.485 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-23T19:14:45.934 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:45.947 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:45.947 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:45.950 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:45.950 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:46.600 INFO:teuthology.orchestra.run.smithi136.stdout:generic/043 [not run] ceph does not support shutdown 2023-06-23T19:14:46.628 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/043 2023-06-23T19:14:46.629 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/043 2023-06-23T19:14:46.629 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:46.634 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:46.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:46.677 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-23T19:14:47.128 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:47.140 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:47.141 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:47.144 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:47.794 INFO:teuthology.orchestra.run.smithi136.stdout:generic/044 [not run] ceph does not support shutdown 2023-06-23T19:14:47.826 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/044 2023-06-23T19:14:47.826 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/044 2023-06-23T19:14:47.826 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:47.832 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:47.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:47.873 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-23T19:14:48.325 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:48.337 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:48.338 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:48.341 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:48.989 INFO:teuthology.orchestra.run.smithi136.stdout:generic/045 [not run] ceph does not support shutdown 2023-06-23T19:14:49.013 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/045 2023-06-23T19:14:49.013 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/045 2023-06-23T19:14:49.013 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:49.017 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:49.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:49.059 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-23T19:14:49.513 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:49.525 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:49.526 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:49.529 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:49.529 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:50.174 INFO:teuthology.orchestra.run.smithi136.stdout:generic/046 [not run] ceph does not support shutdown 2023-06-23T19:14:50.198 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/046 2023-06-23T19:14:50.199 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/046 2023-06-23T19:14:50.199 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:50.204 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:50.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:50.248 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-23T19:14:50.692 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:50.705 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:50.706 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:50.708 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:50.708 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:51.359 INFO:teuthology.orchestra.run.smithi136.stdout:generic/047 [not run] ceph does not support shutdown 2023-06-23T19:14:51.383 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/047 2023-06-23T19:14:51.383 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/047 2023-06-23T19:14:51.384 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:51.389 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:51.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:51.424 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-23T19:14:51.873 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:51.886 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:51.887 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:51.889 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:51.889 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:generic/048 [not run] ceph does not support shutdown 2023-06-23T19:14:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/048 2023-06-23T19:14:52.553 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/048 2023-06-23T19:14:52.554 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:52.559 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:52.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:52.603 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-23T19:14:53.049 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:53.062 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:53.063 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:53.066 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:53.066 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:53.714 INFO:teuthology.orchestra.run.smithi136.stdout:generic/049 [not run] ceph does not support shutdown 2023-06-23T19:14:53.737 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/049 2023-06-23T19:14:53.737 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/049 2023-06-23T19:14:53.738 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:53.743 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:53.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:53.784 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-23T19:14:54.237 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:54.250 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:54.251 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:54.254 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:54.254 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:54.918 INFO:teuthology.orchestra.run.smithi136.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-23T19:14:54.943 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/050 2023-06-23T19:14:54.944 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/050 2023-06-23T19:14:54.944 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:54.949 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:54.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:54.987 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-23T19:14:55.432 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:55.445 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:55.446 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:55.448 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:55.448 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:56.133 INFO:teuthology.orchestra.run.smithi136.stdout:generic/051 [not run] ceph does not support shutdown 2023-06-23T19:14:56.143 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/051 2023-06-23T19:14:56.143 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/051 2023-06-23T19:14:56.144 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:56.149 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:56.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:56.183 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-23T19:14:56.631 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:56.644 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:56.645 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:56.647 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:56.648 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:57.317 INFO:teuthology.orchestra.run.smithi136.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-23T19:14:57.346 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/052 2023-06-23T19:14:57.346 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/052 2023-06-23T19:14:57.346 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:57.352 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:57.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:57.390 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-23T19:14:57.843 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:57.856 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:57.857 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:57.859 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:57.860 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:59.143 INFO:teuthology.orchestra.run.smithi136.stdout:generic/053 1s 2023-06-23T19:14:59.164 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/053 2023-06-23T19:14:59.165 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:14:59.170 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:14:59.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:14:59.191 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-23T19:14:59.643 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:14:59.656 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:14:59.660 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:14:59.660 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:14:59.661 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:00.348 INFO:teuthology.orchestra.run.smithi136.stdout:generic/054 [not run] ceph does not support shutdown 2023-06-23T19:15:00.373 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/054 2023-06-23T19:15:00.374 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/054 2023-06-23T19:15:00.374 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:00.379 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:00.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:00.417 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-23T19:15:00.868 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:00.880 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:00.881 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:00.884 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:00.885 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:01.556 INFO:teuthology.orchestra.run.smithi136.stdout:generic/055 [not run] ceph does not support shutdown 2023-06-23T19:15:01.585 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/055 2023-06-23T19:15:01.585 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/055 2023-06-23T19:15:01.586 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:01.591 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:01.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:01.630 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-23T19:15:02.080 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:02.093 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:02.094 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:02.096 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:02.097 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:02.638 INFO:teuthology.orchestra.run.smithi136.stdout:generic/056 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:15:02.648 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/056 2023-06-23T19:15:02.648 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/056 2023-06-23T19:15:02.649 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:02.654 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:02.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:02.695 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-23T19:15:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:03.164 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:03.711 INFO:teuthology.orchestra.run.smithi136.stdout:generic/057 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:15:03.721 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/057 2023-06-23T19:15:03.722 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/057 2023-06-23T19:15:03.722 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:03.727 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:03.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:03.780 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-23T19:15:04.233 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:04.246 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:04.247 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:04.250 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:04.250 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:04.915 INFO:teuthology.orchestra.run.smithi136.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:15:04.925 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/058 2023-06-23T19:15:04.925 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/058 2023-06-23T19:15:04.925 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:04.931 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:05.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:05.273 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-23T19:15:05.336 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:05.341 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:05.733 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:05.746 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:05.747 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:05.749 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:05.750 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:06.280 INFO:teuthology.orchestra.run.smithi136.stdout:generic/059 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:15:06.290 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/059 2023-06-23T19:15:06.290 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/059 2023-06-23T19:15:06.290 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:06.296 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:06.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:06.333 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-23T19:15:06.785 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:06.797 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:06.798 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:06.801 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:06.801 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:07.450 INFO:teuthology.orchestra.run.smithi136.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:15:07.460 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/060 2023-06-23T19:15:07.460 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/060 2023-06-23T19:15:07.460 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:07.466 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:07.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:07.597 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-23T19:15:08.247 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:08.259 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:08.260 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:08.263 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:08.263 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:08.927 INFO:teuthology.orchestra.run.smithi136.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:15:08.937 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/061 2023-06-23T19:15:08.937 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/061 2023-06-23T19:15:08.937 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:08.943 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:09.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:09.269 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-23T19:15:09.740 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:09.752 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:09.753 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:09.756 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:09.756 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:12.681 INFO:teuthology.orchestra.run.smithi136.stdout:generic/062 3s 2023-06-23T19:15:12.694 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/062 2023-06-23T19:15:12.694 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:12.700 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:12.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:12.722 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-23T19:15:13.170 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:13.183 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:13.184 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:13.186 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:13.187 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:13.891 INFO:teuthology.orchestra.run.smithi136.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:15:13.901 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/063 2023-06-23T19:15:13.902 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/063 2023-06-23T19:15:13.902 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:13.907 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:14.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:14.255 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-23T19:15:14.715 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:14.727 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:14.728 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:14.731 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:15.254 INFO:teuthology.orchestra.run.smithi136.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-23T19:15:15.264 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/064 2023-06-23T19:15:15.264 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/064 2023-06-23T19:15:15.264 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:15.270 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:15.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:15.312 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-23T19:15:15.758 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:15.771 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:15.772 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:15.774 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:15.774 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:16.316 INFO:teuthology.orchestra.run.smithi136.stdout:generic/065 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:15:16.326 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/065 2023-06-23T19:15:16.326 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/065 2023-06-23T19:15:16.327 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:16.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:16.373 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-23T19:15:16.828 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:16.840 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:16.841 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:16.844 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:16.844 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:17.380 INFO:teuthology.orchestra.run.smithi136.stdout:generic/066 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:15:17.391 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/066 2023-06-23T19:15:17.391 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/066 2023-06-23T19:15:17.391 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:17.397 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:17.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:17.435 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-23T19:15:17.883 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:17.896 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:17.897 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:17.899 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:17.899 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:18.470 INFO:teuthology.orchestra.run.smithi136.stdout:generic/067 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:15:18.480 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/067 2023-06-23T19:15:18.481 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/067 2023-06-23T19:15:18.481 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:18.486 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:18.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:18.533 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-23T19:15:18.981 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:18.993 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:18.994 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:18.996 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:18.997 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:19.538 INFO:teuthology.orchestra.run.smithi136.stdout:generic/068 [not run] ceph does not support freezing 2023-06-23T19:15:19.548 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/068 2023-06-23T19:15:19.548 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/068 2023-06-23T19:15:19.548 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:19.554 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:19.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:19.598 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-23T19:15:20.054 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:20.067 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:20.068 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:20.070 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:20.071 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:35.458 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:35.463 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:39.774 INFO:teuthology.orchestra.run.smithi136.stdout:generic/069 19s 2023-06-23T19:15:39.792 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/069 2023-06-23T19:15:39.792 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:15:39.798 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:15:39.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:15:39.819 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-23T19:15:40.269 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:15:40.281 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:15:40.283 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:15:40.285 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:15:40.285 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:04.322 INFO:teuthology.orchestra.run.smithi136.stdout:generic/070 24s 2023-06-23T19:16:04.342 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/070 2023-06-23T19:16:04.343 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:16:04.353 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:04.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:16:04.783 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-23T19:16:05.485 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:16:05.505 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:16:05.506 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:16:05.509 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:16:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:05.571 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:16:05.579 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:16:05.836 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T19:16:05.833+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 137520) UID: 0 2023-06-23T19:16:05.837 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T19:16:05.834+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 137520) UID: 0 2023-06-23T19:16:06.295 INFO:teuthology.orchestra.run.smithi136.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-23T19:16:06.310 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/071 2023-06-23T19:16:06.311 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/071 2023-06-23T19:16:06.311 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:16:06.321 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:06.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:16:06.386 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-23T19:16:07.119 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:16:07.133 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:16:07.135 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:16:07.139 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:16:07.139 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:08.109 INFO:teuthology.orchestra.run.smithi136.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-23T19:16:08.122 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/072 2023-06-23T19:16:08.123 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/072 2023-06-23T19:16:08.123 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:16:08.130 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:08.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:16:08.207 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-23T19:16:08.897 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:16:08.915 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:16:08.917 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:16:08.920 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:16:08.921 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:09.717 INFO:teuthology.orchestra.run.smithi136.stdout:generic/073 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:16:09.733 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/073 2023-06-23T19:16:09.733 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/073 2023-06-23T19:16:09.733 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:16:09.742 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:09.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:16:09.801 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-23T19:16:10.481 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:16:10.497 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:16:10.499 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:16:10.501 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:16:10.502 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:55.776 INFO:teuthology.orchestra.run.smithi136.stdout:generic/074 45s 2023-06-23T19:16:55.798 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/074 2023-06-23T19:16:55.799 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:16:55.808 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:16:56.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:16:56.972 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-23T19:16:57.787 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:16:57.809 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:16:57.810 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:16:57.813 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:16:57.813 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:35.220 INFO:teuthology.orchestra.run.smithi136.stdout:generic/075 37s 2023-06-23T19:17:35.241 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/075 2023-06-23T19:17:35.242 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:35.251 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:35.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:35.585 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-23T19:17:36.327 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:17:36.346 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:17:36.349 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:17:36.353 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:17:36.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:37.124 INFO:teuthology.orchestra.run.smithi136.stdout:generic/076 [not run] require 172.21.15.136:6789:/scratch to be local device 2023-06-23T19:17:37.142 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/076 2023-06-23T19:17:37.142 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/076 2023-06-23T19:17:37.143 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:37.153 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:37.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:37.208 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-23T19:17:37.893 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:17:37.910 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:17:37.912 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:17:37.916 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:17:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:39.638 INFO:teuthology.orchestra.run.smithi136.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T19:17:39.653 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/077 2023-06-23T19:17:39.654 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/077 2023-06-23T19:17:39.654 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:39.666 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:40.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:40.082 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-23T19:17:40.812 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:17:40.836 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:17:40.838 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:17:40.841 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:17:40.841 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:41.647 INFO:teuthology.orchestra.run.smithi136.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-23T19:17:41.666 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/078 2023-06-23T19:17:41.666 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/078 2023-06-23T19:17:41.666 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:41.674 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:42.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:42.044 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-23T19:17:42.662 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:17:42.678 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:17:42.681 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:17:42.684 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:17:42.685 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:43.509 INFO:teuthology.orchestra.run.smithi136.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-23T19:17:43.519 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/079 2023-06-23T19:17:43.520 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/079 2023-06-23T19:17:43.520 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:43.529 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:43.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:43.609 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-23T19:17:44.318 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:17:44.336 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:17:44.340 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:17:44.341 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:17:44.342 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:47.234 INFO:teuthology.orchestra.run.smithi136.stdout:generic/080 3s 2023-06-23T19:17:47.249 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/080 2023-06-23T19:17:47.250 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:47.258 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:47.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:47.334 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-23T19:17:48.063 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:17:48.079 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:17:48.080 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:17:48.084 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:17:48.084 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:48.914 INFO:teuthology.orchestra.run.smithi136.stdout:generic/081 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:17:48.929 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/081 2023-06-23T19:17:48.929 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/081 2023-06-23T19:17:48.929 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:48.938 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:48.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:48.990 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-23T19:17:49.687 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:17:49.707 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:17:49.709 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:17:49.713 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:17:49.713 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:50.503 INFO:teuthology.orchestra.run.smithi136.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T19:17:50.521 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/082 2023-06-23T19:17:50.521 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/082 2023-06-23T19:17:50.521 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:50.529 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:50.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:50.584 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-23T19:17:51.255 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:17:51.271 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:17:51.272 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:17:51.277 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:17:51.277 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:52.045 INFO:teuthology.orchestra.run.smithi136.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T19:17:52.059 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/083 2023-06-23T19:17:52.059 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/083 2023-06-23T19:17:52.059 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:52.066 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:52.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:52.134 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-23T19:17:52.820 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:17:52.838 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:17:52.840 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:17:52.844 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:17:52.844 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:59.352 INFO:teuthology.orchestra.run.smithi136.stdout:generic/084 6s 2023-06-23T19:17:59.375 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/084 2023-06-23T19:17:59.375 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:17:59.384 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:17:59.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:17:59.416 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-23T19:18:00.128 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:18:00.149 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:18:00.151 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:18:00.157 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:18:00.157 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:18:00.982 INFO:teuthology.orchestra.run.smithi136.stdout:generic/085 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:18:01.001 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/085 2023-06-23T19:18:01.001 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/085 2023-06-23T19:18:01.001 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:18:01.008 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:18:01.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:18:01.072 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-23T19:18:01.813 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:18:01.831 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:18:01.832 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:18:01.836 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:18:01.836 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:18:02.835 INFO:teuthology.orchestra.run.smithi136.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:18:02.858 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/086 2023-06-23T19:18:02.859 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/086 2023-06-23T19:18:02.859 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:18:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:18:02.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:18:02.909 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-23T19:18:03.358 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:18:03.371 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:18:03.372 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:18:03.374 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:18:03.374 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:18:04.018 INFO:teuthology.orchestra.run.smithi136.stdout:generic/087 1s 2023-06-23T19:18:04.030 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/087 2023-06-23T19:18:04.031 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:18:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:18:04.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:18:04.293 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-23T19:18:04.878 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:18:04.890 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:18:04.891 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:18:04.894 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:18:04.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:18:05.448 INFO:teuthology.orchestra.run.smithi136.stdout:generic/088 0s 2023-06-23T19:18:05.775 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/088 2023-06-23T19:18:05.775 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:18:05.781 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:18:06.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:18:06.171 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-23T19:18:06.637 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:18:06.649 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:18:06.650 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:18:06.652 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:18:06.653 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:19:07.868 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:19:07.873 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:19:43.667 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:19:43.678 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:13.920 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:13.925 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:44.053 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:44.060 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:14.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:14.213 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:44.405 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:44.410 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:44.515 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T19:21:44.512+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 137918) UID: 0 2023-06-23T19:21:44.515 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T19:21:44.512+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 137918) UID: 0 2023-06-23T19:24:44.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:24:44.016 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:14.381 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:14.386 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:44.518 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:44.524 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:44.917 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T19:25:44.913+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 138023) UID: 0 2023-06-23T19:25:44.918 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T19:25:44.914+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 138023) UID: 0 2023-06-23T19:27:54.180 INFO:teuthology.orchestra.run.smithi136.stdout:generic/089 588s 2023-06-23T19:27:54.192 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/089 2023-06-23T19:27:54.193 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:27:54.198 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:27:54.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:27:54.716 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-06-23T19:27:55.441 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:27:55.453 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:27:55.455 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:27:55.457 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:27:55.457 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:27:56.008 INFO:teuthology.orchestra.run.smithi136.stdout:generic/090 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:27:56.018 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/090 2023-06-23T19:27:56.018 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/090 2023-06-23T19:27:56.018 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:27:56.024 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:27:56.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:27:56.070 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-06-23T19:27:56.523 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:27:56.536 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:27:56.537 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:27:56.539 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:27:56.539 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:28:39.511 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:28:39.517 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:09.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:09.692 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:39.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:39.800 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:46.338 INFO:teuthology.orchestra.run.smithi136.stdout:generic/091 110s 2023-06-23T19:29:46.351 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/091 2023-06-23T19:29:46.351 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:29:46.357 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:29:46.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:29:46.677 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-06-23T19:29:47.219 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:29:47.232 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:29:47.233 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:29:47.236 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:29:47.236 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:29:47.760 INFO:teuthology.orchestra.run.smithi136.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:29:47.770 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/092 2023-06-23T19:29:47.771 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/092 2023-06-23T19:29:47.771 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:29:47.776 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:29:47.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:29:47.816 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-06-23T19:29:48.264 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:29:48.276 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:29:48.277 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:29:48.280 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:29:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:29:49.154 INFO:teuthology.orchestra.run.smithi136.stdout:generic/093 1s 2023-06-23T19:29:49.166 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/093 2023-06-23T19:29:49.167 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:29:49.172 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:29:49.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:29:49.563 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-06-23T19:29:50.036 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:29:50.048 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:29:50.049 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:29:50.052 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:29:50.052 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:29:50.628 INFO:teuthology.orchestra.run.smithi136.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-23T19:29:50.637 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/094 2023-06-23T19:29:50.638 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/094 2023-06-23T19:29:50.640 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:29:50.643 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:29:50.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:29:50.956 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-06-23T19:29:51.487 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:29:51.499 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:29:51.501 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:29:51.503 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:29:51.503 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:07.932 INFO:teuthology.orchestra.run.smithi136.stdout:generic/095 16s 2023-06-23T19:30:07.945 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/095 2023-06-23T19:30:07.945 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:07.951 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:07.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:07.972 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-06-23T19:30:08.424 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:08.437 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:08.438 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:08.441 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:08.441 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:09.088 INFO:teuthology.orchestra.run.smithi136.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-23T19:30:09.098 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/096 2023-06-23T19:30:09.098 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/096 2023-06-23T19:30:09.098 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:09.104 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:09.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:09.151 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-06-23T19:30:09.601 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:09.614 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:09.615 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:09.618 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:09.618 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:10.152 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:10.156 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:10.712 INFO:teuthology.orchestra.run.smithi136.stdout:generic/097 1s 2023-06-23T19:30:10.724 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/097 2023-06-23T19:30:10.725 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:10.730 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:10.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:10.772 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-06-23T19:30:11.232 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:11.244 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:11.246 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:11.248 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:11.248 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:13.044 INFO:teuthology.orchestra.run.smithi136.stdout:generic/098 2s 2023-06-23T19:30:13.057 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/098 2023-06-23T19:30:13.057 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:13.063 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:13.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:13.084 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-06-23T19:30:13.541 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:13.553 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:13.555 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:13.557 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:13.557 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:14.966 INFO:teuthology.orchestra.run.smithi136.stdout:generic/099 1s 2023-06-23T19:30:14.979 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/099 2023-06-23T19:30:14.979 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:14.985 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:15.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:15.405 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-06-23T19:30:15.858 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:15.871 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:15.872 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:15.875 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:38.933 INFO:teuthology.orchestra.run.smithi136.stdout:generic/100 22s 2023-06-23T19:30:38.946 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/100 2023-06-23T19:30:38.946 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:38.951 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:40.474 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:40.487 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:41.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:41.827 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-06-23T19:30:42.280 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:42.292 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:42.293 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:42.296 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:42.296 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:42.827 INFO:teuthology.orchestra.run.smithi136.stdout:generic/101 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:30:42.837 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/101 2023-06-23T19:30:42.837 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/101 2023-06-23T19:30:42.837 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:42.843 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:42.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:42.881 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-06-23T19:30:43.331 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:43.344 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:43.345 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:43.347 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:43.348 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:43.864 INFO:teuthology.orchestra.run.smithi136.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T19:30:43.874 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/102 2023-06-23T19:30:43.874 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/102 2023-06-23T19:30:43.874 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:43.879 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:43.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:43.919 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-06-23T19:30:44.370 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:44.382 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:44.384 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:44.386 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:44.386 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:44.924 INFO:teuthology.orchestra.run.smithi136.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:30:44.933 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/103 2023-06-23T19:30:44.933 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/103 2023-06-23T19:30:44.934 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:44.939 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:45.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:45.227 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-06-23T19:30:45.787 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:45.800 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:45.801 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:45.804 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:45.804 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:46.351 INFO:teuthology.orchestra.run.smithi136.stdout:generic/104 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:30:46.361 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/104 2023-06-23T19:30:46.361 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/104 2023-06-23T19:30:46.361 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:46.367 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:46.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:46.411 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-06-23T19:30:46.861 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:46.873 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:46.874 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:46.877 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:46.877 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:48.019 INFO:teuthology.orchestra.run.smithi136.stdout:generic/105 0s 2023-06-23T19:30:48.066 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/105 2023-06-23T19:30:48.066 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:48.074 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:48.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:48.098 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-06-23T19:30:48.548 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:48.561 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:48.562 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:48.564 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:48.565 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:49.129 INFO:teuthology.orchestra.run.smithi136.stdout:generic/106 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:30:49.139 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/106 2023-06-23T19:30:49.139 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/106 2023-06-23T19:30:49.139 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:49.145 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:49.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:49.183 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-06-23T19:30:49.634 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:49.647 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:49.648 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:49.651 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:49.651 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:50.206 INFO:teuthology.orchestra.run.smithi136.stdout:generic/107 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:30:50.216 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/107 2023-06-23T19:30:50.216 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/107 2023-06-23T19:30:50.217 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:50.222 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:50.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:50.271 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-06-23T19:30:50.733 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:50.746 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:50.747 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:50.749 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:50.750 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:51.413 INFO:teuthology.orchestra.run.smithi136.stdout:generic/108 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T19:30:51.423 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/108 2023-06-23T19:30:51.423 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/108 2023-06-23T19:30:51.424 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:30:51.430 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:30:51.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:30:51.471 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-06-23T19:30:51.938 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:30:51.951 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:30:51.952 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:30:51.954 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:30:51.954 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:31:01.113 INFO:teuthology.orchestra.run.smithi136.stdout:generic/109 9s 2023-06-23T19:31:01.144 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/109 2023-06-23T19:31:01.144 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:31:01.162 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:31:01.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:31:01.187 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-06-23T19:31:02.027 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:31:02.039 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:31:02.040 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:31:02.042 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:31:02.043 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:31:10.862 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:10.867 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:24.198 INFO:teuthology.orchestra.run.smithi136.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:31:24.208 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/110 2023-06-23T19:31:24.208 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/110 2023-06-23T19:31:24.208 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:31:24.214 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:31:24.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:31:24.430 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-06-23T19:31:25.133 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:31:25.146 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:31:25.147 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:31:25.149 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:31:25.149 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:31:25.729 INFO:teuthology.orchestra.run.smithi136.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:31:25.738 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/111 2023-06-23T19:31:25.739 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/111 2023-06-23T19:31:25.739 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:31:25.744 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:31:26.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:31:26.106 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-06-23T19:31:26.583 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:31:26.596 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:31:26.597 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:31:26.599 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:31:26.600 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:31:40.998 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:41.004 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:45.246 INFO:teuthology.orchestra.run.smithi136.stdout:generic/112 19s 2023-06-23T19:31:45.258 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/112 2023-06-23T19:31:45.259 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:31:45.264 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:31:45.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:31:45.553 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-06-23T19:31:46.103 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:31:46.116 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:31:46.116 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:31:46.119 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:31:46.119 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:02.791 INFO:teuthology.orchestra.run.smithi136.stdout:generic/113 16s 2023-06-23T19:32:02.804 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/113 2023-06-23T19:32:02.804 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:02.810 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:03.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:03.073 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-06-23T19:32:03.743 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:03.755 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:03.756 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:03.759 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:03.759 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:04.339 INFO:teuthology.orchestra.run.smithi136.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-06-23T19:32:04.349 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/114 2023-06-23T19:32:04.349 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/114 2023-06-23T19:32:04.350 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:04.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:04.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:04.401 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-06-23T19:32:04.852 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:04.865 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:04.866 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:04.868 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:04.869 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:05.436 INFO:teuthology.orchestra.run.smithi136.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:32:05.445 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/115 2023-06-23T19:32:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/115 2023-06-23T19:32:05.446 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:05.451 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:05.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:05.835 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-06-23T19:32:06.308 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:06.320 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:06.321 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:06.324 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:06.324 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:06.887 INFO:teuthology.orchestra.run.smithi136.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:32:06.897 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/116 2023-06-23T19:32:06.897 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/116 2023-06-23T19:32:06.897 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:06.903 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:07.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:07.279 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-06-23T19:32:07.753 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:07.766 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:07.767 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:07.769 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:07.770 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:11.297 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:32:11.302 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:32:23.631 INFO:teuthology.orchestra.run.smithi136.stdout:generic/117 16s 2023-06-23T19:32:23.643 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/117 2023-06-23T19:32:23.644 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:23.649 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:23.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:23.672 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-06-23T19:32:24.120 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:24.132 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:24.133 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:24.136 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:24.136 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:25.103 INFO:teuthology.orchestra.run.smithi136.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:32:25.113 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/118 2023-06-23T19:32:25.113 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/118 2023-06-23T19:32:25.114 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:25.119 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:25.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:25.457 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-06-23T19:32:26.056 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:26.069 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:26.070 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:26.072 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:26.072 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:26.634 INFO:teuthology.orchestra.run.smithi136.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:32:26.644 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/119 2023-06-23T19:32:26.644 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/119 2023-06-23T19:32:26.644 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:26.650 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:26.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:26.884 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-06-23T19:32:27.480 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:27.493 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:27.494 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:27.496 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:27.497 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:28.005 INFO:teuthology.orchestra.run.smithi136.stdout:generic/120 [not run] atime not maintained by ceph 2023-06-23T19:32:28.015 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/120 2023-06-23T19:32:28.015 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/120 2023-06-23T19:32:28.015 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:28.021 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:28.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:28.055 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-06-23T19:32:28.513 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:28.526 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:28.527 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:28.530 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:28.530 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:29.096 INFO:teuthology.orchestra.run.smithi136.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T19:32:29.106 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/121 2023-06-23T19:32:29.106 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/121 2023-06-23T19:32:29.106 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:29.112 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:29.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:29.333 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-06-23T19:32:29.946 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:29.958 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:29.960 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:29.962 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:29.962 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:30.531 INFO:teuthology.orchestra.run.smithi136.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T19:32:30.541 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/122 2023-06-23T19:32:30.541 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/122 2023-06-23T19:32:30.541 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:30.547 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:30.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:30.877 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-06-23T19:32:31.390 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:31.403 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:31.404 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:31.406 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:32.321 INFO:teuthology.orchestra.run.smithi136.stdout:generic/123 1s 2023-06-23T19:32:32.334 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/123 2023-06-23T19:32:32.334 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:32.340 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:32.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:32.657 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-06-23T19:32:33.190 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:33.203 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:33.204 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:33.207 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:33.207 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:37.270 INFO:teuthology.orchestra.run.smithi136.stdout:generic/124 4s 2023-06-23T19:32:37.285 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/124 2023-06-23T19:32:37.285 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:32:37.291 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:37.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:32:37.817 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-06-23T19:32:38.358 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:32:38.371 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:32:38.372 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:32:38.375 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:32:38.375 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:32:41.954 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:32:41.960 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:12.076 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:12.082 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:40.236 INFO:teuthology.orchestra.run.smithi136.stdout:generic/125 62s 2023-06-23T19:33:40.250 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/125 2023-06-23T19:33:40.250 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:33:40.256 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:33:40.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:33:40.635 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-06-23T19:33:41.108 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:33:41.121 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:33:41.122 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:33:41.125 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:33:41.125 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:33:41.933 INFO:teuthology.orchestra.run.smithi136.stdout:generic/126 0s 2023-06-23T19:33:41.946 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/126 2023-06-23T19:33:41.946 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:33:41.952 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:33:42.263 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:42.286 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:42.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:33:42.310 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-06-23T19:33:42.832 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:33:42.844 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:33:42.846 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:33:42.848 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:33:42.848 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:34:12.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:34:12.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:34:42.630 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:34:42.635 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:12.810 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:12.816 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:43.157 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:43.162 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:13.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:13.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:44.202 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:44.207 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:14.309 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:14.314 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:44.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:44.485 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:14.651 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:14.657 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:44.789 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:44.793 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:39:14.926 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:39:14.931 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:39:45.080 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:39:45.085 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:40:15.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:40:15.203 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:40:15.299 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T19:40:15.297+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 138786) UID: 0 2023-06-23T19:40:15.300 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T19:40:15.297+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 138786) UID: 0 2023-06-23T19:42:52.559 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:42:52.565 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:22.688 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:22.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:52.861 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:52.866 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:56.491 INFO:teuthology.orchestra.run.smithi136.stdout:generic/127 613s 2023-06-23T19:43:56.507 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/127 2023-06-23T19:43:56.507 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:43:56.513 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:43:56.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:43:56.904 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-06-23T19:43:57.582 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:43:57.594 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:43:57.596 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:43:57.598 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:43:57.598 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:43:59.369 INFO:teuthology.orchestra.run.smithi136.stdout:generic/128 2s 2023-06-23T19:43:59.382 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/128 2023-06-23T19:43:59.382 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T19:43:59.388 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:43:59.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T19:43:59.409 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-06-23T19:43:59.866 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T19:43:59.879 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T19:43:59.880 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T19:43:59.882 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T19:43:59.883 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T19:44:22.983 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:44:22.996 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:44:53.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:44:53.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:24.305 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:24.311 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:54.817 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:54.827 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:25.057 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:25.084 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:55.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:55.350 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:55.562 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T19:46:55.559+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139220) UID: 0 2023-06-23T19:46:55.562 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T19:46:55.559+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139220) UID: 0 2023-06-23T19:46:55.563 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T19:46:55.559+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139220) UID: 0 2023-06-23T19:46:55.563 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T19:46:55.559+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139220) UID: 0 2023-06-23T19:46:55.592 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T19:46:55.587+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 284986) UID: 0 2023-06-23T19:46:55.593 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T19:46:55.587+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 284986) UID: 0 2023-06-23T19:46:55.593 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T19:46:55.586+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 284986) UID: 0 2023-06-23T19:46:55.596 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T19:46:55.589+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 284986) UID: 0 2023-06-23T19:51:20.767 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:51:20.778 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:51:21.049 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T19:51:21.046+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 285048) UID: 0 2023-06-23T19:51:21.053 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T19:51:21.046+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 285048) UID: 0 2023-06-23T19:51:21.067 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T19:51:21.044+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 285048) UID: 0 2023-06-23T19:51:21.088 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T19:51:21.046+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 285048) UID: 0 2023-06-23T19:56:19.888 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:56:19.914 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:56:20.038 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T19:56:20.029+0000 7f6f7dbf9700 -1 received signal: Hangup from (PID: 139361) UID: 0 2023-06-23T19:56:20.038 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T19:56:20.032+0000 7fea081f9700 -1 Fail to open '/proc/139361/cmdline' error = (2) No such file or directory 2023-06-23T19:56:20.039 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T19:56:20.032+0000 7fea081f9700 -1 received signal: Hangup from (PID: 139361) UID: 0 2023-06-23T19:56:20.039 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T19:56:20.032+0000 7f5eba7f9700 -1 Fail to open '/proc/139361/cmdline' error = (2) No such file or directory 2023-06-23T19:56:20.040 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T19:56:20.032+0000 7f5eba7f9700 -1 received signal: Hangup from (PID: 139361) UID: 0 2023-06-23T19:56:20.040 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T19:56:20.032+0000 7fa4689f9700 -1 Fail to open '/proc/139361/cmdline' error = (2) No such file or directory 2023-06-23T19:56:20.040 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T19:56:20.032+0000 7fa4689f9700 -1 received signal: Hangup from (PID: 139361) UID: 0 2023-06-23T20:01:22.437 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:01:22.480 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:01:22.623 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T20:01:22.620+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 285196) UID: 0 2023-06-23T20:01:22.623 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T20:01:22.620+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 285196) UID: 0 2023-06-23T20:01:22.624 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T20:01:22.620+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 285196) UID: 0 2023-06-23T20:01:22.624 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T20:01:22.620+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 285196) UID: 0 2023-06-23T20:01:23.039 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T20:01:23.037+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139445) UID: 0 2023-06-23T20:01:23.040 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T20:01:23.037+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139445) UID: 0 2023-06-23T20:01:23.040 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T20:01:23.037+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139445) UID: 0 2023-06-23T20:01:23.041 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T20:01:23.037+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139445) UID: 0 2023-06-23T20:05:10.228 INFO:teuthology.orchestra.run.smithi136.stdout:generic/129 1270s 2023-06-23T20:05:10.271 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/129 2023-06-23T20:05:10.271 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:05:10.277 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:05:10.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:05:10.319 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-06-23T20:05:10.979 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:05:10.993 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:05:10.994 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:05:10.996 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:05:10.997 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:05:25.518 INFO:teuthology.orchestra.run.smithi136.stdout:generic/130 14s 2023-06-23T20:05:25.534 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/130 2023-06-23T20:05:25.534 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:05:25.539 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:05:25.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:05:25.562 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-06-23T20:05:26.013 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:05:26.025 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:05:26.026 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:05:26.029 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:05:26.029 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:05:28.372 INFO:teuthology.orchestra.run.smithi136.stdout:generic/131 2s 2023-06-23T20:05:28.400 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/131 2023-06-23T20:05:28.400 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:05:28.410 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:05:28.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:05:28.695 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-06-23T20:05:29.714 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:05:29.736 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:05:29.739 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:05:29.743 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:05:29.743 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:05:44.893 INFO:teuthology.orchestra.run.smithi136.stdout:generic/132 14s 2023-06-23T20:05:44.906 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/132 2023-06-23T20:05:44.906 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:05:44.911 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:05:44.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:05:44.933 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-06-23T20:05:45.386 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:05:45.398 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:05:45.399 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:05:45.402 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:05:45.402 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:06:07.762 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:06:07.768 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:06:07.928 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T20:06:07.925+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139544) UID: 0 2023-06-23T20:06:07.929 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T20:06:07.925+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139544) UID: 0 2023-06-23T20:06:07.929 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T20:06:07.925+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139544) UID: 0 2023-06-23T20:06:07.929 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T20:06:07.925+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139544) UID: 0 2023-06-23T20:09:11.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:11.466 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:41.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:41.668 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:41.767 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T20:09:41.764+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 287880) UID: 0 2023-06-23T20:09:41.768 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T20:09:41.764+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 287880) UID: 0 2023-06-23T20:09:41.768 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T20:09:41.764+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 287880) UID: 0 2023-06-23T20:09:41.769 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T20:09:41.764+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 287880) UID: 0 2023-06-23T20:09:59.095 INFO:teuthology.orchestra.run.smithi136.stdout:generic/133 254s 2023-06-23T20:09:59.110 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/133 2023-06-23T20:09:59.110 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:09:59.117 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:09:59.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:09:59.525 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-06-23T20:10:00.004 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:00.018 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:00.019 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:00.022 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:00.022 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:00.774 INFO:teuthology.orchestra.run.smithi136.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:00.785 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/134 2023-06-23T20:10:00.785 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/134 2023-06-23T20:10:00.785 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:00.790 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:01.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:01.214 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-06-23T20:10:01.732 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:01.744 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:01.746 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:01.748 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:01.748 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:03.084 INFO:teuthology.orchestra.run.smithi136.stdout:generic/135 2s 2023-06-23T20:10:03.099 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/135 2023-06-23T20:10:03.100 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:03.107 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:03.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:03.131 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-06-23T20:10:03.591 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:03.603 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:03.604 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:03.607 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:03.607 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:04.177 INFO:teuthology.orchestra.run.smithi136.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T20:10:04.187 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/136 2023-06-23T20:10:04.187 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/136 2023-06-23T20:10:04.188 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:04.193 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:04.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:04.654 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-06-23T20:10:05.110 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:05.123 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:05.123 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:05.126 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:05.126 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:05.704 INFO:teuthology.orchestra.run.smithi136.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:05.714 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/137 2023-06-23T20:10:05.714 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/137 2023-06-23T20:10:05.714 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:05.720 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:06.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:06.114 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-06-23T20:10:06.638 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:06.651 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:06.652 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:06.654 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:06.655 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:07.232 INFO:teuthology.orchestra.run.smithi136.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:07.242 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/138 2023-06-23T20:10:07.242 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/138 2023-06-23T20:10:07.242 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:07.248 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:07.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:07.494 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-06-23T20:10:08.179 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:08.191 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:08.192 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:08.195 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:08.195 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:08.755 INFO:teuthology.orchestra.run.smithi136.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:08.764 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/139 2023-06-23T20:10:08.765 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/139 2023-06-23T20:10:08.765 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:08.771 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:08.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:08.881 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-06-23T20:10:09.663 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:09.677 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:09.678 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:09.680 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:09.680 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:10.235 INFO:teuthology.orchestra.run.smithi136.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:10.246 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/140 2023-06-23T20:10:10.246 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/140 2023-06-23T20:10:10.246 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:10.251 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:10.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:10.538 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-06-23T20:10:11.114 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:11.128 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:11.129 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:11.131 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:11.131 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:11.904 INFO:teuthology.orchestra.run.smithi136.stdout:generic/141 0s 2023-06-23T20:10:11.917 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/141 2023-06-23T20:10:11.918 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:11.923 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:11.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:11.945 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-06-23T20:10:12.407 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:12.419 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:12.420 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:12.423 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:12.423 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:12.999 INFO:teuthology.orchestra.run.smithi136.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:13.009 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/142 2023-06-23T20:10:13.010 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/142 2023-06-23T20:10:13.010 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:13.015 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:13.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:13.471 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-06-23T20:10:13.949 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:13.962 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:13.963 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:13.965 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:13.965 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:14.566 INFO:teuthology.orchestra.run.smithi136.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:14.575 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/143 2023-06-23T20:10:14.576 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/143 2023-06-23T20:10:14.576 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:14.582 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:15.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:15.020 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-06-23T20:10:15.505 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:15.518 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:15.519 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:15.521 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:15.521 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:16.082 INFO:teuthology.orchestra.run.smithi136.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:16.092 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/144 2023-06-23T20:10:16.092 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/144 2023-06-23T20:10:16.092 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:16.098 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:16.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:16.513 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-06-23T20:10:17.021 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:17.033 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:17.034 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:17.037 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:17.037 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:17.610 INFO:teuthology.orchestra.run.smithi136.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:17.620 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/145 2023-06-23T20:10:17.620 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/145 2023-06-23T20:10:17.620 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:17.626 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:18.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:18.086 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-06-23T20:10:18.548 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:18.560 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:18.562 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:18.564 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:18.564 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:19.124 INFO:teuthology.orchestra.run.smithi136.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:19.134 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/146 2023-06-23T20:10:19.134 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/146 2023-06-23T20:10:19.134 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:19.140 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:19.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:19.538 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-06-23T20:10:20.044 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:20.056 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:20.057 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:20.059 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:20.060 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:20.617 INFO:teuthology.orchestra.run.smithi136.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:20.627 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/147 2023-06-23T20:10:20.627 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/147 2023-06-23T20:10:20.628 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:20.633 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:21.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:21.001 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-06-23T20:10:21.573 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:21.587 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:21.588 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:21.590 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:21.591 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:22.158 INFO:teuthology.orchestra.run.smithi136.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:22.169 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/148 2023-06-23T20:10:22.169 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/148 2023-06-23T20:10:22.169 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:22.176 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:22.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:22.585 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-06-23T20:10:23.078 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:23.090 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:23.092 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:23.094 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:23.094 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:23.660 INFO:teuthology.orchestra.run.smithi136.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:23.670 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/149 2023-06-23T20:10:23.670 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/149 2023-06-23T20:10:23.671 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:23.676 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:24.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:24.073 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-06-23T20:10:24.583 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:24.596 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:24.597 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:24.599 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:24.600 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:25.172 INFO:teuthology.orchestra.run.smithi136.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:25.181 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/150 2023-06-23T20:10:25.182 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/150 2023-06-23T20:10:25.182 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:25.187 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:25.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:25.520 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-06-23T20:10:26.066 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:26.079 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:26.080 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:26.082 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:26.082 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:26.646 INFO:teuthology.orchestra.run.smithi136.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:26.656 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/151 2023-06-23T20:10:26.656 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/151 2023-06-23T20:10:26.657 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:26.662 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:27.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:27.040 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-06-23T20:10:27.561 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:27.573 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:27.574 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:27.577 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:27.577 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:28.160 INFO:teuthology.orchestra.run.smithi136.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:28.170 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/152 2023-06-23T20:10:28.170 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/152 2023-06-23T20:10:28.170 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:28.176 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:28.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:28.592 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-06-23T20:10:29.085 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:29.098 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:29.099 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:29.101 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:29.102 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:29.674 INFO:teuthology.orchestra.run.smithi136.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:29.684 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/153 2023-06-23T20:10:29.684 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/153 2023-06-23T20:10:29.684 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:29.691 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:30.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:30.085 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-06-23T20:10:30.569 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:30.582 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:30.582 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:30.585 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:30.586 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:31.173 INFO:teuthology.orchestra.run.smithi136.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:31.183 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/154 2023-06-23T20:10:31.183 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/154 2023-06-23T20:10:31.183 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:31.189 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:31.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:31.541 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-06-23T20:10:32.083 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:32.095 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:32.096 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:32.099 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:32.099 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:32.688 INFO:teuthology.orchestra.run.smithi136.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:32.699 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/155 2023-06-23T20:10:32.699 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/155 2023-06-23T20:10:32.699 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:32.707 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:33.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:33.081 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-06-23T20:10:33.613 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:33.625 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:33.626 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:33.628 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:33.629 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:34.190 INFO:teuthology.orchestra.run.smithi136.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:34.200 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/156 2023-06-23T20:10:34.201 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/156 2023-06-23T20:10:34.201 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:34.206 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:34.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:34.642 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-06-23T20:10:35.111 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:35.123 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:35.124 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:35.127 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:35.127 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:35.749 INFO:teuthology.orchestra.run.smithi136.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:10:35.759 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/157 2023-06-23T20:10:35.759 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/157 2023-06-23T20:10:35.760 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:35.765 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:36.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:36.188 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-06-23T20:10:36.683 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:36.695 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:36.696 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:36.699 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:36.699 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:37.282 INFO:teuthology.orchestra.run.smithi136.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T20:10:37.292 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/158 2023-06-23T20:10:37.293 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/158 2023-06-23T20:10:37.293 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:37.298 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:37.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:37.662 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-06-23T20:10:38.178 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:38.191 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:38.192 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:38.194 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:38.195 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:38.801 INFO:teuthology.orchestra.run.smithi136.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-06-23T20:10:38.810 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/159 2023-06-23T20:10:38.811 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/159 2023-06-23T20:10:38.811 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:38.817 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:38.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:38.861 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-06-23T20:10:39.315 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:39.328 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:39.329 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:39.331 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:39.332 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:39.865 INFO:teuthology.orchestra.run.smithi136.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-06-23T20:10:39.875 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/160 2023-06-23T20:10:39.875 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/160 2023-06-23T20:10:39.875 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:39.881 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:39.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:39.924 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-06-23T20:10:40.429 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:40.442 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:40.443 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:40.445 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:40.445 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:41.427 INFO:teuthology.orchestra.run.smithi136.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:10:41.515 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/161 2023-06-23T20:10:41.515 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/161 2023-06-23T20:10:41.515 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:41.530 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:41.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:41.609 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-06-23T20:10:42.077 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:42.090 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:42.091 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:42.093 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:42.093 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:42.828 INFO:teuthology.orchestra.run.smithi136.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-23T20:10:43.092 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/162 2023-06-23T20:10:43.093 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/162 2023-06-23T20:10:43.093 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:43.131 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:43.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:43.310 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-06-23T20:10:43.764 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:43.776 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:43.777 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:43.780 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:43.780 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:44.515 INFO:teuthology.orchestra.run.smithi136.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-23T20:10:44.738 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/163 2023-06-23T20:10:44.738 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/163 2023-06-23T20:10:44.738 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:44.784 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:44.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:44.971 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-06-23T20:10:45.446 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:45.460 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:45.460 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:45.462 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:45.462 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:46.474 INFO:teuthology.orchestra.run.smithi136.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:10:46.531 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/164 2023-06-23T20:10:46.532 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/164 2023-06-23T20:10:46.532 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:46.587 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:46.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:46.665 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-06-23T20:10:47.127 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:47.139 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:47.141 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:47.143 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:48.287 INFO:teuthology.orchestra.run.smithi136.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:10:48.308 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/165 2023-06-23T20:10:48.309 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/165 2023-06-23T20:10:48.309 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:48.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:48.375 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-06-23T20:10:48.842 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:48.856 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:48.856 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:48.858 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:48.859 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:49.916 INFO:teuthology.orchestra.run.smithi136.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:10:49.992 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/166 2023-06-23T20:10:49.993 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/166 2023-06-23T20:10:49.993 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:50.004 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:50.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:50.047 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-06-23T20:10:50.523 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:50.536 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:50.537 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:50.539 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:50.539 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:51.687 INFO:teuthology.orchestra.run.smithi136.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:10:51.706 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/167 2023-06-23T20:10:51.707 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/167 2023-06-23T20:10:51.707 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:51.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:51.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:51.777 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-06-23T20:10:52.237 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:52.249 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:52.250 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:52.253 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:52.253 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:53.248 INFO:teuthology.orchestra.run.smithi136.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:10:53.445 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/168 2023-06-23T20:10:53.445 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/168 2023-06-23T20:10:53.445 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:53.453 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:53.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:53.495 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-06-23T20:10:53.952 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:53.965 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:53.966 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:53.968 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:53.968 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:54.969 INFO:teuthology.orchestra.run.smithi136.stdout:generic/169 0s 2023-06-23T20:10:54.983 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/169 2023-06-23T20:10:54.983 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:54.990 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:55.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:55.014 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-06-23T20:10:55.474 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:55.486 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:55.487 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:55.490 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:55.490 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:56.615 INFO:teuthology.orchestra.run.smithi136.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:10:56.642 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/170 2023-06-23T20:10:56.642 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/170 2023-06-23T20:10:56.642 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:56.651 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:56.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:56.700 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-06-23T20:10:57.156 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:57.168 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:57.169 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:57.172 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:57.172 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:58.381 INFO:teuthology.orchestra.run.smithi136.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:10:58.395 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/171 2023-06-23T20:10:58.396 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/171 2023-06-23T20:10:58.396 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:10:58.403 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:58.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:10:58.448 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-06-23T20:10:58.902 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:10:58.915 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:10:58.916 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:10:58.918 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:10:58.919 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:10:59.948 INFO:teuthology.orchestra.run.smithi136.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:00.070 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/172 2023-06-23T20:11:00.070 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/172 2023-06-23T20:11:00.070 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:00.092 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:00.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:00.141 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-06-23T20:11:00.588 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:00.601 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:00.602 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:00.604 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:00.604 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:01.582 INFO:teuthology.orchestra.run.smithi136.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:01.644 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/173 2023-06-23T20:11:01.699 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/173 2023-06-23T20:11:01.700 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:01.763 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:01.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:01.823 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-06-23T20:11:02.315 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:02.327 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:02.329 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:02.331 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:02.331 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:03.443 INFO:teuthology.orchestra.run.smithi136.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:03.490 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/174 2023-06-23T20:11:03.490 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/174 2023-06-23T20:11:03.490 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:03.499 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:03.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:03.541 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-06-23T20:11:04.003 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:04.015 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:04.016 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:04.019 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:05.079 INFO:teuthology.orchestra.run.smithi136.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:05.148 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/175 2023-06-23T20:11:05.148 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/175 2023-06-23T20:11:05.148 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:05.167 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:05.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:05.218 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-06-23T20:11:05.670 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:05.683 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:05.684 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:05.686 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:05.686 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:06.649 INFO:teuthology.orchestra.run.smithi136.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:06.763 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/176 2023-06-23T20:11:06.763 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/176 2023-06-23T20:11:06.764 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:06.778 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:06.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:06.858 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-06-23T20:11:07.310 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:07.322 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:07.323 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:07.326 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:07.326 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:08.110 INFO:teuthology.orchestra.run.smithi136.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-23T20:11:08.121 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/177 2023-06-23T20:11:08.121 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/177 2023-06-23T20:11:08.121 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:08.126 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:08.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:08.544 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-06-23T20:11:09.031 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:09.044 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:09.045 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:09.047 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:09.048 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:09.660 INFO:teuthology.orchestra.run.smithi136.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:11:09.670 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/178 2023-06-23T20:11:09.671 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/178 2023-06-23T20:11:09.671 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:09.677 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:10.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:10.072 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-06-23T20:11:10.583 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:10.595 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:10.596 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:10.599 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:10.599 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:11.161 INFO:teuthology.orchestra.run.smithi136.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:11:11.170 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/179 2023-06-23T20:11:11.171 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/179 2023-06-23T20:11:11.171 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:11.177 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:11.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:11.544 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-06-23T20:11:12.080 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:12.092 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:12.093 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:12.095 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:12.096 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:12.680 INFO:teuthology.orchestra.run.smithi136.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:11:12.690 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/180 2023-06-23T20:11:12.690 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/180 2023-06-23T20:11:12.690 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:12.696 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:13.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:13.080 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-06-23T20:11:13.640 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:13.654 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:13.655 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:13.657 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:13.657 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:14.239 INFO:teuthology.orchestra.run.smithi136.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:11:14.249 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/181 2023-06-23T20:11:14.249 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/181 2023-06-23T20:11:14.249 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:14.255 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:14.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:14.571 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-06-23T20:11:15.170 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:15.182 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:15.183 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:15.186 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:15.186 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:15.763 INFO:teuthology.orchestra.run.smithi136.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T20:11:15.773 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/182 2023-06-23T20:11:15.773 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/182 2023-06-23T20:11:15.773 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:15.779 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:16.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:16.081 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-06-23T20:11:16.687 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:16.700 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:16.701 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:16.703 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:16.704 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:17.769 INFO:teuthology.orchestra.run.smithi136.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:17.791 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/183 2023-06-23T20:11:17.791 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/183 2023-06-23T20:11:17.791 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:17.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:17.917 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-06-23T20:11:18.371 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:18.383 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:18.385 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:18.387 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:18.992 INFO:teuthology.orchestra.run.smithi136.stdout:generic/184 0s 2023-06-23T20:11:19.006 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/184 2023-06-23T20:11:19.006 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:19.013 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:19.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:19.058 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-06-23T20:11:19.519 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:19.531 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:19.532 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:19.535 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:19.535 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:20.678 INFO:teuthology.orchestra.run.smithi136.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:20.714 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/185 2023-06-23T20:11:20.714 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/185 2023-06-23T20:11:20.714 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:20.724 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:20.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:20.772 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-06-23T20:11:21.226 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:21.240 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:21.241 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:21.243 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:21.243 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:22.119 INFO:teuthology.orchestra.run.smithi136.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:22.177 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/186 2023-06-23T20:11:22.177 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/186 2023-06-23T20:11:22.178 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:22.319 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:22.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:22.402 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-06-23T20:11:22.861 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:22.874 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:22.875 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:22.878 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:22.878 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:23.801 INFO:teuthology.orchestra.run.smithi136.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:23.809 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/187 2023-06-23T20:11:23.809 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/187 2023-06-23T20:11:23.809 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:23.820 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:23.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:23.991 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-06-23T20:11:24.522 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:24.534 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:24.535 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:24.538 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:24.538 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:25.517 INFO:teuthology.orchestra.run.smithi136.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:25.619 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/188 2023-06-23T20:11:25.620 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/188 2023-06-23T20:11:25.620 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:25.696 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:25.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:25.747 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-06-23T20:11:26.200 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:26.212 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:26.214 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:26.216 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:26.217 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:27.140 INFO:teuthology.orchestra.run.smithi136.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:27.327 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/189 2023-06-23T20:11:27.328 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/189 2023-06-23T20:11:27.328 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:27.364 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:27.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:27.425 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-06-23T20:11:27.883 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:27.895 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:27.896 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:27.899 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:27.899 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:29.088 INFO:teuthology.orchestra.run.smithi136.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:29.119 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/190 2023-06-23T20:11:29.120 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/190 2023-06-23T20:11:29.120 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:29.137 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:29.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:29.188 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-06-23T20:11:29.645 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:29.658 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:29.659 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:29.662 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:29.662 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:30.640 INFO:teuthology.orchestra.run.smithi136.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:30.748 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/191 2023-06-23T20:11:30.749 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/191 2023-06-23T20:11:30.749 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:30.831 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:30.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:30.881 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-06-23T20:11:31.358 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:31.370 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:31.372 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:31.374 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:31.375 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:31.915 INFO:teuthology.orchestra.run.smithi136.stdout:generic/192 [not run] atime not maintained by ceph 2023-06-23T20:11:31.925 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/192 2023-06-23T20:11:31.925 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/192 2023-06-23T20:11:31.925 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:31.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:31.972 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-06-23T20:11:32.427 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:32.439 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:32.440 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:32.443 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:32.443 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:34.335 INFO:teuthology.orchestra.run.smithi136.stdout:generic/193 2s 2023-06-23T20:11:34.348 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/193 2023-06-23T20:11:34.348 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:34.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:34.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:34.647 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-06-23T20:11:35.280 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:35.294 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:35.295 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:35.297 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:35.298 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:36.390 INFO:teuthology.orchestra.run.smithi136.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:36.432 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/194 2023-06-23T20:11:36.432 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/194 2023-06-23T20:11:36.433 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:36.442 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:36.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:36.494 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-06-23T20:11:36.958 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:36.971 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:36.972 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:36.975 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:36.975 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:37.966 INFO:teuthology.orchestra.run.smithi136.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:38.113 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/195 2023-06-23T20:11:38.113 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/195 2023-06-23T20:11:38.113 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:38.139 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:38.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:38.202 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-06-23T20:11:38.666 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:38.679 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:38.680 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:38.683 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:39.911 INFO:teuthology.orchestra.run.smithi136.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:39.934 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/196 2023-06-23T20:11:39.934 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/196 2023-06-23T20:11:39.934 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:39.941 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:39.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:39.993 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-06-23T20:11:40.543 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:40.555 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:40.556 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:40.559 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:40.559 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:41.701 INFO:teuthology.orchestra.run.smithi136.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:41.728 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/197 2023-06-23T20:11:41.728 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/197 2023-06-23T20:11:41.728 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:41.757 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:41.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:41.805 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-06-23T20:11:42.264 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:42.277 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:42.278 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:42.280 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:42.280 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:43.805 INFO:teuthology.orchestra.run.smithi136.stdout:generic/198 1s 2023-06-23T20:11:43.818 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/198 2023-06-23T20:11:43.819 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:43.824 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:44.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:44.270 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-06-23T20:11:44.870 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:44.882 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:44.883 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:44.885 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:44.886 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:45.953 INFO:teuthology.orchestra.run.smithi136.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:45.989 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/199 2023-06-23T20:11:45.989 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/199 2023-06-23T20:11:45.989 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:46.024 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:46.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:46.083 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-06-23T20:11:46.541 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:46.553 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:46.554 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:46.556 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:46.557 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:47.632 INFO:teuthology.orchestra.run.smithi136.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:47.664 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/200 2023-06-23T20:11:47.665 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/200 2023-06-23T20:11:47.665 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:47.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:47.746 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-06-23T20:11:48.209 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:48.223 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:48.224 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:48.226 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:49.193 INFO:teuthology.orchestra.run.smithi136.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:49.278 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/201 2023-06-23T20:11:49.278 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/201 2023-06-23T20:11:49.279 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:49.390 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:49.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:49.452 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-06-23T20:11:49.917 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:49.931 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:49.932 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:49.935 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:49.935 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:51.092 INFO:teuthology.orchestra.run.smithi136.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:51.109 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/202 2023-06-23T20:11:51.109 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/202 2023-06-23T20:11:51.110 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:51.116 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:51.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:51.163 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-06-23T20:11:51.619 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:51.631 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:51.632 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:51.635 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:51.635 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:52.777 INFO:teuthology.orchestra.run.smithi136.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:52.790 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/203 2023-06-23T20:11:52.790 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/203 2023-06-23T20:11:52.791 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:52.799 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:52.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:52.844 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-06-23T20:11:53.298 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:53.310 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:53.311 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:53.313 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:53.314 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:54.892 INFO:teuthology.orchestra.run.smithi136.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:11:54.903 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/204 2023-06-23T20:11:54.903 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/204 2023-06-23T20:11:54.903 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:54.909 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:54.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:54.954 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-06-23T20:11:55.406 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:55.419 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:55.420 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:55.422 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:55.422 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:56.339 INFO:teuthology.orchestra.run.smithi136.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:56.357 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/205 2023-06-23T20:11:56.358 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/205 2023-06-23T20:11:56.358 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:56.559 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:56.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:56.611 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-06-23T20:11:57.064 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:57.076 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:57.077 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:57.080 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:57.951 INFO:teuthology.orchestra.run.smithi136.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:11:58.076 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/206 2023-06-23T20:11:58.076 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/206 2023-06-23T20:11:58.077 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:11:58.116 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:11:58.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:11:58.270 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-06-23T20:11:58.730 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:11:58.742 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:11:58.743 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:11:58.746 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:11:58.746 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:12:06.773 INFO:teuthology.orchestra.run.smithi136.stdout:generic/207 8s 2023-06-23T20:12:06.788 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/207 2023-06-23T20:12:06.788 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:12:06.795 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:12:07.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:12:07.050 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-06-23T20:12:07.723 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:12:07.735 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:12:07.737 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:12:07.739 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:12:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:13:03.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:13:03.506 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:13:03.626 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T20:13:03.623+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140105) UID: 0 2023-06-23T20:13:03.626 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T20:13:03.623+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140105) UID: 0 2023-06-23T20:13:03.627 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T20:13:03.623+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140105) UID: 0 2023-06-23T20:13:03.628 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T20:13:03.623+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140105) UID: 0 2023-06-23T20:15:28.500 INFO:teuthology.orchestra.run.smithi136.stdout:generic/208 201s 2023-06-23T20:15:28.513 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/208 2023-06-23T20:15:28.513 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:15:28.519 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:15:28.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:15:28.906 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-06-23T20:15:29.401 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:15:29.414 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:15:29.415 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:15:29.417 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:15:29.417 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:02.037 INFO:teuthology.orchestra.run.smithi136.stdout:generic/209 32s 2023-06-23T20:16:02.051 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/209 2023-06-23T20:16:02.051 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:02.057 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:02.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:02.423 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-06-23T20:16:02.922 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:02.934 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:02.935 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:02.938 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:03.614 INFO:teuthology.orchestra.run.smithi136.stdout:generic/210 0s 2023-06-23T20:16:03.627 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/210 2023-06-23T20:16:03.627 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:03.632 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:03.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:03.876 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-06-23T20:16:04.494 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:04.507 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:04.508 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:04.510 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:05.688 INFO:teuthology.orchestra.run.smithi136.stdout:generic/211 1s 2023-06-23T20:16:05.701 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/211 2023-06-23T20:16:05.701 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:05.707 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:05.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:05.754 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-06-23T20:16:06.208 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:06.221 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:06.222 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:06.224 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:06.225 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:06.843 INFO:teuthology.orchestra.run.smithi136.stdout:generic/212 0s 2023-06-23T20:16:06.855 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/212 2023-06-23T20:16:06.856 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:06.861 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:06.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:06.914 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-06-23T20:16:07.367 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:07.379 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:07.380 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:07.383 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:07.383 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:07.912 INFO:teuthology.orchestra.run.smithi136.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:16:07.922 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/213 2023-06-23T20:16:07.922 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/213 2023-06-23T20:16:07.922 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:07.928 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:07.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:07.976 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-06-23T20:16:08.427 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:08.440 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:08.441 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:08.444 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:08.444 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:08.984 INFO:teuthology.orchestra.run.smithi136.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:16:08.994 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/214 2023-06-23T20:16:08.994 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/214 2023-06-23T20:16:08.994 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:09.000 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:09.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:09.040 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-06-23T20:16:09.497 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:09.509 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:09.510 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:09.513 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:09.513 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:09.687 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:16:09.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:16:09.780 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T20:16:09.777+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 329198) UID: 0 2023-06-23T20:16:09.781 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T20:16:09.777+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 329198) UID: 0 2023-06-23T20:16:09.781 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T20:16:09.777+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 329198) UID: 0 2023-06-23T20:16:09.781 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T20:16:09.777+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 329198) UID: 0 2023-06-23T20:16:12.171 INFO:teuthology.orchestra.run.smithi136.stdout:generic/215 3s 2023-06-23T20:16:12.185 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/215 2023-06-23T20:16:12.185 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:12.191 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:12.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:12.260 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-06-23T20:16:12.753 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:12.765 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:12.766 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:12.769 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:12.769 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:13.900 INFO:teuthology.orchestra.run.smithi136.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:16:13.920 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/216 2023-06-23T20:16:13.920 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/216 2023-06-23T20:16:13.920 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:13.930 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:13.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:13.977 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-06-23T20:16:14.433 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:14.446 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:14.447 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:14.449 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:14.450 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:15.460 INFO:teuthology.orchestra.run.smithi136.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:16:15.541 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/217 2023-06-23T20:16:15.541 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/217 2023-06-23T20:16:15.542 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:15.564 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:15.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:15.652 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-06-23T20:16:16.125 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:16.138 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:16.139 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:16.142 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:16.142 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:17.186 INFO:teuthology.orchestra.run.smithi136.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:16:17.265 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/218 2023-06-23T20:16:17.265 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/218 2023-06-23T20:16:17.266 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:17.282 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:17.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:17.327 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-06-23T20:16:17.782 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:17.794 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:17.795 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:17.798 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:18.307 INFO:teuthology.orchestra.run.smithi136.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:16:18.317 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/219 2023-06-23T20:16:18.317 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/219 2023-06-23T20:16:18.317 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:18.323 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:18.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:18.369 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-06-23T20:16:18.826 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:18.838 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:18.839 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:18.842 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:18.842 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:19.847 INFO:teuthology.orchestra.run.smithi136.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:16:19.988 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/220 2023-06-23T20:16:19.989 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/220 2023-06-23T20:16:19.989 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:20.003 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:20.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:20.057 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-06-23T20:16:20.509 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:20.522 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:20.523 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:20.525 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:20.526 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:22.083 INFO:teuthology.orchestra.run.smithi136.stdout:generic/221 2s 2023-06-23T20:16:22.096 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/221 2023-06-23T20:16:22.097 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:22.102 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:22.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:22.143 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-06-23T20:16:22.597 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:22.609 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:22.610 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:22.612 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:22.613 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:23.547 INFO:teuthology.orchestra.run.smithi136.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:16:23.609 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/222 2023-06-23T20:16:23.609 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/222 2023-06-23T20:16:23.609 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:23.708 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:23.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:23.821 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-06-23T20:16:24.280 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:24.292 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:24.293 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:24.296 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:24.296 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:24.824 INFO:teuthology.orchestra.run.smithi136.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:16:24.834 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/223 2023-06-23T20:16:24.834 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/223 2023-06-23T20:16:24.834 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:24.840 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:24.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:24.882 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-06-23T20:16:25.335 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:25.347 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:25.348 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:25.350 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:25.351 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:25.855 INFO:teuthology.orchestra.run.smithi136.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:16:25.865 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/224 2023-06-23T20:16:25.865 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/224 2023-06-23T20:16:25.865 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:25.871 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:25.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:25.910 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-06-23T20:16:26.371 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:26.383 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:26.384 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:26.387 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:26.387 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:26.996 INFO:teuthology.orchestra.run.smithi136.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-23T20:16:27.006 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/225 2023-06-23T20:16:27.006 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/225 2023-06-23T20:16:27.006 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:27.011 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:27.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:27.470 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-06-23T20:16:27.957 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:27.969 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:27.970 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:27.973 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:27.973 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:28.532 INFO:teuthology.orchestra.run.smithi136.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:16:28.542 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/226 2023-06-23T20:16:28.542 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/226 2023-06-23T20:16:28.542 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:28.548 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:28.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:28.590 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-06-23T20:16:29.050 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:29.065 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:29.065 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:29.066 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:29.066 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:30.147 INFO:teuthology.orchestra.run.smithi136.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:16:30.207 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/227 2023-06-23T20:16:30.207 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/227 2023-06-23T20:16:30.207 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:30.223 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:30.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:30.281 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-06-23T20:16:30.741 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:30.753 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:30.755 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:30.757 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:30.757 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:31.326 INFO:teuthology.orchestra.run.smithi136.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:16:31.336 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/228 2023-06-23T20:16:31.337 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/228 2023-06-23T20:16:31.337 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:31.342 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:31.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:31.378 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-06-23T20:16:31.835 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:31.847 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:31.848 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:31.851 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:31.851 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:32.815 INFO:teuthology.orchestra.run.smithi136.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:16:32.838 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/229 2023-06-23T20:16:32.839 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/229 2023-06-23T20:16:32.839 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:32.851 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:32.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:32.999 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-06-23T20:16:33.483 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:33.495 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:33.497 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:33.499 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:33.499 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:34.014 INFO:teuthology.orchestra.run.smithi136.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:16:34.024 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/230 2023-06-23T20:16:34.024 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/230 2023-06-23T20:16:34.025 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:34.030 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:34.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:34.069 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-06-23T20:16:34.533 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:34.546 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:34.547 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:34.550 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:34.550 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:35.050 INFO:teuthology.orchestra.run.smithi136.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:16:35.060 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/231 2023-06-23T20:16:35.061 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/231 2023-06-23T20:16:35.061 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:35.066 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:35.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:35.105 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-06-23T20:16:35.563 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:35.576 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:35.577 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:35.579 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:35.579 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:36.091 INFO:teuthology.orchestra.run.smithi136.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:16:36.101 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/232 2023-06-23T20:16:36.101 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/232 2023-06-23T20:16:36.101 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:36.107 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:36.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:36.151 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-06-23T20:16:36.615 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:36.627 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:36.628 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:36.631 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:36.631 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:37.142 INFO:teuthology.orchestra.run.smithi136.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:16:37.152 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/233 2023-06-23T20:16:37.153 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/233 2023-06-23T20:16:37.153 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:37.158 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:37.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:37.202 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-06-23T20:16:37.649 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:37.662 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:37.663 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:37.665 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:37.666 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:38.177 INFO:teuthology.orchestra.run.smithi136.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:16:38.187 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/234 2023-06-23T20:16:38.187 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/234 2023-06-23T20:16:38.188 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:38.193 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:38.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:38.230 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-06-23T20:16:38.683 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:38.696 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:38.697 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:38.699 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:39.260 INFO:teuthology.orchestra.run.smithi136.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:16:39.270 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/235 2023-06-23T20:16:39.270 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/235 2023-06-23T20:16:39.270 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:39.276 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:39.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:39.313 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-06-23T20:16:39.765 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:39.777 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:39.778 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:39.781 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:39.781 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:41.422 INFO:teuthology.orchestra.run.smithi136.stdout:generic/236 2s 2023-06-23T20:16:41.435 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/236 2023-06-23T20:16:41.435 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:41.441 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:41.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:41.708 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-06-23T20:16:42.338 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:42.350 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:42.351 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:42.354 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:42.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:43.063 INFO:teuthology.orchestra.run.smithi136.stdout:generic/237 1s 2023-06-23T20:16:43.076 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/237 2023-06-23T20:16:43.077 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:43.082 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:43.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:43.514 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-06-23T20:16:44.037 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:44.049 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:44.050 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:44.052 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:44.053 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:44.981 INFO:teuthology.orchestra.run.smithi136.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:16:44.998 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/238 2023-06-23T20:16:44.999 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/238 2023-06-23T20:16:44.999 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:16:45.009 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:16:45.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:16:45.199 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-06-23T20:16:45.665 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:16:45.678 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:16:45.679 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:16:45.682 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:16:45.682 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:18:58.403 INFO:teuthology.orchestra.run.smithi136.stdout:generic/239 133s 2023-06-23T20:18:58.416 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/239 2023-06-23T20:18:58.416 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:18:58.422 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:18:58.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:18:58.696 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-06-23T20:18:59.312 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:18:59.324 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:18:59.325 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:18:59.327 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:18:59.328 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:19:00.388 INFO:teuthology.orchestra.run.smithi136.stdout:generic/240 1s 2023-06-23T20:19:00.401 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/240 2023-06-23T20:19:00.401 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:19:00.406 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:19:00.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:19:00.855 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-06-23T20:19:01.365 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:19:01.378 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:19:01.379 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:19:01.381 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:19:01.381 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:19:52.862 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:19:52.866 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:14.846 INFO:teuthology.orchestra.run.smithi136.stdout:generic/241 73s 2023-06-23T20:20:14.883 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/241 2023-06-23T20:20:14.884 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:14.889 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:15.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:15.773 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-06-23T20:20:16.725 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:16.738 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:16.739 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:16.742 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:16.742 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:17.691 INFO:teuthology.orchestra.run.smithi136.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:20:17.753 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/242 2023-06-23T20:20:17.753 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/242 2023-06-23T20:20:17.753 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:17.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:17.931 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-06-23T20:20:18.382 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:18.395 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:18.396 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:18.398 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:19.400 INFO:teuthology.orchestra.run.smithi136.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:20:19.527 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/243 2023-06-23T20:20:19.527 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/243 2023-06-23T20:20:19.528 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:19.536 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:19.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:19.584 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-06-23T20:20:20.036 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:20.048 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:20.050 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:20.052 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:20.052 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:20.562 INFO:teuthology.orchestra.run.smithi136.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:20:20.572 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/244 2023-06-23T20:20:20.572 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/244 2023-06-23T20:20:20.572 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:20.578 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:20.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:20.618 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-06-23T20:20:21.066 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:21.078 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:21.079 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:21.082 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:21.082 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:21.698 INFO:teuthology.orchestra.run.smithi136.stdout:generic/245 0s 2023-06-23T20:20:21.710 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/245 2023-06-23T20:20:21.711 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:21.717 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:22.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:22.107 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-06-23T20:20:22.604 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:22.616 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:22.617 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:22.620 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:22.621 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:23.209 INFO:teuthology.orchestra.run.smithi136.stdout:generic/246 1s 2023-06-23T20:20:23.222 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/246 2023-06-23T20:20:23.222 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:23.228 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:23.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:23.629 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-06-23T20:20:24.104 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:24.116 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:24.117 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:24.120 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:24.120 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:24.140 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:24.144 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:33.410 INFO:teuthology.orchestra.run.smithi136.stdout:generic/247 9s 2023-06-23T20:20:33.423 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/247 2023-06-23T20:20:33.423 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:33.429 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:33.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:33.450 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-06-23T20:20:33.918 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:33.931 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:33.932 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:33.934 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:33.935 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:34.487 INFO:teuthology.orchestra.run.smithi136.stdout:generic/248 0s 2023-06-23T20:20:34.500 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/248 2023-06-23T20:20:34.500 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:34.506 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:34.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:34.560 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-06-23T20:20:35.021 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:35.033 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:35.034 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:35.037 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:35.037 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:35.912 INFO:teuthology.orchestra.run.smithi136.stdout:generic/249 0s 2023-06-23T20:20:35.925 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/249 2023-06-23T20:20:35.925 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:35.930 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:36.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:36.353 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-06-23T20:20:36.811 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:36.823 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:36.825 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:36.827 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:36.827 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:37.432 INFO:teuthology.orchestra.run.smithi136.stdout:generic/250 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:20:37.442 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/250 2023-06-23T20:20:37.442 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/250 2023-06-23T20:20:37.443 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:37.448 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:37.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:37.486 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-06-23T20:20:37.944 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:37.956 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:37.957 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:37.960 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:38.641 INFO:teuthology.orchestra.run.smithi136.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:38.668 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/251 2023-06-23T20:20:38.669 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/251 2023-06-23T20:20:38.669 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:38.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:38.713 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-06-23T20:20:39.171 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:39.184 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:39.184 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:39.187 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:39.187 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:39.714 INFO:teuthology.orchestra.run.smithi136.stdout:generic/252 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:20:39.724 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/252 2023-06-23T20:20:39.725 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/252 2023-06-23T20:20:39.725 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:39.730 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:39.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:39.769 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-06-23T20:20:40.221 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:40.234 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:40.235 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:40.237 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:40.238 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:41.167 INFO:teuthology.orchestra.run.smithi136.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:20:41.227 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/253 2023-06-23T20:20:41.227 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/253 2023-06-23T20:20:41.228 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:41.303 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:41.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:41.399 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-06-23T20:20:41.850 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:41.863 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:41.864 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:41.866 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:41.867 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:42.806 INFO:teuthology.orchestra.run.smithi136.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:20:42.967 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/254 2023-06-23T20:20:42.971 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/254 2023-06-23T20:20:42.971 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:42.987 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:43.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:43.039 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-06-23T20:20:43.502 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:43.514 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:43.515 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:43.518 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:43.518 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:44.235 INFO:teuthology.orchestra.run.smithi136.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:20:44.245 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/255 2023-06-23T20:20:44.245 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/255 2023-06-23T20:20:44.245 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:44.251 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:44.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:44.555 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-06-23T20:20:45.131 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:45.143 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:45.144 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:45.147 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:45.147 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:46.112 INFO:teuthology.orchestra.run.smithi136.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:20:46.122 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/256 2023-06-23T20:20:46.122 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/256 2023-06-23T20:20:46.122 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:46.128 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:46.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:46.174 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-06-23T20:20:46.634 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:46.647 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:46.648 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:46.651 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:46.651 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:47.857 INFO:teuthology.orchestra.run.smithi136.stdout:generic/257 1s 2023-06-23T20:20:47.870 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/257 2023-06-23T20:20:47.870 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:47.876 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:48.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:48.188 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-06-23T20:20:48.678 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:48.690 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:48.692 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:48.694 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:48.694 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:49.313 INFO:teuthology.orchestra.run.smithi136.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-06-23T20:20:49.323 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/258 2023-06-23T20:20:49.323 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/258 2023-06-23T20:20:49.323 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:49.329 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:49.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:49.381 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-06-23T20:20:49.833 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:49.846 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:49.847 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:49.849 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:49.849 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:50.870 INFO:teuthology.orchestra.run.smithi136.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:20:50.891 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/259 2023-06-23T20:20:50.892 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/259 2023-06-23T20:20:50.892 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:50.906 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:51.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:51.007 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-06-23T20:20:51.456 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:51.469 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:51.469 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:51.472 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:51.472 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:52.162 INFO:teuthology.orchestra.run.smithi136.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:52.191 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/260 2023-06-23T20:20:52.192 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/260 2023-06-23T20:20:52.192 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:52.198 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:52.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:52.245 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-06-23T20:20:52.706 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:52.719 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:52.720 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:52.723 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:53.776 INFO:teuthology.orchestra.run.smithi136.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:20:53.802 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/261 2023-06-23T20:20:53.803 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/261 2023-06-23T20:20:53.803 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:53.816 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:53.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:53.889 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-06-23T20:20:54.346 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:54.359 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:54.360 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:54.362 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:54.363 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:54.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:54.440 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:55.493 INFO:teuthology.orchestra.run.smithi136.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:20:55.508 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/262 2023-06-23T20:20:55.508 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/262 2023-06-23T20:20:55.509 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:20:55.516 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:20:55.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:20:55.559 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-06-23T20:20:56.047 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:20:56.060 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:20:56.061 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:20:56.064 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:20:56.064 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:24.582 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:24.588 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:36.997 INFO:teuthology.orchestra.run.smithi136.stdout:generic/263 40s 2023-06-23T20:21:37.011 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/263 2023-06-23T20:21:37.011 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:37.016 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:37.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:37.358 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-06-23T20:21:37.867 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:37.879 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:37.880 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:37.883 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:38.892 INFO:teuthology.orchestra.run.smithi136.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:21:38.911 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/264 2023-06-23T20:21:38.912 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/264 2023-06-23T20:21:38.912 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:38.927 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:39.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:39.022 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-06-23T20:21:39.473 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:39.485 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:39.486 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:39.489 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:39.489 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:40.518 INFO:teuthology.orchestra.run.smithi136.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:21:40.554 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/265 2023-06-23T20:21:40.554 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/265 2023-06-23T20:21:40.554 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:40.572 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:40.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:40.663 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-06-23T20:21:41.118 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:41.129 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:41.130 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:41.133 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:41.133 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:42.253 INFO:teuthology.orchestra.run.smithi136.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:21:42.270 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/266 2023-06-23T20:21:42.270 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/266 2023-06-23T20:21:42.270 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:42.277 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:42.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:42.319 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-06-23T20:21:42.768 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:42.780 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:42.781 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:42.784 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:42.784 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:43.910 INFO:teuthology.orchestra.run.smithi136.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:21:43.928 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/267 2023-06-23T20:21:43.929 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/267 2023-06-23T20:21:43.929 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:43.937 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:43.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:43.986 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-06-23T20:21:44.446 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:44.459 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:44.460 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:44.463 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:44.463 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:45.540 INFO:teuthology.orchestra.run.smithi136.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:21:45.559 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/268 2023-06-23T20:21:45.559 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/268 2023-06-23T20:21:45.559 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:45.571 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:45.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:45.645 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-06-23T20:21:46.104 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:46.116 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:46.117 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:46.120 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:46.120 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:46.625 INFO:teuthology.orchestra.run.smithi136.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:21:46.635 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/269 2023-06-23T20:21:46.635 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/269 2023-06-23T20:21:46.635 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:46.641 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:46.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:46.681 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-06-23T20:21:47.142 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:47.156 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:47.156 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:47.158 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:47.661 INFO:teuthology.orchestra.run.smithi136.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:21:47.671 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/270 2023-06-23T20:21:47.671 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/270 2023-06-23T20:21:47.671 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:47.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:47.714 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-06-23T20:21:48.167 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:48.179 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:48.180 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:48.183 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:48.183 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:49.283 INFO:teuthology.orchestra.run.smithi136.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:21:49.299 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/271 2023-06-23T20:21:49.299 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/271 2023-06-23T20:21:49.299 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:49.307 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:49.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:49.358 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-06-23T20:21:49.810 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:49.823 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:49.824 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:49.826 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:49.827 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:50.927 INFO:teuthology.orchestra.run.smithi136.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:21:50.947 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/272 2023-06-23T20:21:50.947 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/272 2023-06-23T20:21:50.948 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:50.957 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:51.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:51.009 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-06-23T20:21:51.462 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:51.475 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:51.476 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:51.478 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:51.478 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:52.010 INFO:teuthology.orchestra.run.smithi136.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:21:52.019 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/273 2023-06-23T20:21:52.020 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/273 2023-06-23T20:21:52.020 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:52.025 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:52.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:52.068 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-06-23T20:21:52.527 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:52.539 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:52.541 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:52.543 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:52.543 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:53.073 INFO:teuthology.orchestra.run.smithi136.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-23T20:21:53.083 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/274 2023-06-23T20:21:53.083 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/274 2023-06-23T20:21:53.083 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:53.089 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:53.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:53.140 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-06-23T20:21:53.595 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:53.607 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:53.608 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:53.611 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:53.611 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:54.137 INFO:teuthology.orchestra.run.smithi136.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:21:54.147 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/275 2023-06-23T20:21:54.147 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/275 2023-06-23T20:21:54.147 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:54.153 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:54.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:54.198 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-06-23T20:21:54.650 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:54.663 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:54.664 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:54.666 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:54.666 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:54.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:54.735 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:55.788 INFO:teuthology.orchestra.run.smithi136.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:21:55.802 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/276 2023-06-23T20:21:55.803 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/276 2023-06-23T20:21:55.803 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:55.810 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:55.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:55.856 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-06-23T20:21:56.359 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:56.371 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:56.372 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:56.375 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:56.375 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:56.940 INFO:teuthology.orchestra.run.smithi136.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-06-23T20:21:56.951 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/277 2023-06-23T20:21:56.951 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/277 2023-06-23T20:21:56.952 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:56.957 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:57.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:57.003 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-06-23T20:21:57.454 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:57.466 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:57.467 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:57.470 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:57.470 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:58.419 INFO:teuthology.orchestra.run.smithi136.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:21:58.525 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/278 2023-06-23T20:21:58.525 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/278 2023-06-23T20:21:58.525 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:21:58.547 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:21:58.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:21:58.645 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-06-23T20:21:59.101 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:21:59.114 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:21:59.115 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:21:59.118 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:21:59.118 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:00.227 INFO:teuthology.orchestra.run.smithi136.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:00.244 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/279 2023-06-23T20:22:00.244 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/279 2023-06-23T20:22:00.244 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:00.252 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:00.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:00.312 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-06-23T20:22:00.770 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:00.783 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:00.784 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:00.786 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:00.786 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:01.336 INFO:teuthology.orchestra.run.smithi136.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:22:01.346 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/280 2023-06-23T20:22:01.346 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/280 2023-06-23T20:22:01.346 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:01.352 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:01.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:01.393 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-06-23T20:22:01.852 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:01.864 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:01.865 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:01.868 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:01.868 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:02.987 INFO:teuthology.orchestra.run.smithi136.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:03.006 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/281 2023-06-23T20:22:03.006 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/281 2023-06-23T20:22:03.006 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:03.019 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:03.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:03.064 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-06-23T20:22:03.517 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:03.529 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:03.530 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:03.533 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:03.533 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:04.664 INFO:teuthology.orchestra.run.smithi136.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:04.680 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/282 2023-06-23T20:22:04.681 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/282 2023-06-23T20:22:04.681 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:04.687 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:04.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:04.731 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-06-23T20:22:05.183 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:05.196 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:05.197 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:05.200 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:05.200 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:06.229 INFO:teuthology.orchestra.run.smithi136.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:06.254 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/283 2023-06-23T20:22:06.255 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/283 2023-06-23T20:22:06.255 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:06.308 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:06.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:06.379 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-06-23T20:22:06.825 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:06.838 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:06.839 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:06.842 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:06.842 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:07.908 INFO:teuthology.orchestra.run.smithi136.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:07.948 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/284 2023-06-23T20:22:07.948 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/284 2023-06-23T20:22:07.948 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:07.959 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:08.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:08.039 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-06-23T20:22:08.493 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:08.506 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:08.507 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:08.509 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:08.509 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:10.409 INFO:teuthology.orchestra.run.smithi136.stdout:generic/285 2s 2023-06-23T20:22:10.422 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/285 2023-06-23T20:22:10.422 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:10.428 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:11.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:11.168 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-06-23T20:22:11.892 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:11.911 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:11.913 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:11.918 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:11.918 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:12.719 INFO:teuthology.orchestra.run.smithi136.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:22:12.735 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/286 2023-06-23T20:22:12.735 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/286 2023-06-23T20:22:12.735 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:12.744 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:12.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:12.801 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-06-23T20:22:13.489 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:13.507 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:13.509 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:13.512 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:13.512 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:14.875 INFO:teuthology.orchestra.run.smithi136.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:14.932 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/287 2023-06-23T20:22:14.932 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/287 2023-06-23T20:22:14.933 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:14.971 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:15.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:15.054 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-06-23T20:22:15.767 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:15.790 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:15.792 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:15.795 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:16.504 INFO:teuthology.orchestra.run.smithi136.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:16.531 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/288 2023-06-23T20:22:16.532 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/288 2023-06-23T20:22:16.532 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:16.538 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:16.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:16.573 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-06-23T20:22:17.032 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:17.045 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:17.046 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:17.048 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:17.048 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:18.143 INFO:teuthology.orchestra.run.smithi136.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:18.168 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/289 2023-06-23T20:22:18.169 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/289 2023-06-23T20:22:18.169 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:18.176 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:18.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:18.220 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-06-23T20:22:18.672 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:18.684 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:18.686 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:18.688 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:18.688 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:19.546 INFO:teuthology.orchestra.run.smithi136.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:19.577 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/290 2023-06-23T20:22:19.577 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/290 2023-06-23T20:22:19.578 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:19.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:19.830 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-06-23T20:22:20.288 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:20.301 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:20.302 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:20.305 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:20.305 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:21.365 INFO:teuthology.orchestra.run.smithi136.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:21.384 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/291 2023-06-23T20:22:21.385 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/291 2023-06-23T20:22:21.385 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:21.432 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:21.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:21.484 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-06-23T20:22:21.935 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:21.948 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:21.949 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:21.951 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:21.952 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:23.043 INFO:teuthology.orchestra.run.smithi136.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:23.087 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/292 2023-06-23T20:22:23.088 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/292 2023-06-23T20:22:23.088 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:23.098 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:23.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:23.140 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-06-23T20:22:23.592 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:23.605 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:23.606 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:23.608 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:23.609 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:24.677 INFO:teuthology.orchestra.run.smithi136.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:24.702 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/293 2023-06-23T20:22:24.702 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/293 2023-06-23T20:22:24.702 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:24.720 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:24.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:24.771 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-06-23T20:22:24.876 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:22:24.881 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:22:25.221 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:25.234 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:25.235 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:25.237 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:25.238 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:26.495 INFO:teuthology.orchestra.run.smithi136.stdout:generic/294 1s 2023-06-23T20:22:26.510 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/294 2023-06-23T20:22:26.510 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:26.515 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:26.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:26.537 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-06-23T20:22:26.985 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:26.999 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:27.000 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:27.002 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:27.002 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:27.944 INFO:teuthology.orchestra.run.smithi136.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:27.963 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/295 2023-06-23T20:22:27.963 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/295 2023-06-23T20:22:27.963 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:27.978 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:28.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:28.163 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-06-23T20:22:28.619 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:28.631 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:28.632 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:28.635 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:28.635 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:29.679 INFO:teuthology.orchestra.run.smithi136.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:29.713 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/296 2023-06-23T20:22:29.713 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/296 2023-06-23T20:22:29.713 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:29.746 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:29.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:29.800 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-06-23T20:22:30.257 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:30.270 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:30.271 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:30.274 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:30.274 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:31.239 INFO:teuthology.orchestra.run.smithi136.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:31.297 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/297 2023-06-23T20:22:31.298 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/297 2023-06-23T20:22:31.298 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:31.320 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:31.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:31.427 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-06-23T20:22:31.879 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:31.892 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:31.892 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:31.895 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:32.926 INFO:teuthology.orchestra.run.smithi136.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:32.990 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/298 2023-06-23T20:22:32.991 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/298 2023-06-23T20:22:32.991 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:33.016 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:33.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:33.071 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-06-23T20:22:33.528 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:33.540 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:33.542 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:33.544 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:33.544 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:34.139 INFO:teuthology.orchestra.run.smithi136.stdout:generic/299 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:22:34.149 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/299 2023-06-23T20:22:34.150 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/299 2023-06-23T20:22:34.150 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:34.155 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:34.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:34.206 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-06-23T20:22:34.659 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:34.672 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:34.673 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:34.675 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:34.676 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:35.256 INFO:teuthology.orchestra.run.smithi136.stdout:generic/300 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:22:35.265 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/300 2023-06-23T20:22:35.266 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/300 2023-06-23T20:22:35.266 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:35.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:35.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:35.317 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-06-23T20:22:35.766 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:35.778 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:35.779 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:35.782 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:35.782 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:36.831 INFO:teuthology.orchestra.run.smithi136.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:36.856 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/301 2023-06-23T20:22:36.857 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/301 2023-06-23T20:22:36.857 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:36.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:36.933 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-06-23T20:22:37.390 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:37.403 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:37.404 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:37.406 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:37.407 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:38.457 INFO:teuthology.orchestra.run.smithi136.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:38.523 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/302 2023-06-23T20:22:38.523 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/302 2023-06-23T20:22:38.523 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:38.530 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:38.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:38.577 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-06-23T20:22:39.035 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:39.048 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:39.049 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:39.051 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:39.052 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:39.638 INFO:teuthology.orchestra.run.smithi136.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:22:39.647 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/303 2023-06-23T20:22:39.648 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/303 2023-06-23T20:22:39.648 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:39.653 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:40.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:40.050 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-06-23T20:22:40.520 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:40.533 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:40.534 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:40.537 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:40.537 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:41.111 INFO:teuthology.orchestra.run.smithi136.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T20:22:41.121 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/304 2023-06-23T20:22:41.121 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/304 2023-06-23T20:22:41.122 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:41.127 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:41.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:41.515 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-06-23T20:22:41.988 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:42.000 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:42.002 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:42.004 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:42.004 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:43.005 INFO:teuthology.orchestra.run.smithi136.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:22:43.024 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/305 2023-06-23T20:22:43.024 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/305 2023-06-23T20:22:43.024 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:43.046 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:43.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:43.144 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-06-23T20:22:43.596 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:43.609 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:43.610 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:43.613 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:43.613 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:44.896 INFO:teuthology.orchestra.run.smithi136.stdout:generic/306 1s 2023-06-23T20:22:44.924 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/306 2023-06-23T20:22:44.925 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:44.932 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:45.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:45.342 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-06-23T20:22:45.801 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:45.814 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:45.815 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:45.817 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:45.817 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:47.883 INFO:teuthology.orchestra.run.smithi136.stdout:generic/307 1s 2023-06-23T20:22:47.895 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/307 2023-06-23T20:22:47.896 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:47.901 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:47.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:47.923 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-06-23T20:22:48.377 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:48.389 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:48.390 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:48.393 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:48.393 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:48.977 INFO:teuthology.orchestra.run.smithi136.stdout:generic/308 0s 2023-06-23T20:22:49.634 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/308 2023-06-23T20:22:49.634 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:49.641 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:49.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:49.686 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-06-23T20:22:50.141 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:50.153 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:50.154 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:50.157 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:50.157 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:51.769 INFO:teuthology.orchestra.run.smithi136.stdout:generic/309 1s 2023-06-23T20:22:51.782 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/309 2023-06-23T20:22:51.782 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:22:51.788 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:52.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:22:52.193 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-06-23T20:22:52.650 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:22:52.662 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:22:52.664 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:22:52.666 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:22:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:22:55.014 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:22:55.019 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:25.129 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:25.133 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:55.257 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:55.262 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:10.687 INFO:teuthology.orchestra.run.smithi136.stdout:generic/310 78s 2023-06-23T20:24:10.700 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/310 2023-06-23T20:24:10.700 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:10.706 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:11.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:11.087 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-06-23T20:24:11.733 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:11.745 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:11.746 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:11.749 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:11.749 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:12.328 INFO:teuthology.orchestra.run.smithi136.stdout:generic/311 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:24:12.338 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/311 2023-06-23T20:24:12.338 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/311 2023-06-23T20:24:12.338 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:12.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:12.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:12.389 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-06-23T20:24:12.843 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:12.855 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:12.856 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:12.859 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:12.859 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:13.378 INFO:teuthology.orchestra.run.smithi136.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:24:13.388 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/312 2023-06-23T20:24:13.388 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/312 2023-06-23T20:24:13.388 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:13.394 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:13.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:13.444 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-06-23T20:24:13.898 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:13.911 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:13.912 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:13.914 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:13.915 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:18.491 INFO:teuthology.orchestra.run.smithi136.stdout:generic/313 4s 2023-06-23T20:24:18.505 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/313 2023-06-23T20:24:18.505 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:18.512 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:18.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:18.560 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-06-23T20:24:19.014 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:19.027 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:19.028 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:19.030 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:19.031 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:19.856 INFO:teuthology.orchestra.run.smithi136.stdout:generic/314 0s 2023-06-23T20:24:19.869 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/314 2023-06-23T20:24:19.869 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:19.875 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:19.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:19.921 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-06-23T20:24:20.377 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:20.389 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:20.390 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:20.393 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:20.393 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-23T20:24:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/315 2023-06-23T20:24:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/315 2023-06-23T20:24:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:20.935 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:20.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:20.977 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-06-23T20:24:21.431 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:21.443 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:21.444 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:21.447 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:21.447 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:22.158 INFO:teuthology.orchestra.run.smithi136.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-23T20:24:22.168 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/316 2023-06-23T20:24:22.169 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/316 2023-06-23T20:24:22.169 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:22.175 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:22.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:22.507 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-06-23T20:24:23.040 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:23.052 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:23.053 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:23.056 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:23.056 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:24.385 INFO:teuthology.orchestra.run.smithi136.stdout:generic/317 1s 2023-06-23T20:24:24.398 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/317 2023-06-23T20:24:24.398 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:24.405 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:24.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:24.426 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-06-23T20:24:24.880 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:24.893 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:24.894 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:24.896 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:24.897 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:25.578 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:25.583 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:26.252 INFO:teuthology.orchestra.run.smithi136.stdout:generic/318 1s 2023-06-23T20:24:26.264 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/318 2023-06-23T20:24:26.265 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:26.270 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:26.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:26.292 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-06-23T20:24:26.747 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:26.759 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:26.760 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:26.763 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:26.763 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:27.575 INFO:teuthology.orchestra.run.smithi136.stdout:generic/319 1s 2023-06-23T20:24:27.587 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/319 2023-06-23T20:24:27.588 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:27.593 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:27.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:27.615 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-06-23T20:24:28.074 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:28.086 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:28.087 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:28.090 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:28.090 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:28.611 INFO:teuthology.orchestra.run.smithi136.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:24:28.620 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/320 2023-06-23T20:24:28.621 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/320 2023-06-23T20:24:28.621 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:28.627 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:28.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:28.669 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-06-23T20:24:29.126 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:29.139 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:29.140 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:29.143 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:29.143 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:29.675 INFO:teuthology.orchestra.run.smithi136.stdout:generic/321 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:24:29.685 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/321 2023-06-23T20:24:29.685 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/321 2023-06-23T20:24:29.685 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:29.691 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:29.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:29.733 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-06-23T20:24:30.187 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:30.199 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:30.201 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:30.203 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:30.203 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:30.735 INFO:teuthology.orchestra.run.smithi136.stdout:generic/322 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:24:30.745 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/322 2023-06-23T20:24:30.745 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/322 2023-06-23T20:24:30.745 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:24:30.751 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:30.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:24:30.790 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-06-23T20:24:31.237 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:24:31.250 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:24:31.251 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:24:31.253 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:24:31.254 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:24:56.553 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:56.558 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:26.685 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:26.690 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:56.932 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:56.938 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:57.851 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T20:25:57.848+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140569) UID: 0 2023-06-23T20:25:57.852 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T20:25:57.848+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140569) UID: 0 2023-06-23T20:25:57.852 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T20:25:57.848+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140569) UID: 0 2023-06-23T20:25:57.853 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T20:25:57.848+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140569) UID: 0 2023-06-23T20:26:32.795 INFO:teuthology.orchestra.run.smithi136.stdout:generic/323 121s 2023-06-23T20:26:32.807 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/323 2023-06-23T20:26:32.807 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:32.813 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:33.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:33.148 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-06-23T20:26:33.679 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:33.691 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:33.693 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:33.695 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:33.696 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:34.197 INFO:teuthology.orchestra.run.smithi136.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-06-23T20:26:34.207 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/324 2023-06-23T20:26:34.207 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/324 2023-06-23T20:26:34.207 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:34.213 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:34.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:34.271 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-06-23T20:26:34.726 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:34.739 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:34.740 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:34.743 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:34.743 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:35.271 INFO:teuthology.orchestra.run.smithi136.stdout:generic/325 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:26:35.281 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/325 2023-06-23T20:26:35.281 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/325 2023-06-23T20:26:35.281 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:35.287 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:35.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:35.323 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-06-23T20:26:35.779 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:35.791 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:35.792 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:35.795 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:35.795 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:36.775 INFO:teuthology.orchestra.run.smithi136.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:26:36.902 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/326 2023-06-23T20:26:36.902 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/326 2023-06-23T20:26:36.902 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:36.920 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:36.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:36.982 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-06-23T20:26:37.432 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:37.444 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:37.445 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:37.448 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:37.449 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:38.510 INFO:teuthology.orchestra.run.smithi136.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:26:38.591 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/327 2023-06-23T20:26:38.591 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/327 2023-06-23T20:26:38.592 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:38.602 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:38.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:38.656 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-06-23T20:26:39.110 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:39.122 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:39.123 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:39.126 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:39.126 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:40.203 INFO:teuthology.orchestra.run.smithi136.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:26:40.239 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/328 2023-06-23T20:26:40.239 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/328 2023-06-23T20:26:40.239 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:40.258 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:40.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:40.309 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-06-23T20:26:40.763 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:40.775 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:40.777 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:40.779 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:40.779 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:41.901 INFO:teuthology.orchestra.run.smithi136.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:26:41.920 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/329 2023-06-23T20:26:41.921 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/329 2023-06-23T20:26:41.921 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:41.939 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:41.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:41.991 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-06-23T20:26:42.437 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:42.450 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:42.451 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:42.453 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:43.451 INFO:teuthology.orchestra.run.smithi136.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:26:43.502 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/330 2023-06-23T20:26:43.502 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/330 2023-06-23T20:26:43.502 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:43.515 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:43.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:43.701 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-06-23T20:26:44.166 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:44.179 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:44.180 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:44.182 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:44.182 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:45.157 INFO:teuthology.orchestra.run.smithi136.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:26:45.210 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/331 2023-06-23T20:26:45.210 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/331 2023-06-23T20:26:45.210 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:45.245 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:45.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:45.358 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-06-23T20:26:45.809 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:45.821 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:45.822 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:45.824 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:45.825 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:46.802 INFO:teuthology.orchestra.run.smithi136.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:26:46.870 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/332 2023-06-23T20:26:46.871 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/332 2023-06-23T20:26:46.871 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:46.935 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:46.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:46.990 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-06-23T20:26:47.444 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:47.456 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:47.457 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:47.460 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:47.460 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:48.486 INFO:teuthology.orchestra.run.smithi136.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:26:48.549 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/333 2023-06-23T20:26:48.550 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/333 2023-06-23T20:26:48.550 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:48.584 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:48.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:48.636 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-06-23T20:26:49.094 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:49.107 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:49.108 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:49.110 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:49.110 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:50.198 INFO:teuthology.orchestra.run.smithi136.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:26:50.222 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/334 2023-06-23T20:26:50.222 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/334 2023-06-23T20:26:50.222 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:50.237 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:50.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:50.293 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-06-23T20:26:50.748 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:50.761 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:50.762 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:50.764 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:50.765 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:51.305 INFO:teuthology.orchestra.run.smithi136.stdout:generic/335 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:26:51.314 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/335 2023-06-23T20:26:51.314 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/335 2023-06-23T20:26:51.314 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:51.324 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:51.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:51.363 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-06-23T20:26:51.811 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:51.824 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:51.825 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:51.828 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:51.828 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:52.386 INFO:teuthology.orchestra.run.smithi136.stdout:generic/336 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:26:52.396 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/336 2023-06-23T20:26:52.396 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/336 2023-06-23T20:26:52.397 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:52.403 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:52.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:52.450 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-06-23T20:26:52.900 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:52.913 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:52.913 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:52.916 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:52.916 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:53.736 INFO:teuthology.orchestra.run.smithi136.stdout:generic/337 0s 2023-06-23T20:26:53.749 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/337 2023-06-23T20:26:53.749 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:53.755 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:53.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:53.776 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-06-23T20:26:54.232 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:54.244 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:54.245 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:54.248 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:54.248 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:54.790 INFO:teuthology.orchestra.run.smithi136.stdout:generic/338 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:26:54.800 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/338 2023-06-23T20:26:54.800 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/338 2023-06-23T20:26:54.801 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:26:54.806 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:26:54.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:26:54.845 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-06-23T20:26:55.296 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:26:55.308 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:26:55.309 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:26:55.312 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:26:55.312 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:27:56.876 INFO:teuthology.orchestra.run.smithi136.stdout:generic/339 61s 2023-06-23T20:27:56.888 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/339 2023-06-23T20:27:56.889 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:27:56.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:27:56.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:27:56.916 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-06-23T20:27:57.639 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:27:57.652 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:27:57.653 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:27:57.655 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:27:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:02.987 INFO:teuthology.orchestra.run.smithi136.stdout:generic/340 5s 2023-06-23T20:28:03.095 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/340 2023-06-23T20:28:03.096 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:03.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:03.124 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-06-23T20:28:03.818 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:03.831 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:03.832 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:03.835 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:03.835 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:04.388 INFO:teuthology.orchestra.run.smithi136.stdout:generic/341 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:28:04.398 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/341 2023-06-23T20:28:04.398 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/341 2023-06-23T20:28:04.399 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:04.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:04.456 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-06-23T20:28:04.916 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:04.928 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:04.929 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:04.932 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:04.932 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:generic/342 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:28:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/342 2023-06-23T20:28:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/342 2023-06-23T20:28:05.487 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:05.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:05.530 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-06-23T20:28:05.981 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:05.994 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:05.995 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:05.997 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:05.998 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:06.564 INFO:teuthology.orchestra.run.smithi136.stdout:generic/343 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:28:06.573 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/343 2023-06-23T20:28:06.574 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/343 2023-06-23T20:28:06.574 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:06.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:06.625 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-06-23T20:28:07.085 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:07.097 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:07.098 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:07.101 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:07.101 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:16.966 INFO:teuthology.orchestra.run.smithi136.stdout:generic/344 9s 2023-06-23T20:28:16.980 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/344 2023-06-23T20:28:16.981 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:16.986 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:17.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:17.007 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-06-23T20:28:17.708 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:17.750 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:17.752 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:17.756 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:17.756 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:28.801 INFO:teuthology.orchestra.run.smithi136.stdout:generic/345 10s 2023-06-23T20:28:28.847 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/345 2023-06-23T20:28:28.847 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:28.853 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:28.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:28.874 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-06-23T20:28:29.493 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:29.511 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:29.512 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:29.516 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:29.516 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:34.997 INFO:teuthology.orchestra.run.smithi136.stdout:generic/346 5s 2023-06-23T20:28:35.014 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/346 2023-06-23T20:28:35.014 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:35.020 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:35.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:35.041 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-06-23T20:28:35.753 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:35.774 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:35.775 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:35.777 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:35.777 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:36.374 INFO:teuthology.orchestra.run.smithi136.stdout:generic/347 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:28:36.384 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/347 2023-06-23T20:28:36.384 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/347 2023-06-23T20:28:36.384 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:36.390 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:36.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:36.436 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-06-23T20:28:36.891 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:36.903 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:36.904 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:36.907 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:36.907 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:37.481 INFO:teuthology.orchestra.run.smithi136.stdout:generic/348 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:28:37.491 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/348 2023-06-23T20:28:37.491 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/348 2023-06-23T20:28:37.492 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:37.497 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:37.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:37.544 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-06-23T20:28:37.998 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:38.010 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:38.011 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:38.013 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:38.014 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:38.715 INFO:teuthology.orchestra.run.smithi136.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-23T20:28:38.725 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/349 2023-06-23T20:28:38.725 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/349 2023-06-23T20:28:38.725 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:38.731 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:38.740 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:28:38.745 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:28:38.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:38.782 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-06-23T20:28:38.931 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T20:28:38.928+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 140795) UID: 0 2023-06-23T20:28:38.931 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T20:28:38.928+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 140795) UID: 0 2023-06-23T20:28:39.287 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:39.300 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:39.301 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:39.303 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:39.304 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:40.584 INFO:teuthology.orchestra.run.smithi136.stdout:generic/350 1s 2023-06-23T20:28:40.596 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/350 2023-06-23T20:28:40.597 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:40.602 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:40.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:40.624 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-06-23T20:28:41.083 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:41.096 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:41.097 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:41.099 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:41.100 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:41.643 INFO:teuthology.orchestra.run.smithi136.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:28:41.653 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/351 2023-06-23T20:28:41.653 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/351 2023-06-23T20:28:41.653 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:41.659 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:41.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:41.708 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-06-23T20:28:42.167 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:42.179 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:42.180 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:42.183 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:42.183 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:43.200 INFO:teuthology.orchestra.run.smithi136.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:28:43.305 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/352 2023-06-23T20:28:43.305 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/352 2023-06-23T20:28:43.305 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:43.316 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:43.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:43.370 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-06-23T20:28:43.824 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:43.836 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:43.838 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:43.840 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:43.840 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:44.913 INFO:teuthology.orchestra.run.smithi136.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:28:45.008 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/353 2023-06-23T20:28:45.008 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/353 2023-06-23T20:28:45.009 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:45.016 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:45.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:45.069 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-06-23T20:28:45.522 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:45.535 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:45.536 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:45.538 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:45.539 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:55.860 INFO:teuthology.orchestra.run.smithi136.stdout:generic/354 10s 2023-06-23T20:28:55.876 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/354 2023-06-23T20:28:55.877 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:55.882 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:55.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:55.905 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-06-23T20:28:56.492 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:56.507 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:56.509 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:56.513 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:56.513 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:57.735 INFO:teuthology.orchestra.run.smithi136.stdout:generic/355 1s 2023-06-23T20:28:57.747 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/355 2023-06-23T20:28:57.748 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:57.753 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:58.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:58.133 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-06-23T20:28:58.618 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:58.631 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:58.632 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:58.635 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:58.635 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:59.422 INFO:teuthology.orchestra.run.smithi136.stdout:generic/356 [not run] swapfiles are not supported 2023-06-23T20:28:59.431 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/356 2023-06-23T20:28:59.432 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/356 2023-06-23T20:28:59.432 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:28:59.437 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:28:59.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:28:59.479 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-06-23T20:28:59.937 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:28:59.950 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:28:59.951 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:28:59.954 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:28:59.954 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:00.739 INFO:teuthology.orchestra.run.smithi136.stdout:generic/357 [not run] swapfiles are not supported 2023-06-23T20:29:00.750 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/357 2023-06-23T20:29:00.750 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/357 2023-06-23T20:29:00.750 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:00.756 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:00.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:00.800 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-06-23T20:29:01.255 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:01.268 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:01.269 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:01.272 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:01.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:02.199 INFO:teuthology.orchestra.run.smithi136.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:29:02.258 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/358 2023-06-23T20:29:02.259 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/358 2023-06-23T20:29:02.259 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:02.300 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:02.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:02.435 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-06-23T20:29:02.887 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:02.900 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:02.901 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:02.903 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:03.962 INFO:teuthology.orchestra.run.smithi136.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:29:04.014 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/359 2023-06-23T20:29:04.014 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/359 2023-06-23T20:29:04.014 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:04.040 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:04.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:04.100 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-06-23T20:29:04.551 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:04.564 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:04.565 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:04.567 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:05.216 INFO:teuthology.orchestra.run.smithi136.stdout:generic/360 1s 2023-06-23T20:29:05.229 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/360 2023-06-23T20:29:05.229 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:05.235 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:05.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:05.286 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-06-23T20:29:05.738 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:05.751 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:05.752 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:05.755 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:05.755 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:06.276 INFO:teuthology.orchestra.run.smithi136.stdout:generic/361 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:29:06.286 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/361 2023-06-23T20:29:06.287 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/361 2023-06-23T20:29:06.287 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:06.292 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:06.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:06.336 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-06-23T20:29:06.791 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:06.804 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:06.805 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:06.808 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:06.808 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:07.319 INFO:teuthology.orchestra.run.smithi136.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-23T20:29:07.329 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/362 2023-06-23T20:29:07.330 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/362 2023-06-23T20:29:07.330 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:07.336 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:07.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:07.374 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-06-23T20:29:07.834 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:07.847 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:07.848 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:07.850 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:07.850 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:08.363 INFO:teuthology.orchestra.run.smithi136.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-23T20:29:08.373 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/363 2023-06-23T20:29:08.374 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/363 2023-06-23T20:29:08.374 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:08.379 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:08.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:08.424 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-06-23T20:29:08.880 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:08.893 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:08.894 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:08.896 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:08.896 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:09.399 INFO:teuthology.orchestra.run.smithi136.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-23T20:29:09.409 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/364 2023-06-23T20:29:09.409 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/364 2023-06-23T20:29:09.410 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:09.415 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:09.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:09.455 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-06-23T20:29:09.908 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:09.921 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:09.922 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:09.925 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:09.925 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:10.436 INFO:teuthology.orchestra.run.smithi136.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-23T20:29:10.445 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/365 2023-06-23T20:29:10.446 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/365 2023-06-23T20:29:10.446 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:10.452 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:10.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:10.488 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-06-23T20:29:10.939 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:10.952 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:10.953 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:10.955 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:10.956 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:11.464 INFO:teuthology.orchestra.run.smithi136.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-23T20:29:11.474 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/366 2023-06-23T20:29:11.474 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/366 2023-06-23T20:29:11.474 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:11.480 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:11.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:11.519 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-06-23T20:29:11.971 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:11.984 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:11.985 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:11.988 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:11.988 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:12.506 INFO:teuthology.orchestra.run.smithi136.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-23T20:29:12.516 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/367 2023-06-23T20:29:12.517 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/367 2023-06-23T20:29:12.517 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:12.522 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:12.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:12.565 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-06-23T20:29:13.023 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:13.036 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:13.037 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:13.039 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:13.039 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:13.553 INFO:teuthology.orchestra.run.smithi136.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-23T20:29:13.563 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/368 2023-06-23T20:29:13.563 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/368 2023-06-23T20:29:13.564 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:13.569 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:13.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:13.608 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-06-23T20:29:14.071 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:14.083 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:14.084 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:14.087 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:14.087 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:14.598 INFO:teuthology.orchestra.run.smithi136.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-23T20:29:14.608 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/369 2023-06-23T20:29:14.608 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/369 2023-06-23T20:29:14.608 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:14.614 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:14.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:14.654 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-06-23T20:29:15.109 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:15.121 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:15.122 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:15.125 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:15.640 INFO:teuthology.orchestra.run.smithi136.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-23T20:29:15.649 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/370 2023-06-23T20:29:15.650 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/370 2023-06-23T20:29:15.650 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:15.655 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:15.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:15.697 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-06-23T20:29:16.147 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:16.160 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:16.161 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:16.163 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:16.164 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:16.704 INFO:teuthology.orchestra.run.smithi136.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:29:16.714 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/371 2023-06-23T20:29:16.714 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/371 2023-06-23T20:29:16.715 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:16.720 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:16.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:16.765 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-06-23T20:29:17.224 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:17.237 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:17.238 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:17.240 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:17.241 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:18.285 INFO:teuthology.orchestra.run.smithi136.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:29:18.349 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/372 2023-06-23T20:29:18.350 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/372 2023-06-23T20:29:18.350 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:18.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:18.439 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-06-23T20:29:18.894 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:18.906 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:18.907 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:18.910 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:19.894 INFO:teuthology.orchestra.run.smithi136.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:29:19.926 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/373 2023-06-23T20:29:19.926 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/373 2023-06-23T20:29:19.926 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:20.047 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:20.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:20.104 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-06-23T20:29:20.557 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:20.569 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:20.570 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:20.573 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:20.573 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:21.322 INFO:teuthology.orchestra.run.smithi136.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-23T20:29:21.555 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/374 2023-06-23T20:29:21.555 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/374 2023-06-23T20:29:21.555 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:21.648 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:21.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:21.780 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-06-23T20:29:22.236 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:22.248 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:22.249 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:22.252 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:22.252 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:22.931 INFO:teuthology.orchestra.run.smithi136.stdout:generic/375 0s 2023-06-23T20:29:22.944 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/375 2023-06-23T20:29:22.944 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:22.950 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:23.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:23.138 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-06-23T20:29:23.813 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:23.825 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:23.826 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:23.829 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:23.829 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:24.372 INFO:teuthology.orchestra.run.smithi136.stdout:generic/376 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:29:24.382 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/376 2023-06-23T20:29:24.382 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/376 2023-06-23T20:29:24.383 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:24.388 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:24.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:24.425 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-06-23T20:29:24.880 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:24.893 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:24.894 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:24.896 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:24.897 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:25.723 INFO:teuthology.orchestra.run.smithi136.stdout:generic/377 0s 2023-06-23T20:29:25.736 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/377 2023-06-23T20:29:25.736 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:25.741 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:25.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:25.763 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-06-23T20:29:26.222 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:26.235 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:26.236 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:26.239 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:26.239 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:27.119 INFO:teuthology.orchestra.run.smithi136.stdout:generic/378 1s 2023-06-23T20:29:27.132 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/378 2023-06-23T20:29:27.132 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:27.138 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:27.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:27.522 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-06-23T20:29:28.012 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:28.025 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:28.026 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:28.028 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:28.029 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:28.561 INFO:teuthology.orchestra.run.smithi136.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:29:28.570 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/379 2023-06-23T20:29:28.571 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/379 2023-06-23T20:29:28.571 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:28.576 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:28.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:28.614 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-06-23T20:29:29.072 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:29.085 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:29.086 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:29.088 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:29.089 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:29.617 INFO:teuthology.orchestra.run.smithi136.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:29:29.627 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/380 2023-06-23T20:29:29.628 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/380 2023-06-23T20:29:29.628 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:29.633 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:29.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:29.675 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-06-23T20:29:30.136 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:30.149 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:30.150 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:30.152 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:30.152 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:30.667 INFO:teuthology.orchestra.run.smithi136.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:29:30.677 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/381 2023-06-23T20:29:30.677 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/381 2023-06-23T20:29:30.677 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:30.684 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:30.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:30.726 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-06-23T20:29:31.179 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:31.192 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:31.193 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:31.196 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:31.197 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:31.716 INFO:teuthology.orchestra.run.smithi136.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:29:31.727 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/382 2023-06-23T20:29:31.728 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/382 2023-06-23T20:29:31.728 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:31.733 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:31.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:31.774 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-06-23T20:29:32.226 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:32.239 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:32.240 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:32.243 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:32.243 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:32.752 INFO:teuthology.orchestra.run.smithi136.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:29:32.761 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/383 2023-06-23T20:29:32.762 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/383 2023-06-23T20:29:32.762 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:32.767 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:32.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:32.806 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-06-23T20:29:33.272 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:33.285 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:33.286 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:33.289 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:33.813 INFO:teuthology.orchestra.run.smithi136.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:29:33.823 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/384 2023-06-23T20:29:33.823 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/384 2023-06-23T20:29:33.823 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:33.829 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:33.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:33.870 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-06-23T20:29:34.332 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:34.345 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:34.346 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:34.349 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:34.349 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:34.861 INFO:teuthology.orchestra.run.smithi136.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:29:34.871 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/385 2023-06-23T20:29:34.872 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/385 2023-06-23T20:29:34.872 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:34.877 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:34.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:34.920 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-06-23T20:29:35.373 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:35.385 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:35.386 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:35.389 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:35.389 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:35.900 INFO:teuthology.orchestra.run.smithi136.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:29:35.912 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/386 2023-06-23T20:29:35.912 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/386 2023-06-23T20:29:35.913 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:35.919 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:35.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:35.964 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-06-23T20:29:36.420 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:36.433 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:36.434 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:36.436 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:36.436 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:37.446 INFO:teuthology.orchestra.run.smithi136.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:29:37.497 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/387 2023-06-23T20:29:37.498 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/387 2023-06-23T20:29:37.498 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:37.561 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:37.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:37.626 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-06-23T20:29:38.078 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:38.091 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:38.092 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:38.094 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:38.095 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:38.665 INFO:teuthology.orchestra.run.smithi136.stdout:generic/388 [not run] require 172.21.15.136:6789:/scratch to be local device 2023-06-23T20:29:38.675 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/388 2023-06-23T20:29:38.675 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/388 2023-06-23T20:29:38.676 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:38.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:38.721 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-06-23T20:29:39.180 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:39.193 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:39.194 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:39.196 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:39.196 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:39.720 INFO:teuthology.orchestra.run.smithi136.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-06-23T20:29:39.730 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/389 2023-06-23T20:29:39.730 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/389 2023-06-23T20:29:39.730 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:39.736 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:39.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:39.775 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-06-23T20:29:40.228 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:40.241 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:40.242 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:40.244 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:40.245 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:40.788 INFO:teuthology.orchestra.run.smithi136.stdout:generic/390 [not run] ceph does not support freezing 2023-06-23T20:29:40.798 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/390 2023-06-23T20:29:40.798 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/390 2023-06-23T20:29:40.799 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:40.804 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:40.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:40.845 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-06-23T20:29:41.302 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:41.315 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:41.316 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:41.318 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:41.318 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:41.861 INFO:teuthology.orchestra.run.smithi136.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:29:41.871 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/391 2023-06-23T20:29:41.871 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/391 2023-06-23T20:29:41.871 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:41.877 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:41.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:41.928 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-06-23T20:29:42.387 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:42.400 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:42.401 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:42.403 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:43.081 INFO:teuthology.orchestra.run.smithi136.stdout:generic/392 [not run] ceph does not support shutdown 2023-06-23T20:29:43.108 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/392 2023-06-23T20:29:43.109 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/392 2023-06-23T20:29:43.109 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:43.114 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:43.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:43.159 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-06-23T20:29:43.611 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:43.624 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:43.625 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:43.627 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:43.627 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:45.003 INFO:teuthology.orchestra.run.smithi136.stdout:generic/393 1s 2023-06-23T20:29:45.016 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/393 2023-06-23T20:29:45.016 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:45.022 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:45.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:45.045 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-06-23T20:29:45.502 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:45.514 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:45.515 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:45.518 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:45.518 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:46.104 INFO:teuthology.orchestra.run.smithi136.stdout:generic/394 1s 2023-06-23T20:29:46.117 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/394 2023-06-23T20:29:46.117 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:46.123 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:46.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:46.544 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-06-23T20:29:47.239 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:47.257 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:47.258 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:47.261 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:47.261 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:49.425 INFO:teuthology.orchestra.run.smithi136.stdout:generic/395 2s 2023-06-23T20:29:49.476 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/395 2023-06-23T20:29:49.477 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:49.484 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:49.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:49.508 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-06-23T20:29:49.962 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:49.975 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:49.976 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:49.979 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:49.979 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:51.221 INFO:teuthology.orchestra.run.smithi136.stdout:generic/396 1s 2023-06-23T20:29:51.234 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/396 2023-06-23T20:29:51.234 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:51.240 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:51.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:51.261 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-06-23T20:29:51.717 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:51.730 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:51.731 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:51.733 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:51.733 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:53.938 INFO:teuthology.orchestra.run.smithi136.stdout:generic/397 2s 2023-06-23T20:29:53.950 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/397 2023-06-23T20:29:53.951 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:53.956 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:53.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:53.977 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-06-23T20:29:54.440 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:54.452 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:54.453 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:54.456 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:54.456 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:55.373 INFO:teuthology.orchestra.run.smithi136.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-06-23T20:29:55.383 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/398 2023-06-23T20:29:55.383 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/398 2023-06-23T20:29:55.384 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:55.389 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:55.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:55.704 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-06-23T20:29:56.251 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:56.264 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:56.265 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:56.267 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:56.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:57.142 INFO:teuthology.orchestra.run.smithi136.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-06-23T20:29:57.152 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/399 2023-06-23T20:29:57.153 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/399 2023-06-23T20:29:57.153 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:57.159 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:57.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:57.200 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-06-23T20:29:57.659 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:57.671 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:57.672 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:57.675 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:57.675 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:58.174 INFO:teuthology.orchestra.run.smithi136.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T20:29:58.184 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/400 2023-06-23T20:29:58.184 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/400 2023-06-23T20:29:58.184 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:58.190 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:58.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:58.232 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-06-23T20:29:58.695 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:29:58.707 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:29:58.708 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:29:58.711 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:29:58.711 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:59.870 INFO:teuthology.orchestra.run.smithi136.stdout:generic/401 1s 2023-06-23T20:29:59.904 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/401 2023-06-23T20:29:59.904 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:29:59.924 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:29:59.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:29:59.953 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-06-23T20:30:00.425 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:00.437 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:00.438 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:00.441 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:00.441 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:01.186 INFO:teuthology.orchestra.run.smithi136.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-06-23T20:30:01.216 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/402 2023-06-23T20:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/402 2023-06-23T20:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:01.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:01.272 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-06-23T20:30:01.732 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:01.744 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:01.745 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:01.748 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:01.748 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:02.935 INFO:teuthology.orchestra.run.smithi136.stdout:generic/403 1s 2023-06-23T20:30:02.948 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/403 2023-06-23T20:30:02.948 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:02.954 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:02.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:02.976 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-06-23T20:30:03.434 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:03.447 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:03.448 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:03.451 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:04.003 INFO:teuthology.orchestra.run.smithi136.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:30:04.013 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/404 2023-06-23T20:30:04.014 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/404 2023-06-23T20:30:04.014 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:04.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:04.067 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-06-23T20:30:04.529 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:04.542 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:04.543 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:04.546 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:05.146 INFO:teuthology.orchestra.run.smithi136.stdout:generic/405 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:30:05.156 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/405 2023-06-23T20:30:05.156 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/405 2023-06-23T20:30:05.156 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:05.162 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:05.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:05.206 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-06-23T20:30:05.668 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:05.680 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:05.681 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:05.684 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:05.684 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:07.999 INFO:teuthology.orchestra.run.smithi136.stdout:generic/406 2s 2023-06-23T20:30:08.012 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/406 2023-06-23T20:30:08.012 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:08.018 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:08.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:08.040 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-06-23T20:30:08.498 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:08.511 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:08.512 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:08.515 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:08.515 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:09.118 INFO:teuthology.orchestra.run.smithi136.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:30:09.128 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/407 2023-06-23T20:30:09.128 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/407 2023-06-23T20:30:09.128 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:09.134 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:09.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:09.543 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-06-23T20:30:10.057 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:10.070 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:10.071 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:10.073 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:10.074 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:10.666 INFO:teuthology.orchestra.run.smithi136.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T20:30:10.676 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/408 2023-06-23T20:30:10.676 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/408 2023-06-23T20:30:10.676 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:10.682 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:11.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:11.003 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-06-23T20:30:11.542 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:11.554 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:11.555 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:11.558 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:11.558 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:12.084 INFO:teuthology.orchestra.run.smithi136.stdout:generic/409 [not run] require 172.21.15.136:6789:/scratch to be local device 2023-06-23T20:30:12.094 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/409 2023-06-23T20:30:12.094 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/409 2023-06-23T20:30:12.094 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:12.100 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:12.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:12.145 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-06-23T20:30:12.600 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:12.613 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:12.614 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:12.616 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:12.616 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:13.154 INFO:teuthology.orchestra.run.smithi136.stdout:generic/410 [not run] require 172.21.15.136:6789:/scratch to be local device 2023-06-23T20:30:13.164 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/410 2023-06-23T20:30:13.164 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/410 2023-06-23T20:30:13.164 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:13.170 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:13.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:13.212 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-06-23T20:30:13.663 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:13.675 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:13.677 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:13.679 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:13.679 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:14.210 INFO:teuthology.orchestra.run.smithi136.stdout:generic/411 [not run] require 172.21.15.136:6789:/scratch to be local device 2023-06-23T20:30:14.220 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/411 2023-06-23T20:30:14.220 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/411 2023-06-23T20:30:14.220 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:14.226 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:14.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:14.274 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-06-23T20:30:14.731 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:14.743 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:14.744 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:14.747 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:15.731 INFO:teuthology.orchestra.run.smithi136.stdout:generic/412 1s 2023-06-23T20:30:15.743 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/412 2023-06-23T20:30:15.744 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:15.749 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:15.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:15.771 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-06-23T20:30:16.230 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:16.243 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:16.244 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:16.246 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:16.247 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:16.928 INFO:teuthology.orchestra.run.smithi136.stdout:generic/413 [not run] mount 172.21.15.136:6789:/scratch with dax failed 2023-06-23T20:30:16.938 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/413 2023-06-23T20:30:16.939 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/413 2023-06-23T20:30:16.939 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:16.945 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:16.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:16.987 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-06-23T20:30:17.453 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:17.465 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:17.466 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:17.469 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:17.469 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:18.421 INFO:teuthology.orchestra.run.smithi136.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:30:18.489 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/414 2023-06-23T20:30:18.489 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/414 2023-06-23T20:30:18.489 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:18.508 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:18.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:18.656 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-06-23T20:30:19.112 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:19.124 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:19.126 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:19.128 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:19.129 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:20.099 INFO:teuthology.orchestra.run.smithi136.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:30:20.216 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/415 2023-06-23T20:30:20.216 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/415 2023-06-23T20:30:20.217 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:20.226 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:20.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:20.301 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-06-23T20:30:20.760 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:20.773 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:20.774 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:20.776 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:20.777 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:21.301 INFO:teuthology.orchestra.run.smithi136.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:30:21.311 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/416 2023-06-23T20:30:21.311 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/416 2023-06-23T20:30:21.311 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:21.317 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:21.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:21.362 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-06-23T20:30:21.814 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:21.826 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:21.829 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:21.830 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:21.831 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:22.507 INFO:teuthology.orchestra.run.smithi136.stdout:generic/417 [not run] ceph does not support shutdown 2023-06-23T20:30:22.533 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/417 2023-06-23T20:30:22.534 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/417 2023-06-23T20:30:22.534 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:22.539 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:22.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:22.577 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-06-23T20:30:23.030 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:23.043 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:23.044 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:23.047 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:23.047 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:23.609 INFO:teuthology.orchestra.run.smithi136.stdout:generic/418 [not run] require 172.21.15.136:6789:/test to be valid block disk 2023-06-23T20:30:23.619 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/418 2023-06-23T20:30:23.619 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/418 2023-06-23T20:30:23.619 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:23.625 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:23.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:23.671 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-06-23T20:30:24.125 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:24.137 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:24.138 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:24.141 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:24.141 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:25.023 INFO:teuthology.orchestra.run.smithi136.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-06-23T20:30:25.033 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/419 2023-06-23T20:30:25.034 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/419 2023-06-23T20:30:25.034 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:25.039 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:25.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:25.426 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-06-23T20:30:25.900 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:25.913 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:25.914 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:25.917 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:25.917 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:26.643 INFO:teuthology.orchestra.run.smithi136.stdout:generic/420 0s 2023-06-23T20:30:26.656 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/420 2023-06-23T20:30:26.656 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:26.662 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:27.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:27.003 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-06-23T20:30:27.544 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:27.557 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:27.558 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:27.560 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:27.560 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:34.759 INFO:teuthology.orchestra.run.smithi136.stdout:generic/421 7s 2023-06-23T20:30:34.786 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/421 2023-06-23T20:30:34.787 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:34.811 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:34.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:34.856 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-06-23T20:30:35.319 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:35.331 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:35.332 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:35.335 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:35.335 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:35.887 INFO:teuthology.orchestra.run.smithi136.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-23T20:30:35.897 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/422 2023-06-23T20:30:35.897 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/422 2023-06-23T20:30:35.897 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:35.903 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:35.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:35.954 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-06-23T20:30:36.411 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:36.423 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:36.425 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:36.427 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:36.427 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:37.094 INFO:teuthology.orchestra.run.smithi136.stdout:generic/423 1s 2023-06-23T20:30:37.106 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/423 2023-06-23T20:30:37.108 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:37.112 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:37.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:37.437 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-06-23T20:30:37.985 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:37.997 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:37.998 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:38.001 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:38.001 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:38.556 INFO:teuthology.orchestra.run.smithi136.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-06-23T20:30:38.566 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/424 2023-06-23T20:30:38.566 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/424 2023-06-23T20:30:38.566 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:38.572 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:38.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:38.625 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-06-23T20:30:39.081 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:39.094 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:39.095 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:39.097 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:39.098 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:39.684 INFO:teuthology.orchestra.run.smithi136.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-06-23T20:30:39.694 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/425 2023-06-23T20:30:39.694 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/425 2023-06-23T20:30:39.694 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:30:39.700 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:30:39.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:30:39.889 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-06-23T20:30:40.565 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:30:40.590 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:30:40.590 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:30:40.591 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:30:40.591 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:21.613 INFO:teuthology.orchestra.run.smithi136.stdout:generic/426 41s 2023-06-23T20:31:21.699 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/426 2023-06-23T20:31:21.699 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:31:21.706 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:22.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:31:22.167 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-06-23T20:31:23.558 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:31:23.570 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:31:23.571 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:31:23.574 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:31:23.574 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:24.231 INFO:teuthology.orchestra.run.smithi136.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:31:24.241 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/427 2023-06-23T20:31:24.241 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/427 2023-06-23T20:31:24.241 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:31:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:24.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:31:24.300 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-06-23T20:31:24.758 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:31:24.770 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:31:24.771 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:31:24.774 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:31:24.774 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:25.344 INFO:teuthology.orchestra.run.smithi136.stdout:generic/428 1s 2023-06-23T20:31:25.357 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/428 2023-06-23T20:31:25.357 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:31:25.363 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:25.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:31:25.410 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-06-23T20:31:25.868 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:31:25.880 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:31:25.881 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:31:25.883 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:31:25.883 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:37.760 INFO:teuthology.orchestra.run.smithi136.stdout:generic/429 11s 2023-06-23T20:31:37.773 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/429 2023-06-23T20:31:37.773 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:31:37.779 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:37.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:31:37.801 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-06-23T20:31:38.256 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:31:38.268 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:31:38.269 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:31:38.272 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:31:38.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:39.106 INFO:teuthology.orchestra.run.smithi136.stdout:generic/430 1s 2023-06-23T20:31:39.119 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/430 2023-06-23T20:31:39.119 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:31:39.125 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:39.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:31:39.559 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-06-23T20:31:40.019 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:31:40.031 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:31:40.032 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:31:40.035 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:31:40.035 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:40.713 INFO:teuthology.orchestra.run.smithi136.stdout:generic/431 0s 2023-06-23T20:31:40.726 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/431 2023-06-23T20:31:40.726 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:31:40.732 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:41.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:31:41.096 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-06-23T20:31:41.618 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:31:41.627 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:31:41.627 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:31:41.630 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:31:41.630 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:42.342 INFO:teuthology.orchestra.run.smithi136.stdout:generic/432 1s 2023-06-23T20:31:42.355 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/432 2023-06-23T20:31:42.355 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:31:42.361 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:42.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:31:42.687 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-06-23T20:31:43.229 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:31:43.242 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:31:43.243 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:31:43.245 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:31:43.246 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:43.907 INFO:teuthology.orchestra.run.smithi136.stdout:generic/433 0s 2023-06-23T20:31:43.920 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/433 2023-06-23T20:31:43.921 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:31:43.926 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:44.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:31:44.223 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-06-23T20:31:44.812 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:31:44.825 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:31:44.826 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:31:44.828 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:31:44.829 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:45.497 INFO:teuthology.orchestra.run.smithi136.stdout:generic/434 0s 2023-06-23T20:31:45.510 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/434 2023-06-23T20:31:45.510 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:31:45.516 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:31:45.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:31:45.770 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-06-23T20:31:46.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:31:46.038 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:31:46.366 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:31:46.379 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:31:46.380 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:31:46.383 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:31:46.384 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:32:16.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:32:16.241 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:32:46.374 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:32:46.379 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:16.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:16.485 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:47.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:47.701 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:17.832 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:17.838 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:47.939 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:47.954 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:18.668 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:18.674 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:49.300 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:49.306 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:21.026 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:21.031 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:51.131 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:51.136 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:51.230 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T20:36:51.226+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 141108) UID: 0 2023-06-23T20:36:51.230 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T20:36:51.226+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 141108) UID: 0 2023-06-23T20:40:21.437 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:40:21.443 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:40:55.994 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:40:55.999 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:26.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:26.111 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:56.370 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:56.386 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:56.983 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T20:41:56.979+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 141243) UID: 0 2023-06-23T20:41:56.984 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T20:41:56.979+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 141243) UID: 0 2023-06-23T20:43:59.577 INFO:teuthology.orchestra.run.smithi136.stdout:generic/435 733s 2023-06-23T20:43:59.590 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/435 2023-06-23T20:43:59.590 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:43:59.596 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:43:59.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:43:59.618 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-06-23T20:44:00.077 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:44:00.089 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:44:00.091 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:44:00.093 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:44:00.093 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:44:01.032 INFO:teuthology.orchestra.run.smithi136.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:44:01.043 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/436 2023-06-23T20:44:01.043 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/436 2023-06-23T20:44:01.044 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:44:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:44:01.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:44:01.462 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-06-23T20:44:01.918 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:44:01.930 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:44:01.931 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:44:01.934 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:44:01.934 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:44:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:generic/437 1s 2023-06-23T20:44:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/437 2023-06-23T20:44:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:44:03.235 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:44:03.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:44:03.281 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-06-23T20:44:03.736 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:44:03.749 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:44:03.750 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:44:03.752 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:44:03.752 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:06.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:06.758 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:13.494 INFO:teuthology.orchestra.run.smithi136.stdout:generic/438 70s 2023-06-23T20:45:13.507 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/438 2023-06-23T20:45:13.507 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:13.513 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:13.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:13.553 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-06-23T20:45:14.007 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:14.019 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:14.020 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:14.023 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:14.023 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:15.457 INFO:teuthology.orchestra.run.smithi136.stdout:generic/439 1s 2023-06-23T20:45:15.470 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/439 2023-06-23T20:45:15.470 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:15.476 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:15.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:15.527 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-06-23T20:45:15.979 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:15.991 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:15.992 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:15.995 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:15.995 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:17.875 INFO:teuthology.orchestra.run.smithi136.stdout:generic/440 1s 2023-06-23T20:45:17.888 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/440 2023-06-23T20:45:17.888 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:17.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:17.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:17.914 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-06-23T20:45:18.372 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:18.385 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:18.390 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:18.390 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:19.044 INFO:teuthology.orchestra.run.smithi136.stdout:generic/441 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:45:19.054 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/441 2023-06-23T20:45:19.054 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/441 2023-06-23T20:45:19.054 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:19.060 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:19.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:19.102 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-06-23T20:45:19.556 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:19.569 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:19.570 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:19.572 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:19.572 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:20.118 INFO:teuthology.orchestra.run.smithi136.stdout:generic/442 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:45:20.127 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/442 2023-06-23T20:45:20.128 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/442 2023-06-23T20:45:20.128 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:20.133 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:20.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:20.178 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-06-23T20:45:20.636 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:20.649 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:20.650 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:20.653 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:20.653 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:21.378 INFO:teuthology.orchestra.run.smithi136.stdout:generic/443 1s 2023-06-23T20:45:21.404 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/443 2023-06-23T20:45:21.405 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:21.410 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:21.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:21.463 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-06-23T20:45:21.916 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:21.929 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:21.930 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:21.932 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:21.933 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:22.762 INFO:teuthology.orchestra.run.smithi136.stdout:generic/444 0s 2023-06-23T20:45:22.775 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/444 2023-06-23T20:45:22.776 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:22.781 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:22.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:22.847 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-06-23T20:45:23.309 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:23.322 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:23.323 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:23.325 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:23.326 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:24.251 INFO:teuthology.orchestra.run.smithi136.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:45:24.261 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/445 2023-06-23T20:45:24.261 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/445 2023-06-23T20:45:24.261 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:24.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:24.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:24.675 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-06-23T20:45:25.131 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:25.144 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:25.145 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:25.147 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:25.147 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:36.877 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:36.884 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:47.601 INFO:teuthology.orchestra.run.smithi136.stdout:generic/446 22s 2023-06-23T20:45:47.661 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/446 2023-06-23T20:45:47.662 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:47.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:47.707 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-06-23T20:45:48.165 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:48.178 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:48.179 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:48.182 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:48.182 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:49.292 INFO:teuthology.orchestra.run.smithi136.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:45:49.309 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/447 2023-06-23T20:45:49.309 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/447 2023-06-23T20:45:49.310 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:49.318 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:49.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:49.366 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-06-23T20:45:49.821 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:49.833 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:49.834 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:49.837 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:49.837 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:generic/448 1s 2023-06-23T20:45:51.212 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/448 2023-06-23T20:45:51.212 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:51.218 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:51.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:51.608 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-06-23T20:45:52.096 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:52.109 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:52.110 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:52.113 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:52.113 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:52.706 INFO:teuthology.orchestra.run.smithi136.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T20:45:52.715 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/449 2023-06-23T20:45:52.716 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/449 2023-06-23T20:45:52.716 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:53.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:53.092 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-06-23T20:45:53.594 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:53.606 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:53.607 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:53.610 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:53.610 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:54.671 INFO:teuthology.orchestra.run.smithi136.stdout:generic/450 1s 2023-06-23T20:45:54.684 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/450 2023-06-23T20:45:54.684 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:45:54.690 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:45:55.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:45:55.007 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-06-23T20:45:55.551 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:45:55.563 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:45:55.564 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:45:55.567 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:45:55.567 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:07.068 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:07.073 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:26.254 INFO:teuthology.orchestra.run.smithi136.stdout:generic/451 31s 2023-06-23T20:46:26.267 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/451 2023-06-23T20:46:26.267 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:26.273 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:26.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:26.553 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-06-23T20:46:27.100 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:27.113 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:27.114 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:27.117 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:27.117 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:27.984 INFO:teuthology.orchestra.run.smithi136.stdout:generic/452 0s 2023-06-23T20:46:27.997 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/452 2023-06-23T20:46:27.998 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:28.003 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:28.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:28.024 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-06-23T20:46:28.480 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:28.492 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:28.494 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:28.496 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:28.496 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:29.014 INFO:teuthology.orchestra.run.smithi136.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-06-23T20:46:29.024 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/453 2023-06-23T20:46:29.024 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/453 2023-06-23T20:46:29.025 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:29.030 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:29.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:29.074 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-06-23T20:46:29.529 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:29.542 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:29.543 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:29.545 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:29.546 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:30.101 INFO:teuthology.orchestra.run.smithi136.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-06-23T20:46:30.111 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/454 2023-06-23T20:46:30.111 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/454 2023-06-23T20:46:30.112 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:30.117 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:30.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:30.166 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-06-23T20:46:30.623 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:30.636 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:30.637 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:30.639 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:30.639 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:31.302 INFO:teuthology.orchestra.run.smithi136.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-23T20:46:31.312 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/455 2023-06-23T20:46:31.313 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/455 2023-06-23T20:46:31.313 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:31.318 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:31.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:31.364 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-06-23T20:46:31.823 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:31.835 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:31.836 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:31.839 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:31.839 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:32.401 INFO:teuthology.orchestra.run.smithi136.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T20:46:32.411 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/456 2023-06-23T20:46:32.411 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/456 2023-06-23T20:46:32.411 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:32.417 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:32.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:32.469 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-06-23T20:46:32.926 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:32.938 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:32.939 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:32.942 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:32.942 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:34.143 INFO:teuthology.orchestra.run.smithi136.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:46:34.154 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/457 2023-06-23T20:46:34.154 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/457 2023-06-23T20:46:34.154 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:34.160 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:34.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:34.200 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-06-23T20:46:34.656 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:34.668 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:34.669 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:34.672 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:34.672 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:35.723 INFO:teuthology.orchestra.run.smithi136.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T20:46:35.802 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/458 2023-06-23T20:46:35.803 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/458 2023-06-23T20:46:35.803 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:35.816 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:35.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:35.874 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-06-23T20:46:36.327 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:36.339 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:36.340 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:36.343 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:36.343 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:37.083 INFO:teuthology.orchestra.run.smithi136.stdout:generic/459 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:46:37.093 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/459 2023-06-23T20:46:37.094 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/459 2023-06-23T20:46:37.094 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:37.099 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:37.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:37.144 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-06-23T20:46:37.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:37.262 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:37.605 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:37.617 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:37.619 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:37.621 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:37.622 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:40.902 INFO:teuthology.orchestra.run.smithi136.stdout:generic/460 3s 2023-06-23T20:46:40.915 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/460 2023-06-23T20:46:40.915 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:40.921 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:40.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:40.943 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-06-23T20:46:41.405 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:41.418 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:41.419 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:41.421 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:41.422 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:42.149 INFO:teuthology.orchestra.run.smithi136.stdout:generic/461 [not run] ceph does not support shutdown 2023-06-23T20:46:42.159 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/461 2023-06-23T20:46:42.160 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/461 2023-06-23T20:46:42.160 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:42.165 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:42.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:42.203 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-06-23T20:46:42.843 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:42.856 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:42.857 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:42.859 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:42.860 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:43.529 INFO:teuthology.orchestra.run.smithi136.stdout:generic/462 [not run] mount 172.21.15.136:6789:/scratch with dax failed 2023-06-23T20:46:43.538 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/462 2023-06-23T20:46:43.539 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/462 2023-06-23T20:46:43.539 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:43.545 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:43.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:43.585 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-06-23T20:46:44.041 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:44.054 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:44.055 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:44.058 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:44.058 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:44.665 INFO:teuthology.orchestra.run.smithi136.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T20:46:44.675 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/463 2023-06-23T20:46:44.675 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/463 2023-06-23T20:46:44.675 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:46:44.681 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:46:45.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:46:45.120 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-06-23T20:46:45.589 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:46:45.602 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:46:45.603 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:46:45.606 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:46:45.606 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:47:07.365 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:07.396 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:37.935 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:37.959 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:44.854 INFO:teuthology.orchestra.run.smithi136.stdout:generic/464 59s 2023-06-23T20:47:44.867 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/464 2023-06-23T20:47:44.867 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:47:44.872 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:47:44.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:47:44.893 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-06-23T20:47:45.352 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:47:45.364 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:47:45.365 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:47:45.368 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:47:45.368 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:47:50.359 INFO:teuthology.orchestra.run.smithi136.stdout:generic/465 4s 2023-06-23T20:47:50.374 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/465 2023-06-23T20:47:50.374 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:47:50.381 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:47:50.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:47:50.402 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-06-23T20:47:50.904 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:47:50.917 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:47:50.918 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:47:50.921 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:47:50.921 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:47:51.423 INFO:teuthology.orchestra.run.smithi136.stdout:generic/466 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:47:51.433 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/466 2023-06-23T20:47:51.433 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/466 2023-06-23T20:47:51.433 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:47:51.439 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:47:51.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:47:51.476 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-06-23T20:47:51.932 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:47:51.945 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:47:51.946 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:47:51.948 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:47:51.948 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:01.767 INFO:teuthology.orchestra.run.smithi136.stdout:generic/467 9s 2023-06-23T20:48:01.850 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/467 2023-06-23T20:48:01.850 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:48:01.890 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:02.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:48:02.247 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-06-23T20:48:03.595 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:48:03.607 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:48:03.608 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:48:03.611 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:48:03.611 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:04.379 INFO:teuthology.orchestra.run.smithi136.stdout:generic/468 [not run] ceph does not support shutdown 2023-06-23T20:48:04.407 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/468 2023-06-23T20:48:04.408 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/468 2023-06-23T20:48:04.408 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:48:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:04.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:48:04.454 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-06-23T20:48:04.909 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:48:04.921 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:48:04.922 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:48:04.925 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:48:04.925 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:05.467 INFO:teuthology.orchestra.run.smithi136.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-23T20:48:05.476 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/469 2023-06-23T20:48:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/469 2023-06-23T20:48:05.477 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:48:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:05.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:48:05.533 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-06-23T20:48:05.996 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:48:06.008 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:48:06.009 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:48:06.012 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:48:06.012 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:06.622 INFO:teuthology.orchestra.run.smithi136.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-23T20:48:06.632 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/470 2023-06-23T20:48:06.632 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/470 2023-06-23T20:48:06.632 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:48:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:06.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:48:06.681 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-06-23T20:48:07.141 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:48:07.153 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:48:07.154 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:48:07.157 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:48:07.157 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:07.761 INFO:teuthology.orchestra.run.smithi136.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-06-23T20:48:07.771 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/471 2023-06-23T20:48:07.772 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/471 2023-06-23T20:48:07.772 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:48:07.778 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:08.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:48:08.158 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-06-23T20:48:08.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:48:08.345 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:48:08.641 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:48:08.654 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:48:08.655 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:48:08.658 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:48:08.658 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:09.465 INFO:teuthology.orchestra.run.smithi136.stdout:generic/472 [not run] swapfiles are not supported 2023-06-23T20:48:09.475 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/472 2023-06-23T20:48:09.475 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/472 2023-06-23T20:48:09.475 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:48:09.481 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:09.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:48:09.520 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-06-23T20:48:09.972 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:48:09.985 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:48:09.986 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:48:09.988 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:48:09.989 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:10.575 INFO:teuthology.orchestra.run.smithi136.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-23T20:48:10.585 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/473 2023-06-23T20:48:10.585 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/473 2023-06-23T20:48:10.585 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:48:10.591 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:10.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:48:10.637 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-06-23T20:48:11.094 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:48:11.106 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:48:11.107 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:48:11.110 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:48:11.110 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:11.785 INFO:teuthology.orchestra.run.smithi136.stdout:generic/474 [not run] ceph does not support shutdown 2023-06-23T20:48:11.813 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/474 2023-06-23T20:48:11.814 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/474 2023-06-23T20:48:11.814 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:48:11.819 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:11.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:48:11.857 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-06-23T20:48:12.329 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:48:12.342 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:48:12.343 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:48:12.345 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:48:12.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:12.923 INFO:teuthology.orchestra.run.smithi136.stdout:generic/475 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T20:48:12.933 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/475 2023-06-23T20:48:12.933 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/475 2023-06-23T20:48:12.933 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T20:48:12.939 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:12.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T20:48:12.982 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-06-23T20:48:13.440 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T20:48:13.452 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T20:48:13.453 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T20:48:13.456 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T20:48:13.456 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T20:48:38.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:48:38.648 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:09.776 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:09.801 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:43.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:43.201 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:13.478 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:13.548 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:43.920 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:43.944 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:51:14.356 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:51:14.362 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:51:14.482 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T20:51:14.479+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568027) UID: 0 2023-06-23T20:51:14.483 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T20:51:14.479+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568027) UID: 0 2023-06-23T20:51:14.483 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T20:51:14.479+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568027) UID: 0 2023-06-23T20:51:14.484 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T20:51:14.479+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568027) UID: 0 2023-06-23T20:55:46.885 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:55:46.911 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:56:18.434 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:56:18.443 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:56:18.632 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T20:56:18.628+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142163) UID: 0 2023-06-23T20:56:18.635 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T20:56:18.628+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142163) UID: 0 2023-06-23T21:00:32.963 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T21:00:32.955+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142221) UID: 0 2023-06-23T21:00:32.969 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T21:00:32.955+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142221) UID: 0 2023-06-23T21:00:32.970 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T21:00:32.961+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142221) UID: 0 2023-06-23T21:00:32.985 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T21:00:32.956+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142221) UID: 0 2023-06-23T21:10:40.350 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:10:40.363 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:10:40.721 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T21:10:40.717+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142355) UID: 0 2023-06-23T21:10:40.722 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T21:10:40.717+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142355) UID: 0 2023-06-23T21:10:41.032 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T21:10:41.028+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568375) UID: 0 2023-06-23T21:10:41.032 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T21:10:41.027+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568375) UID: 0 2023-06-23T21:10:41.033 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T21:10:41.028+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568375) UID: 0 2023-06-23T21:10:41.033 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T21:10:41.028+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568375) UID: 0 2023-06-23T21:14:22.183 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T21:14:22.173+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142395) UID: 0 2023-06-23T21:14:22.189 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T21:14:22.173+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142395) UID: 0 2023-06-23T21:14:22.190 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T21:14:22.173+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142395) UID: 0 2023-06-23T21:14:22.192 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T21:14:22.173+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142395) UID: 0 2023-06-23T21:24:35.895 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:24:35.925 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:24:36.218 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T21:24:36.214+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568542) UID: 0 2023-06-23T21:24:36.220 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T21:24:36.214+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568542) UID: 0 2023-06-23T21:24:36.221 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T21:24:36.214+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568542) UID: 0 2023-06-23T21:24:36.221 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T21:24:36.214+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568542) UID: 0 2023-06-23T21:24:36.293 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T21:24:36.288+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142525) UID: 0 2023-06-23T21:24:36.293 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T21:24:36.288+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142525) UID: 0 2023-06-23T21:28:27.586 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T21:28:27.582+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142736) UID: 0 2023-06-23T21:28:27.587 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T21:28:27.582+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142736) UID: 0 2023-06-23T21:28:27.588 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T21:28:27.582+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142736) UID: 0 2023-06-23T21:28:27.588 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T21:28:27.582+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142736) UID: 0 2023-06-23T21:33:57.172 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:33:57.217 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:27.635 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:27.643 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:58.042 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:58.055 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:28.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:28.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:58.953 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:58.962 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:59.108 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T21:35:59.103+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568779) UID: 0 2023-06-23T21:35:59.109 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T21:35:59.103+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568779) UID: 0 2023-06-23T21:35:59.109 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T21:35:59.104+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568779) UID: 0 2023-06-23T21:35:59.112 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T21:35:59.107+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 568779) UID: 0 2023-06-23T21:40:22.100 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:40:22.108 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:40:22.458 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T21:40:22.454+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142997) UID: 0 2023-06-23T21:40:22.460 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T21:40:22.449+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142997) UID: 0 2023-06-23T21:45:52.374 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T21:45:52.357+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143058) UID: 0 2023-06-23T21:45:52.377 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T21:45:52.369+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143058) UID: 0 2023-06-23T21:45:52.378 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T21:45:52.370+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143058) UID: 0 2023-06-23T21:45:52.383 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T21:45:52.369+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143058) UID: 0 2023-06-23T21:51:48.842 INFO:teuthology.orchestra.run.smithi136.stdout:generic/476 3815s 2023-06-23T21:51:48.874 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/476 2023-06-23T21:51:48.875 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T21:51:48.885 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T21:51:48.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T21:51:49.006 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-06-23T21:52:00.599 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T21:52:00.614 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T21:52:00.616 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T21:52:00.619 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T21:52:00.620 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T21:52:01.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:52:01.089 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:52:01.249 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T21:52:01.244+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569282) UID: 0 2023-06-23T21:52:01.252 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T21:52:01.247+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569282) UID: 0 2023-06-23T21:52:01.252 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T21:52:01.247+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569282) UID: 0 2023-06-23T21:52:01.252 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T21:52:01.247+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569282) UID: 0 2023-06-23T21:52:02.159 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T21:52:02.154+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 143154) UID: 0 2023-06-23T21:52:02.159 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T21:52:02.154+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 143154) UID: 0 2023-06-23T21:55:13.129 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T21:55:13.124+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143181) UID: 0 2023-06-23T21:55:13.130 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T21:55:13.124+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143181) UID: 0 2023-06-23T21:55:13.130 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T21:55:13.126+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143181) UID: 0 2023-06-23T21:55:13.131 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T21:55:13.126+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143181) UID: 0 2023-06-23T22:02:55.794 INFO:teuthology.orchestra.run.smithi136.stdout:generic/477 34s 2023-06-23T22:02:55.910 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/477 2023-06-23T22:02:55.910 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:02:55.934 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:02:56.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:02:56.088 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-06-23T22:02:57.653 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:02:57.673 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:02:57.674 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:02:57.678 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:02:57.678 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:09.394 INFO:teuthology.orchestra.run.smithi136.stdout:generic/478 11s 2023-06-23T22:03:09.418 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/478 2023-06-23T22:03:09.418 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:09.429 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:09.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:09.513 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-06-23T22:03:10.272 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:10.292 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:10.293 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:10.297 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:10.297 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:11.260 INFO:teuthology.orchestra.run.smithi136.stdout:generic/479 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:03:11.279 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/479 2023-06-23T22:03:11.279 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/479 2023-06-23T22:03:11.279 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:11.288 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:11.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:11.381 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-06-23T22:03:12.068 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:12.090 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:12.091 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:12.094 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:12.094 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:12.955 INFO:teuthology.orchestra.run.smithi136.stdout:generic/480 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:03:12.972 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/480 2023-06-23T22:03:12.972 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/480 2023-06-23T22:03:12.972 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:12.980 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:13.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:13.054 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-06-23T22:03:13.798 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:13.817 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:13.818 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:13.821 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:13.822 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:14.680 INFO:teuthology.orchestra.run.smithi136.stdout:generic/481 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:03:14.693 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/481 2023-06-23T22:03:14.693 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/481 2023-06-23T22:03:14.693 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:14.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:14.765 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-06-23T22:03:15.506 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:15.520 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:15.521 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:15.523 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:15.523 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:16.499 INFO:teuthology.orchestra.run.smithi136.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-23T22:03:16.512 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/482 2023-06-23T22:03:16.513 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/482 2023-06-23T22:03:16.513 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:16.519 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:16.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:16.576 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-06-23T22:03:17.272 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:17.299 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:17.301 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:17.304 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:17.304 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:18.187 INFO:teuthology.orchestra.run.smithi136.stdout:generic/483 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:03:18.199 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/483 2023-06-23T22:03:18.199 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/483 2023-06-23T22:03:18.199 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:18.205 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:18.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:18.272 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-06-23T22:03:18.953 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:18.973 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:18.977 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:18.982 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:18.983 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:19.804 INFO:teuthology.orchestra.run.smithi136.stdout:generic/484 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:03:19.817 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/484 2023-06-23T22:03:19.817 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/484 2023-06-23T22:03:19.817 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:19.824 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:19.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:19.891 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-06-23T22:03:20.604 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:20.626 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:20.627 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:20.631 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:20.632 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:21.750 INFO:teuthology.orchestra.run.smithi136.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-23T22:03:21.763 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/485 2023-06-23T22:03:21.763 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/485 2023-06-23T22:03:21.763 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:21.780 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:21.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:21.855 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-06-23T22:03:22.590 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:22.611 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:22.612 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:22.615 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:22.616 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:24.496 INFO:teuthology.orchestra.run.smithi136.stdout:generic/486 1s 2023-06-23T22:03:24.522 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/486 2023-06-23T22:03:24.522 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:24.532 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:24.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:24.564 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-06-23T22:03:25.274 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:25.294 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:25.296 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:25.305 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:25.305 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:26.133 INFO:teuthology.orchestra.run.smithi136.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-06-23T22:03:26.150 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/487 2023-06-23T22:03:26.151 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/487 2023-06-23T22:03:26.151 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:26.160 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:26.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:26.246 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-06-23T22:03:26.953 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:26.973 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:26.975 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:26.979 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:26.979 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:27.776 INFO:teuthology.orchestra.run.smithi136.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T22:03:27.791 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/488 2023-06-23T22:03:27.792 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/488 2023-06-23T22:03:27.792 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:27.799 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:27.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:27.865 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-06-23T22:03:28.608 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:28.623 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:28.625 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:28.628 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:28.628 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:29.467 INFO:teuthology.orchestra.run.smithi136.stdout:generic/489 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:03:29.481 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/489 2023-06-23T22:03:29.481 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/489 2023-06-23T22:03:29.481 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:29.490 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:29.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:29.552 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-06-23T22:03:30.285 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:30.304 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:30.306 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:30.309 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:30.309 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:33.071 INFO:teuthology.orchestra.run.smithi136.stdout:generic/490 3s 2023-06-23T22:03:33.091 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/490 2023-06-23T22:03:33.091 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:33.101 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:33.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:33.540 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-06-23T22:03:34.334 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:34.349 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:34.352 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:34.358 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:34.358 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:35.219 INFO:teuthology.orchestra.run.smithi136.stdout:generic/491 [not run] ceph does not support freezing 2023-06-23T22:03:35.237 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/491 2023-06-23T22:03:35.237 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/491 2023-06-23T22:03:35.237 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:35.245 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:35.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:35.315 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-06-23T22:03:36.018 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:36.036 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:36.038 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:36.041 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:36.041 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:36.826 INFO:teuthology.orchestra.run.smithi136.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-06-23T22:03:36.843 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/492 2023-06-23T22:03:36.843 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/492 2023-06-23T22:03:36.843 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:36.853 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:36.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:36.906 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-06-23T22:03:37.569 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:37.586 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:37.587 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:37.590 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:37.590 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:38.806 INFO:teuthology.orchestra.run.smithi136.stdout:generic/493 [not run] swapfiles are not supported 2023-06-23T22:03:38.820 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/493 2023-06-23T22:03:38.821 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/493 2023-06-23T22:03:38.821 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:38.833 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:38.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:38.904 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-06-23T22:03:39.612 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:39.629 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:39.630 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:39.634 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:39.634 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:40.806 INFO:teuthology.orchestra.run.smithi136.stdout:generic/494 [not run] swapfiles are not supported 2023-06-23T22:03:40.823 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/494 2023-06-23T22:03:40.823 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/494 2023-06-23T22:03:40.824 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:40.833 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:40.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:40.905 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-06-23T22:03:41.616 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:41.634 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:41.635 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:41.638 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:41.638 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:42.967 INFO:teuthology.orchestra.run.smithi136.stdout:generic/495 [not run] swapfiles are not supported 2023-06-23T22:03:42.985 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/495 2023-06-23T22:03:42.985 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/495 2023-06-23T22:03:42.986 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:42.995 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:43.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:43.050 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-06-23T22:03:43.774 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:43.796 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:43.798 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:43.801 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:43.801 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:44.991 INFO:teuthology.orchestra.run.smithi136.stdout:generic/496 [not run] swapfiles are not supported 2023-06-23T22:03:45.006 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/496 2023-06-23T22:03:45.007 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/496 2023-06-23T22:03:45.007 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:45.014 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:45.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:45.079 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-06-23T22:03:45.782 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:45.795 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:45.796 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:45.799 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:45.799 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:46.958 INFO:teuthology.orchestra.run.smithi136.stdout:generic/497 [not run] swapfiles are not supported 2023-06-23T22:03:46.977 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/497 2023-06-23T22:03:46.977 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/497 2023-06-23T22:03:46.977 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:46.986 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:47.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:47.053 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-06-23T22:03:47.761 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:47.779 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:47.781 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:47.784 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:47.784 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:48.659 INFO:teuthology.orchestra.run.smithi136.stdout:generic/498 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:03:48.679 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/498 2023-06-23T22:03:48.680 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/498 2023-06-23T22:03:48.680 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:48.693 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:48.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:48.753 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-06-23T22:03:49.482 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:49.510 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:49.512 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:49.515 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:49.515 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:50.327 INFO:teuthology.orchestra.run.smithi136.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-23T22:03:50.343 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/499 2023-06-23T22:03:50.343 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/499 2023-06-23T22:03:50.343 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:50.355 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:50.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:50.434 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-06-23T22:03:51.190 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:51.208 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:51.209 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:51.212 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:51.212 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:52.067 INFO:teuthology.orchestra.run.smithi136.stdout:generic/500 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:03:52.079 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/500 2023-06-23T22:03:52.080 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/500 2023-06-23T22:03:52.080 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:52.088 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:52.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:52.158 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-06-23T22:03:52.832 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:52.852 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:52.857 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:52.860 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:52.860 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:54.278 INFO:teuthology.orchestra.run.smithi136.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T22:03:54.419 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/501 2023-06-23T22:03:54.419 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/501 2023-06-23T22:03:54.420 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:54.432 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:54.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:54.511 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-06-23T22:03:55.236 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:55.259 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:55.260 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:55.264 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:55.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:56.346 INFO:teuthology.orchestra.run.smithi136.stdout:generic/502 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:03:56.358 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/502 2023-06-23T22:03:56.358 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/502 2023-06-23T22:03:56.358 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:56.369 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:56.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:56.449 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-06-23T22:03:57.191 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:57.838 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:57.838 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:57.838 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:57.838 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:58.584 INFO:teuthology.orchestra.run.smithi136.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T22:03:58.598 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/503 2023-06-23T22:03:58.599 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/503 2023-06-23T22:03:58.599 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:03:58.613 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:03:58.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:03:58.696 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-06-23T22:03:59.368 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:03:59.389 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:03:59.391 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:03:59.396 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:03:59.396 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:00.296 INFO:teuthology.orchestra.run.smithi136.stdout:generic/504 1s 2023-06-23T22:04:00.315 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/504 2023-06-23T22:04:00.316 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:00.325 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:00.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:00.385 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-06-23T22:04:01.081 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:01.097 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:01.099 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:01.104 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:01.104 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:02.136 INFO:teuthology.orchestra.run.smithi136.stdout:generic/505 [not run] ceph does not support shutdown 2023-06-23T22:04:02.183 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/505 2023-06-23T22:04:02.184 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/505 2023-06-23T22:04:02.184 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:02.190 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:02.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:02.248 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-06-23T22:04:02.946 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:02.974 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:02.976 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:02.980 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:02.980 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:03.759 INFO:teuthology.orchestra.run.smithi136.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T22:04:03.775 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/506 2023-06-23T22:04:03.775 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/506 2023-06-23T22:04:03.776 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:03.783 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:03.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:03.837 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-06-23T22:04:04.555 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:04.573 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:04.575 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:04.579 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:05.420 INFO:teuthology.orchestra.run.smithi136.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-06-23T22:04:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/507 2023-06-23T22:04:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/507 2023-06-23T22:04:05.433 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:05.442 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:05.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:05.523 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-06-23T22:04:06.225 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:06.248 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:06.248 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:06.251 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:06.251 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:07.036 INFO:teuthology.orchestra.run.smithi136.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-06-23T22:04:07.054 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/508 2023-06-23T22:04:07.054 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/508 2023-06-23T22:04:07.054 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:07.061 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:07.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:07.130 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-06-23T22:04:07.853 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:07.869 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:07.871 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:07.874 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:07.874 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:08.699 INFO:teuthology.orchestra.run.smithi136.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-06-23T22:04:08.713 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/509 2023-06-23T22:04:08.713 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/509 2023-06-23T22:04:08.714 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:08.727 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:08.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:08.783 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-06-23T22:04:09.479 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:09.500 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:09.502 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:09.505 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:09.505 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:10.324 INFO:teuthology.orchestra.run.smithi136.stdout:generic/510 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:04:10.341 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/510 2023-06-23T22:04:10.341 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/510 2023-06-23T22:04:10.342 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:10.350 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:10.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:10.415 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-06-23T22:04:11.098 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:11.122 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:11.124 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:11.128 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:11.128 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:11.940 INFO:teuthology.orchestra.run.smithi136.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-23T22:04:11.956 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/511 2023-06-23T22:04:11.956 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/511 2023-06-23T22:04:11.956 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:11.964 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:12.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:12.047 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-06-23T22:04:12.777 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:12.793 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:12.794 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:12.797 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:12.797 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:13.639 INFO:teuthology.orchestra.run.smithi136.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T22:04:13.653 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/512 2023-06-23T22:04:13.653 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/512 2023-06-23T22:04:13.653 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:13.662 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:13.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:13.741 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-06-23T22:04:14.456 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:14.482 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:14.485 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:14.489 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:14.489 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:16.098 INFO:teuthology.orchestra.run.smithi136.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T22:04:16.120 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/513 2023-06-23T22:04:16.121 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/513 2023-06-23T22:04:16.121 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:16.131 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:16.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:16.183 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-06-23T22:04:16.867 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:16.887 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:16.889 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:16.892 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:16.893 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:18.471 INFO:teuthology.orchestra.run.smithi136.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T22:04:18.492 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/514 2023-06-23T22:04:18.492 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/514 2023-06-23T22:04:18.492 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:18.519 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:18.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:18.598 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-06-23T22:04:19.314 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:19.341 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:19.342 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:19.348 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:19.348 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:20.759 INFO:teuthology.orchestra.run.smithi136.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T22:04:20.893 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/515 2023-06-23T22:04:20.893 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/515 2023-06-23T22:04:20.894 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:20.923 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:21.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:21.008 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-06-23T22:04:21.669 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:21.685 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:21.686 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:21.689 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:21.690 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:22.601 INFO:teuthology.orchestra.run.smithi136.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T22:04:22.615 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/516 2023-06-23T22:04:22.615 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/516 2023-06-23T22:04:22.616 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:22.625 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:23.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:23.029 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-06-23T22:04:23.791 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:23.809 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:23.811 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:23.815 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:23.815 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:24.967 INFO:teuthology.orchestra.run.smithi136.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-23T22:04:25.323 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/517 2023-06-23T22:04:25.323 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/517 2023-06-23T22:04:25.323 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:25.352 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:25.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:25.481 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-06-23T22:04:26.206 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:26.228 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:26.230 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:26.233 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:26.233 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:27.690 INFO:teuthology.orchestra.run.smithi136.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-23T22:04:27.782 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/518 2023-06-23T22:04:27.782 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/518 2023-06-23T22:04:27.782 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:27.816 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:27.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:27.884 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-06-23T22:04:28.612 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:28.630 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:28.631 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:28.634 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:28.634 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:29.591 INFO:teuthology.orchestra.run.smithi136.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-06-23T22:04:29.604 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/519 2023-06-23T22:04:29.605 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/519 2023-06-23T22:04:29.605 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:29.613 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:29.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:29.887 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-06-23T22:04:30.765 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:30.785 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:30.786 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:30.790 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:30.790 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:31.727 INFO:teuthology.orchestra.run.smithi136.stdout:generic/520 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-23T22:04:31.741 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/520 2023-06-23T22:04:31.742 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/520 2023-06-23T22:04:31.742 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T22:04:31.751 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:04:31.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T22:04:31.819 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-06-23T22:04:32.508 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T22:04:32.531 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T22:04:32.536 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T22:04:32.540 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T22:04:32.540 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T22:07:51.009 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:07:51.016 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:07:51.268 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T22:07:51.262+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 143331) UID: 0 2023-06-23T22:07:51.268 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T22:07:51.262+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 143331) UID: 0 2023-06-23T22:07:54.312 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T22:07:54.305+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 591458) UID: 0 2023-06-23T22:07:54.313 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T22:07:54.305+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 591458) UID: 0 2023-06-23T22:07:54.313 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T22:07:54.305+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 591458) UID: 0 2023-06-23T22:07:54.315 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T22:07:54.307+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 591458) UID: 0 2023-06-23T22:20:28.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:20:28.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:20:28.850 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T22:20:28.844+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143474) UID: 0 2023-06-23T22:20:28.850 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T22:20:28.844+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143474) UID: 0 2023-06-23T22:20:28.851 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T22:20:28.844+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143474) UID: 0 2023-06-23T22:20:28.851 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T22:20:28.844+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143474) UID: 0 2023-06-23T22:24:28.668 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:24:28.675 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:24:58.965 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:24:58.973 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:25:30.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:25:30.207 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:00.382 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:00.388 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:30.530 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:30.538 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:00.706 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:00.711 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:32.124 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:32.129 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:02.821 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:02.831 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:32.967 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:32.972 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:04.131 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:04.138 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:34.275 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:34.282 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:04.440 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:04.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:35.822 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:35.828 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:31:06.007 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:31:06.013 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:31:06.158 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T22:31:06.153+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143872) UID: 0 2023-06-23T22:31:06.159 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T22:31:06.154+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143872) UID: 0 2023-06-23T22:31:06.159 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T22:31:06.154+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143872) UID: 0 2023-06-23T22:31:06.160 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T22:31:06.154+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143872) UID: 0 2023-06-23T22:34:57.750 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:34:57.757 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:34:59.557 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T22:34:59.552+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592242) UID: 0 2023-06-23T22:34:59.558 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T22:34:59.552+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592242) UID: 0 2023-06-23T22:34:59.558 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T22:34:59.552+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592242) UID: 0 2023-06-23T22:34:59.559 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T22:34:59.552+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592242) UID: 0 2023-06-23T22:38:58.862 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:38:58.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:29.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:29.217 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:59.380 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:59.386 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:40:29.777 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:40:29.785 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:40:29.914 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T22:40:29.910+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144063) UID: 0 2023-06-23T22:40:29.915 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T22:40:29.910+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144063) UID: 0 2023-06-23T22:40:29.915 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T22:40:29.910+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144063) UID: 0 2023-06-23T22:40:29.916 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T22:40:29.910+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144063) UID: 0 2023-06-23T22:40:29.928 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T22:40:29.923+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592376) UID: 0 2023-06-23T22:40:29.929 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T22:40:29.923+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592376) UID: 0 2023-06-23T22:40:29.929 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T22:40:29.923+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592376) UID: 0 2023-06-23T22:40:29.929 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T22:40:29.923+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592376) UID: 0 2023-06-23T22:47:43.406 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:47:43.412 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:47:43.548 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T22:47:43.543+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592459) UID: 0 2023-06-23T22:47:43.549 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T22:47:43.544+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592459) UID: 0 2023-06-23T22:47:43.549 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T22:47:43.544+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592459) UID: 0 2023-06-23T22:47:43.549 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T22:47:43.544+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592459) UID: 0 2023-06-23T22:47:43.950 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T22:47:43.944+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144147) UID: 0 2023-06-23T22:47:43.950 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T22:47:43.945+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144147) UID: 0 2023-06-23T22:47:43.951 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T22:47:43.945+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144147) UID: 0 2023-06-23T22:47:43.951 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T22:47:43.945+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144147) UID: 0 2023-06-23T22:51:56.675 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:51:56.682 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:26.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:26.842 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:57.464 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:57.470 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:27.674 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:27.680 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:57.841 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:57.850 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:27.994 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:28.001 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:58.681 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:58.687 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:55:28.841 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:55:28.846 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:00.023 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:00.033 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:31.426 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:31.431 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:02.331 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:02.337 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:32.484 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:32.490 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:04.280 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:04.286 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:34.694 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:34.699 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:04.841 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:04.847 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:35.009 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:35.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:35.528 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T22:59:35.524+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592906) UID: 0 2023-06-23T22:59:35.529 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T22:59:35.524+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592906) UID: 0 2023-06-23T22:59:35.529 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T22:59:35.524+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592906) UID: 0 2023-06-23T22:59:35.530 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T22:59:35.524+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592906) UID: 0 2023-06-23T23:03:09.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:03:09.216 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:03:09.415 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T23:03:09.412+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144663) UID: 0 2023-06-23T23:03:09.416 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T23:03:09.413+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144663) UID: 0 2023-06-23T23:03:09.416 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T23:03:09.413+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144663) UID: 0 2023-06-23T23:03:09.418 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T23:03:09.413+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144663) UID: 0 2023-06-23T23:03:09.557 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T23:03:09.554+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592981) UID: 0 2023-06-23T23:03:09.558 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T23:03:09.554+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592981) UID: 0 2023-06-23T23:03:09.558 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T23:03:09.554+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592981) UID: 0 2023-06-23T23:03:09.558 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T23:03:09.554+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592981) UID: 0 2023-06-23T23:07:10.705 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:07:10.710 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:07:40.996 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:07:41.005 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:11.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:11.168 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:41.429 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:41.435 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:11.573 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:11.582 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:42.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:42.811 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:12.964 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:12.970 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:43.159 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:43.166 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:13.309 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:13.315 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:43.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:43.468 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:13.623 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:13.634 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:43.784 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:43.792 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:15.072 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:15.081 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:45.448 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:45.453 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:15.596 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:15.603 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:45.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:45.756 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:15.900 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:15.907 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:46.402 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:46.412 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:16.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:16.568 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:46.717 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:46.724 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:17:16.881 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:17:16.887 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:17:17.175 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T23:17:17.172+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145234) UID: 0 2023-06-23T23:17:17.175 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T23:17:17.173+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145234) UID: 0 2023-06-23T23:17:17.176 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T23:17:17.173+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145234) UID: 0 2023-06-23T23:17:17.176 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T23:17:17.173+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145234) UID: 0 2023-06-23T23:21:13.181 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:21:13.187 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:21:44.982 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:21:44.990 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:15.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:15.231 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:45.381 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:45.391 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:23:15.584 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:23:15.591 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:23:15.721 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T23:23:15.718+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145398) UID: 0 2023-06-23T23:23:15.721 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T23:23:15.718+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145398) UID: 0 2023-06-23T23:23:15.722 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T23:23:15.720+0000 7fa4689f9700 -1 received signal: Hangup from (PID: 145398) UID: 0 2023-06-23T23:23:15.722 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T23:23:15.719+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145398) UID: 0 2023-06-23T23:27:00.539 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:27:00.549 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:27:00.661 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T23:27:00.659+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145447) UID: 0 2023-06-23T23:27:00.662 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T23:27:00.659+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145447) UID: 0 2023-06-23T23:27:00.662 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T23:27:00.659+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145447) UID: 0 2023-06-23T23:27:00.663 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T23:27:00.659+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145447) UID: 0 2023-06-23T23:27:01.076 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T23:27:01.073+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 593764) UID: 0 2023-06-23T23:27:01.078 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T23:27:01.075+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 593764) UID: 0 2023-06-23T23:27:01.078 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T23:27:01.074+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 593764) UID: 0 2023-06-23T23:27:01.079 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T23:27:01.075+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 593764) UID: 0 2023-06-23T23:34:16.605 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:34:16.615 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:34:16.766 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T23:34:16.764+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 593856) UID: 0 2023-06-23T23:34:16.767 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T23:34:16.764+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 593856) UID: 0 2023-06-23T23:34:16.768 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T23:34:16.764+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 593856) UID: 0 2023-06-23T23:34:16.768 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T23:34:16.764+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 593856) UID: 0 2023-06-23T23:38:36.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:38:36.210 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:38:36.422 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T23:38:36.419+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145600) UID: 0 2023-06-23T23:38:36.422 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T23:38:36.420+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145600) UID: 0 2023-06-23T23:38:36.423 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T23:38:36.420+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145600) UID: 0 2023-06-23T23:38:36.423 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T23:38:36.420+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145600) UID: 0 2023-06-23T23:42:48.506 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:42:48.513 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:42:48.757 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-23T23:42:48.754+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 145663) UID: 0 2023-06-23T23:42:48.757 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-23T23:42:48.754+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 145663) UID: 0 2023-06-23T23:46:05.771 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-23T23:46:05.770+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145701) UID: 0 2023-06-23T23:46:05.772 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-23T23:46:05.771+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145701) UID: 0 2023-06-23T23:46:05.773 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-23T23:46:05.771+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145701) UID: 0 2023-06-23T23:46:05.773 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-23T23:46:05.771+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145701) UID: 0 2023-06-23T23:47:34.280 INFO:teuthology.orchestra.run.smithi136.stdout:generic/521 6182s 2023-06-23T23:47:34.323 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/521 2023-06-23T23:47:34.323 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-23T23:47:34.332 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T23:47:34.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-23T23:47:34.810 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-06-23T23:47:35.796 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-23T23:47:35.814 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T23:47:35.816 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-23T23:47:35.820 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-23T23:47:35.820 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-23T23:50:09.626 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:50:09.631 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:50:39.834 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:50:39.841 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:09.980 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:09.989 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:40.223 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:40.230 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:40.380 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T23:51:40.379+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594635) UID: 0 2023-06-23T23:51:40.380 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T23:51:40.379+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594635) UID: 0 2023-06-23T23:51:40.381 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T23:51:40.379+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594635) UID: 0 2023-06-23T23:51:40.381 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T23:51:40.379+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594635) UID: 0 2023-06-23T23:55:26.210 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:55:26.218 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:55:26.377 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-23T23:55:26.375+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594695) UID: 0 2023-06-23T23:55:26.377 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-23T23:55:26.375+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594695) UID: 0 2023-06-23T23:55:26.377 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-23T23:55:26.375+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594695) UID: 0 2023-06-23T23:55:26.382 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-23T23:55:26.375+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594695) UID: 0 2023-06-23T23:59:10.203 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:59:10.208 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:59:40.529 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:59:40.535 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:10.721 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:10.729 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:41.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:41.042 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:01:11.318 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:01:11.325 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:01:41.558 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:01:41.563 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:11.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:11.739 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:43.667 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:43.674 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:03:13.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:03:13.844 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:03:14.033 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T00:03:14.032+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146224) UID: 0 2023-06-24T00:03:14.034 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T00:03:14.032+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146224) UID: 0 2023-06-24T00:03:14.034 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T00:03:14.032+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146224) UID: 0 2023-06-24T00:03:14.034 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T00:03:14.032+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146224) UID: 0 2023-06-24T00:07:04.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:07:04.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:07:04.817 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T00:07:04.814+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595082) UID: 0 2023-06-24T00:07:04.817 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T00:07:04.814+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595082) UID: 0 2023-06-24T00:07:04.818 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T00:07:04.814+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595082) UID: 0 2023-06-24T00:07:04.818 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T00:07:04.814+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595082) UID: 0 2023-06-24T00:11:05.820 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:11:05.825 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:11:05.957 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T00:11:05.956+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146355) UID: 0 2023-06-24T00:11:05.958 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T00:11:05.956+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146355) UID: 0 2023-06-24T00:11:05.958 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T00:11:05.956+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146355) UID: 0 2023-06-24T00:11:05.959 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T00:11:05.956+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146355) UID: 0 2023-06-24T00:14:50.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:14:50.203 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:14:50.475 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T00:14:50.473+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595202) UID: 0 2023-06-24T00:14:50.475 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T00:14:50.473+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595202) UID: 0 2023-06-24T00:14:50.476 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T00:14:50.473+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595202) UID: 0 2023-06-24T00:14:50.476 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T00:14:50.473+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595202) UID: 0 2023-06-24T00:18:38.853 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:18:38.860 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:18:39.204 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T00:18:39.201+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146459) UID: 0 2023-06-24T00:18:39.205 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T00:18:39.201+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146459) UID: 0 2023-06-24T00:18:39.205 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T00:18:39.201+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146459) UID: 0 2023-06-24T00:18:39.206 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T00:18:39.201+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146459) UID: 0 2023-06-24T00:22:48.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:22:48.755 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:22:48.929 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T00:22:48.926+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595322) UID: 0 2023-06-24T00:22:48.929 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T00:22:48.926+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595322) UID: 0 2023-06-24T00:22:48.930 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T00:22:48.926+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595322) UID: 0 2023-06-24T00:22:48.930 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T00:22:48.926+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595322) UID: 0 2023-06-24T00:26:49.520 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:26:49.535 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:26:49.654 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T00:26:49.652+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146576) UID: 0 2023-06-24T00:26:49.654 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T00:26:49.652+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146576) UID: 0 2023-06-24T00:26:49.655 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T00:26:49.652+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146576) UID: 0 2023-06-24T00:26:49.657 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T00:26:49.652+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146576) UID: 0 2023-06-24T00:30:52.487 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:30:52.500 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:22.760 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:22.772 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:53.013 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:53.020 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:23.184 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:23.189 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:53.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:53.351 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:23.541 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:23.554 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:53.889 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:53.896 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:25.518 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:25.525 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:57.493 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:57.498 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:27.717 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:27.723 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:57.874 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:57.881 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:58.065 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T00:35:58.061+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595693) UID: 0 2023-06-24T00:35:58.065 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T00:35:58.062+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595693) UID: 0 2023-06-24T00:35:58.065 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T00:35:58.062+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595693) UID: 0 2023-06-24T00:35:58.067 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T00:35:58.064+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595693) UID: 0 2023-06-24T00:39:40.034 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:39:40.040 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:39:40.771 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T00:39:40.768+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595751) UID: 0 2023-06-24T00:39:40.771 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T00:39:40.768+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595751) UID: 0 2023-06-24T00:39:40.772 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T00:39:40.768+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595751) UID: 0 2023-06-24T00:39:40.772 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T00:39:40.768+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595751) UID: 0 2023-06-24T00:43:48.723 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:43:48.730 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:43:48.918 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T00:43:48.915+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595813) UID: 0 2023-06-24T00:43:48.919 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T00:43:48.915+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595813) UID: 0 2023-06-24T00:43:48.919 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T00:43:48.916+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595813) UID: 0 2023-06-24T00:43:48.919 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T00:43:48.917+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595813) UID: 0 2023-06-24T00:47:39.788 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:47:39.797 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:47:39.926 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-24T00:47:39.923+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 147059) UID: 0 2023-06-24T00:47:39.927 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-24T00:47:39.923+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 147059) UID: 0 2023-06-24T00:49:28.045 INFO:teuthology.orchestra.run.smithi136.stdout:generic/522 3712s 2023-06-24T00:49:28.088 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/522 2023-06-24T00:49:28.088 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:28.095 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:28.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:28.191 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-06-24T00:49:29.131 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:29.151 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:29.152 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:29.156 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:29.157 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:30.440 INFO:teuthology.orchestra.run.smithi136.stdout:generic/523 1s 2023-06-24T00:49:30.457 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/523 2023-06-24T00:49:30.457 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:30.465 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:30.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:30.497 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-06-24T00:49:31.200 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:31.221 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:31.222 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:31.227 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:31.227 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:39.620 INFO:teuthology.orchestra.run.smithi136.stdout:generic/524 8s 2023-06-24T00:49:39.642 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/524 2023-06-24T00:49:39.642 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:39.655 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:39.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:39.703 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-06-24T00:49:40.449 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:40.469 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:40.470 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:40.474 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:40.474 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:41.765 INFO:teuthology.orchestra.run.smithi136.stdout:generic/525 [not run] filesystem does not support huge file size 2023-06-24T00:49:41.820 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/525 2023-06-24T00:49:41.821 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/525 2023-06-24T00:49:41.821 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:41.827 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:41.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:41.890 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-06-24T00:49:42.601 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:42.618 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:42.619 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:42.625 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:42.626 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:43.550 INFO:teuthology.orchestra.run.smithi136.stdout:generic/526 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T00:49:43.561 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/526 2023-06-24T00:49:43.562 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/526 2023-06-24T00:49:43.562 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:43.571 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:43.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:43.654 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-06-24T00:49:44.372 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:44.391 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:44.393 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:44.396 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:44.396 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:45.270 INFO:teuthology.orchestra.run.smithi136.stdout:generic/527 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T00:49:45.283 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/527 2023-06-24T00:49:45.283 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/527 2023-06-24T00:49:45.283 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:45.292 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:45.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:45.363 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-06-24T00:49:46.066 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:46.086 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:46.087 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:46.090 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:46.090 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:47.111 INFO:teuthology.orchestra.run.smithi136.stdout:generic/528 1s 2023-06-24T00:49:47.129 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/528 2023-06-24T00:49:47.129 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:47.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:47.566 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-06-24T00:49:48.330 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:48.350 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:48.351 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:48.354 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:49.611 INFO:teuthology.orchestra.run.smithi136.stdout:generic/529 1s 2023-06-24T00:49:49.632 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/529 2023-06-24T00:49:49.632 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:49.645 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:49.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:49.677 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-06-24T00:49:50.329 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:50.344 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:50.346 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:50.349 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:50.349 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:51.361 INFO:teuthology.orchestra.run.smithi136.stdout:generic/530 [not run] ceph does not support shutdown 2023-06-24T00:49:51.398 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/530 2023-06-24T00:49:51.399 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/530 2023-06-24T00:49:51.399 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:51.408 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:51.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:51.471 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-06-24T00:49:52.168 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:52.186 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:52.187 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:52.191 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:52.192 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:52.980 INFO:teuthology.orchestra.run.smithi136.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-06-24T00:49:52.994 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/531 2023-06-24T00:49:52.994 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/531 2023-06-24T00:49:52.994 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:53.003 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:53.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:53.057 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-06-24T00:49:53.732 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:53.749 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:53.750 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:53.753 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:53.754 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:54.633 INFO:teuthology.orchestra.run.smithi136.stdout:generic/532 0s 2023-06-24T00:49:54.655 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/532 2023-06-24T00:49:54.655 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:54.662 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:54.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:54.751 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-06-24T00:49:55.428 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:55.449 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:55.451 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:55.454 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:55.454 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:57.362 INFO:teuthology.orchestra.run.smithi136.stdout:generic/533 2s 2023-06-24T00:49:57.377 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/533 2023-06-24T00:49:57.377 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:57.385 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:57.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:57.439 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-06-24T00:49:58.104 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:58.123 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:58.125 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:58.128 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:58.128 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:58.934 INFO:teuthology.orchestra.run.smithi136.stdout:generic/534 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T00:49:58.944 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/534 2023-06-24T00:49:58.945 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/534 2023-06-24T00:49:58.945 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:49:58.955 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:49:59.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:49:59.021 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-06-24T00:49:59.695 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:49:59.711 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:49:59.712 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:49:59.716 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:49:59.716 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:50:00.556 INFO:teuthology.orchestra.run.smithi136.stdout:generic/535 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T00:50:00.578 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/535 2023-06-24T00:50:00.579 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/535 2023-06-24T00:50:00.579 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:50:00.588 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:50:00.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:50:00.650 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-06-24T00:50:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:50:01.398 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:50:01.400 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:50:01.402 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:50:01.403 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:50:02.427 INFO:teuthology.orchestra.run.smithi136.stdout:generic/536 [not run] ceph does not support shutdown 2023-06-24T00:50:02.474 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/536 2023-06-24T00:50:02.475 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/536 2023-06-24T00:50:02.475 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:50:02.484 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:50:02.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:50:02.549 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-06-24T00:50:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:50:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:50:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:50:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:50:03.212 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:50:04.213 INFO:teuthology.orchestra.run.smithi136.stdout:generic/537 [not run] FSTRIM not supported 2023-06-24T00:50:04.253 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/537 2023-06-24T00:50:04.254 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/537 2023-06-24T00:50:04.254 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T00:50:04.263 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:50:04.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T00:50:04.326 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-06-24T00:50:05.001 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T00:50:05.019 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T00:50:05.021 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T00:50:05.025 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T00:50:05.025 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T00:50:55.783 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T00:50:55.781+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147282) UID: 0 2023-06-24T00:50:55.784 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T00:50:55.781+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147282) UID: 0 2023-06-24T00:50:55.784 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T00:50:55.781+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147282) UID: 0 2023-06-24T00:50:55.785 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T00:50:55.781+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147282) UID: 0 2023-06-24T00:58:22.822 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:58:22.828 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:58:23.484 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T00:58:23.481+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147592) UID: 0 2023-06-24T00:58:23.485 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T00:58:23.481+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147592) UID: 0 2023-06-24T00:58:23.485 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T00:58:23.482+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147592) UID: 0 2023-06-24T00:58:23.488 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T00:58:23.484+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147592) UID: 0 2023-06-24T01:02:38.846 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:02:38.854 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:02:39.120 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T01:02:39.118+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 610849) UID: 0 2023-06-24T01:02:39.121 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T01:02:39.118+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 610849) UID: 0 2023-06-24T01:02:39.121 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T01:02:39.118+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 610849) UID: 0 2023-06-24T01:02:39.122 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T01:02:39.118+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 610849) UID: 0 2023-06-24T01:03:11.717 INFO:teuthology.orchestra.run.smithi136.stdout:generic/538 786s 2023-06-24T01:03:11.738 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/538 2023-06-24T01:03:11.738 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:11.748 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:12.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:12.367 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-06-24T01:03:13.353 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:13.382 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:13.383 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:13.386 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:13.386 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:16.869 INFO:teuthology.orchestra.run.smithi136.stdout:generic/539 3s 2023-06-24T01:03:17.277 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/539 2023-06-24T01:03:17.277 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:17.288 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:17.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:17.708 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-06-24T01:03:18.772 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:18.796 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:18.798 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:18.807 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:18.807 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:20.342 INFO:teuthology.orchestra.run.smithi136.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-24T01:03:20.465 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/540 2023-06-24T01:03:20.465 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/540 2023-06-24T01:03:20.465 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:20.553 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:20.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:20.745 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-06-24T01:03:21.592 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:21.630 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:21.631 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:21.635 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:21.636 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:23.423 INFO:teuthology.orchestra.run.smithi136.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-24T01:03:23.448 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/541 2023-06-24T01:03:23.449 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/541 2023-06-24T01:03:23.449 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:23.459 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:23.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:23.542 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-06-24T01:03:24.495 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:24.519 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:24.521 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:24.525 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:24.525 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:26.150 INFO:teuthology.orchestra.run.smithi136.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-24T01:03:26.361 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/542 2023-06-24T01:03:26.362 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/542 2023-06-24T01:03:26.362 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:26.388 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:26.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:26.502 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-06-24T01:03:27.417 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:27.443 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:27.445 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:27.448 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:27.449 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:29.008 INFO:teuthology.orchestra.run.smithi136.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-24T01:03:29.087 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/543 2023-06-24T01:03:29.088 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/543 2023-06-24T01:03:29.088 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:29.099 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:29.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:29.301 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-06-24T01:03:30.127 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:30.151 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:30.154 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:30.156 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:30.156 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:31.872 INFO:teuthology.orchestra.run.smithi136.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-24T01:03:31.900 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/544 2023-06-24T01:03:31.900 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/544 2023-06-24T01:03:31.900 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:32.022 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:32.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:32.161 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-06-24T01:03:32.966 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:32.995 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:32.997 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:33.000 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:33.001 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:34.143 INFO:teuthology.orchestra.run.smithi136.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-06-24T01:03:34.159 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/545 2023-06-24T01:03:34.159 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/545 2023-06-24T01:03:34.159 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:34.174 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:34.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:34.248 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-06-24T01:03:35.088 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:35.112 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:35.113 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:35.116 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:35.116 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:36.175 INFO:teuthology.orchestra.run.smithi136.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-24T01:03:36.202 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/546 2023-06-24T01:03:36.202 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/546 2023-06-24T01:03:36.202 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:36.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:36.304 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-06-24T01:03:37.158 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:37.182 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:37.183 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:37.188 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:37.189 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:38.251 INFO:teuthology.orchestra.run.smithi136.stdout:generic/547 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T01:03:38.273 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/547 2023-06-24T01:03:38.273 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/547 2023-06-24T01:03:38.274 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:38.282 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:38.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:38.357 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-06-24T01:03:39.186 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:39.205 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:39.207 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:39.210 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:39.210 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:41.758 INFO:teuthology.orchestra.run.smithi136.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-24T01:03:41.786 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/548 2023-06-24T01:03:41.786 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/548 2023-06-24T01:03:41.786 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:41.793 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:41.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:41.901 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-06-24T01:03:42.822 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:42.853 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:42.857 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:42.867 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:42.867 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:45.508 INFO:teuthology.orchestra.run.smithi136.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-24T01:03:45.524 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/549 2023-06-24T01:03:45.525 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/549 2023-06-24T01:03:45.525 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:45.538 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:45.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:45.627 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-06-24T01:03:46.460 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:46.497 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:46.501 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:46.505 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:46.505 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:48.157 INFO:teuthology.orchestra.run.smithi136.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-06-24T01:03:48.202 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/550 2023-06-24T01:03:48.203 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/550 2023-06-24T01:03:48.203 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:03:48.208 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:03:48.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:03:48.250 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-06-24T01:03:49.058 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:03:49.090 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:03:49.097 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:03:49.102 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:03:49.103 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:07:06.194 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:07:06.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:07:06.393 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T01:07:06.391+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618469) UID: 0 2023-06-24T01:07:06.394 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T01:07:06.391+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618469) UID: 0 2023-06-24T01:07:06.394 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T01:07:06.391+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618469) UID: 0 2023-06-24T01:07:06.395 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T01:07:06.391+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618469) UID: 0 2023-06-24T01:10:24.839 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:10:24.844 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:10:55.175 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:10:55.180 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:25.281 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:25.286 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:55.469 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:55.489 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:25.852 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:25.857 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:55.990 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:55.995 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:13:26.189 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:13:26.195 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:13:26.445 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T01:13:26.443+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148021) UID: 0 2023-06-24T01:13:26.445 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T01:13:26.443+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148021) UID: 0 2023-06-24T01:13:26.446 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T01:13:26.443+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148021) UID: 0 2023-06-24T01:13:26.446 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T01:13:26.443+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148021) UID: 0 2023-06-24T01:16:29.232 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:16:29.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:16:59.454 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:16:59.460 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:29.581 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:29.587 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:59.705 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:59.723 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:18:31.769 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:18:31.815 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:02.234 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:02.240 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:32.353 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:32.357 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:02.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:02.508 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:33.644 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:33.649 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:03.755 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:03.761 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:33.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:33.904 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:22:04.021 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:22:04.027 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:22:04.136 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T01:22:04.134+0000 7f6f7dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148401) UID: 0 2023-06-24T01:22:04.136 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T01:22:04.134+0000 7f5eba7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148401) UID: 0 2023-06-24T01:22:04.137 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T01:22:04.134+0000 7fea081f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148401) UID: 0 2023-06-24T01:22:04.137 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T01:22:04.134+0000 7fa4689f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148401) UID: 0 2023-06-24T01:24:31.678 INFO:teuthology.orchestra.run.smithi136.stdout:generic/551 1242s 2023-06-24T01:24:31.721 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/551 2023-06-24T01:24:31.721 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:31.727 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:31.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:31.748 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-06-24T01:24:32.411 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:32.423 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:32.424 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:32.427 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:32.427 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:33.133 INFO:teuthology.orchestra.run.smithi136.stdout:generic/552 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T01:24:33.143 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/552 2023-06-24T01:24:33.143 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/552 2023-06-24T01:24:33.143 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:33.149 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:33.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:33.214 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-06-24T01:24:33.706 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:33.719 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:33.720 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:33.723 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:33.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:34.338 INFO:teuthology.orchestra.run.smithi136.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-06-24T01:24:34.348 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/553 2023-06-24T01:24:34.348 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/553 2023-06-24T01:24:34.348 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:34.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:34.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:34.802 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-06-24T01:24:35.275 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:35.287 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:35.289 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:35.291 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:35.291 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:36.203 INFO:teuthology.orchestra.run.smithi136.stdout:generic/554 [not run] swapfiles are not supported 2023-06-24T01:24:36.213 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/554 2023-06-24T01:24:36.213 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/554 2023-06-24T01:24:36.213 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:36.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:36.632 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-06-24T01:24:37.128 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:37.141 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:37.142 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:37.145 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:37.145 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:37.756 INFO:teuthology.orchestra.run.smithi136.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-06-24T01:24:37.766 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/555 2023-06-24T01:24:37.766 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/555 2023-06-24T01:24:37.767 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:37.772 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:38.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:38.118 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-06-24T01:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:39.181 INFO:teuthology.orchestra.run.smithi136.stdout:generic/556 [not run] ceph does not support casefold feature 2023-06-24T01:24:39.190 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/556 2023-06-24T01:24:39.191 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/556 2023-06-24T01:24:39.191 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:39.197 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:39.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:39.245 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-06-24T01:24:39.702 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:39.715 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:39.716 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:39.718 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:39.719 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:40.280 INFO:teuthology.orchestra.run.smithi136.stdout:generic/557 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T01:24:40.290 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/557 2023-06-24T01:24:40.290 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/557 2023-06-24T01:24:40.290 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:40.296 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:40.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:40.338 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-06-24T01:24:40.795 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:40.807 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:40.808 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:40.811 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:40.811 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:41.345 INFO:teuthology.orchestra.run.smithi136.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-24T01:24:41.355 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/558 2023-06-24T01:24:41.355 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/558 2023-06-24T01:24:41.355 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:41.361 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:41.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:41.405 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-06-24T01:24:41.859 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:41.872 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:41.873 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:41.876 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:41.876 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:42.416 INFO:teuthology.orchestra.run.smithi136.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-06-24T01:24:42.426 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/559 2023-06-24T01:24:42.426 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/559 2023-06-24T01:24:42.426 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:42.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:42.475 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-06-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:42.949 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:42.950 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:42.952 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:42.952 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:43.479 INFO:teuthology.orchestra.run.smithi136.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-06-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/560 2023-06-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/560 2023-06-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:43.495 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:43.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:43.538 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-06-24T01:24:43.995 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:44.007 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:44.008 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:44.011 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:44.011 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:44.546 INFO:teuthology.orchestra.run.smithi136.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-06-24T01:24:44.556 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/561 2023-06-24T01:24:44.556 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/561 2023-06-24T01:24:44.556 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:44.563 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:44.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:44.605 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-06-24T01:24:45.064 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:45.076 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:45.078 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:45.080 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:45.080 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:46.237 INFO:teuthology.orchestra.run.smithi136.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-24T01:24:46.255 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/562 2023-06-24T01:24:46.255 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/562 2023-06-24T01:24:46.256 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:46.273 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:46.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:46.325 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-06-24T01:24:46.787 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:46.800 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:46.801 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:46.804 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:46.804 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:47.366 INFO:teuthology.orchestra.run.smithi136.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-06-24T01:24:47.376 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/563 2023-06-24T01:24:47.377 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/563 2023-06-24T01:24:47.377 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:47.382 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:47.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:47.431 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-06-24T01:24:47.895 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:47.907 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:47.908 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:47.911 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:48.562 INFO:teuthology.orchestra.run.smithi136.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-06-24T01:24:48.572 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/564 2023-06-24T01:24:48.572 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/564 2023-06-24T01:24:48.572 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:48.578 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:48.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:48.969 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-06-24T01:24:49.473 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:49.486 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:49.487 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:49.489 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:49.490 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:50.365 INFO:teuthology.orchestra.run.smithi136.stdout:generic/565 1s 2023-06-24T01:24:50.378 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/565 2023-06-24T01:24:50.379 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:50.384 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:50.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:50.815 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-06-24T01:24:51.302 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:51.315 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:51.316 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:51.319 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:51.319 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:51.841 INFO:teuthology.orchestra.run.smithi136.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-24T01:24:51.851 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/566 2023-06-24T01:24:51.851 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/566 2023-06-24T01:24:51.851 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:51.857 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:51.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:51.920 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-06-24T01:24:52.379 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:52.391 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:52.392 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:52.395 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:52.395 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:52.481 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:24:52.486 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:24:52.591 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T01:24:52.589+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 627558) UID: 0 2023-06-24T01:24:52.592 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T01:24:52.589+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 627558) UID: 0 2023-06-24T01:24:52.592 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T01:24:52.589+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 627558) UID: 0 2023-06-24T01:24:52.592 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T01:24:52.589+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 627558) UID: 0 2023-06-24T01:24:53.543 INFO:teuthology.orchestra.run.smithi136.stdout:generic/567 1s 2023-06-24T01:24:53.556 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/567 2023-06-24T01:24:53.556 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:53.562 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:53.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:53.583 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-06-24T01:24:54.087 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:54.100 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:54.101 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:54.103 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:54.104 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:54.648 INFO:teuthology.orchestra.run.smithi136.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-24T01:24:54.658 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/568 2023-06-24T01:24:54.658 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/568 2023-06-24T01:24:54.658 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:54.664 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:54.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:54.716 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-06-24T01:24:55.189 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:55.201 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:55.202 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:55.205 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:55.205 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:55.753 INFO:teuthology.orchestra.run.smithi136.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-24T01:24:55.762 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/569 2023-06-24T01:24:55.763 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/569 2023-06-24T01:24:55.763 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:55.769 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:55.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:55.822 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-06-24T01:24:56.285 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:56.297 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:56.298 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:56.301 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:56.301 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:56.897 INFO:teuthology.orchestra.run.smithi136.stdout:generic/570 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T01:24:56.906 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/570 2023-06-24T01:24:56.907 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/570 2023-06-24T01:24:56.907 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:56.913 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:56.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:56.959 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-06-24T01:24:57.421 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:57.434 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:57.435 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:57.438 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:57.438 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:58.048 INFO:teuthology.orchestra.run.smithi136.stdout:generic/571 [not run] Require fcntl setlease support 2023-06-24T01:24:58.058 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/571 2023-06-24T01:24:58.059 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/571 2023-06-24T01:24:58.059 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:58.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:58.121 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-06-24T01:24:58.579 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:58.591 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:58.592 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:58.595 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:58.595 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:59.155 INFO:teuthology.orchestra.run.smithi136.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-06-24T01:24:59.165 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/572 2023-06-24T01:24:59.165 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/572 2023-06-24T01:24:59.166 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:24:59.171 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:24:59.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:24:59.214 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-06-24T01:24:59.677 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:24:59.689 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:24:59.690 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:24:59.693 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:24:59.693 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:00.218 INFO:teuthology.orchestra.run.smithi136.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-06-24T01:25:00.228 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/573 2023-06-24T01:25:00.228 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/573 2023-06-24T01:25:00.228 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:00.234 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:00.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:00.278 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-06-24T01:25:00.731 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:00.744 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:00.745 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:00.747 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:00.747 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:01.271 INFO:teuthology.orchestra.run.smithi136.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-06-24T01:25:01.281 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/574 2023-06-24T01:25:01.281 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/574 2023-06-24T01:25:01.281 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:01.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:01.326 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-06-24T01:25:01.789 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:01.801 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:01.802 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:01.805 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:01.805 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:02.553 INFO:teuthology.orchestra.run.smithi136.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-06-24T01:25:02.563 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/575 2023-06-24T01:25:02.563 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/575 2023-06-24T01:25:02.563 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:02.569 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:02.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:02.609 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-06-24T01:25:03.071 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:03.084 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:03.085 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:03.088 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:03.906 INFO:teuthology.orchestra.run.smithi136.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-06-24T01:25:03.915 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/576 2023-06-24T01:25:03.916 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/576 2023-06-24T01:25:03.916 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:03.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:03.960 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-06-24T01:25:04.439 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:04.451 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:04.452 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:04.455 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:04.455 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:04.992 INFO:teuthology.orchestra.run.smithi136.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-06-24T01:25:05.002 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/577 2023-06-24T01:25:05.002 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/577 2023-06-24T01:25:05.002 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:05.008 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:05.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:05.055 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-06-24T01:25:05.551 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:05.563 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:05.564 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:05.566 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:06.218 INFO:teuthology.orchestra.run.smithi136.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph 2023-06-24T01:25:06.228 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/578 2023-06-24T01:25:06.229 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/578 2023-06-24T01:25:06.229 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:06.235 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:06.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:06.565 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-06-24T01:25:07.190 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:07.204 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:07.205 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:07.208 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:07.208 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:07.789 INFO:teuthology.orchestra.run.smithi136.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-06-24T01:25:07.799 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/579 2023-06-24T01:25:07.799 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/579 2023-06-24T01:25:07.799 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:07.805 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:07.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:07.850 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-06-24T01:25:08.334 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:08.347 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:08.348 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:08.350 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:08.351 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:09.221 INFO:teuthology.orchestra.run.smithi136.stdout:generic/580 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:25:09.263 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/580 2023-06-24T01:25:09.264 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/580 2023-06-24T01:25:09.264 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:09.270 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:09.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:09.317 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-06-24T01:25:09.789 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:09.803 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:09.804 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:09.806 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:09.807 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:11.882 INFO:teuthology.orchestra.run.smithi136.stdout:generic/581 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:25:11.922 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/581 2023-06-24T01:25:11.923 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/581 2023-06-24T01:25:11.923 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:11.928 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:11.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:11.973 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-06-24T01:25:12.438 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:12.450 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:12.451 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:12.454 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:12.454 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:13.346 INFO:teuthology.orchestra.run.smithi136.stdout:generic/582 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:25:13.385 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/582 2023-06-24T01:25:13.386 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/582 2023-06-24T01:25:13.386 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:13.391 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:13.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:13.440 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-06-24T01:25:13.915 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:13.928 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:13.928 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:13.931 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:13.931 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:14.827 INFO:teuthology.orchestra.run.smithi136.stdout:generic/583 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:25:14.874 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/583 2023-06-24T01:25:14.875 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/583 2023-06-24T01:25:14.875 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:14.880 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:14.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:14.924 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-06-24T01:25:15.384 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:15.396 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:15.397 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:15.400 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:15.400 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:16.313 INFO:teuthology.orchestra.run.smithi136.stdout:generic/584 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:25:16.355 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/584 2023-06-24T01:25:16.355 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/584 2023-06-24T01:25:16.355 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:16.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:16.406 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-06-24T01:25:16.871 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:16.884 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:16.885 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:16.887 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:16.888 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:17.542 INFO:teuthology.orchestra.run.smithi136.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-06-24T01:25:17.552 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/585 2023-06-24T01:25:17.552 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/585 2023-06-24T01:25:17.552 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:17.558 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:17.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:17.948 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-06-24T01:25:18.499 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:18.511 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:18.512 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:18.515 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:18.515 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:19.149 INFO:teuthology.orchestra.run.smithi136.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-24T01:25:19.159 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/586 2023-06-24T01:25:19.159 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/586 2023-06-24T01:25:19.159 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:19.168 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:19.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:19.501 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-06-24T01:25:20.096 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:20.110 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:20.111 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:20.114 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:20.114 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:20.709 INFO:teuthology.orchestra.run.smithi136.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-24T01:25:20.720 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/587 2023-06-24T01:25:20.720 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/587 2023-06-24T01:25:20.720 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:20.727 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:20.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:20.774 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-06-24T01:25:21.241 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:21.253 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:21.254 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:21.257 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:21.257 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:22.446 INFO:teuthology.orchestra.run.smithi136.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-24T01:25:22.509 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/588 2023-06-24T01:25:22.510 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/588 2023-06-24T01:25:22.510 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:22.518 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:22.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:22.572 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-06-24T01:25:23.043 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:23.055 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:23.057 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:23.059 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:23.060 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:23.812 INFO:teuthology.orchestra.run.smithi136.stdout:generic/589 [not run] require 172.21.15.136:6789:/scratch to be local device 2023-06-24T01:25:23.822 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/589 2023-06-24T01:25:23.822 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/589 2023-06-24T01:25:23.822 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:23.828 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:23.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:23.880 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-06-24T01:25:24.340 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:24.353 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:24.354 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:24.357 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:24.357 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi136.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/590 2023-06-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/590 2023-06-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:24.931 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:24.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:24.984 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-06-24T01:25:25.457 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:25.470 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:25.471 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:25.473 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:25.473 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:26.189 INFO:teuthology.orchestra.run.smithi136.stdout:generic/591 1s 2023-06-24T01:25:26.203 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/591 2023-06-24T01:25:26.204 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:26.209 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:26.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:26.549 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-06-24T01:25:27.214 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:27.228 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:27.229 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:27.232 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:27.232 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:28.321 INFO:teuthology.orchestra.run.smithi136.stdout:generic/592 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:25:28.359 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/592 2023-06-24T01:25:28.360 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/592 2023-06-24T01:25:28.360 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:28.365 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:28.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:28.410 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-06-24T01:25:28.875 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:28.887 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:28.888 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:28.891 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:28.891 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:29.806 INFO:teuthology.orchestra.run.smithi136.stdout:generic/593 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:25:29.844 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/593 2023-06-24T01:25:29.845 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/593 2023-06-24T01:25:29.845 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:29.850 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:29.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:29.891 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-06-24T01:25:30.353 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:30.365 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:30.366 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:30.369 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:30.369 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:30.965 INFO:teuthology.orchestra.run.smithi136.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-24T01:25:30.976 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/594 2023-06-24T01:25:30.976 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/594 2023-06-24T01:25:30.976 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:30.983 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:31.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:31.026 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-06-24T01:25:31.483 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:31.495 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:31.496 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:31.499 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:31.499 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:32.379 INFO:teuthology.orchestra.run.smithi136.stdout:generic/595 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:25:32.421 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/595 2023-06-24T01:25:32.422 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/595 2023-06-24T01:25:32.422 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:32.427 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:32.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:32.466 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-06-24T01:25:32.928 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:32.940 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:32.941 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:32.944 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:32.944 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:33.591 INFO:teuthology.orchestra.run.smithi136.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-06-24T01:25:33.601 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/596 2023-06-24T01:25:33.601 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/596 2023-06-24T01:25:33.601 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:33.607 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:33.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:33.658 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-06-24T01:25:34.126 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:34.139 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:34.140 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:34.143 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:34.143 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:35.759 INFO:teuthology.orchestra.run.smithi136.stdout:generic/597 1s 2023-06-24T01:25:35.772 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/597 2023-06-24T01:25:35.772 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:35.778 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:36.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:36.248 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-06-24T01:25:36.747 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:36.760 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:36.761 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:36.763 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:36.763 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:38.295 INFO:teuthology.orchestra.run.smithi136.stdout:generic/598 2s 2023-06-24T01:25:38.310 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/598 2023-06-24T01:25:38.310 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:38.317 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:38.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:38.802 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-06-24T01:25:39.286 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:39.299 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:39.300 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:39.303 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:39.303 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:40.058 INFO:teuthology.orchestra.run.smithi136.stdout:generic/599 [not run] ceph does not support shutdown 2023-06-24T01:25:40.092 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/599 2023-06-24T01:25:40.092 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/599 2023-06-24T01:25:40.092 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:40.098 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:40.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:40.138 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-06-24T01:25:40.605 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:40.618 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:40.619 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:40.622 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:41.163 INFO:teuthology.orchestra.run.smithi136.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-24T01:25:41.173 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/600 2023-06-24T01:25:41.173 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/600 2023-06-24T01:25:41.173 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:41.179 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:41.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:41.223 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-06-24T01:25:41.685 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:41.698 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:41.699 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:41.701 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:41.701 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:42.256 INFO:teuthology.orchestra.run.smithi136.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-24T01:25:42.266 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/601 2023-06-24T01:25:42.266 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/601 2023-06-24T01:25:42.266 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:42.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:42.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:42.317 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-06-24T01:25:42.781 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:42.793 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:42.794 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:42.797 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:42.797 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:43.911 INFO:teuthology.orchestra.run.smithi136.stdout:generic/602 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:25:43.942 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/602 2023-06-24T01:25:43.943 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/602 2023-06-24T01:25:43.943 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:43.948 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:43.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:43.992 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-06-24T01:25:44.454 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:44.466 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:44.467 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:44.470 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:44.470 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:45.054 INFO:teuthology.orchestra.run.smithi136.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-24T01:25:45.064 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/603 2023-06-24T01:25:45.064 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/603 2023-06-24T01:25:45.065 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:45.070 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:45.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:45.109 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-06-24T01:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:45.591 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:45.592 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:45.595 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:45.595 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:50.939 INFO:teuthology.orchestra.run.smithi136.stdout:generic/604 5s 2023-06-24T01:25:50.952 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/604 2023-06-24T01:25:50.953 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:50.958 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:50.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:50.981 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-06-24T01:25:51.447 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:51.460 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:51.461 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:51.463 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:51.464 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:53.650 INFO:teuthology.orchestra.run.smithi136.stdout:generic/605 [not run] mount 172.21.15.136:6789:/scratch with dax=always failed 2023-06-24T01:25:53.661 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/605 2023-06-24T01:25:53.661 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/605 2023-06-24T01:25:53.661 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:53.668 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:53.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:53.712 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-06-24T01:25:54.173 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:54.185 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:54.186 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:54.189 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:54.189 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:54.862 INFO:teuthology.orchestra.run.smithi136.stdout:generic/606 [not run] mount 172.21.15.136:6789:/scratch with dax=always failed 2023-06-24T01:25:54.872 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/606 2023-06-24T01:25:54.872 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/606 2023-06-24T01:25:54.872 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:54.878 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:54.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:54.923 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-06-24T01:25:55.495 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:55.507 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:55.509 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:55.511 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:55.511 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:56.211 INFO:teuthology.orchestra.run.smithi136.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-06-24T01:25:56.221 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/607 2023-06-24T01:25:56.221 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/607 2023-06-24T01:25:56.221 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:56.227 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:56.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:56.584 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-06-24T01:25:57.118 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:57.130 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:57.131 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:57.134 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:57.134 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:57.818 INFO:teuthology.orchestra.run.smithi136.stdout:generic/608 [not run] mount 172.21.15.136:6789:/scratch with dax=always failed 2023-06-24T01:25:57.828 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/608 2023-06-24T01:25:57.828 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/608 2023-06-24T01:25:57.828 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:57.834 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:57.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:57.873 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-06-24T01:25:58.333 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:25:58.345 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:25:58.346 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:25:58.349 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:25:58.349 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:59.121 INFO:teuthology.orchestra.run.smithi136.stdout:generic/609 1s 2023-06-24T01:25:59.133 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/609 2023-06-24T01:25:59.134 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:25:59.140 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:25:59.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:25:59.334 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-06-24T01:26:00.050 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:26:00.063 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:26:00.063 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:26:00.066 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:26:00.066 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:00.734 INFO:teuthology.orchestra.run.smithi136.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-24T01:26:00.744 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/610 2023-06-24T01:26:00.744 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/610 2023-06-24T01:26:00.744 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:26:00.750 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:00.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:26:00.807 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-06-24T01:26:01.273 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:26:01.286 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:26:01.286 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:26:01.289 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:26:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:02.294 INFO:teuthology.orchestra.run.smithi136.stdout:generic/611 1s 2023-06-24T01:26:02.308 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/611 2023-06-24T01:26:02.308 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:26:02.314 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:02.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:26:02.335 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-06-24T01:26:02.798 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:26:02.811 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:26:02.812 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:26:02.814 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:26:02.814 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:03.456 INFO:teuthology.orchestra.run.smithi136.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-06-24T01:26:03.466 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/612 2023-06-24T01:26:03.466 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/612 2023-06-24T01:26:03.466 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:26:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:03.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:26:03.916 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-06-24T01:26:04.412 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:26:04.424 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:26:04.425 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:26:04.427 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:26:04.428 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:05.302 INFO:teuthology.orchestra.run.smithi136.stdout:generic/613 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:26:05.339 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/613 2023-06-24T01:26:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/613 2023-06-24T01:26:05.340 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:26:05.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:05.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:26:05.385 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-06-24T01:26:05.845 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:26:05.858 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:26:05.859 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:26:05.861 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:26:05.862 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:06.890 INFO:teuthology.orchestra.run.smithi136.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-06-24T01:26:06.935 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/614 2023-06-24T01:26:06.936 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/614 2023-06-24T01:26:06.936 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:26:06.941 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:26:06.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:26:06.990 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-06-24T01:26:07.452 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:26:07.465 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:26:07.466 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:02.984 INFO:teuthology.orchestra.run.smithi136.stdout:generic/615 55s 2023-06-24T01:27:02.997 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/615 2023-06-24T01:27:02.997 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:03.003 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:03.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:03.024 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-06-24T01:27:03.493 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:03.505 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:03.506 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:03.509 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:03.509 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:04.104 INFO:teuthology.orchestra.run.smithi136.stdout:generic/616 [not run] kernel does not support IO_URING 2023-06-24T01:27:04.113 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/616 2023-06-24T01:27:04.114 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/616 2023-06-24T01:27:04.114 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:04.119 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:04.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:04.169 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-06-24T01:27:04.624 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:04.637 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:04.638 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:04.640 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:04.640 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:05.244 INFO:teuthology.orchestra.run.smithi136.stdout:generic/617 [not run] kernel does not support IO_URING 2023-06-24T01:27:05.254 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/617 2023-06-24T01:27:05.254 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/617 2023-06-24T01:27:05.254 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:05.260 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:05.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:05.323 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-06-24T01:27:05.788 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:05.802 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:05.803 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:05.805 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:05.805 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:06.996 INFO:teuthology.orchestra.run.smithi136.stdout:generic/618 0s 2023-06-24T01:27:07.009 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/618 2023-06-24T01:27:07.009 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:07.015 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:07.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:07.036 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-06-24T01:27:07.495 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:07.507 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:07.508 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:07.511 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:07.511 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:08.156 INFO:teuthology.orchestra.run.smithi136.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-24T01:27:08.167 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/619 2023-06-24T01:27:08.167 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/619 2023-06-24T01:27:08.167 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:08.174 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:08.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:08.228 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-06-24T01:27:08.706 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:08.720 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:08.721 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:08.723 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:08.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:09.348 INFO:teuthology.orchestra.run.smithi136.stdout:generic/620 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T01:27:09.357 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/620 2023-06-24T01:27:09.358 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/620 2023-06-24T01:27:09.358 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:09.364 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:09.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:09.407 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-06-24T01:27:09.865 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:09.877 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:09.878 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:09.881 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:09.881 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:10.745 INFO:teuthology.orchestra.run.smithi136.stdout:generic/621 [not run] xfs_io get_encpolicy doesn't support -t 2023-06-24T01:27:10.785 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/621 2023-06-24T01:27:10.785 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/621 2023-06-24T01:27:10.785 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:10.792 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:10.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:10.841 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-06-24T01:27:11.309 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:11.325 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:11.325 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:11.327 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:11.328 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:12.046 INFO:teuthology.orchestra.run.smithi136.stdout:generic/622 [not run] ceph does not support shutdown 2023-06-24T01:27:12.076 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/622 2023-06-24T01:27:12.077 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/622 2023-06-24T01:27:12.077 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:12.082 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:12.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:12.127 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-06-24T01:27:12.584 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:12.597 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:12.598 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:12.600 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:12.600 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:13.325 INFO:teuthology.orchestra.run.smithi136.stdout:generic/623 [not run] ceph does not support shutdown 2023-06-24T01:27:13.362 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/623 2023-06-24T01:27:13.363 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/623 2023-06-24T01:27:13.363 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:13.368 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:13.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:13.411 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-06-24T01:27:13.873 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:13.885 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:13.886 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:13.888 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:13.889 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:14.420 INFO:teuthology.orchestra.run.smithi136.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-06-24T01:27:14.430 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/624 2023-06-24T01:27:14.430 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/624 2023-06-24T01:27:14.430 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:14.436 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:14.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:14.479 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-06-24T01:27:14.941 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:14.954 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:14.955 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:14.958 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:14.958 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:15.692 INFO:teuthology.orchestra.run.smithi136.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-06-24T01:27:15.703 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/625 2023-06-24T01:27:15.703 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/625 2023-06-24T01:27:15.703 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:15.709 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:15.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:15.751 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-06-24T01:27:16.247 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:16.258 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:16.259 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:16.261 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:16.262 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:16.893 INFO:teuthology.orchestra.run.smithi136.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-06-24T01:27:16.903 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/626 2023-06-24T01:27:16.903 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/626 2023-06-24T01:27:16.903 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:16.909 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:17.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:17.254 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-06-24T01:27:17.898 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:17.913 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:17.914 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:17.917 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:17.917 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:18.583 INFO:teuthology.orchestra.run.smithi136.stdout:generic/627 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T01:27:18.593 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/627 2023-06-24T01:27:18.594 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/627 2023-06-24T01:27:18.594 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:18.599 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:18.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:18.654 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-06-24T01:27:19.132 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:19.146 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:19.147 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:19.150 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:19.150 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:20.312 INFO:teuthology.orchestra.run.smithi136.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-24T01:27:20.372 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/628 2023-06-24T01:27:20.372 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/628 2023-06-24T01:27:20.372 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:20.393 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:20.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:20.450 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-06-24T01:27:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:20.921 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:20.922 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:21.491 INFO:teuthology.orchestra.run.smithi136.stdout:generic/629 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T01:27:21.501 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/629 2023-06-24T01:27:21.502 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/629 2023-06-24T01:27:21.502 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:21.508 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:21.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:21.551 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-06-24T01:27:22.012 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:22.025 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:22.026 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:22.029 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:22.029 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:22.783 INFO:teuthology.orchestra.run.smithi136.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-24T01:27:22.960 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/630 2023-06-24T01:27:22.960 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/630 2023-06-24T01:27:22.961 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:23.000 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:23.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:23.248 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-06-24T01:27:23.710 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:23.723 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:23.723 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:23.727 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:23.727 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:49.866 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:27:49.871 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:27:55.220 INFO:teuthology.orchestra.run.smithi136.stdout:generic/631 - output mismatch (see /tmp/tmp.AfPoID7zOVxfstests-dev/results//generic/631.out.bad) 2023-06-24T01:27:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: --- tests/generic/631.out 2023-06-23 19:02:57.395933855 +0000 2023-06-24T01:27:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: +++ /tmp/tmp.AfPoID7zOVxfstests-dev/results//generic/631.out.bad 2023-06-24 01:27:55.205369110 +0000 2023-06-24T01:27:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: @@ -1,2 +1,4700 @@ 2023-06-24T01:27:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: QA output created by 631 2023-06-24T01:27:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.258 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.258 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.258 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.258 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.258 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.258 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.258 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.259 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.259 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.259 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.259 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.259 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.259 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.259 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.259 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.260 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.260 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.260 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.260 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.260 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.260 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.260 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted./tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.261 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.261 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.261 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.261 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.261 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.261 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.261 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.261 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.262 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.262 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.262 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.262 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.262 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.262 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.262 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.263 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.263 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.263 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.263 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.263 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.263 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.263 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.264 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.264 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.264 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.264 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.264 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.264 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.264 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.264 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.265 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.265 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.265 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.265 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.265 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.265 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.265 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.266 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.266 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted./tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.266 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.266 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.266 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.266 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.266 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.266 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.267 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.267 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.267 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.267 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.267 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.267 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.267 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.268 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.268 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.268 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.268 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.268 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.268 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.268 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.268 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.269 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.269 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.269 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.269 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.269 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.269 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.269 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.270 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.270 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.270 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.270 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.270 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.270 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.270 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.270 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.271 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.271 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.271 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.271 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.271 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.271 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.271 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.271 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.272 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.272 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.272 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.272 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.272 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.272 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.272 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.273 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.273 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.273 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.273 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.273 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.273 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.273 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.273 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.274 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.274 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.274 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.274 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.274 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.274 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.274 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.275 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.275 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.275 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.275 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.275 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.275 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.275 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.276 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.276 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.276 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.276 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.276 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.276 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.276 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.277 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.277 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.277 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.277 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.277 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.277 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.277 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.278 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.278 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.278 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.278 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.278 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.278 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.278 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.278 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.279 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.279 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.279 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.279 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.279 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.279 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.279 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.279 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.280 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.280 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.280 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.280 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.280 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.280 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.280 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.281 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.281 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.281 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.281 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.281 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.281 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.281 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.281 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.282 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.282 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.282 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.282 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.282 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.282 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.282 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.282 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.283 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.283 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.283 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.283 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.283 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.283 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.283 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.283 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.284 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.284 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.284 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.284 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.284 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.284 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.284 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.285 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.285 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.285 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.285 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.285 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.285 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.285 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.285 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.286 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.286 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.286 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.286 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.286 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.286 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.286 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.287 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.287 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.287 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.287 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.287 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.287 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.287 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: touch: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf' 2023-06-24T01:27:55.287 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.288 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.288 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.288 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.288 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.288 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.288 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.288 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.289 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.289 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.289 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.289 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.289 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.289 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.289 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.289 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.290 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.290 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.290 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.290 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.290 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.290 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.290 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.290 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.291 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.291 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.291 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.291 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.291 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.291 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.291 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.291 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.292 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.292 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.292 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: mv: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.292 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.292 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf' 2023-06-24T01:27:55.292 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.292 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.293 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.293 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.293 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.293 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.293 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.293 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.293 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.293 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.294 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.294 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.294 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.294 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.294 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.294 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.294 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.294 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.295 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.295 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.295 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.295 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.295 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.295 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.295 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.296 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.296 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.296 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: mount: mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.296 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.296 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.296 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.297 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.297 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.297 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.297 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.297 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.297 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.297 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.297 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.298 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf' 2023-06-24T01:27:55.298 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.298 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.298 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.298 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.298 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.298 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.298 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.299 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.299 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.299 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directoryumount: 2023-06-24T01:27:55.299 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.299 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.299 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.299 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.300 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.300 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.300 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.300 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.300 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.300 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.300 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.300 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.301 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.301 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.301 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.301 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.301 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.301 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.301 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.301 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.302 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.302 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.302 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.302 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.302 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.302 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.302 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.303 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.303 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.303 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.303 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.303 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.303 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.303 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.303 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.304 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.304 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.304 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.304 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.304 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.304 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.304 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.305 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.305 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.305 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.305 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.305 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.305 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.305 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.305 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.306 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.306 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.306 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.306 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.306 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.306 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.306 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.307 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.307 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.307 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.307 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.307 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.307 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.307 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.308 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.308 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.308 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.308 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.308 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.308 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.308 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.309 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.309 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.309 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.309 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.309 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.309 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.309 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.309 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.310 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.310 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.310 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.310 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.310 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.310 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.310 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.310 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.311 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.311 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.311 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.311 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.311 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.311 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.311 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.312 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.312 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.312 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.312 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.313 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.313 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.313 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.313 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.314 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.314 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.314 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.315 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.315 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.315 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.315 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.316 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.316 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.317 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.317 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.317 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.318 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.318 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.318 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.318 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.319 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.319 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.319 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.320 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.320 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.320 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.320 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.321 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.321 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.321 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.321 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.322 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.322 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.322 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.323 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.323 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.323 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.323 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.323 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.324 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.324 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.324 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.324 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.324 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.324 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.325 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.325 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.325 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.325 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.325 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.325 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.325 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.326 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.326 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.326 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.326 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.326 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.326 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.326 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.327 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.327 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.327 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.327 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.327 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.327 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.327 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.327 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.328 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.328 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.328 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.328 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.328 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.328 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.329 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.329 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.329 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.329 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.329 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.329 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.329 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.330 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.330 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.330 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.330 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.330 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.330 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.330 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.331 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.331 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.331 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.331 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.331 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.331 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.331 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.332 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.332 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.332 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.332 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.332 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.332 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.332 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.333 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.333 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.333 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.333 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.333 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.333 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.333 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.334 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.334 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.334 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.334 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.334 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.334 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.334 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.335 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.335 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.335 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.335 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.335 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.335 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.335 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.336 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.336 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.336 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.336 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.336 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.336 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.337 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.337 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.337 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.337 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.337 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.338 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.338 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.338 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.338 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.338 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.338 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.339 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.339 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.339 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.339 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.339 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.339 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.339 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.340 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.340 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.340 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.340 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.340 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.340 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.340 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.341 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.341 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.341 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.341 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.341 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.341 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.341 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.342 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.342 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.342 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.342 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.343 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.343 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.343 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.343 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.343 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.343 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.343 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.344 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.344 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.344 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.344 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.344 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.344 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.345 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.345 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.345 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.345 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.346 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.346 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.346 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.347 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.347 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.347 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.347 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.348 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.348 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.348 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.349 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.349 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.349 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf' 2023-06-24T01:27:55.350 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.350 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.350 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.351 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.351 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.351 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.351 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.351 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.351 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.351 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.352 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.352 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.352 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.352 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.352 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.353 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.353 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.353 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.353 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.353 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.353 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.353 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.354 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.354 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.354 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.354 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.354 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.354 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.354 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.355 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.355 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.355 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.355 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.355 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.355 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.355 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.356 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.356 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.356 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.356 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.356 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.356 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.356 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.357 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.357 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.357 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.357 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.357 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.357 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.357 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.358 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.359 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.359 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.359 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.359 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.359 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.359 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.359 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.360 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.360 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.360 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.360 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.360 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.360 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.361 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.361 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.361 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.361 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.361 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.361 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.361 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.362 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.362 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.362 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.362 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.362 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.362 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.362 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.363 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.363 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.363 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.363 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.363 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.363 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.363 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.364 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.364 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.364 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.364 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.364 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.364 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.364 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.365 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.365 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.365 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.365 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.365 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.365 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.366 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.366 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.366 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.367 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.367 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.367 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.367 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.368 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.368 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.368 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.369 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.369 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.369 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.369 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.370 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.370 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.370 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.371 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.371 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.371 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.372 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.372 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.372 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.373 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.373 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.373 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.374 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.374 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.374 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.374 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.374 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.375 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.375 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.375 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.375 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.376 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.376 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.376 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.379 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.379 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.379 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.379 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.379 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.379 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.380 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.380 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.380 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.380 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.380 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.380 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.380 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.381 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.381 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.381 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.381 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.381 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.381 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.381 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.382 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.382 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.382 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.382 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.382 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.382 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.382 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.383 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.383 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.383 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.383 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.383 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.383 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.383 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.384 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.384 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.384 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.384 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.384 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.384 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.385 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.385 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.385 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.385 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.385 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.385 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.385 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.386 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.386 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.386 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.386 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.386 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.387 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.387 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.387 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.387 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.388 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.388 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.388 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.389 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.389 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.389 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.390 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.390 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.390 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.390 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.391 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.391 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.391 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.392 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.392 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.392 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.393 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.393 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.393 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.394 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.394 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.394 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.394 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.395 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.395 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.395 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.395 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.396 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.396 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.396 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.397 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.397 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.397 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.398 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.398 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.398 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.398 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.398 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.398 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.399 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.399 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.399 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.399 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.399 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.399 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.400 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.400 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.400 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.400 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.401 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.401 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.401 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.401 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.401 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.401 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.401 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.402 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.402 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.402 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.402 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.402 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted./tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.402 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.403 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.403 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.403 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.403 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.403 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.403 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.403 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.404 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.404 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.404 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.404 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.404 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.404 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.405 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.405 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.405 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.405 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.405 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.405 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.406 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.406 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.406 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.406 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.406 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.407 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.407 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.407 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.407 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.407 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.407 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.407 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.408 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.408 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.408 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.408 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.408 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.408 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.408 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.409 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.409 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.409 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.409 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.409 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.409 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.409 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.410 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.410 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.410 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.410 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.410 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.410 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.411 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.411 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.411 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.411 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.411 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.411 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.411 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.411 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.412 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.412 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.412 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.412 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.412 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.412 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.413 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.413 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.413 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.413 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.413 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.413 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.413 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.414 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.414 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.414 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.414 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.414 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.414 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.414 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.415 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.415 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.415 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.415 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.415 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.415 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.415 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.415 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.416 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.416 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.416 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.416 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.416 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.417 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.417 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.417 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.417 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.417 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.417 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.417 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.418 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.418 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.418 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.418 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.418 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.419 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.419 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.419 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.419 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.420 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.420 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.420 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.421 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.421 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.421 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.421 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.422 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.422 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.422 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.422 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.423 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.423 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.423 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.424 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.424 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.424 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.425 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.425 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.425 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.425 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.425 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.425 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.426 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.426 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.426 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.427 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.427 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.427 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.427 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.428 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.428 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.428 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.429 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.429 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.429 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.429 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.430 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.430 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directorymv: 2023-06-24T01:27:55.430 INFO:teuthology.orchestra.run.smithi136.stdout: +cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.431 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.431 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.431 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.432 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.432 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.432 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.432 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.432 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.433 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.433 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.433 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.433 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.433 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.433 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.433 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.434 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.434 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.434 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.434 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.434 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.434 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.434 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.435 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.435 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.435 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.435 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.436 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.436 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.436 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.436 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.436 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.437 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.437 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.437 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.437 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.437 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.438 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.438 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.438 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.438 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.439 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.439 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.439 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.439 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.439 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.439 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.439 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.440 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.440 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.440 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.440 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted./tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.440 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.440 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.441 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.441 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.441 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.441 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.441 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.441 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.441 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.442 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.442 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.442 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.442 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.442 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.442 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.442 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.443 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.443 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.443 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.443 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.443 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.443 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.443 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.444 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.444 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.444 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.444 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.444 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.444 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.444 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.445 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.445 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.445 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.445 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.445 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.445 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.445 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.446 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.446 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.446 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directorymv: 2023-06-24T01:27:55.446 INFO:teuthology.orchestra.run.smithi136.stdout: +cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.446 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.446 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.446 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.447 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.447 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.447 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.447 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.447 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.447 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.447 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.448 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.448 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.448 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.448 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.448 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.448 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.448 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.449 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.449 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.449 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.449 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.449 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.449 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.449 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.449 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.450 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.450 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.450 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.450 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.450 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.450 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.450 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.451 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.451 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.451 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.451 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.451 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.451 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.452 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.452 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.452 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.452 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.452 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.452 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.452 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.453 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.453 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.453 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.453 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.453 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.453 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.453 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.454 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.454 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.454 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.454 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.454 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.454 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.454 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.455 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.455 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.455 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.455 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.455 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.455 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.455 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.455 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.456 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.456 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.456 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.456 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.456 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.456 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.456 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.457 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.457 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.457 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.457 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.457 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.457 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.457 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.458 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.458 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.458 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.458 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.458 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.458 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.458 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.459 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.459 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted./tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.459 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.459 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.459 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.459 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.459 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.460 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.460 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.460 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.460 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.460 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.460 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.460 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.461 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.461 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.461 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.461 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.461 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.461 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.461 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.462 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.462 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.462 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.462 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.462 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.462 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.462 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.463 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.463 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.463 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.463 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.463 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.463 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.463 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.464 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.464 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.464 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.464 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.464 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.464 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.464 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.465 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.465 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.465 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.465 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.465 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.465 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.465 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.466 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.466 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.466 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.466 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.466 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.466 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.466 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.467 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.467 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.467 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.467 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.467 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.467 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.467 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.468 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.468 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.468 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.468 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.468 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.468 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.468 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.469 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.469 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.469 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.469 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.469 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.469 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.469 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.470 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.470 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.470 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.470 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.470 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.470 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.470 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.471 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.471 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.471 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.471 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.471 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.471 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.471 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.471 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.472 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.472 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.472 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf' 2023-06-24T01:27:55.472 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.472 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.472 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.473 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.473 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.473 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.473 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.473 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.473 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.473 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.473 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.474 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.474 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.474 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.474 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.474 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.474 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.475 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.475 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.475 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.475 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.475 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.475 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.475 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.476 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.476 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.476 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.476 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.476 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.476 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.476 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.477 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.477 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.477 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.477 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.477 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.477 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.477 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.478 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.478 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.478 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.478 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.478 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.478 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.478 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.479 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.479 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.479 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.479 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.479 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.479 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.479 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.479 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.480 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.480 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.480 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.480 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.480 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.480 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.480 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.481 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.481 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.481 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.481 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.481 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.481 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.481 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.482 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.482 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.482 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.482 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.482 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.482 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.482 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.483 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.483 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.483 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.483 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.483 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.483 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.483 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.484 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.484 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.484 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.484 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.484 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.484 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.484 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.485 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.485 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.485 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.485 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.485 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.485 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.486 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.486 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.486 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.486 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.486 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.486 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.486 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.486 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.487 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.487 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.487 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.487 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.487 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.487 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.487 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.488 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.488 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.488 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.488 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.488 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.488 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.488 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.489 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.489 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.489 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.489 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.489 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.489 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.489 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.490 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.490 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.490 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.490 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.490 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.490 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.490 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.491 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.491 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.491 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.491 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.491 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.491 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.491 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.492 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.492 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.492 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.492 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.492 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.492 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.492 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.493 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.493 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.493 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.493 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.493 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.493 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.493 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.494 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.494 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.494 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.494 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.494 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.494 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.494 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.495 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.495 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.495 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.495 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.495 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.495 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.495 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.495 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.496 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.496 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.496 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.496 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.496 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.496 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.497 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.497 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.497 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.497 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.497 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.497 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.497 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.498 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.498 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.498 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.498 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.498 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.498 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.498 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.498 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.499 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.499 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.499 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.499 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.499 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.499 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.499 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.500 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.500 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.500 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.500 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.500 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.500 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.500 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.501 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.501 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.501 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.501 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.501 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.501 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.501 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.502 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.502 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.502 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.502 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.502 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.502 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.502 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.503 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.503 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.503 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.503 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.503 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.503 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.503 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.504 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.504 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.504 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.504 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.504 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.504 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.504 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.505 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.505 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.505 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.505 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.505 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.505 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.505 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.505 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.506 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.506 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.506 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.506 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.506 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.506 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.506 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.507 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.507 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.507 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.507 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.507 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.507 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.508 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.508 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.508 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.508 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.508 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.508 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.508 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.509 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.509 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.509 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.509 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.509 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.509 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.509 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.509 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.510 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.510 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.510 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.510 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.510 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.510 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.510 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.511 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.511 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.511 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.511 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.511 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.511 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.511 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.512 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.512 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.512 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.512 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.512 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.512 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.512 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.513 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.513 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.513 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.513 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.513 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.513 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.513 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.514 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.514 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.514 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.514 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.514 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.514 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.514 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.514 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.515 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.515 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.515 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.515 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.515 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.515 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.515 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.516 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.516 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.516 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.516 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.516 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.516 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.516 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.517 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.517 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.517 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.517 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.517 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.517 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.517 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.518 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.518 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.518 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.518 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.518 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.518 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.519 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.519 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.519 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.519 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.519 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.519 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.519 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.519 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.520 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.520 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.520 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.520 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.520 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.520 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.520 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.521 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.521 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.521 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.521 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.521 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.521 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.521 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.522 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.522 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.522 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.522 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.522 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.522 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.522 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.523 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.523 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.523 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.523 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.523 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.523 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.523 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.524 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.524 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.524 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.524 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.524 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.524 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.524 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.525 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.525 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.525 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.525 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.525 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.525 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.525 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf' 2023-06-24T01:27:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.527 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.527 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.527 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.527 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.527 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.527 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.527 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.528 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.528 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.528 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.528 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.528 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.528 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.528 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.529 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.529 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.529 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.529 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.529 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.529 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.529 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.530 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.530 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.530 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.530 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.530 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.530 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.530 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.531 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.531 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.531 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.531 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.531 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.531 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.531 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.532 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.532 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.532 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.532 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.532 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.532 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.532 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.533 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.533 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.533 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.533 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.533 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.533 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.533 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.534 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.534 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.534 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.534 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.534 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.534 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.534 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.535 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.535 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.535 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.535 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.535 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.535 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.535 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.536 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.536 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.536 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: touch: /tmp/tmp.FtStipGKalscratch/merged3: not mounted.cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf' 2023-06-24T01:27:55.536 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.536 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.536 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.536 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.537 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.537 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.537 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.537 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.537 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.537 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.537 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.538 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.538 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.538 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.538 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.538 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.538 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.538 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.538 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.539 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.539 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.539 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.539 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.539 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.539 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.539 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.540 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.540 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.540 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.540 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.540 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.541 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.541 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.541 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.541 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.541 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.541 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.541 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.542 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.542 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.542 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.542 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.542 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.542 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.542 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.543 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.543 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.543 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.543 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.543 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.543 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.543 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.544 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.544 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.544 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.544 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.544 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.544 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.544 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.545 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.545 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.545 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.545 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.545 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.545 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.545 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.546 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.546 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.546 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.546 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.546 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.546 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.546 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.546 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.547 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.547 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.547 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.547 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.547 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.547 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.547 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.548 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.548 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.548 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.548 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.548 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.548 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.548 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.549 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.549 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.549 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.549 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.549 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.549 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.549 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.550 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.550 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.550 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.550 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.550 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.550 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.550 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.551 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.551 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.551 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.551 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.551 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.551 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.551 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.552 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.552 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.552 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.552 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.552 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.552 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.552 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.553 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.553 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.553 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.553 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.553 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.553 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.553 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.554 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.554 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.554 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.554 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.554 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.554 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.554 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.554 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.555 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.555 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.555 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.555 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.555 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.555 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.555 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.556 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.556 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.556 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.556 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.556 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.556 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.556 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.557 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.557 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.557 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.557 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.557 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.557 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.557 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.558 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.558 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.558 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.558 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.558 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.558 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.558 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.559 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.559 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.559 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.559 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.559 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.559 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.559 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.559 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.560 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.560 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.560 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.560 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.560 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.560 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.560 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.561 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.561 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.561 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.561 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.561 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.561 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.561 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.562 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.562 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.562 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.562 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.562 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.562 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.562 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.563 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.563 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.563 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.563 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.563 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.563 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.563 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.564 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.564 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.564 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.564 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.564 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.564 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.564 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.565 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.565 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.565 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.565 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.565 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.565 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.565 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.566 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.566 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.566 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.566 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.566 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.566 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.566 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.567 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.567 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.567 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.567 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.567 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.567 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.567 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.568 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.568 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.568 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.568 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.568 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.568 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.568 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.569 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.569 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.569 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.569 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.569 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.569 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.569 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.569 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.570 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.570 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.570 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.570 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.570 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.570 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.570 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.571 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.571 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.571 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.571 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.571 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.571 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.571 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.572 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.572 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.572 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.572 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.572 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.572 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.572 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.573 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.573 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.573 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.573 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.573 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.573 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.573 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.574 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.574 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.574 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.574 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.574 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.574 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.574 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.575 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.575 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.575 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.575 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.575 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.575 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.575 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.576 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.576 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.576 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.576 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.576 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.576 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.576 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.576 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.577 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.577 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.577 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.577 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.577 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.577 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.577 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.578 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.578 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.578 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.578 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.578 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.578 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.578 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.579 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.579 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: 2023-06-24T01:27:55.579 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.579 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.579 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.579 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.579 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.580 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.580 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.580 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.580 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.580 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.580 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.580 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.581 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.581 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.581 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.581 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.581 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.581 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.581 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.582 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.582 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.582 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.582 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.582 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.582 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.582 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.582 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.583 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.583 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.583 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.583 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.583 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.583 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.583 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.584 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.584 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.584 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.584 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.584 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.584 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.585 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.585 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.585 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.585 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.585 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted./tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.585 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.585 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.585 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.586 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.586 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.586 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.586 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.586 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.586 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.586 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.587 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.587 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.587 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.587 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.587 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.587 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.587 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.589 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.589 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.589 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.589 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.589 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.589 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.589 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.590 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.590 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.590 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.590 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.590 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.590 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.590 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.590 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.591 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.591 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.591 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.591 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.591 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.591 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.591 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.592 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.592 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.592 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.592 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.592 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.592 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.592 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.593 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.593 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.593 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.593 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.593 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.593 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.593 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.594 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.594 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.594 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.594 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.594 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.594 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.594 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.595 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.595 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.595 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.595 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.595 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.595 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.595 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.596 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.596 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.596 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.596 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.596 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.596 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.596 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.597 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.597 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.597 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.597 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.597 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.597 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.597 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.597 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.598 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.598 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.598 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.598 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.598 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.598 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.598 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.599 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.599 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.599 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.599 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.599 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.599 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.599 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.600 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.600 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.600 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.600 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.600 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.600 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.600 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.601 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.601 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.601 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.601 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.601 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.601 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.601 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.602 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.602 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.602 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.602 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.602 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.602 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.602 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.602 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.603 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.603 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.603 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.603 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.603 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.603 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.603 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.604 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.604 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.604 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.604 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.604 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.604 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.604 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.605 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.605 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.605 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.605 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.605 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.605 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.605 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.606 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.606 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.606 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.606 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.606 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.606 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.606 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.607 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.607 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.607 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.607 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.607 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.607 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.607 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.608 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.608 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.608 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.608 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.608 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.608 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.608 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.609 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.609 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.609 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.609 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.609 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.609 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.609 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.609 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.610 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.610 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.610 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.610 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.610 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.610 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.610 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.611 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.611 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.611 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.611 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.611 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.611 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.611 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.612 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.612 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.612 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.612 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.612 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.612 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.612 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.613 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.613 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.613 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.613 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.613 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.613 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directorymv: 2023-06-24T01:27:55.613 INFO:teuthology.orchestra.run.smithi136.stdout: +cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.614 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.614 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.614 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.614 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.614 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.614 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.614 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.614 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.615 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.615 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.615 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.615 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.615 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.615 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.615 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.616 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.616 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.616 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.616 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.616 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.616 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.616 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.617 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.617 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.617 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.617 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.617 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.617 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.617 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf' 2023-06-24T01:27:55.618 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.618 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.618 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.618 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.618 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.618 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.618 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.619 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.619 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.619 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.619 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.619 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.619 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.619 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.620 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.620 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.620 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.620 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.620 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.620 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.620 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.621 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.621 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.621 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.621 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.621 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.621 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.621 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.622 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.622 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.622 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.622 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.622 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.622 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.622 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.622 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.623 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.623 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.623 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.623 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.623 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.623 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.623 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.624 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.624 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.624 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.624 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.624 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.624 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.624 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.625 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.625 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.625 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.625 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.625 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.625 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.625 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.626 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.626 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.626 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.626 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.626 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.626 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.626 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.627 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.627 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.627 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.627 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.627 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.627 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.627 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.628 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.628 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.628 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.628 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.628 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.628 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.628 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.629 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.629 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.629 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.629 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.629 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.629 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.629 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.630 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.630 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.630 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.630 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.630 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.630 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.630 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.630 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.631 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.631 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.631 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.631 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.631 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.631 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.631 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.632 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.632 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.632 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.632 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.632 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.632 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.632 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.633 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.633 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.633 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.633 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.633 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.633 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.633 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.634 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.634 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.634 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.634 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.634 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.634 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.634 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.635 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.635 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.635 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.635 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.635 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.635 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.635 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.635 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.636 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.636 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.636 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.636 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.636 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.636 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.636 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.637 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.637 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.637 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.637 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.637 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.637 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.637 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.638 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.638 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.638 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.638 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.638 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.638 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.638 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.639 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.639 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.639 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.639 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.639 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.639 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.639 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.640 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.640 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.640 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.640 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.640 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.640 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.640 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.641 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.641 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.641 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.641 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.641 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.641 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.641 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.642 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.642 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.642 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.642 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.642 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted.umount: 2023-06-24T01:27:55.642 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.642 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.643 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.643 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.643 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.643 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.643 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.643 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.643 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.644 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.644 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.644 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.644 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.644 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.644 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.644 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.645 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.645 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.645 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.645 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.645 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.645 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.645 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.645 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted./tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.646 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.646 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.646 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.646 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.646 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.646 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.646 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.647 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.647 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.647 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.647 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.647 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.647 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.647 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.648 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.648 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.648 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.648 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.648 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.648 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.648 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.649 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.649 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.649 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.649 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.649 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.649 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.649 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.650 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.650 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.650 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.650 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.650 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.650 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.650 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.651 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.651 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.651 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.651 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.651 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.651 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.651 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.652 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.652 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.652 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.652 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.652 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.652 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.652 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.653 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.653 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.653 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.653 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.653 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.653 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.653 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.653 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.654 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.654 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.654 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.654 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.654 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.654 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.654 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.655 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.655 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.655 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.655 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.655 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.655 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.655 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.656 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.656 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.656 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.656 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.656 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.656 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.656 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.657 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.657 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.657 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.657 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.657 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.657 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.657 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.658 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.658 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.658 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.658 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.658 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.658 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.658 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.659 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.659 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.659 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.659 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.659 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.659 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.659 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.659 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.660 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.660 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.660 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.660 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.660 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.660 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.660 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.661 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.661 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.661 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.661 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.661 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.661 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.662 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.662 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.662 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.662 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.662 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.662 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.662 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.662 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.663 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.663 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.663 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.663 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.663 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.663 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.663 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.664 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.664 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.664 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.664 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.664 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.664 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.664 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.665 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.665 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.665 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.665 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.665 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.665 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.665 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.666 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.666 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.666 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.666 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.666 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.666 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.666 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.667 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.667 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.667 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.667 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.667 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.667 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.667 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.668 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.668 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.668 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.668 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.669 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.669 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.669 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.669 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.670 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.670 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.670 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.670 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.671 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.671 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.671 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.672 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.672 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.672 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.672 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.673 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.673 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.673 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.673 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.673 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.673 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.674 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.674 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.674 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.674 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.674 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.674 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.674 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.675 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.675 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf'umount: : No such file or directory/tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.675 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.675 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.675 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.675 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.675 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.675 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.676 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.676 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.676 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.676 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.676 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.676 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.676 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.677 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.677 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.677 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.677 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.677 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.677 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.677 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.678 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.678 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.678 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.678 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.678 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.678 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.678 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.678 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.679 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.679 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.679 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.679 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.679 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.679 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: mount: mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.679 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.679 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.680 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.680 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.680 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.680 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.680 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.680 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.680 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.681 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.681 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.681 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.681 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.681 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.681 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.681 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.681 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.682 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.682 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.682 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.682 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.682 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.682 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.682 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.683 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.683 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.683 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.683 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.684 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.684 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.684 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.685 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.685 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.685 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.685 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.686 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.686 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.686 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.686 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.687 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.687 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.687 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.688 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.688 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.688 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.689 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.689 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.689 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.690 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.690 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.690 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.690 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.691 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.691 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.691 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.691 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.691 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.692 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.692 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.692 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.693 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.693 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.693 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.693 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.693 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.694 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.694 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.694 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.694 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.694 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.694 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.694 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.695 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.695 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.695 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.695 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.695 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.695 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.695 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.695 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.696 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.696 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.696 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.696 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.696 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.696 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.696 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.697 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.697 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.697 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.697 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.697 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.697 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.698 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.698 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.698 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.698 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.698 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.698 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.698 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.700 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.700 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.700 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.700 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.700 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.700 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.701 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.701 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.701 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.701 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.701 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.701 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.702 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.702 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.702 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.702 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.702 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.702 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.702 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.703 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.703 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.703 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.703 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.703 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.703 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.703 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.703 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.704 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.704 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.704 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.704 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.704 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.704 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.704 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.705 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.705 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.705 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.705 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.705 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.705 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.705 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.706 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.706 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.706 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.706 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.706 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.706 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.706 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.706 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.707 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.707 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.707 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.707 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.707 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.707 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.707 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.707 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.708 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.708 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.708 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.708 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.708 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.708 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.708 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.709 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.709 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.709 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.709 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.709 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.709 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.710 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.710 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.710 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.710 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.711 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.711 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.711 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.712 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.712 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.712 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.712 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.713 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.713 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.713 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.713 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.714 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.714 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.714 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.715 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.715 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.715 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.715 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.716 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.716 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.716 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.716 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.716 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.716 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.716 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.717 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.717 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.717 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.717 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.717 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.717 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.717 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.717 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.718 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted./tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.718 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.718 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.718 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.718 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.718 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.718 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.718 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.719 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.719 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.719 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.719 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.719 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.719 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.719 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.719 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.720 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.720 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.720 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.720 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.720 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.720 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.721 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.721 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.721 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.721 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.721 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.721 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.721 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.722 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.722 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.722 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.722 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.722 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.722 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.722 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.722 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.723 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.723 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted.umount: 2023-06-24T01:27:55.723 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.723 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.723 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.723 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.723 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.724 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.724 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.724 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.724 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.724 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.724 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.724 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.725 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.725 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.725 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.725 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.725 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.725 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.725 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.726 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.726 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.726 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.726 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.727 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.727 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.727 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.728 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.728 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.728 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.728 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.729 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.729 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.729 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.730 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.730 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.730 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.731 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.731 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.731 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.731 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.732 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.732 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.732 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.732 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.732 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.732 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.732 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.732 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.733 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.733 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.733 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.733 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.733 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.733 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.733 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.734 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.734 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.734 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.734 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.734 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.734 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.734 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.735 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.735 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.735 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.735 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.735 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.735 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.735 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.736 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.736 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.736 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.736 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.736 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.736 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.737 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.737 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.737 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.737 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.737 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.737 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.737 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.738 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.738 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.738 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.738 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.738 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.738 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.738 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.739 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.739 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.739 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.739 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.739 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.739 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.739 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.739 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.740 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.740 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.740 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.740 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.740 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.740 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.741 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.741 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.741 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.741 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.741 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.741 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.741 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.741 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.742 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.742 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.742 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.742 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.742 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.742 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.742 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.743 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.743 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.743 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.743 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.743 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.743 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.743 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.743 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.744 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.744 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.744 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.744 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.744 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.744 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.744 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.745 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.745 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.745 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.745 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.745 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.745 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.745 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.746 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.746 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.746 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.746 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.746 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.746 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.746 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.747 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.747 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.747 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.747 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.747 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.747 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.747 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.748 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.748 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.748 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.748 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.748 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.748 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.748 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.748 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.749 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.749 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.749 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.749 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.749 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.749 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.750 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.750 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.750 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.750 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.750 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.750 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.750 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.750 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.751 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.751 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.751 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.751 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.751 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.751 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.751 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.752 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.752 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.752 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.752 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.752 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.753 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.753 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.753 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.754 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.754 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.754 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.754 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.755 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.755 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.755 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.756 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.756 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.756 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.756 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.756 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.756 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.757 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.757 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.757 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.757 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.757 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.757 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.757 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.757 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.758 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.758 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.758 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.758 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.758 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.758 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.758 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.758 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.759 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.759 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.759 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.759 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.759 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.759 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.759 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.760 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.760 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.760 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.760 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.760 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.760 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.760 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.760 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.761 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.761 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.761 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.761 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.761 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.761 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.761 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.762 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.762 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.762 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.762 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.762 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.762 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.762 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.763 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.763 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.763 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.763 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.763 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.763 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.763 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.763 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.764 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.764 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.764 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.764 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.764 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.764 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.765 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.765 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.765 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.765 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.765 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.765 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.765 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.765 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.766 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.766 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.766 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.766 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.766 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.766 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.766 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.767 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.767 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.767 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.767 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.767 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.767 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.767 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.767 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.768 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.768 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.768 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.768 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.768 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.768 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.768 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.769 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.769 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.769 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.769 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.769 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.769 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.769 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.770 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.770 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.770 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.770 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.770 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.770 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.770 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.770 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.771 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.771 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.771 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.771 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.771 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.771 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.771 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.771 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.772 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.772 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.772 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.772 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.772 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.773 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.773 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.773 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.773 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.773 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.773 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.773 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.773 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.774 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.774 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.774 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.774 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.774 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.774 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.774 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.774 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.775 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.775 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.775 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.775 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.775 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.775 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.775 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.776 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.776 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.776 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.776 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.776 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.776 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.776 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.776 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.777 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.777 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.777 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.777 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.777 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.777 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.777 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.778 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.778 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.778 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.778 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.778 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.778 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.778 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.778 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.779 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.779 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.779 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.779 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.779 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.779 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.779 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.780 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.780 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.780 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.780 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.780 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.780 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.780 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.780 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.781 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.781 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.781 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.781 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.781 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.781 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.781 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.781 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.782 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.782 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.782 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.782 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.782 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.782 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.782 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.783 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.783 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.783 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.783 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.783 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.783 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.783 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.783 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.784 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.784 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.784 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.784 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.784 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.784 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.784 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.785 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.785 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.785 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.785 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.785 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.785 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.785 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.785 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.786 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.786 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.786 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.786 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.786 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.786 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.786 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.787 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.787 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.787 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.787 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.787 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.787 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.787 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.787 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.788 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.788 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.788 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.788 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.788 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.788 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.788 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.788 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.789 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.789 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.789 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.789 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.789 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.789 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.789 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.790 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.790 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.790 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.790 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.790 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.790 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.790 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.790 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.791 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.791 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.791 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.791 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.791 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.791 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.791 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.791 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.792 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.792 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.792 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.792 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.792 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.792 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.792 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.793 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.793 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.793 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.793 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.793 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.793 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.793 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.793 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.794 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.794 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.794 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.794 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.794 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.794 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.794 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.795 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.795 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.795 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.795 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.795 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.795 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.796 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.796 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.796 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.796 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.796 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.796 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.796 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.797 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.797 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.797 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.797 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.797 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.797 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.797 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.798 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.798 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.798 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.798 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.798 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.798 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.798 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.798 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.799 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.799 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.799 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.799 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.799 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.799 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.799 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.800 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.800 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.800 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.800 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.800 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.800 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.800 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.800 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.801 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.801 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.801 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.801 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.801 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.801 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.801 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.802 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.802 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.802 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.802 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.802 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.802 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.802 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.802 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.803 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.803 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.803 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.803 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.803 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.803 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.803 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.803 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.804 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.804 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.804 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.804 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.804 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.804 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.804 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.805 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.805 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.805 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.805 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.805 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.805 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.805 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.805 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.806 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.806 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.806 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.806 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.806 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.806 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.806 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.807 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.807 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.807 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.807 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.807 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.807 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.807 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.807 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.808 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.808 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.808 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.808 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.808 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.808 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.808 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.808 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.809 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.809 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.809 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.809 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.809 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.809 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.809 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.809 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.810 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.810 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.810 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.810 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.810 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.810 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.810 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.810 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.811 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.811 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.811 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.811 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.811 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.811 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.811 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.811 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.812 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.812 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.812 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.812 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.812 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.812 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.812 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.813 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.813 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.813 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.813 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.813 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.813 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.813 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.813 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.814 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.814 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.814 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.814 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.814 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.814 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.814 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.814 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.815 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.815 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.815 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.815 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.815 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.815 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.815 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.815 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.816 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.816 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.816 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.816 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.816 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.816 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.816 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.817 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.817 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.817 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.817 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted.umount: 2023-06-24T01:27:55.817 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.817 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.817 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.818 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.818 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.818 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.818 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.818 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.818 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.818 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.818 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.819 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.819 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.819 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.819 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: 2023-06-24T01:27:55.819 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.819 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.819 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.820 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.820 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.820 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.820 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.820 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.820 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.820 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.820 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.821 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.821 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.821 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.821 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.821 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.821 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.821 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.821 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.822 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.822 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.822 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.822 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.822 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.822 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.822 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.822 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.823 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.823 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.823 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.823 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.823 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.823 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.823 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.823 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.824 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.824 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.824 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.824 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.824 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.824 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.824 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.825 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.825 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.825 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.825 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.825 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.825 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.825 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.825 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.826 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.826 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.826 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.826 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.826 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.826 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.826 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.826 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.827 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.827 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.827 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.827 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.827 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.827 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.827 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.827 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.828 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.828 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.828 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.828 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.828 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.828 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.828 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.828 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.829 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.829 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.829 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.829 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.829 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.829 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.829 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.830 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.830 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.830 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.830 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.830 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.830 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.830 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.830 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.831 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.831 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.831 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.831 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.831 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.831 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.831 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.831 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.832 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.832 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.832 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.832 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.832 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.832 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.832 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.832 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.833 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.833 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.833 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.833 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.833 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.833 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.833 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.833 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.834 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.834 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.834 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.834 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.834 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.834 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.834 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.834 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.835 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.835 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.835 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.835 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.835 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.835 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.835 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.836 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.836 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.836 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.836 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.836 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.836 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.837 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.837 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.837 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.837 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.837 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.837 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.837 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.837 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.838 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.838 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.838 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.838 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.838 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.838 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.838 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.839 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.839 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.839 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.839 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.839 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.839 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.840 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.840 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.840 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.840 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.840 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.840 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.841 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.841 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.841 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.841 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.841 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.842 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.842 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.842 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.842 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.842 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.842 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.842 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.842 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.843 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.843 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.843 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.843 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.843 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.843 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.843 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.844 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.844 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.844 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.844 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.844 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.844 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.844 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.844 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.845 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.845 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.845 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.845 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.845 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.845 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.845 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.845 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.846 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.846 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.846 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.846 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.846 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.846 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.846 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.846 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.847 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.847 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.847 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.847 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.847 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.847 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.847 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.848 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted./tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.848 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.848 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.848 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.848 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.848 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.848 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.848 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.849 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.849 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.849 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.849 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.849 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.849 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.849 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.850 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.850 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.850 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.850 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.850 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.850 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.850 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.850 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.851 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.851 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.851 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.851 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.851 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.851 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.851 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.851 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.852 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.852 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.852 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.852 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.852 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.852 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.852 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.852 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.853 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.853 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.853 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.853 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.853 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.853 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.853 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.853 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.854 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.854 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.854 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.854 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.854 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.854 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.854 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.855 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.855 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.855 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.855 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.855 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.855 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.855 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.855 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.856 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.856 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.856 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.856 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.856 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.856 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.856 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.856 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.857 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.857 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.857 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.857 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.857 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.857 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.857 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.857 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.858 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.858 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.858 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.858 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.858 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.858 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.858 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.859 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.859 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.859 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.859 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.859 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.859 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.859 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.859 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.860 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.860 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.860 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.860 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.860 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.860 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.860 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.860 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.861 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.861 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.861 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.861 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.861 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.861 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.861 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.861 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.862 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.862 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.862 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.862 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.862 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.862 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.862 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.863 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.863 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.863 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.863 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.863 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.863 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.863 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.863 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.864 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.864 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.864 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.864 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.864 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.864 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.864 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.864 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.865 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.865 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.865 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.865 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.865 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.865 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.865 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.866 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.866 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.866 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.866 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.866 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.866 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.866 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.866 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.867 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.867 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.867 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.867 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.867 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.867 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.867 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.867 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.868 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.868 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.868 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.868 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.868 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.868 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.868 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.869 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.869 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.869 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.869 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.869 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.869 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.869 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.869 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.870 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.870 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.870 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.870 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.870 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.870 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.870 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.870 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.871 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.871 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.871 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.871 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.871 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.871 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.871 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.871 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.872 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.872 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.872 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.872 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.872 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.872 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.872 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.873 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.873 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.873 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.873 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.873 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.873 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.873 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.873 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.874 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.874 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.874 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.874 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.874 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.874 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.874 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.874 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.875 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.875 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.875 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.875 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.875 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.875 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.875 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.875 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.876 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.876 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.876 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.876 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.876 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.876 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.876 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.876 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.877 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.877 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.877 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.877 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.877 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.877 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.877 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.877 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.878 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.878 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.878 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.878 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.878 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.878 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.878 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.879 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.879 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.879 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.879 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.879 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.879 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.879 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.879 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.880 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.880 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.880 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.880 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.880 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.880 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.880 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.880 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.881 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.881 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.881 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.881 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.881 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.881 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.881 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.882 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.882 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.882 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.882 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.882 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.882 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.882 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.882 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.883 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.883 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.883 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.883 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.883 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.883 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.883 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.883 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.884 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.884 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.884 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.884 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.884 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.884 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.884 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.884 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.885 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.885 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.885 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.885 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.885 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.885 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.885 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.885 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.886 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.886 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.886 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.886 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.886 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.886 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.886 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.887 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf' 2023-06-24T01:27:55.887 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.887 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.887 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.887 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.887 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.887 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.887 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.888 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.888 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.888 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.888 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.888 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.888 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.888 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.889 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.889 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.889 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.889 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.889 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.889 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.889 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.889 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.890 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.890 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.890 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.890 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.890 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.890 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-06-24T01:27:55.890 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.890 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.891 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.891 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.891 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.891 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.891 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.891 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.891 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.891 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted./tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.892 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.892 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.892 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.892 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.892 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.892 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.892 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.893 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.893 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.893 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.893 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.893 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.893 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.893 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.893 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.894 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.894 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.894 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.894 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.894 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.894 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.894 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.894 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.895 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.895 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.895 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.895 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.895 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.895 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.895 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.895 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.896 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.896 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.896 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.896 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.896 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.896 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.896 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.897 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.897 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.897 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.897 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.897 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.897 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.897 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.897 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.898 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.898 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.898 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.898 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.898 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.898 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.898 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.899 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.899 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.899 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.899 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.899 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.899 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.899 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.899 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.900 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.900 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.900 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.900 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.900 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.900 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.900 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.900 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.901 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.901 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.901 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.901 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.901 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.901 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.901 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.901 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.902 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.902 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.902 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.902 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.902 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.902 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.902 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.902 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.903 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.903 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.903 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.903 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.903 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.903 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.903 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.903 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.904 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.904 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.904 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.904 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.904 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.904 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.904 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.905 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.905 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.905 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.905 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.905 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.905 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.905 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.905 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.906 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.906 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.906 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.906 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.906 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.906 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.906 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.906 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.907 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.907 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.907 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.907 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.907 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.907 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.907 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.907 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.908 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted.umount: 2023-06-24T01:27:55.908 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.908 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.908 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.908 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.908 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.909 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.909 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.909 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.909 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.909 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.909 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.909 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.910 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.910 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.910 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.910 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.910 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.910 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.910 INFO:teuthology.orchestra.run.smithi136.stdout: + 2023-06-24T01:27:55.910 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.911 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.911 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.911 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.911 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.911 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.911 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.911 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.912 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.912 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.912 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.912 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.912 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.912 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.912 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.912 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.913 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.913 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.913 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: touch: /tmp/tmp.FtStipGKalscratch/merged2: not mounted.cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf' 2023-06-24T01:27:55.913 INFO:teuthology.orchestra.run.smithi136.stdout: +: No such file or directory 2023-06-24T01:27:55.913 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.913 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.913 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.913 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.914 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.914 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.914 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.914 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.914 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.914 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.914 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.914 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.915 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.915 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.915 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.915 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.915 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.915 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.915 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.915 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.916 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-24T01:27:55.916 INFO:teuthology.orchestra.run.smithi136.stdout: +/tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.916 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.916 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.916 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.916 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.916 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.917 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.917 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.917 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.917 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.917 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.917 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.917 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.917 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.918 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.918 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.918 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.918 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.918 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.918 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.918 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.918 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.919 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.919 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.919 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.919 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.919 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.919 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.919 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.920 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.920 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.920 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.920 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.920 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.920 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.920 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.920 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.921 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.921 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.921 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.921 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.921 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.921 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.921 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.922 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.922 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.922 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.922 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.922 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.922 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.922 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.922 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.923 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.923 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.923 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.923 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.923 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.923 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.923 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.924 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.924 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.924 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.924 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.924 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.924 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.924 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.924 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.925 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.925 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.925 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.925 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.925 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.925 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.925 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.925 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged3/etc/access.conf': No such file or directory 2023-06-24T01:27:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged0/etc/access.conf': No such file or directory 2023-06-24T01:27:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged3: not mounted. 2023-06-24T01:27:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged0: not mounted. 2023-06-24T01:27:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged4/etc/access.conf': No such file or directory 2023-06-24T01:27:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged4: not mounted. 2023-06-24T01:27:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.928 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.928 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.928 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.928 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.928 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.928 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.928 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged5/etc/access.conf': No such file or directory 2023-06-24T01:27:55.929 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged1/etc/access.conf': No such file or directory 2023-06-24T01:27:55.929 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged5: not mounted. 2023-06-24T01:27:55.929 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged1: not mounted. 2023-06-24T01:27:55.929 INFO:teuthology.orchestra.run.smithi136.stdout: +mount: /tmp/tmp.FtStipGKalscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-24T01:27:55.929 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.929 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.929 INFO:teuthology.orchestra.run.smithi136.stdout: +mv: cannot stat '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.930 INFO:teuthology.orchestra.run.smithi136.stdout: +touch: cannot touch '/tmp/tmp.FtStipGKalscratch/merged2/etc/access.conf': No such file or directory 2023-06-24T01:27:55.930 INFO:teuthology.orchestra.run.smithi136.stdout: +umount: /tmp/tmp.FtStipGKalscratch/merged2: not mounted. 2023-06-24T01:27:55.930 INFO:teuthology.orchestra.run.smithi136.stdout: Silence is golden. 2023-06-24T01:27:55.930 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:55.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T01:27:55.932 INFO:teuthology.orchestra.run.smithi136.stdout:HINT: You _MAY_ be missing kernel fix: 2023-06-24T01:27:55.932 INFO:teuthology.orchestra.run.smithi136.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-06-24T01:27:55.932 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:55.932 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/631 2023-06-24T01:27:55.932 INFO:teuthology.orchestra.run.smithi136.stdout:Failures: generic/631 2023-06-24T01:27:55.932 INFO:teuthology.orchestra.run.smithi136.stdout:Failed 1 of 1 tests 2023-06-24T01:27:55.933 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:55.933 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-06-24T01:27:55.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-06-24T01:27:55.934 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-06-24T01:27:56.387 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:56.399 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:56.400 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:56.403 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:56.403 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:58.269 INFO:teuthology.orchestra.run.smithi136.stdout:generic/632 2s 2023-06-24T01:27:58.282 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/632 2023-06-24T01:27:58.282 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:58.288 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:58.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:27:58.345 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-06-24T01:27:58.804 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:27:58.817 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:27:58.818 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:27:58.821 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:27:58.821 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:27:59.725 INFO:teuthology.orchestra.run.smithi136.stdout:generic/633 0s 2023-06-24T01:27:59.739 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/633 2023-06-24T01:27:59.739 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:27:59.745 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:00.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:28:00.173 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-06-24T01:28:00.637 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:28:00.649 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:28:00.650 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:28:00.653 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:28:00.653 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:02.122 INFO:teuthology.orchestra.run.smithi136.stdout:generic/634 2s 2023-06-24T01:28:02.135 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/634 2023-06-24T01:28:02.135 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:28:02.140 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:02.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:28:02.162 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-06-24T01:28:02.627 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:28:02.639 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:28:02.642 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:28:02.643 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:28:02.643 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:03.365 INFO:teuthology.orchestra.run.smithi136.stdout:generic/635 [not run] ceph does not support shutdown 2023-06-24T01:28:03.404 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/635 2023-06-24T01:28:03.404 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/635 2023-06-24T01:28:03.404 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:28:03.410 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:03.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:28:03.454 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-06-24T01:28:03.913 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:28:03.926 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:28:03.927 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:28:03.929 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:28:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:04.754 INFO:teuthology.orchestra.run.smithi136.stdout:generic/636 [not run] swapfiles are not supported 2023-06-24T01:28:04.764 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/636 2023-06-24T01:28:04.764 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/636 2023-06-24T01:28:04.764 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:28:04.771 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:04.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:28:04.827 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-06-24T01:28:05.286 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:28:05.298 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:28:05.300 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:28:05.302 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:28:05.303 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:06.289 INFO:teuthology.orchestra.run.smithi136.stdout:generic/637 1s 2023-06-24T01:28:06.301 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/637 2023-06-24T01:28:06.302 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:28:06.307 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:06.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:28:06.656 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-06-24T01:28:07.156 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:28:07.168 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:28:07.169 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:28:07.172 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:28:07.172 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:07.775 INFO:teuthology.orchestra.run.smithi136.stdout:generic/638 0s 2023-06-24T01:28:07.788 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/638 2023-06-24T01:28:07.788 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:28:07.794 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:07.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:28:07.842 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-06-24T01:28:08.307 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:28:08.319 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:28:08.320 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:28:08.323 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:28:08.323 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:09.048 INFO:teuthology.orchestra.run.smithi136.stdout:generic/639 1s 2023-06-24T01:28:09.061 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/639 2023-06-24T01:28:09.061 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:28:09.067 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:09.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:28:09.125 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-06-24T01:28:09.583 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:28:09.596 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:28:09.597 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:28:09.599 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:28:09.599 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:10.153 INFO:teuthology.orchestra.run.smithi136.stdout:generic/640 [not run] require 172.21.15.136:6789:/scratch to be valid block disk 2023-06-24T01:28:10.163 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/640 2023-06-24T01:28:10.163 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/640 2023-06-24T01:28:10.163 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:28:10.169 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:10.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:28:10.210 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-06-24T01:28:10.671 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:28:10.683 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:28:10.685 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:28:10.687 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:28:10.688 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:11.485 INFO:teuthology.orchestra.run.smithi136.stdout:generic/641 [not run] swapfiles are not supported 2023-06-24T01:28:11.495 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/641 2023-06-24T01:28:11.495 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/641 2023-06-24T01:28:11.496 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:28:11.501 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:11.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:28:11.548 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-06-24T01:28:12.011 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:28:12.024 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:28:12.025 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:28:12.027 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:28:12.027 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:28:20.093 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:28:20.098 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:28:50.240 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:28:50.245 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:29:20.362 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:29:20.367 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:29:51.407 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:29:51.412 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:21.548 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:21.561 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:53.472 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:53.477 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:31:23.618 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:31:23.624 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:31:23.728 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-24T01:31:23.726+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 148873) UID: 0 2023-06-24T01:31:23.729 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-24T01:31:23.726+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 148873) UID: 0 2023-06-24T01:34:55.353 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:34:55.358 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:34:55.474 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T01:34:55.471+0000 7f2405df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 704432) UID: 0 2023-06-24T01:34:55.474 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T01:34:55.471+0000 7f494e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 704432) UID: 0 2023-06-24T01:34:55.475 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T01:34:55.471+0000 7f91d13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 704432) UID: 0 2023-06-24T01:34:55.475 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T01:34:55.471+0000 7fe8a6ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 704432) UID: 0 2023-06-24T01:37:28.272 INFO:teuthology.orchestra.run.smithi136.stdout:generic/642 556s 2023-06-24T01:37:28.285 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/642 2023-06-24T01:37:28.285 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:37:28.291 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:37:28.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:37:28.313 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-06-24T01:37:32.363 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:37:32.377 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:37:32.379 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:37:32.381 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:37:32.381 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:38:04.163 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:38:04.169 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:38:04.922 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-24T01:38:04.919+0000 7f535adf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 148968) UID: 0 2023-06-24T01:38:04.922 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-24T01:38:04.919+0000 7f113b1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 148968) UID: 0 2023-06-24T01:41:25.800 INFO:teuthology.orchestra.run.smithi136.stdout:generic/643 [not run] swapfiles are not supported 2023-06-24T01:41:25.810 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/643 2023-06-24T01:41:25.810 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/643 2023-06-24T01:41:25.810 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:41:25.816 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:25.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:41:25.859 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-06-24T01:41:26.337 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:41:26.350 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:41:26.351 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:41:26.354 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:41:26.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:26.897 INFO:teuthology.orchestra.run.smithi136.stdout:generic/644 [not run] vfstest not support by ceph 2023-06-24T01:41:26.906 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/644 2023-06-24T01:41:26.907 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/644 2023-06-24T01:41:26.907 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:41:26.913 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:26.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:41:26.955 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-06-24T01:41:27.412 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:41:27.425 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:41:27.426 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:41:27.429 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:41:27.429 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:27.933 INFO:teuthology.orchestra.run.smithi136.stdout:generic/645 [not run] vfstest not support by ceph 2023-06-24T01:41:27.943 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/645 2023-06-24T01:41:27.943 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/645 2023-06-24T01:41:27.944 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:41:27.950 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:27.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:41:27.994 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-06-24T01:41:28.449 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:41:28.462 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:41:28.463 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:41:28.466 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:41:28.466 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:29.151 INFO:teuthology.orchestra.run.smithi136.stdout:generic/646 [not run] ceph does not support shutdown 2023-06-24T01:41:29.180 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/646 2023-06-24T01:41:29.180 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/646 2023-06-24T01:41:29.180 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:41:29.186 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:29.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:41:29.226 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-06-24T01:41:29.682 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:41:29.694 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:41:29.695 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:41:29.698 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:41:29.698 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:30.467 INFO:teuthology.orchestra.run.smithi136.stdout:generic/647 1s 2023-06-24T01:41:30.480 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/647 2023-06-24T01:41:30.480 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:41:30.486 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:30.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:41:30.634 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-06-24T01:41:31.336 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:41:31.348 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:41:31.349 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:41:31.352 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:41:31.352 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:32.492 INFO:teuthology.orchestra.run.smithi136.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-24T01:41:32.513 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/648 2023-06-24T01:41:32.513 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/648 2023-06-24T01:41:32.513 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:41:32.523 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:32.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:41:32.579 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-06-24T01:41:33.037 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:41:33.049 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:41:33.050 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:41:33.053 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:41:33.053 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:33.658 INFO:teuthology.orchestra.run.smithi136.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-06-24T01:41:33.668 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/649 2023-06-24T01:41:33.668 INFO:teuthology.orchestra.run.smithi136.stdout:Not run: generic/649 2023-06-24T01:41:33.668 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2023-06-24T01:41:33.674 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:41:34.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-24T01:41:34.073 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.AfPoID7zOVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-06-24T01:41:34.559 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2023-06-24T01:41:34.571 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-24T01:41:34.573 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2023-06-24T01:41:34.575 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCu65Vksi4eMxAAat0M1NQG5zJbuvvSy/zZAg== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.FtStipGKalscratch 2023-06-24T01:41:34.575 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:42:22.777 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:42:22.800 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:42:53.525 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:42:53.546 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:24.433 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:24.470 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:37.644 INFO:tasks.ceph.mon.a.smithi136.stderr:2023-06-24T01:43:37.639+0000 7f35d6bf9700 -1 rocksdb: submit_common error: IO error: While appending to file: /var/lib/ceph/mon/ceph-a/store.db/000619.log: Input/output error code =  Rocksdb transaction: 2023-06-24T01:43:37.645 INFO:tasks.ceph.mon.a.smithi136.stderr:PutCF( prefix = paxos key = '29478' value size = 5838) 2023-06-24T01:43:37.645 INFO:tasks.ceph.mon.a.smithi136.stderr:PutCF( prefix = paxos key = 'pending_v' value size = 8) 2023-06-24T01:43:37.645 INFO:tasks.ceph.mon.a.smithi136.stderr:PutCF( prefix = paxos key = 'pending_pn' value size = 8) 2023-06-24T01:43:37.696 INFO:tasks.ceph.mon.a.smithi136.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mon/MonitorDBStore.h: In function 'int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)' thread 7f35d6bf9700 time 2023-06-24T01:43:37.640394+0000 2023-06-24T01:43:37.696 INFO:tasks.ceph.mon.a.smithi136.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mon/MonitorDBStore.h: 355: ceph_abort_msg("failed to write to db") 2023-06-24T01:43:37.696 INFO:tasks.ceph.mon.a.smithi136.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-24T01:43:37.697 INFO:tasks.ceph.mon.a.smithi136.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f35e88aa41f] 2023-06-24T01:43:37.697 INFO:tasks.ceph.mon.a.smithi136.stderr: 2: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x55a3ff27809f] 2023-06-24T01:43:37.697 INFO:tasks.ceph.mon.a.smithi136.stderr: 3: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x55a3ff38ac5b] 2023-06-24T01:43:37.697 INFO:tasks.ceph.mon.a.smithi136.stderr: 4: (Paxos::propose_pending()+0x126) [0x55a3ff38f8a6] 2023-06-24T01:43:37.697 INFO:tasks.ceph.mon.a.smithi136.stderr: 5: (Paxos::trigger_propose()+0x146) [0x55a3ff38fcc6] 2023-06-24T01:43:37.697 INFO:tasks.ceph.mon.a.smithi136.stderr: 6: (PaxosService::propose_pending()+0x178) [0x55a3ff39a488] 2023-06-24T01:43:37.697 INFO:tasks.ceph.mon.a.smithi136.stderr: 7: (Context::complete(int)+0xd) [0x55a3ff24a91d] 2023-06-24T01:43:37.698 INFO:tasks.ceph.mon.a.smithi136.stderr: 8: (CommonSafeTimer::timer_thread()+0x127) [0x7f35e899b2a7] 2023-06-24T01:43:37.698 INFO:tasks.ceph.mon.a.smithi136.stderr: 9: (CommonSafeTimerThread::entry()+0x11) [0x7f35e899c3d1] 2023-06-24T01:43:37.698 INFO:tasks.ceph.mon.a.smithi136.stderr: 10: /lib64/libpthread.so.0(+0x81cf) [0x7f35e48081cf] 2023-06-24T01:43:37.698 INFO:tasks.ceph.mon.a.smithi136.stderr: 11: clone() 2023-06-24T01:43:37.698 INFO:tasks.ceph.mon.a.smithi136.stderr:*** Caught signal (Aborted) ** 2023-06-24T01:43:37.698 INFO:tasks.ceph.mon.a.smithi136.stderr: in thread 7f35d6bf9700 thread_name:safe_timer 2023-06-24T01:43:37.698 INFO:tasks.ceph.mon.a.smithi136.stderr:2023-06-24T01:43:37.692+0000 7f35d6bf9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mon/MonitorDBStore.h: In function 'int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)' thread 7f35d6bf9700 time 2023-06-24T01:43:37.640394+0000 2023-06-24T01:43:37.699 INFO:tasks.ceph.mon.a.smithi136.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mon/MonitorDBStore.h: 355: ceph_abort_msg("failed to write to db") 2023-06-24T01:43:37.699 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:37.699 INFO:tasks.ceph.mon.a.smithi136.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-24T01:43:37.699 INFO:tasks.ceph.mon.a.smithi136.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f35e88aa41f] 2023-06-24T01:43:37.699 INFO:tasks.ceph.mon.a.smithi136.stderr: 2: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x55a3ff27809f] 2023-06-24T01:43:37.699 INFO:tasks.ceph.mon.a.smithi136.stderr: 3: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x55a3ff38ac5b] 2023-06-24T01:43:37.700 INFO:tasks.ceph.mon.a.smithi136.stderr: 4: (Paxos::propose_pending()+0x126) [0x55a3ff38f8a6] 2023-06-24T01:43:37.700 INFO:tasks.ceph.mon.a.smithi136.stderr: 5: (Paxos::trigger_propose()+0x146) [0x55a3ff38fcc6] 2023-06-24T01:43:37.700 INFO:tasks.ceph.mon.a.smithi136.stderr: 6: (PaxosService::propose_pending()+0x178) [0x55a3ff39a488] 2023-06-24T01:43:37.700 INFO:tasks.ceph.mon.a.smithi136.stderr: 7: (Context::complete(int)+0xd) [0x55a3ff24a91d] 2023-06-24T01:43:37.700 INFO:tasks.ceph.mon.a.smithi136.stderr: 8: (CommonSafeTimer::timer_thread()+0x127) [0x7f35e899b2a7] 2023-06-24T01:43:37.700 INFO:tasks.ceph.mon.a.smithi136.stderr: 9: (CommonSafeTimerThread::entry()+0x11) [0x7f35e899c3d1] 2023-06-24T01:43:37.700 INFO:tasks.ceph.mon.a.smithi136.stderr: 10: /lib64/libpthread.so.0(+0x81cf) [0x7f35e48081cf] 2023-06-24T01:43:37.701 INFO:tasks.ceph.mon.a.smithi136.stderr: 11: clone() 2023-06-24T01:43:37.701 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:37.701 INFO:tasks.ceph.mon.a.smithi136.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-24T01:43:37.702 INFO:tasks.ceph.mon.a.smithi136.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f35e4812ce0] 2023-06-24T01:43:37.702 INFO:tasks.ceph.mon.a.smithi136.stderr: 2: gsignal() 2023-06-24T01:43:37.702 INFO:tasks.ceph.mon.a.smithi136.stderr: 3: abort() 2023-06-24T01:43:37.702 INFO:tasks.ceph.mon.a.smithi136.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f35e88aa4df] 2023-06-24T01:43:37.702 INFO:tasks.ceph.mon.a.smithi136.stderr: 5: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x55a3ff27809f] 2023-06-24T01:43:37.702 INFO:tasks.ceph.mon.a.smithi136.stderr: 6: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x55a3ff38ac5b] 2023-06-24T01:43:37.702 INFO:tasks.ceph.mon.a.smithi136.stderr: 7: (Paxos::propose_pending()+0x126) [0x55a3ff38f8a6] 2023-06-24T01:43:37.703 INFO:tasks.ceph.mon.a.smithi136.stderr: 8: (Paxos::trigger_propose()+0x146) [0x55a3ff38fcc6] 2023-06-24T01:43:37.703 INFO:tasks.ceph.mon.a.smithi136.stderr: 9: (PaxosService::propose_pending()+0x178) [0x55a3ff39a488] 2023-06-24T01:43:37.703 INFO:tasks.ceph.mon.a.smithi136.stderr: 10: (Context::complete(int)+0xd) [0x55a3ff24a91d] 2023-06-24T01:43:37.703 INFO:tasks.ceph.mon.a.smithi136.stderr: 11: (CommonSafeTimer::timer_thread()+0x127) [0x7f35e899b2a7] 2023-06-24T01:43:37.703 INFO:tasks.ceph.mon.a.smithi136.stderr: 12: (CommonSafeTimerThread::entry()+0x11) [0x7f35e899c3d1] 2023-06-24T01:43:37.703 INFO:tasks.ceph.mon.a.smithi136.stderr: 13: /lib64/libpthread.so.0(+0x81cf) [0x7f35e48081cf] 2023-06-24T01:43:37.703 INFO:tasks.ceph.mon.a.smithi136.stderr: 14: clone() 2023-06-24T01:43:37.704 INFO:tasks.ceph.mon.a.smithi136.stderr:2023-06-24T01:43:37.693+0000 7f35d6bf9700 -1 *** Caught signal (Aborted) ** 2023-06-24T01:43:37.704 INFO:tasks.ceph.mon.a.smithi136.stderr: in thread 7f35d6bf9700 thread_name:safe_timer 2023-06-24T01:43:37.704 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:37.704 INFO:tasks.ceph.mon.a.smithi136.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-24T01:43:37.704 INFO:tasks.ceph.mon.a.smithi136.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f35e4812ce0] 2023-06-24T01:43:37.704 INFO:tasks.ceph.mon.a.smithi136.stderr: 2: gsignal() 2023-06-24T01:43:37.704 INFO:tasks.ceph.mon.a.smithi136.stderr: 3: abort() 2023-06-24T01:43:37.705 INFO:tasks.ceph.mon.a.smithi136.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f35e88aa4df] 2023-06-24T01:43:37.705 INFO:tasks.ceph.mon.a.smithi136.stderr: 5: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x55a3ff27809f] 2023-06-24T01:43:37.705 INFO:tasks.ceph.mon.a.smithi136.stderr: 6: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x55a3ff38ac5b] 2023-06-24T01:43:37.705 INFO:tasks.ceph.mon.a.smithi136.stderr: 7: (Paxos::propose_pending()+0x126) [0x55a3ff38f8a6] 2023-06-24T01:43:37.705 INFO:tasks.ceph.mon.a.smithi136.stderr: 8: (Paxos::trigger_propose()+0x146) [0x55a3ff38fcc6] 2023-06-24T01:43:37.705 INFO:tasks.ceph.mon.a.smithi136.stderr: 9: (PaxosService::propose_pending()+0x178) [0x55a3ff39a488] 2023-06-24T01:43:37.705 INFO:tasks.ceph.mon.a.smithi136.stderr: 10: (Context::complete(int)+0xd) [0x55a3ff24a91d] 2023-06-24T01:43:37.706 INFO:tasks.ceph.mon.a.smithi136.stderr: 11: (CommonSafeTimer::timer_thread()+0x127) [0x7f35e899b2a7] 2023-06-24T01:43:37.706 INFO:tasks.ceph.mon.a.smithi136.stderr: 12: (CommonSafeTimerThread::entry()+0x11) [0x7f35e899c3d1] 2023-06-24T01:43:37.706 INFO:tasks.ceph.mon.a.smithi136.stderr: 13: /lib64/libpthread.so.0(+0x81cf) [0x7f35e48081cf] 2023-06-24T01:43:37.706 INFO:tasks.ceph.mon.a.smithi136.stderr: 14: clone() 2023-06-24T01:43:37.706 INFO:tasks.ceph.mon.a.smithi136.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-24T01:43:37.706 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:38.106 INFO:tasks.ceph.mon.a.smithi136.stderr: -2> 2023-06-24T01:43:37.639+0000 7f35d6bf9700 -1 rocksdb: submit_common error: IO error: While appending to file: /var/lib/ceph/mon/ceph-a/store.db/000619.log: Input/output error code =  Rocksdb transaction: 2023-06-24T01:43:38.106 INFO:tasks.ceph.mon.a.smithi136.stderr:PutCF( prefix = paxos key = '29478' value size = 5838) 2023-06-24T01:43:38.107 INFO:tasks.ceph.mon.a.smithi136.stderr:PutCF( prefix = paxos key = 'pending_v' value size = 8) 2023-06-24T01:43:38.107 INFO:tasks.ceph.mon.a.smithi136.stderr:PutCF( prefix = paxos key = 'pending_pn' value size = 8) 2023-06-24T01:43:38.107 INFO:tasks.ceph.mon.a.smithi136.stderr: -1> 2023-06-24T01:43:37.692+0000 7f35d6bf9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mon/MonitorDBStore.h: In function 'int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)' thread 7f35d6bf9700 time 2023-06-24T01:43:37.640394+0000 2023-06-24T01:43:38.107 INFO:tasks.ceph.mon.a.smithi136.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mon/MonitorDBStore.h: 355: ceph_abort_msg("failed to write to db") 2023-06-24T01:43:38.107 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:38.107 INFO:tasks.ceph.mon.a.smithi136.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-24T01:43:38.108 INFO:tasks.ceph.mon.a.smithi136.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f35e88aa41f] 2023-06-24T01:43:38.108 INFO:tasks.ceph.mon.a.smithi136.stderr: 2: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x55a3ff27809f] 2023-06-24T01:43:38.108 INFO:tasks.ceph.mon.a.smithi136.stderr: 3: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x55a3ff38ac5b] 2023-06-24T01:43:38.108 INFO:tasks.ceph.mon.a.smithi136.stderr: 4: (Paxos::propose_pending()+0x126) [0x55a3ff38f8a6] 2023-06-24T01:43:38.108 INFO:tasks.ceph.mon.a.smithi136.stderr: 5: (Paxos::trigger_propose()+0x146) [0x55a3ff38fcc6] 2023-06-24T01:43:38.108 INFO:tasks.ceph.mon.a.smithi136.stderr: 6: (PaxosService::propose_pending()+0x178) [0x55a3ff39a488] 2023-06-24T01:43:38.108 INFO:tasks.ceph.mon.a.smithi136.stderr: 7: (Context::complete(int)+0xd) [0x55a3ff24a91d] 2023-06-24T01:43:38.109 INFO:tasks.ceph.mon.a.smithi136.stderr: 8: (CommonSafeTimer::timer_thread()+0x127) [0x7f35e899b2a7] 2023-06-24T01:43:38.109 INFO:tasks.ceph.mon.a.smithi136.stderr: 9: (CommonSafeTimerThread::entry()+0x11) [0x7f35e899c3d1] 2023-06-24T01:43:38.109 INFO:tasks.ceph.mon.a.smithi136.stderr: 10: /lib64/libpthread.so.0(+0x81cf) [0x7f35e48081cf] 2023-06-24T01:43:38.109 INFO:tasks.ceph.mon.a.smithi136.stderr: 11: clone() 2023-06-24T01:43:38.109 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:38.109 INFO:tasks.ceph.mon.a.smithi136.stderr: 0> 2023-06-24T01:43:37.693+0000 7f35d6bf9700 -1 *** Caught signal (Aborted) ** 2023-06-24T01:43:38.109 INFO:tasks.ceph.mon.a.smithi136.stderr: in thread 7f35d6bf9700 thread_name:safe_timer 2023-06-24T01:43:38.109 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:38.110 INFO:tasks.ceph.mon.a.smithi136.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-24T01:43:38.110 INFO:tasks.ceph.mon.a.smithi136.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f35e4812ce0] 2023-06-24T01:43:38.110 INFO:tasks.ceph.mon.a.smithi136.stderr: 2: gsignal() 2023-06-24T01:43:38.110 INFO:tasks.ceph.mon.a.smithi136.stderr: 3: abort() 2023-06-24T01:43:38.110 INFO:tasks.ceph.mon.a.smithi136.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f35e88aa4df] 2023-06-24T01:43:38.110 INFO:tasks.ceph.mon.a.smithi136.stderr: 5: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x55a3ff27809f] 2023-06-24T01:43:38.110 INFO:tasks.ceph.mon.a.smithi136.stderr: 6: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x55a3ff38ac5b] 2023-06-24T01:43:38.110 INFO:tasks.ceph.mon.a.smithi136.stderr: 7: (Paxos::propose_pending()+0x126) [0x55a3ff38f8a6] 2023-06-24T01:43:38.111 INFO:tasks.ceph.mon.a.smithi136.stderr: 8: (Paxos::trigger_propose()+0x146) [0x55a3ff38fcc6] 2023-06-24T01:43:38.111 INFO:tasks.ceph.mon.a.smithi136.stderr: 9: (PaxosService::propose_pending()+0x178) [0x55a3ff39a488] 2023-06-24T01:43:38.111 INFO:tasks.ceph.mon.a.smithi136.stderr: 10: (Context::complete(int)+0xd) [0x55a3ff24a91d] 2023-06-24T01:43:38.111 INFO:tasks.ceph.mon.a.smithi136.stderr: 11: (CommonSafeTimer::timer_thread()+0x127) [0x7f35e899b2a7] 2023-06-24T01:43:38.111 INFO:tasks.ceph.mon.a.smithi136.stderr: 12: (CommonSafeTimerThread::entry()+0x11) [0x7f35e899c3d1] 2023-06-24T01:43:38.111 INFO:tasks.ceph.mon.a.smithi136.stderr: 13: /lib64/libpthread.so.0(+0x81cf) [0x7f35e48081cf] 2023-06-24T01:43:38.111 INFO:tasks.ceph.mon.a.smithi136.stderr: 14: clone() 2023-06-24T01:43:38.111 INFO:tasks.ceph.mon.a.smithi136.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-24T01:43:38.112 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:38.119 INFO:tasks.ceph.mon.a.smithi136.stderr: -9999> 2023-06-24T01:43:37.639+0000 7f35d6bf9700 -1 rocksdb: submit_common error: IO error: While appending to file: /var/lib/ceph/mon/ceph-a/store.db/000619.log: Input/output error code =  Rocksdb transaction: 2023-06-24T01:43:38.119 INFO:tasks.ceph.mon.a.smithi136.stderr:PutCF( prefix = paxos key = '29478' value size = 5838) 2023-06-24T01:43:38.119 INFO:tasks.ceph.mon.a.smithi136.stderr:PutCF( prefix = paxos key = 'pending_v' value size = 8) 2023-06-24T01:43:38.119 INFO:tasks.ceph.mon.a.smithi136.stderr:PutCF( prefix = paxos key = 'pending_pn' value size = 8) 2023-06-24T01:43:38.119 INFO:tasks.ceph.mon.a.smithi136.stderr: -9998> 2023-06-24T01:43:37.692+0000 7f35d6bf9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mon/MonitorDBStore.h: In function 'int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)' thread 7f35d6bf9700 time 2023-06-24T01:43:37.640394+0000 2023-06-24T01:43:38.119 INFO:tasks.ceph.mon.a.smithi136.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mon/MonitorDBStore.h: 355: ceph_abort_msg("failed to write to db") 2023-06-24T01:43:38.120 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:38.120 INFO:tasks.ceph.mon.a.smithi136.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-24T01:43:38.120 INFO:tasks.ceph.mon.a.smithi136.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f35e88aa41f] 2023-06-24T01:43:38.120 INFO:tasks.ceph.mon.a.smithi136.stderr: 2: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x55a3ff27809f] 2023-06-24T01:43:38.120 INFO:tasks.ceph.mon.a.smithi136.stderr: 3: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x55a3ff38ac5b] 2023-06-24T01:43:38.120 INFO:tasks.ceph.mon.a.smithi136.stderr: 4: (Paxos::propose_pending()+0x126) [0x55a3ff38f8a6] 2023-06-24T01:43:38.121 INFO:tasks.ceph.mon.a.smithi136.stderr: 5: (Paxos::trigger_propose()+0x146) [0x55a3ff38fcc6] 2023-06-24T01:43:38.121 INFO:tasks.ceph.mon.a.smithi136.stderr: 6: (PaxosService::propose_pending()+0x178) [0x55a3ff39a488] 2023-06-24T01:43:38.121 INFO:tasks.ceph.mon.a.smithi136.stderr: 7: (Context::complete(int)+0xd) [0x55a3ff24a91d] 2023-06-24T01:43:38.121 INFO:tasks.ceph.mon.a.smithi136.stderr: 8: (CommonSafeTimer::timer_thread()+0x127) [0x7f35e899b2a7] 2023-06-24T01:43:38.121 INFO:tasks.ceph.mon.a.smithi136.stderr: 9: (CommonSafeTimerThread::entry()+0x11) [0x7f35e899c3d1] 2023-06-24T01:43:38.121 INFO:tasks.ceph.mon.a.smithi136.stderr: 10: /lib64/libpthread.so.0(+0x81cf) [0x7f35e48081cf] 2023-06-24T01:43:38.121 INFO:tasks.ceph.mon.a.smithi136.stderr: 11: clone() 2023-06-24T01:43:38.121 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:38.122 INFO:tasks.ceph.mon.a.smithi136.stderr: -9997> 2023-06-24T01:43:37.693+0000 7f35d6bf9700 -1 *** Caught signal (Aborted) ** 2023-06-24T01:43:38.122 INFO:tasks.ceph.mon.a.smithi136.stderr: in thread 7f35d6bf9700 thread_name:safe_timer 2023-06-24T01:43:38.122 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:38.122 INFO:tasks.ceph.mon.a.smithi136.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-24T01:43:38.122 INFO:tasks.ceph.mon.a.smithi136.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f35e4812ce0] 2023-06-24T01:43:38.122 INFO:tasks.ceph.mon.a.smithi136.stderr: 2: gsignal() 2023-06-24T01:43:38.122 INFO:tasks.ceph.mon.a.smithi136.stderr: 3: abort() 2023-06-24T01:43:38.122 INFO:tasks.ceph.mon.a.smithi136.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f35e88aa4df] 2023-06-24T01:43:38.123 INFO:tasks.ceph.mon.a.smithi136.stderr: 5: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x55a3ff27809f] 2023-06-24T01:43:38.123 INFO:tasks.ceph.mon.a.smithi136.stderr: 6: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x55a3ff38ac5b] 2023-06-24T01:43:38.123 INFO:tasks.ceph.mon.a.smithi136.stderr: 7: (Paxos::propose_pending()+0x126) [0x55a3ff38f8a6] 2023-06-24T01:43:38.123 INFO:tasks.ceph.mon.a.smithi136.stderr: 8: (Paxos::trigger_propose()+0x146) [0x55a3ff38fcc6] 2023-06-24T01:43:38.123 INFO:tasks.ceph.mon.a.smithi136.stderr: 9: (PaxosService::propose_pending()+0x178) [0x55a3ff39a488] 2023-06-24T01:43:38.123 INFO:tasks.ceph.mon.a.smithi136.stderr: 10: (Context::complete(int)+0xd) [0x55a3ff24a91d] 2023-06-24T01:43:38.123 INFO:tasks.ceph.mon.a.smithi136.stderr: 11: (CommonSafeTimer::timer_thread()+0x127) [0x7f35e899b2a7] 2023-06-24T01:43:38.123 INFO:tasks.ceph.mon.a.smithi136.stderr: 12: (CommonSafeTimerThread::entry()+0x11) [0x7f35e899c3d1] 2023-06-24T01:43:38.124 INFO:tasks.ceph.mon.a.smithi136.stderr: 13: /lib64/libpthread.so.0(+0x81cf) [0x7f35e48081cf] 2023-06-24T01:43:38.124 INFO:tasks.ceph.mon.a.smithi136.stderr: 14: clone() 2023-06-24T01:43:38.124 INFO:tasks.ceph.mon.a.smithi136.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-24T01:43:38.124 INFO:tasks.ceph.mon.a.smithi136.stderr: 2023-06-24T01:43:45.699 INFO:tasks.ceph.mon.a.smithi136.stderr:daemon-helper: command crashed with signal 6 2023-06-24T01:43:49.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-06-24T01:43:55.957 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:55.982 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:56.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~7s 2023-06-24T01:44:02.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~13s 2023-06-24T01:44:09.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~20s 2023-06-24T01:44:16.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~26s 2023-06-24T01:44:22.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~33s 2023-06-24T01:44:26.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:44:26.563 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:44:29.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~40s 2023-06-24T01:44:36.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~46s 2023-06-24T01:44:42.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~53s 2023-06-24T01:44:49.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~59s 2023-06-24T01:44:55.839 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~66s 2023-06-24T01:44:57.228 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:44:57.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:02.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~73s 2023-06-24T01:45:09.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~79s 2023-06-24T01:45:15.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~86s 2023-06-24T01:45:22.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~93s 2023-06-24T01:45:27.706 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:27.773 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:28.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~99s 2023-06-24T01:45:35.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~106s 2023-06-24T01:45:42.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~112s 2023-06-24T01:45:48.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~119s 2023-06-24T01:45:55.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~126s 2023-06-24T01:45:58.925 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:59.019 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:46:01.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~132s 2023-06-24T01:46:08.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~139s 2023-06-24T01:46:15.179 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2023-06-24T01:46:21.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~152s 2023-06-24T01:46:28.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~159s 2023-06-24T01:46:30.881 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:46:30.914 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:46:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~165s 2023-06-24T01:46:41.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~172s 2023-06-24T01:46:48.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~179s 2023-06-24T01:46:54.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~185s 2023-06-24T01:47:01.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~192s 2023-06-24T01:47:02.618 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:02.656 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:08.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~198s 2023-06-24T01:47:14.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~205s 2023-06-24T01:47:21.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~212s 2023-06-24T01:47:27.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~218s 2023-06-24T01:47:34.062 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:34.090 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:34.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~225s 2023-06-24T01:47:41.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~231s 2023-06-24T01:47:47.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~238s 2023-06-24T01:47:54.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~245s 2023-06-24T01:48:00.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~251s 2023-06-24T01:48:05.609 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:05.685 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:07.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~258s 2023-06-24T01:48:14.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~264s 2023-06-24T01:48:20.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~271s 2023-06-24T01:48:27.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~278s 2023-06-24T01:48:34.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~284s 2023-06-24T01:48:36.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:36.508 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:40.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~291s 2023-06-24T01:48:47.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~298s 2023-06-24T01:48:53.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~304s 2023-06-24T01:48:53.867 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-06-24T01:48:53.868 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-24T01:48:53.868 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-24T01:48:54.593 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-24T01:48:54.594 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-24T01:48:55.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-24T01:48:59.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.384+0000 7f31a09fe700 1 Processor -- start 2023-06-24T01:48:59.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.384+0000 7f31a09fe700 1 -- start start 2023-06-24T01:48:59.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.386+0000 7f31a09fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f319c0cb5c0 0x7f319c16d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:48:59.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.386+0000 7f31a09fe700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c0c8e20 con 0x7f319c071db0 2023-06-24T01:48:59.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.386+0000 7f31a09fe700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c1693b0 con 0x7f319c0891f0 2023-06-24T01:48:59.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.386+0000 7f31a09fe700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c0ca5e0 con 0x7f319c0cb5c0 2023-06-24T01:48:59.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.386+0000 7f319ad9d700 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f319c071db0 legacy=0x7f319c0caeb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2023-06-24T01:48:59.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.387+0000 7f319b59e700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f319c0891f0 0x7f319c070090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:44250/0 (socket says 172.21.15.136:44250) 2023-06-24T01:48:59.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.387+0000 7f319b59e700 1 -- 172.21.15.136:0/1780302612 learned_addr learned my addr 172.21.15.136:0/1780302612 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-24T01:48:59.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.388+0000 7f319a59c700 1 -- 172.21.15.136:0/1780302612 >> v2:172.21.15.136:3300/0 conn(0x7f319c0cb5c0 msgr2=0x7f319c16d4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:48:59.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.388+0000 7f319a59c700 1 --2- 172.21.15.136:0/1780302612 >> v2:172.21.15.136:3300/0 conn(0x7f319c0cb5c0 0x7f319c16d4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:48:59.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.399+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123441898 0 0) 0x7f319c1693b0 con 0x7f319c0891f0 2023-06-24T01:48:59.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.399+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3184003590 con 0x7f319c0891f0 2023-06-24T01:48:59.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.399+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4291595297 0 0) 0x7f3184003590 con 0x7f319c0891f0 2023-06-24T01:48:59.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.399+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 >> v2:172.21.15.136:3300/0 conn(0x7f319c0cb5c0 msgr2=0x7f319c16d4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:48:59.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.399+0000 7f3199d9b700 1 --2- 172.21.15.136:0/1780302612 >> v2:172.21.15.136:3300/0 conn(0x7f319c0cb5c0 0x7f319c16d4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:48:59.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.399+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 >> v1:172.21.15.136:6789/0 conn(0x7f319c071db0 legacy=0x7f319c0caeb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:48:59.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.399+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0c8af0 con 0x7f319c0891f0 2023-06-24T01:48:59.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7f318c0015a0 con 0x7f319c0891f0 2023-06-24T01:48:59.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 >> v1:172.21.15.178:6789/0 conn(0x7f319c0891f0 legacy=0x7f319c070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:48:59.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f3199d9b700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3184003c30 0x7f31840072d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:48:59.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f3199d9b700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3184007960 0x7f3184009de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:48:59.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f3199d9b700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318400a5e0 0x7f318400ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:48:59.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f319b59e700 1 -- 172.21.15.136:0/1780302612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318400a5e0 msgr2=0x7f318400ca90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:48:59.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f319b59e700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318400a5e0 0x7f318400ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:48:59.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0ca5e0 con 0x7f318400a5e0 2023-06-24T01:48:59.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318400d370 con 0x7f3184007960 2023-06-24T01:48:59.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318400d530 con 0x7f3184003c30 2023-06-24T01:48:59.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.400+0000 7f319a59c700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3184007960 0x7f3184009de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:48:59.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.401+0000 7f319ad9d700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3184003c30 0x7f31840072d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:48:59.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.401+0000 7f319a59c700 1 -- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3184003c30 msgr2=0x7f31840072d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-24T01:48:59.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.401+0000 7f319a59c700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3184003c30 0x7f31840072d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:48:59.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.401+0000 7f319a59c700 1 -- 172.21.15.136:0/1780302612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318400a5e0 msgr2=0x7f318400ca90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:48:59.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.401+0000 7f319a59c700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318400a5e0 0x7f318400ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:48:59.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.401+0000 7f319b59e700 1 -- 172.21.15.136:0/1780302612 reap_dead start 2023-06-24T01:48:59.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.401+0000 7f319a59c700 1 -- 172.21.15.136:0/1780302612 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184003590 con 0x7f3184007960 2023-06-24T01:48:59.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.402+0000 7f319a59c700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3184007960 0x7f3184009de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3190003940 tx=0x7f3184003840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d51c6467a1996781 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:48:59.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.407+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190003b70 con 0x7f3184007960 2023-06-24T01:48:59.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.407+0000 7f3199d9b700 1 -- 172.21.15.136:0/1780302612 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3190003cd0 con 0x7f3184007960 2023-06-24T01:48:59.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.408+0000 7f31a09fe700 1 -- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3184007960 msgr2=0x7f3184009de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:48:59.411 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.408+0000 7f31a09fe700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3184007960 0x7f3184009de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3190003940 tx=0x7f3184003840 comp rx=0 tx=0).stop 2023-06-24T01:48:59.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.408+0000 7f31a09fe700 1 -- 172.21.15.136:0/1780302612 shutdown_connections 2023-06-24T01:48:59.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.408+0000 7f31a09fe700 1 --2- 172.21.15.136:0/1780302612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3184007960 0x7f3184009de0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:48:59.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.408+0000 7f31a09fe700 1 -- 172.21.15.136:0/1780302612 >> 172.21.15.136:0/1780302612 conn(0x7f319c06c0a0 msgr2=0x7f319c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:48:59.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.408+0000 7f31a09fe700 1 -- 172.21.15.136:0/1780302612 shutdown_connections 2023-06-24T01:48:59.413 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.409+0000 7f31a09fe700 1 -- 172.21.15.136:0/1780302612 wait complete. 2023-06-24T01:48:59.418 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.411+0000 7f31a09fe700 1 Processor -- start 2023-06-24T01:48:59.418 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.412+0000 7f31a09fe700 1 -- start start 2023-06-24T01:48:59.418 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.413+0000 7f31a09fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3184007960 0x7f319c0c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:48:59.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.413+0000 7f319ad9d700 1 -- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3184007960 msgr2=0x7f319c0c29e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:48:59.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.413+0000 7f319ad9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3184007960 0x7f319c0c29e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:48:59.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.413+0000 7f31a09fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f319c0c9480 0x7f319c088550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:48:59.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.414+0000 7f31a09fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f319c0b34a0 0x7f319c0b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:48:59.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.414+0000 7f31a09fe700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c20b0d0 con 0x7f3184007960 2023-06-24T01:48:59.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.414+0000 7f31a09fe700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c088a90 con 0x7f319c0b34a0 2023-06-24T01:48:59.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.414+0000 7f31a09fe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0b3e50 con 0x7f319c0c9480 2023-06-24T01:48:59.420 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.414+0000 7f319a59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f319c0c9480 0x7f319c088550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:48:59.420 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.414+0000 7f319a59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f319c0c9480 0x7f319c088550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:49498/0 (socket says 172.21.15.136:49498) 2023-06-24T01:48:59.420 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.414+0000 7f319a59c700 1 -- 172.21.15.136:0/3029754539 learned_addr learned my addr 172.21.15.136:0/3029754539 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-24T01:48:59.420 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.415+0000 7f319a59c700 1 -- 172.21.15.136:0/3029754539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f319c0b34a0 msgr2=0x7f319c0b3910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-24T01:48:59.420 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.415+0000 7f319a59c700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f319c0b34a0 0x7f319c0b3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:48:59.421 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.415+0000 7f319a59c700 1 -- 172.21.15.136:0/3029754539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3184007960 msgr2=0x7f319c0c29e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-24T01:48:59.421 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.415+0000 7f319a59c700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3184007960 0x7f319c0c29e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:48:59.421 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.415+0000 7f319a59c700 1 -- 172.21.15.136:0/3029754539 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c20a4c0 con 0x7f319c0c9480 2023-06-24T01:48:59.421 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.416+0000 7f319a59c700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f319c0c9480 0x7f319c088550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f319000d5d0 tx=0x7f31900059d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:48:59.449 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.445+0000 7f31837fe700 1 -- 172.21.15.136:0/3029754539 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900054e0 con 0x7f319c0c9480 2023-06-24T01:48:59.451 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.446+0000 7f31a09fe700 1 -- 172.21.15.136:0/3029754539 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c20a7a0 con 0x7f319c0c9480 2023-06-24T01:48:59.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.446+0000 7f31a09fe700 1 -- 172.21.15.136:0/3029754539 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c20ad60 con 0x7f319c0c9480 2023-06-24T01:48:59.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.447+0000 7f31837fe700 1 -- 172.21.15.136:0/3029754539 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3190005640 con 0x7f319c0c9480 2023-06-24T01:48:59.452 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.447+0000 7f31837fe700 1 -- 172.21.15.136:0/3029754539 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000be60 con 0x7f319c0c9480 2023-06-24T01:48:59.454 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.450+0000 7f31837fe700 1 -- 172.21.15.136:0/3029754539 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f319001b450 con 0x7f319c0c9480 2023-06-24T01:48:59.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.452+0000 7f31837fe700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f318806adb0 0x7f318806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:48:59.455 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.452+0000 7f31837fe700 1 -- 172.21.15.136:0/3029754539 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3190003e40 con 0x7f319c0c9480 2023-06-24T01:48:59.456 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.452+0000 7f319ad9d700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f318806adb0 0x7f318806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:48:59.457 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.453+0000 7f31817fa700 1 -- 172.21.15.136:0/3029754539 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c0052f0 con 0x7f319c0c9480 2023-06-24T01:48:59.462 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.456+0000 7f319ad9d700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f318806adb0 0x7f318806d260 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3194003ca0 tx=0x7f3194008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:48:59.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:48:59.473+0000 7f31837fe700 1 -- 172.21.15.136:0/3029754539 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f31900552e0 con 0x7f319c0c9480 2023-06-24T01:49:00.590 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.586+0000 7f31817fa700 1 -- 172.21.15.136:0/3029754539 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f317c0055a0 con 0x7f319c0c9480 2023-06-24T01:49:00.594 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-06-24T01:49:00.595 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.588+0000 7f31837fe700 1 -- 172.21.15.136:0/3029754539 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18615 (secure 0 0 0) 0x7f3190029090 con 0x7f319c0c9480 2023-06-24T01:49:00.595 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":46,"fsid":"ad363bec-53b9-481a-9d11-1e4839eb0e65","created":"2023-06-23T19:00:36.062836+0000","modified":"2023-06-23T19:03:45.027273+0000","last_up_change":"2023-06-23T19:00:48.989242+0000","last_in_change":"2023-06-23T19:00:39.635787+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T19:00:48.985482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T19:00:56.098251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-23T19:02:41.186859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-23T19:02:42.355631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1391cb3-e6f8-4211-a8dc-ec9664243e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6824","nonce":1091078003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6827","nonce":1091078003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6831","nonce":1091078003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1091078003},{"type":"v1","addr":"172.21.15.136:6829","nonce":1091078003}]},"public_addr":"172.21.15.136:6824/1091078003","cluster_addr":"172.21.15.136:6827/1091078003","heartbeat_back_addr":"172.21.15.136:6831/1091078003","heartbeat_front_addr":"172.21.15.136:6829/1091078003","state":["exists","up"]},{"osd":1,"uuid":"a68c2f59-6364-4da0-bf4f-effe0c0f0c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6809","nonce":3924036391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6813","nonce":3924036391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6821","nonce":3924036391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3924036391},{"type":"v1","addr":"172.21.15.136:6817","nonce":3924036391}]},"public_addr":"172.21.15.136:6809/3924036391","cluster_addr":"172.21.15.136:6813/3924036391","heartbeat_back_addr":"172.21.15.136:6821/3924036391","heartbeat_front_addr":"172.21.15.136:6817/3924036391","state":["exists","up"]},{"osd":2,"uuid":"8fd8d6af-bd2b-46d3-90df-79c0fdf2e6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6812","nonce":1156429713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6816","nonce":1156429713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6825","nonce":1156429713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1156429713},{"type":"v1","addr":"172.21.15.136:6820","nonce":1156429713}]},"public_addr":"172.21.15.136:6812/1156429713","cluster_addr":"172.21.15.136:6816/1156429713","heartbeat_back_addr":"172.21.15.136:6825/1156429713","heartbeat_front_addr":"172.21.15.136:6820/1156429713","state":["exists","up"]},{"osd":3,"uuid":"491ea7ca-6e40-4205-b2ed-c5171ced5dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6801","nonce":4143692413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6803","nonce":4143692413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6808","nonce":4143692413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":4143692413},{"type":"v1","addr":"172.21.15.136:6805","nonce":4143692413}]},"public_addr":"172.21.15.136:6801/4143692413","cluster_addr":"172.21.15.136:6803/4143692413","heartbeat_back_addr":"172.21.15.136:6808/4143692413","heartbeat_front_addr":"172.21.15.136:6805/4143692413","state":["exists","up"]},{"osd":4,"uuid":"52320eb5-b8e0-4054-9017-683dd67f4f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6801","nonce":597055350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6803","nonce":597055350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6807","nonce":597055350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":597055350},{"type":"v1","addr":"172.21.15.178:6805","nonce":597055350}]},"public_addr":"172.21.15.178:6801/597055350","cluster_addr":"172.21.15.178:6803/597055350","heartbeat_back_addr":"172.21.15.178:6807/597055350","heartbeat_front_addr":"172.21.15.178:6805/597055350","state":["exists","up"]},{"osd":5,"uuid":"e381a4d7-491a-43bd-9f07-d27ea87c30d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6825","nonce":2052306776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6827","nonce":2052306776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6831","nonce":2052306776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2052306776},{"type":"v1","addr":"172.21.15.178:6829","nonce":2052306776}]},"public_addr":"172.21.15.178:6825/2052306776","cluster_addr":"172.21.15.178:6827/2052306776","heartbeat_back_addr":"172.21.15.178:6831/2052306776","heartbeat_front_addr":"172.21.15.178:6829/2052306776","state":["exists","up"]},{"osd":6,"uuid":"e3239dd0-b26f-40a1-acfc-4e15a61fb220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6809","nonce":458584113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6811","nonce":458584113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6815","nonce":458584113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":458584113},{"type":"v1","addr":"172.21.15.178:6813","nonce":458584113}]},"public_addr":"172.21.15.178:6809/458584113","cluster_addr":"172.21.15.178:6811/458584113","heartbeat_back_addr":"172.21.15.178:6815/458584113","heartbeat_front_addr":"172.21.15.178:6813/458584113","state":["exists","up"]},{"osd":7,"uuid":"3f02d50d-1afd-4974-9214-5462856d6431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6817","nonce":400133386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6819","nonce":400133386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6823","nonce":400133386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":400133386},{"type":"v1","addr":"172.21.15.178:6821","nonce":400133386}]},"public_addr":"172.21.15.178:6817/400133386","cluster_addr":"172.21.15.178:6819/400133386","heartbeat_back_addr":"172.21.15.178:6823/400133386","heartbeat_front_addr":"172.21.15.178:6821/400133386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.988015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.007481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.966574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.752593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:45.210742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.960622+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.917083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T19:00:44.971933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-24T01:49:00.600 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.597+0000 7f31a09fe700 1 -- 172.21.15.136:0/3029754539 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f318806adb0 msgr2=0x7f318806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:00.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.597+0000 7f31a09fe700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f318806adb0 0x7f318806d260 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3194003ca0 tx=0x7f3194008040 comp rx=0 tx=0).stop 2023-06-24T01:49:00.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.597+0000 7f31a09fe700 1 -- 172.21.15.136:0/3029754539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f319c0c9480 msgr2=0x7f319c088550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:00.601 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.598+0000 7f31a09fe700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f319c0c9480 0x7f319c088550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f319000d5d0 tx=0x7f31900059d0 comp rx=0 tx=0).stop 2023-06-24T01:49:00.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.635+0000 7f31a09fe700 1 -- 172.21.15.136:0/3029754539 shutdown_connections 2023-06-24T01:49:00.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.635+0000 7f31a09fe700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f318806adb0 0x7f318806d260 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:00.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.635+0000 7f31a09fe700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f319c0b34a0 0x7f319c0b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:00.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.635+0000 7f31a09fe700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3184007960 0x7f319c0c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:00.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.635+0000 7f31a09fe700 1 --2- 172.21.15.136:0/3029754539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f319c0c9480 0x7f319c088550 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:00.639 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.635+0000 7f31a09fe700 1 -- 172.21.15.136:0/3029754539 >> 172.21.15.136:0/3029754539 conn(0x7f319c06c0a0 msgr2=0x7f319c1671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:00.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.636+0000 7f31a09fe700 1 -- 172.21.15.136:0/3029754539 shutdown_connections 2023-06-24T01:49:00.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:00.636+0000 7f31a09fe700 1 -- 172.21.15.136:0/3029754539 wait complete. 2023-06-24T01:49:00.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T19:00:48.985482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T19:00:56.098251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T19:02:41.186859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T19:02:42.355631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-24T01:49:00.681 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-24T01:49:01.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.860+0000 7f2d68fff700 1 Processor -- start 2023-06-24T01:49:01.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.860+0000 7f2d68fff700 1 -- start start 2023-06-24T01:49:01.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.862+0000 7f2d68fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2d640cd930 0x7f2d64070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:01.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.862+0000 7f2d68fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640ce010 0x7f2d6415c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:01.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.862+0000 7f2d68fff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d640b00b0 con 0x7f2d6406cc70 2023-06-24T01:49:01.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.862+0000 7f2d68fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d640b0f10 con 0x7f2d640cd930 2023-06-24T01:49:01.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.862+0000 7f2d68fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640b0300 con 0x7f2d640ce010 2023-06-24T01:49:01.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.863+0000 7f2d61d9b700 1 -- >> v2:172.21.15.136:3300/0 conn(0x7f2d640cd930 msgr2=0x7f2d64070160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:49:01.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.863+0000 7f2d61d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2d640cd930 0x7f2d64070160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:49:01.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.863+0000 7f2d6259c700 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f2d6406cc70 legacy=0x7f2d640cae30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2023-06-24T01:49:01.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.863+0000 7f2d62d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640ce010 0x7f2d6415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:01.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.864+0000 7f2d62d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640ce010 0x7f2d6415c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:49514/0 (socket says 172.21.15.136:49514) 2023-06-24T01:49:01.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.864+0000 7f2d62d9d700 1 -- 172.21.15.136:0/1877433116 learned_addr learned my addr 172.21.15.136:0/1877433116 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-24T01:49:01.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.865+0000 7f2d62d9d700 1 -- 172.21.15.136:0/1877433116 >> v2:172.21.15.136:3300/0 conn(0x7f2d640cd930 msgr2=0x7f2d64070160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:49:01.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.865+0000 7f2d62d9d700 1 --2- 172.21.15.136:0/1877433116 >> v2:172.21.15.136:3300/0 conn(0x7f2d640cd930 0x7f2d64070160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:01.876 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.873+0000 7f2d62d9d700 1 -- 172.21.15.136:0/1877433116 >> v1:172.21.15.136:6789/0 conn(0x7f2d6406cc70 legacy=0x7f2d640cae30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:49:01.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.873+0000 7f2d62d9d700 1 -- 172.21.15.136:0/1877433116 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640b05e0 con 0x7f2d640ce010 2023-06-24T01:49:01.877 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.874+0000 7f2d62d9d700 1 --2- 172.21.15.136:0/1877433116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640ce010 0x7f2d6415c110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009e50 tx=0x7f2d5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38bf6b40db38014c server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:01.878 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.874+0000 7f2d6159a700 1 -- 172.21.15.136:0/1877433116 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00e070 con 0x7f2d640ce010 2023-06-24T01:49:01.879 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.875+0000 7f2d6159a700 1 -- 172.21.15.136:0/1877433116 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c003a20 con 0x7f2d640ce010 2023-06-24T01:49:01.879 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.876+0000 7f2d6159a700 1 -- 172.21.15.136:0/1877433116 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c003dd0 con 0x7f2d640ce010 2023-06-24T01:49:01.880 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.877+0000 7f2d68fff700 1 -- 172.21.15.136:0/1877433116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640ce010 msgr2=0x7f2d6415c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:01.880 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.877+0000 7f2d68fff700 1 --2- 172.21.15.136:0/1877433116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640ce010 0x7f2d6415c110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009e50 tx=0x7f2d5c00b330 comp rx=0 tx=0).stop 2023-06-24T01:49:01.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.878+0000 7f2d68fff700 1 -- 172.21.15.136:0/1877433116 shutdown_connections 2023-06-24T01:49:01.881 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.878+0000 7f2d68fff700 1 --2- 172.21.15.136:0/1877433116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640ce010 0x7f2d6415c110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:01.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.878+0000 7f2d68fff700 1 --2- 172.21.15.136:0/1877433116 >> v2:172.21.15.136:3300/0 conn(0x7f2d640cd930 0x7f2d64070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:01.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.878+0000 7f2d68fff700 1 -- 172.21.15.136:0/1877433116 >> 172.21.15.136:0/1877433116 conn(0x7f2d6406c160 msgr2=0x7f2d6406c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:01.882 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.879+0000 7f2d68fff700 1 -- 172.21.15.136:0/1877433116 shutdown_connections 2023-06-24T01:49:01.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.888+0000 7f2d68fff700 1 -- 172.21.15.136:0/1877433116 wait complete. 2023-06-24T01:49:01.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.898+0000 7f2d68fff700 1 Processor -- start 2023-06-24T01:49:01.902 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.899+0000 7f2d68fff700 1 -- start start 2023-06-24T01:49:01.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.900+0000 7f2d68fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d6406cc70 0x7f2d640c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:01.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.900+0000 7f2d68fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640cd930 0x7f2d640c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:01.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.900+0000 7f2d68fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d640ce010 0x7f2d641e2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:01.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.900+0000 7f2d68fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640c3c60 con 0x7f2d640ce010 2023-06-24T01:49:01.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.900+0000 7f2d68fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640c45c0 con 0x7f2d6406cc70 2023-06-24T01:49:01.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.900+0000 7f2d68fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640c2fe0 con 0x7f2d640cd930 2023-06-24T01:49:01.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.901+0000 7f2d6259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d6406cc70 0x7f2d640c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:01.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.901+0000 7f2d62d9d700 1 -- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d640ce010 msgr2=0x7f2d641e2050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:49:01.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.901+0000 7f2d62d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d640ce010 0x7f2d641e2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:49:01.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.901+0000 7f2d6259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d6406cc70 0x7f2d640c4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:53888/0 (socket says 172.21.15.136:53888) 2023-06-24T01:49:01.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.901+0000 7f2d6259c700 1 -- 172.21.15.136:0/383753861 learned_addr learned my addr 172.21.15.136:0/383753861 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-24T01:49:01.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.901+0000 7f2d61d9b700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640cd930 0x7f2d640c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:01.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.902+0000 7f2d6259c700 1 -- 172.21.15.136:0/383753861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640cd930 msgr2=0x7f2d640c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:01.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.902+0000 7f2d6259c700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640cd930 0x7f2d640c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:01.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.902+0000 7f2d6259c700 1 -- 172.21.15.136:0/383753861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d640ce010 msgr2=0x7f2d641e2050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-24T01:49:01.906 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.902+0000 7f2d6259c700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d640ce010 0x7f2d641e2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:01.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.902+0000 7f2d6259c700 1 -- 172.21.15.136:0/383753861 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c009b30 con 0x7f2d6406cc70 2023-06-24T01:49:01.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.903+0000 7f2d6259c700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d6406cc70 0x7f2d640c4080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800b550 tx=0x7f2d5800b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:01.907 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.903+0000 7f2d52ffd700 1 -- 172.21.15.136:0/383753861 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58003d80 con 0x7f2d6406cc70 2023-06-24T01:49:01.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.903+0000 7f2d52ffd700 1 -- 172.21.15.136:0/383753861 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d58005070 con 0x7f2d6406cc70 2023-06-24T01:49:01.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.903+0000 7f2d52ffd700 1 -- 172.21.15.136:0/383753861 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58005420 con 0x7f2d6406cc70 2023-06-24T01:49:01.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.904+0000 7f2d68fff700 1 -- 172.21.15.136:0/383753861 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d640c32c0 con 0x7f2d6406cc70 2023-06-24T01:49:01.908 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.904+0000 7f2d68fff700 1 -- 172.21.15.136:0/383753861 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d640c3880 con 0x7f2d6406cc70 2023-06-24T01:49:01.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.908+0000 7f2d68fff700 1 -- 172.21.15.136:0/383753861 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d64067550 con 0x7f2d6406cc70 2023-06-24T01:49:01.913 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.909+0000 7f2d52ffd700 1 -- 172.21.15.136:0/383753861 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d58005580 con 0x7f2d6406cc70 2023-06-24T01:49:01.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.912+0000 7f2d52ffd700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d4406ace0 0x7f2d4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:01.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.912+0000 7f2d61d9b700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d4406ace0 0x7f2d4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:01.917 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.914+0000 7f2d61d9b700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d4406ace0 0x7f2d4406d190 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400fc30 tx=0x7f2d54016040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:01.918 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.914+0000 7f2d52ffd700 1 -- 172.21.15.136:0/383753861 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f2d5805b560 con 0x7f2d6406cc70 2023-06-24T01:49:01.924 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:01.921+0000 7f2d52ffd700 1 -- 172.21.15.136:0/383753861 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d58054070 con 0x7f2d6406cc70 2023-06-24T01:49:03.136 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.133+0000 7f2d68fff700 1 -- 172.21.15.136:0/383753861 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d640b0b70 con 0x7f2d6406cc70 2023-06-24T01:49:03.137 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.134+0000 7f2d52ffd700 1 -- 172.21.15.136:0/383753861 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d58054210 con 0x7f2d6406cc70 2023-06-24T01:49:03.141 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2023-06-24T01:49:03.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.139+0000 7f2d50ff9700 1 -- 172.21.15.136:0/383753861 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d4406ace0 msgr2=0x7f2d4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:03.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.139+0000 7f2d50ff9700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d4406ace0 0x7f2d4406d190 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400fc30 tx=0x7f2d54016040 comp rx=0 tx=0).stop 2023-06-24T01:49:03.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.140+0000 7f2d50ff9700 1 -- 172.21.15.136:0/383753861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d6406cc70 msgr2=0x7f2d640c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:03.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.140+0000 7f2d50ff9700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d6406cc70 0x7f2d640c4080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800b550 tx=0x7f2d5800b860 comp rx=0 tx=0).stop 2023-06-24T01:49:03.144 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.140+0000 7f2d50ff9700 1 -- 172.21.15.136:0/383753861 shutdown_connections 2023-06-24T01:49:03.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.140+0000 7f2d50ff9700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f2d4406ace0 0x7f2d4406d190 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:03.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.140+0000 7f2d50ff9700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d6406cc70 0x7f2d640c4080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:03.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.140+0000 7f2d50ff9700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d640ce010 0x7f2d641e2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:03.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.140+0000 7f2d50ff9700 1 --2- 172.21.15.136:0/383753861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640cd930 0x7f2d640c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:03.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.140+0000 7f2d50ff9700 1 -- 172.21.15.136:0/383753861 >> 172.21.15.136:0/383753861 conn(0x7f2d6406c160 msgr2=0x7f2d6406c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:03.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.141+0000 7f2d50ff9700 1 -- 172.21.15.136:0/383753861 shutdown_connections 2023-06-24T01:49:03.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:03.141+0000 7f2d50ff9700 1 -- 172.21.15.136:0/383753861 wait complete. 2023-06-24T01:49:03.311 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-24T01:49:04.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.276+0000 7fa6d61ff700 1 Processor -- start 2023-06-24T01:49:04.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.287+0000 7fa6d61ff700 1 -- start start 2023-06-24T01:49:04.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.289+0000 7fa6d61ff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa6c803a7e0 0x7fa6c80e9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:04.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.289+0000 7fa6d61ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c8006090 con 0x7fa6c8036e50 2023-06-24T01:49:04.294 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.289+0000 7fa6d61ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80decd0 con 0x7fa6c80547d0 2023-06-24T01:49:04.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.289+0000 7fa6d61ff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c8007080 con 0x7fa6c803a7e0 2023-06-24T01:49:04.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.289+0000 7fa6cffff700 1 -- >> v2:172.21.15.136:3300/0 conn(0x7fa6c803a7e0 msgr2=0x7fa6c80e9750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:49:04.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.289+0000 7fa6cffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa6c803a7e0 0x7fa6c80e9750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:49:04.295 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.289+0000 7fa6ceffd700 1 -- >> v1:172.21.15.136:6789/0 conn(0x7fa6c8036e50 legacy=0x7fa6c803a0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2023-06-24T01:49:04.316 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.313+0000 7fa6cf7fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fa6c80547d0 0x7fa6c8036740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:44254/0 (socket says 172.21.15.136:44254) 2023-06-24T01:49:04.317 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.313+0000 7fa6cf7fe700 1 -- 172.21.15.136:0/2066806373 learned_addr learned my addr 172.21.15.136:0/2066806373 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-24T01:49:04.322 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.319+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415937867 0 0) 0x7fa6c80decd0 con 0x7fa6c80547d0 2023-06-24T01:49:04.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.319+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c00035b0 con 0x7fa6c80547d0 2023-06-24T01:49:04.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.322+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2706663822 0 0) 0x7fa6c00035b0 con 0x7fa6c80547d0 2023-06-24T01:49:04.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.322+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 >> v2:172.21.15.136:3300/0 conn(0x7fa6c803a7e0 msgr2=0x7fa6c80e9750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:49:04.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.322+0000 7fa6ce7fc700 1 --2- 172.21.15.136:0/2066806373 >> v2:172.21.15.136:3300/0 conn(0x7fa6c803a7e0 0x7fa6c80e9750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:04.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.322+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 >> v1:172.21.15.136:6789/0 conn(0x7fa6c8036e50 legacy=0x7fa6c803a0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:49:04.326 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.322+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80062c0 con 0x7fa6c80547d0 2023-06-24T01:49:04.327 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.323+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3912002089 0 0) 0x7fa6d004ea20 con 0x7fa6c80547d0 2023-06-24T01:49:04.327 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.323+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 >> v1:172.21.15.178:6789/0 conn(0x7fa6c80547d0 legacy=0x7fa6c8036740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:04.327 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.323+0000 7fa6ce7fc700 1 --2- 172.21.15.136:0/2066806373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c0003a40 0x7fa6c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:04.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.323+0000 7fa6ce7fc700 1 --2- 172.21.15.136:0/2066806373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c0004850 0x7fa6c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:04.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.323+0000 7fa6ce7fc700 1 --2- 172.21.15.136:0/2066806373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6c0005320 0x7fa6c00079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:04.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.323+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c8007080 con 0x7fa6c0005320 2023-06-24T01:49:04.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.323+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00081e0 con 0x7fa6c0003a40 2023-06-24T01:49:04.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.323+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00083a0 con 0x7fa6c0004850 2023-06-24T01:49:04.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.324+0000 7fa6ceffd700 1 --2- 172.21.15.136:0/2066806373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c0004850 0x7fa6c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:04.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.325+0000 7fa6ceffd700 1 -- 172.21.15.136:0/2066806373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c0003a40 msgr2=0x7fa6c0003e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:49:04.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.325+0000 7fa6ceffd700 1 --2- 172.21.15.136:0/2066806373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c0003a40 0x7fa6c0003e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:04.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.325+0000 7fa6ceffd700 1 -- 172.21.15.136:0/2066806373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6c0005320 msgr2=0x7fa6c00079f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:49:04.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.325+0000 7fa6ceffd700 1 --2- 172.21.15.136:0/2066806373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6c0005320 0x7fa6c00079f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:04.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.325+0000 7fa6ceffd700 1 -- 172.21.15.136:0/2066806373 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80062c0 con 0x7fa6c0004850 2023-06-24T01:49:04.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.326+0000 7fa6cffff700 1 -- 172.21.15.136:0/2066806373 reap_dead start 2023-06-24T01:49:04.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.326+0000 7fa6ceffd700 1 --2- 172.21.15.136:0/2066806373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c0004850 0x7fa6c0004cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc003a10 tx=0x7fa6c0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da90454d012ddff0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:04.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.327+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc003c40 con 0x7fa6c0004850 2023-06-24T01:49:04.331 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.327+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc003da0 con 0x7fa6c0004850 2023-06-24T01:49:04.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.327+0000 7fa6ce7fc700 1 -- 172.21.15.136:0/2066806373 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00bae0 con 0x7fa6c0004850 2023-06-24T01:49:04.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.328+0000 7fa6d61ff700 1 -- 172.21.15.136:0/2066806373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c0004850 msgr2=0x7fa6c0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:04.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.328+0000 7fa6d61ff700 1 --2- 172.21.15.136:0/2066806373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c0004850 0x7fa6c0004cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc003a10 tx=0x7fa6c0005880 comp rx=0 tx=0).stop 2023-06-24T01:49:04.332 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.329+0000 7fa6d61ff700 1 -- 172.21.15.136:0/2066806373 shutdown_connections 2023-06-24T01:49:04.333 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.329+0000 7fa6d61ff700 1 --2- 172.21.15.136:0/2066806373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c0004850 0x7fa6c0004cc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:04.333 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.329+0000 7fa6d61ff700 1 -- 172.21.15.136:0/2066806373 >> 172.21.15.136:0/2066806373 conn(0x7fa6c8051740 msgr2=0x7fa6c8051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:04.337 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.334+0000 7fa6d61ff700 1 -- 172.21.15.136:0/2066806373 shutdown_connections 2023-06-24T01:49:04.341 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.335+0000 7fa6d61ff700 1 -- 172.21.15.136:0/2066806373 wait complete. 2023-06-24T01:49:04.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.343+0000 7fa6d61ff700 1 Processor -- start 2023-06-24T01:49:04.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.344+0000 7fa6d61ff700 1 -- start start 2023-06-24T01:49:04.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.350+0000 7fa6d61ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c80d4470 0x7fa6c804e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:04.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.350+0000 7fa6d61ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c80d4840 0x7fa6c80e1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:04.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.351+0000 7fa6cf7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c80d4470 0x7fa6c804e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:04.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.351+0000 7fa6cf7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c80d4470 0x7fa6c804e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:49544/0 (socket says 172.21.15.136:49544) 2023-06-24T01:49:04.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.351+0000 7fa6d61ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6c80dffb0 0x7fa6c804c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:04.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.351+0000 7fa6ceffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c80d4840 0x7fa6c80e1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:04.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.351+0000 7fa6ceffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c80d4840 0x7fa6c80e1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:53902/0 (socket says 172.21.15.136:53902) 2023-06-24T01:49:04.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.351+0000 7fa6cffff700 1 -- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6c80dffb0 msgr2=0x7fa6c804c680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:49:04.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.351+0000 7fa6cffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6c80dffb0 0x7fa6c804c680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:49:04.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.352+0000 7fa6cf7fe700 1 -- 172.21.15.136:0/3928520261 learned_addr learned my addr 172.21.15.136:0/3928520261 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-24T01:49:04.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.352+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80e1da0 con 0x7fa6c80dffb0 2023-06-24T01:49:04.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.352+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80e13d0 con 0x7fa6c80d4840 2023-06-24T01:49:04.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.352+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80e07c0 con 0x7fa6c80d4470 2023-06-24T01:49:04.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.353+0000 7fa6cf7fe700 1 -- 172.21.15.136:0/3928520261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c80d4840 msgr2=0x7fa6c80e1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:04.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.354+0000 7fa6cf7fe700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c80d4840 0x7fa6c80e1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:04.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.354+0000 7fa6cf7fe700 1 -- 172.21.15.136:0/3928520261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6c80dffb0 msgr2=0x7fa6c804c680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-24T01:49:04.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.354+0000 7fa6cf7fe700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6c80dffb0 0x7fa6c804c680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:04.357 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.354+0000 7fa6cf7fe700 1 -- 172.21.15.136:0/3928520261 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80e0aa0 con 0x7fa6c80d4470 2023-06-24T01:49:04.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.354+0000 7fa6ceffd700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c80d4840 0x7fa6c80e1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-24T01:49:04.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.355+0000 7fa6cf7fe700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c80d4470 0x7fa6c804e840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6d004fb70 tx=0x7fa6d00673d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:04.358 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.355+0000 7fa6bbfff700 1 -- 172.21.15.136:0/3928520261 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00721c0 con 0x7fa6c80d4470 2023-06-24T01:49:04.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.355+0000 7fa6bbfff700 1 -- 172.21.15.136:0/3928520261 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0072320 con 0x7fa6c80d4470 2023-06-24T01:49:04.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.355+0000 7fa6bbfff700 1 -- 172.21.15.136:0/3928520261 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0072490 con 0x7fa6c80d4470 2023-06-24T01:49:04.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.355+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c80e0d80 con 0x7fa6c80d4470 2023-06-24T01:49:04.359 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.356+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c80e0430 con 0x7fa6c80d4470 2023-06-24T01:49:04.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.359+0000 7fa6bbfff700 1 -- 172.21.15.136:0/3928520261 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6d00923c0 con 0x7fa6c80d4470 2023-06-24T01:49:04.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.361+0000 7fa6bbfff700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa6b406ac90 0x7fa6b406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:04.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.362+0000 7fa6bbfff700 1 -- 172.21.15.136:0/3928520261 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa6d00d57f0 con 0x7fa6c80d4470 2023-06-24T01:49:04.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.362+0000 7fa6ceffd700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa6b406ac90 0x7fa6b406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:04.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.363+0000 7fa6b9ffb700 1 -- 172.21.15.136:0/3928520261 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c8005500 con 0x7fa6c80d4470 2023-06-24T01:49:04.367 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.363+0000 7fa6ceffd700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa6b406ac90 0x7fa6b406d140 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80042f0 tx=0x7fa6bc005000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:04.386 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:04.383+0000 7fa6bbfff700 1 -- 172.21.15.136:0/3928520261 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6d00ce300 con 0x7fa6c80d4470 2023-06-24T01:49:05.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.286+0000 7fa6b9ffb700 1 -- 172.21.15.136:0/3928520261 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6c80078b0 con 0x7fa6c80d4470 2023-06-24T01:49:05.292 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.288+0000 7fa6bbfff700 1 -- 172.21.15.136:0/3928520261 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6d00ce300 con 0x7fa6c80d4470 2023-06-24T01:49:05.296 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 8 2023-06-24T01:49:05.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.295+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa6b406ac90 msgr2=0x7fa6b406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:05.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.295+0000 7fa6d61ff700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa6b406ac90 0x7fa6b406d140 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80042f0 tx=0x7fa6bc005000 comp rx=0 tx=0).stop 2023-06-24T01:49:05.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.295+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c80d4470 msgr2=0x7fa6c804e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:05.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.296+0000 7fa6d61ff700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c80d4470 0x7fa6c804e840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6d004fb70 tx=0x7fa6d00673d0 comp rx=0 tx=0).stop 2023-06-24T01:49:05.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.296+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 shutdown_connections 2023-06-24T01:49:05.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.297+0000 7fa6d61ff700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7fa6b406ac90 0x7fa6b406d140 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:05.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.297+0000 7fa6d61ff700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6c80dffb0 0x7fa6c804c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:05.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.297+0000 7fa6d61ff700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6c80d4470 0x7fa6c804e840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:05.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.297+0000 7fa6d61ff700 1 --2- 172.21.15.136:0/3928520261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6c80d4840 0x7fa6c80e1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:05.301 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.297+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 >> 172.21.15.136:0/3928520261 conn(0x7fa6c8051740 msgr2=0x7fa6c8048d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:05.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.299+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 shutdown_connections 2023-06-24T01:49:05.303 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:05.299+0000 7fa6d61ff700 1 -- 172.21.15.136:0/3928520261 wait complete. 2023-06-24T01:49:05.506 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-24T01:49:07.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:49:07.075 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:49:08.067 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.062+0000 7f01637ff700 1 Processor -- start 2023-06-24T01:49:08.067 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.062+0000 7f01637ff700 1 -- start start 2023-06-24T01:49:08.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.066+0000 7f01637ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0cb4b0 0x7f015c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:08.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.066+0000 7f01637ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f015c0ca260 0x7f015c160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:08.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.067+0000 7f01637ff700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c06cc90 con 0x7f015c0cb880 2023-06-24T01:49:08.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.067+0000 7f0161d9c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f015c0ca260 0x7f015c160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:08.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.067+0000 7f0160d9a700 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f015c0cb880 legacy=0x7f015c0c9b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2023-06-24T01:49:08.072 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.067+0000 7f0161d9c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f015c0ca260 0x7f015c160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:33034/0 (socket says 172.21.15.136:33034) 2023-06-24T01:49:08.073 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.067+0000 7f01637ff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c06cf70 con 0x7f015c0ca260 2023-06-24T01:49:08.073 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.067+0000 7f01637ff700 1 -- 172.21.15.136:0/1162023669 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c06d250 con 0x7f015c0cb4b0 2023-06-24T01:49:08.073 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.067+0000 7f0161d9c700 1 -- 172.21.15.136:0/1162023669 learned_addr learned my addr 172.21.15.136:0/1162023669 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-24T01:49:08.073 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.069+0000 7f0161d9c700 1 -- 172.21.15.136:0/1162023669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0cb4b0 msgr2=0x7f015c06c6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-24T01:49:08.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.069+0000 7f0161d9c700 1 --2- 172.21.15.136:0/1162023669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0cb4b0 0x7f015c06c6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:08.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.069+0000 7f0161d9c700 1 -- 172.21.15.136:0/1162023669 >> v1:172.21.15.136:6789/0 conn(0x7f015c0cb880 legacy=0x7f015c0c9b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:49:08.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.069+0000 7f0161d9c700 1 -- 172.21.15.136:0/1162023669 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c06d530 con 0x7f015c0ca260 2023-06-24T01:49:08.074 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.070+0000 7f0161d9c700 1 --2- 172.21.15.136:0/1162023669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0ca260 0x7f015c160390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0154009e50 tx=0x7f015400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fece83e95586fc server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:08.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.080+0000 7f0153fff700 1 -- 172.21.15.136:0/1162023669 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015400e070 con 0x7f015c0ca260 2023-06-24T01:49:08.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.080+0000 7f0153fff700 1 -- 172.21.15.136:0/1162023669 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0154003a20 con 0x7f015c0ca260 2023-06-24T01:49:08.097 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.094+0000 7f0153fff700 1 -- 172.21.15.136:0/1162023669 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0154003dd0 con 0x7f015c0ca260 2023-06-24T01:49:08.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.097+0000 7f01637ff700 1 -- 172.21.15.136:0/1162023669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0ca260 msgr2=0x7f015c160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:08.100 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.097+0000 7f01637ff700 1 --2- 172.21.15.136:0/1162023669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0ca260 0x7f015c160390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0154009e50 tx=0x7f015400b330 comp rx=0 tx=0).stop 2023-06-24T01:49:08.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.099+0000 7f01637ff700 1 -- 172.21.15.136:0/1162023669 shutdown_connections 2023-06-24T01:49:08.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.099+0000 7f01637ff700 1 --2- 172.21.15.136:0/1162023669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0ca260 0x7f015c160390 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:08.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.099+0000 7f01637ff700 1 --2- 172.21.15.136:0/1162023669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0cb4b0 0x7f015c06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:08.104 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.099+0000 7f01637ff700 1 -- 172.21.15.136:0/1162023669 >> 172.21.15.136:0/1162023669 conn(0x7f015c069ef0 msgr2=0x7f015c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:08.105 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.101+0000 7f01637ff700 1 -- 172.21.15.136:0/1162023669 shutdown_connections 2023-06-24T01:49:08.107 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.104+0000 7f01637ff700 1 -- 172.21.15.136:0/1162023669 wait complete. 2023-06-24T01:49:08.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.107+0000 7f01637ff700 1 Processor -- start 2023-06-24T01:49:08.111 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.108+0000 7f01637ff700 1 -- start start 2023-06-24T01:49:08.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.110+0000 7f01637ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0ca260 0x7f015c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:08.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.110+0000 7f01637ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c0cb4b0 0x7f015c20a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:08.113 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.110+0000 7f01637ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0cb880 0x7f015c0c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:08.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.110+0000 7f01637ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0c21f0 con 0x7f015c0cb4b0 2023-06-24T01:49:08.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.110+0000 7f01637ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c20a950 con 0x7f015c0cb880 2023-06-24T01:49:08.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.110+0000 7f01637ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0c7950 con 0x7f015c0ca260 2023-06-24T01:49:08.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.110+0000 7f0160d9a700 1 -- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c0cb4b0 msgr2=0x7f015c20a410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:49:08.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.110+0000 7f0160d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c0cb4b0 0x7f015c20a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:49:08.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.117+0000 7f016159b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0ca260 0x7f015c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:08.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.117+0000 7f016159b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0ca260 0x7f015c0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:37418/0 (socket says 172.21.15.136:37418) 2023-06-24T01:49:08.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.117+0000 7f016159b700 1 -- 172.21.15.136:0/2699271894 learned_addr learned my addr 172.21.15.136:0/2699271894 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-24T01:49:08.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.120+0000 7f0161d9c700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0cb880 0x7f015c0c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:08.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.120+0000 7f016159b700 1 -- 172.21.15.136:0/2699271894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0cb880 msgr2=0x7f015c0c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:08.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.120+0000 7f016159b700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0cb880 0x7f015c0c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:08.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.120+0000 7f016159b700 1 -- 172.21.15.136:0/2699271894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c0cb4b0 msgr2=0x7f015c20a410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-24T01:49:08.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.120+0000 7f016159b700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c0cb4b0 0x7f015c20a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:08.125 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.120+0000 7f016159b700 1 -- 172.21.15.136:0/2699271894 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0154009b30 con 0x7f015c0ca260 2023-06-24T01:49:08.125 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.121+0000 7f016159b700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0ca260 0x7f015c0c6d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f014c00b550 tx=0x7f014c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:08.130 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.127+0000 7f0151ffb700 1 -- 172.21.15.136:0/2699271894 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c011830 con 0x7f015c0ca260 2023-06-24T01:49:08.131 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.128+0000 7f0151ffb700 1 -- 172.21.15.136:0/2699271894 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c0119b0 con 0x7f015c0ca260 2023-06-24T01:49:08.131 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.128+0000 7f0151ffb700 1 -- 172.21.15.136:0/2699271894 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c011d60 con 0x7f015c0ca260 2023-06-24T01:49:08.132 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.129+0000 7f01637ff700 1 -- 172.21.15.136:0/2699271894 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c0c7c30 con 0x7f015c0ca260 2023-06-24T01:49:08.132 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.129+0000 7f01637ff700 1 -- 172.21.15.136:0/2699271894 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c0c2440 con 0x7f015c0ca260 2023-06-24T01:49:08.135 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.132+0000 7f01637ff700 1 -- 172.21.15.136:0/2699271894 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c0c8150 con 0x7f015c0ca260 2023-06-24T01:49:08.136 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.133+0000 7f0151ffb700 1 -- 172.21.15.136:0/2699271894 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f014c01a410 con 0x7f015c0ca260 2023-06-24T01:49:08.141 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.138+0000 7f0151ffb700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f014006ace0 0x7f014006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:08.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.139+0000 7f0160d9a700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f014006ace0 0x7f014006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:08.144 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.141+0000 7f0151ffb700 1 -- 172.21.15.136:0/2699271894 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f014c089190 con 0x7f015c0ca260 2023-06-24T01:49:08.144 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.141+0000 7f0151ffb700 1 -- 172.21.15.136:0/2699271894 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f014c08b660 con 0x7f015c0ca260 2023-06-24T01:49:08.145 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:08.142+0000 7f0160d9a700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f014006ace0 0x7f014006d190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0158006fd0 tx=0x7f0158006dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:09.154 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.151+0000 7f01637ff700 1 -- 172.21.15.136:0/2699271894 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f015c04ea20 con 0x7f015c0ca260 2023-06-24T01:49:09.160 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.157+0000 7f0151ffb700 1 -- 172.21.15.136:0/2699271894 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f014c0540a0 con 0x7f015c0ca260 2023-06-24T01:49:09.162 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2023-06-24T01:49:09.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.186+0000 7f013f7fe700 1 -- 172.21.15.136:0/2699271894 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f014006ace0 msgr2=0x7f014006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:09.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.186+0000 7f013f7fe700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f014006ace0 0x7f014006d190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0158006fd0 tx=0x7f0158006dc0 comp rx=0 tx=0).stop 2023-06-24T01:49:09.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.187+0000 7f013f7fe700 1 -- 172.21.15.136:0/2699271894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0ca260 msgr2=0x7f015c0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:09.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.187+0000 7f013f7fe700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0ca260 0x7f015c0c6d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f014c00b550 tx=0x7f014c00b910 comp rx=0 tx=0).stop 2023-06-24T01:49:09.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.201+0000 7f013f7fe700 1 -- 172.21.15.136:0/2699271894 shutdown_connections 2023-06-24T01:49:09.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.201+0000 7f013f7fe700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f014006ace0 0x7f014006d190 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:09.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.201+0000 7f013f7fe700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0cb880 0x7f015c0c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:09.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.201+0000 7f013f7fe700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c0ca260 0x7f015c0c6d70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:09.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.201+0000 7f013f7fe700 1 --2- 172.21.15.136:0/2699271894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c0cb4b0 0x7f015c20a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:09.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.202+0000 7f013f7fe700 1 -- 172.21.15.136:0/2699271894 >> 172.21.15.136:0/2699271894 conn(0x7f015c069ef0 msgr2=0x7f015c0cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:09.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.203+0000 7f013f7fe700 1 -- 172.21.15.136:0/2699271894 shutdown_connections 2023-06-24T01:49:09.206 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:09.203+0000 7f013f7fe700 1 -- 172.21.15.136:0/2699271894 wait complete. 2023-06-24T01:49:09.661 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-24T01:49:10.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.886+0000 7f3a1a39d700 1 Processor -- start 2023-06-24T01:49:10.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.886+0000 7f3a1a39d700 1 -- start start 2023-06-24T01:49:10.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.892+0000 7f3a1a39d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3a14160700 0x7f3a1406cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:10.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.892+0000 7f3a1a39d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14164200 0x7f3a14164680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:10.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.893+0000 7f3a1939b700 1 -- >> v2:172.21.15.136:3300/0 conn(0x7f3a14160700 msgr2=0x7f3a1406cbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:49:10.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.893+0000 7f3a1939b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3a14160700 0x7f3a1406cbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:49:10.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.894+0000 7f3a1a39d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140c8c10 con 0x7f3a140c1240 2023-06-24T01:49:10.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.894+0000 7f3a1a39d700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a14164bc0 con 0x7f3a14160700 2023-06-24T01:49:10.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.894+0000 7f3a1a39d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14160ad0 con 0x7f3a14164200 2023-06-24T01:49:10.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.898+0000 7f3a18b9a700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3a140c1240 0x7f3a140ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:44086/0 (socket says 172.21.15.136:44086) 2023-06-24T01:49:10.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.898+0000 7f3a18b9a700 1 -- 172.21.15.136:0/1650406585 learned_addr learned my addr 172.21.15.136:0/1650406585 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-24T01:49:10.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.912+0000 7f3a19b9c700 1 --2- 172.21.15.136:0/1650406585 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14164200 0x7f3a14164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:10.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.917+0000 7f3a19b9c700 1 -- 172.21.15.136:0/1650406585 >> v2:172.21.15.136:3300/0 conn(0x7f3a14160700 msgr2=0x7f3a1406cbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:49:10.921 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.918+0000 7f3a19b9c700 1 --2- 172.21.15.136:0/1650406585 >> v2:172.21.15.136:3300/0 conn(0x7f3a14160700 0x7f3a1406cbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:10.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.918+0000 7f3a19b9c700 1 -- 172.21.15.136:0/1650406585 >> v1:172.21.15.178:6789/0 conn(0x7f3a140c1240 legacy=0x7f3a140ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:10.922 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.919+0000 7f3a19b9c700 1 -- 172.21.15.136:0/1650406585 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a14164dd0 con 0x7f3a14164200 2023-06-24T01:49:10.923 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:10.920+0000 7f3a19b9c700 1 --2- 172.21.15.136:0/1650406585 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14164200 0x7f3a14164680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009840 tx=0x7f3a04009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25e9607261d0e123 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:11.076 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.072+0000 7f3a0bfff700 1 -- 172.21.15.136:0/1650406585 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04004230 con 0x7f3a14164200 2023-06-24T01:49:11.077 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.074+0000 7f3a0bfff700 1 -- 172.21.15.136:0/1650406585 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a04004390 con 0x7f3a14164200 2023-06-24T01:49:11.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.076+0000 7f3a1a39d700 1 -- 172.21.15.136:0/1650406585 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14164200 msgr2=0x7f3a14164680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:11.080 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.076+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/1650406585 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14164200 0x7f3a14164680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009840 tx=0x7f3a04009b50 comp rx=0 tx=0).stop 2023-06-24T01:49:11.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.077+0000 7f3a1a39d700 1 -- 172.21.15.136:0/1650406585 shutdown_connections 2023-06-24T01:49:11.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.077+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/1650406585 >> v2:172.21.15.136:3300/0 conn(0x7f3a14160700 0x7f3a1406cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:11.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.077+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/1650406585 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14164200 0x7f3a14164680 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:11.081 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.077+0000 7f3a1a39d700 1 -- 172.21.15.136:0/1650406585 >> 172.21.15.136:0/1650406585 conn(0x7f3a1406c0c0 msgr2=0x7f3a1406c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:11.082 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.078+0000 7f3a1a39d700 1 -- 172.21.15.136:0/1650406585 shutdown_connections 2023-06-24T01:49:11.083 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.078+0000 7f3a1a39d700 1 -- 172.21.15.136:0/1650406585 wait complete. 2023-06-24T01:49:11.130 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.127+0000 7f3a1a39d700 1 Processor -- start 2023-06-24T01:49:11.187 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.128+0000 7f3a1a39d700 1 -- start start 2023-06-24T01:49:11.248 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.244+0000 7f3a1a39d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a140c1240 0x7f3a14157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:11.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.245+0000 7f3a1939b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a140c1240 0x7f3a14157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:11.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.246+0000 7f3a1939b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a140c1240 0x7f3a14157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:33062/0 (socket says 172.21.15.136:33062) 2023-06-24T01:49:11.249 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.246+0000 7f3a1939b700 1 -- 172.21.15.136:0/642099177 learned_addr learned my addr 172.21.15.136:0/642099177 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-24T01:49:11.250 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.246+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14160700 0x7f3a140c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:11.251 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.248+0000 7f3a18b9a700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14160700 0x7f3a140c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:11.264 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.261+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a140c2680 0x7f3a140b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:11.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.262+0000 7f3a19b9c700 1 -- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a140c2680 msgr2=0x7f3a140b1560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:49:11.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.262+0000 7f3a19b9c700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a140c2680 0x7f3a140b1560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:49:11.265 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.262+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140c3af0 con 0x7f3a140c2680 2023-06-24T01:49:11.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.263+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140c3f10 con 0x7f3a140c1240 2023-06-24T01:49:11.266 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.263+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140c2e70 con 0x7f3a14160700 2023-06-24T01:49:11.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.265+0000 7f3a1939b700 1 -- 172.21.15.136:0/642099177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14160700 msgr2=0x7f3a140c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:11.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.265+0000 7f3a1939b700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14160700 0x7f3a140c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:11.268 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.265+0000 7f3a1939b700 1 -- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a140c2680 msgr2=0x7f3a140b1560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-24T01:49:11.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.265+0000 7f3a1939b700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a140c2680 0x7f3a140b1560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:11.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.265+0000 7f3a1939b700 1 -- 172.21.15.136:0/642099177 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040094a0 con 0x7f3a140c1240 2023-06-24T01:49:11.269 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.265+0000 7f3a1939b700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a140c1240 0x7f3a14157d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000b580 tx=0x7f3a1000b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:11.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.273+0000 7f3a09ffb700 1 -- 172.21.15.136:0/642099177 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10003e50 con 0x7f3a140c1240 2023-06-24T01:49:11.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.274+0000 7f3a09ffb700 1 -- 172.21.15.136:0/642099177 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a10005070 con 0x7f3a140c1240 2023-06-24T01:49:11.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.275+0000 7f3a09ffb700 1 -- 172.21.15.136:0/642099177 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10005420 con 0x7f3a140c1240 2023-06-24T01:49:11.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.276+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a140c3150 con 0x7f3a140c1240 2023-06-24T01:49:11.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.276+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a140c3710 con 0x7f3a140c1240 2023-06-24T01:49:11.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.281+0000 7f3a09ffb700 1 -- 172.21.15.136:0/642099177 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a10005580 con 0x7f3a140c1240 2023-06-24T01:49:11.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.296+0000 7f39f77fe700 1 -- 172.21.15.136:0/642099177 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1404ea20 con 0x7f3a140c1240 2023-06-24T01:49:11.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.300+0000 7f3a09ffb700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f39f806ace0 0x7f39f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:11.304 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.301+0000 7f3a09ffb700 1 -- 172.21.15.136:0/642099177 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3a100889f0 con 0x7f3a140c1240 2023-06-24T01:49:11.305 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.301+0000 7f3a18b9a700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f39f806ace0 0x7f39f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:11.306 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.303+0000 7f3a18b9a700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f39f806ace0 0x7f39f806d190 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3a140b4470 tx=0x7f3a0c001c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:11.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:11.305+0000 7f3a09ffb700 1 -- 172.21.15.136:0/642099177 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3a10053900 con 0x7f3a140c1240 2023-06-24T01:49:12.742 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.738+0000 7f39f77fe700 1 -- 172.21.15.136:0/642099177 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a140b44a0 con 0x7f3a140c1240 2023-06-24T01:49:12.746 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.742+0000 7f3a09ffb700 1 -- 172.21.15.136:0/642099177 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a10056f20 con 0x7f3a140c1240 2023-06-24T01:49:12.746 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2023-06-24T01:49:12.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.759+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f39f806ace0 msgr2=0x7f39f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:12.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.760+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f39f806ace0 0x7f39f806d190 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3a140b4470 tx=0x7f3a0c001c40 comp rx=0 tx=0).stop 2023-06-24T01:49:12.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.760+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a140c1240 msgr2=0x7f3a14157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:12.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.761+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a140c1240 0x7f3a14157d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000b580 tx=0x7f3a1000b890 comp rx=0 tx=0).stop 2023-06-24T01:49:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.761+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 shutdown_connections 2023-06-24T01:49:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.761+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f39f806ace0 0x7f39f806d190 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.762+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a140c1240 0x7f3a14157d70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.762+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a140c2680 0x7f3a140b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:12.765 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.762+0000 7f3a1a39d700 1 --2- 172.21.15.136:0/642099177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a14160700 0x7f3a140c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:12.766 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.762+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 >> 172.21.15.136:0/642099177 conn(0x7f3a1406c0c0 msgr2=0x7f3a140712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.762+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 shutdown_connections 2023-06-24T01:49:12.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:12.762+0000 7f3a1a39d700 1 -- 172.21.15.136:0/642099177 wait complete. 2023-06-24T01:49:12.824 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-24T01:49:14.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.376+0000 7f155939d700 1 Processor -- start 2023-06-24T01:49:14.380 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.377+0000 7f155939d700 1 -- start start 2023-06-24T01:49:14.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.386+0000 7f1553fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f15540d0500 0x7f15540d08d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.136:44092/0 (socket says 172.21.15.136:44092) 2023-06-24T01:49:14.390 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.386+0000 7f155939d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f15541458c0 0x7f155406bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.387+0000 7f15537fe700 1 -- >> v2:172.21.15.136:3300/0 conn(0x7f15541458c0 msgr2=0x7f155406bb60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:49:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.388+0000 7f15537fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f15541458c0 0x7f155406bb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:49:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.388+0000 7f1553fff700 1 -- 172.21.15.136:0/3580334306 learned_addr learned my addr 172.21.15.136:0/3580334306 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-06-24T01:49:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.388+0000 7f155939d700 1 --2- 172.21.15.136:0/3580334306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540af5c0 0x7f15540afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:14.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.389+0000 7f1558b9c700 1 --2- 172.21.15.136:0/3580334306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540af5c0 0x7f15540afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:14.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.389+0000 7f155939d700 1 -- 172.21.15.136:0/3580334306 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1554146110 con 0x7f15540d0500 2023-06-24T01:49:14.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.390+0000 7f155939d700 1 -- 172.21.15.136:0/3580334306 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155406ce00 con 0x7f15541458c0 2023-06-24T01:49:14.393 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.390+0000 7f155939d700 1 -- 172.21.15.136:0/3580334306 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155415c9b0 con 0x7f15540af5c0 2023-06-24T01:49:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.391+0000 7f1558b9c700 1 -- 172.21.15.136:0/3580334306 >> v2:172.21.15.136:3300/0 conn(0x7f15541458c0 msgr2=0x7f155406bb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-24T01:49:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.391+0000 7f1558b9c700 1 --2- 172.21.15.136:0/3580334306 >> v2:172.21.15.136:3300/0 conn(0x7f15541458c0 0x7f155406bb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.391+0000 7f1558b9c700 1 -- 172.21.15.136:0/3580334306 >> v1:172.21.15.178:6789/0 conn(0x7f15540d0500 legacy=0x7f15540d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.392+0000 7f1558b9c700 1 -- 172.21.15.136:0/3580334306 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155406c1f0 con 0x7f15540af5c0 2023-06-24T01:49:14.396 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.393+0000 7f1558b9c700 1 --2- 172.21.15.136:0/3580334306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540af5c0 0x7f15540afa40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f154c009d90 tx=0x7f154c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54931c8d3a2406c1 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:14.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.396+0000 7f1552ffd700 1 -- 172.21.15.136:0/3580334306 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00e070 con 0x7f15540af5c0 2023-06-24T01:49:14.399 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.396+0000 7f1552ffd700 1 -- 172.21.15.136:0/3580334306 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c00bad0 con 0x7f15540af5c0 2023-06-24T01:49:14.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.397+0000 7f1552ffd700 1 -- 172.21.15.136:0/3580334306 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00be80 con 0x7f15540af5c0 2023-06-24T01:49:14.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.398+0000 7f155939d700 1 -- 172.21.15.136:0/3580334306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540af5c0 msgr2=0x7f15540afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:14.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.399+0000 7f155939d700 1 --2- 172.21.15.136:0/3580334306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540af5c0 0x7f15540afa40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f154c009d90 tx=0x7f154c00b330 comp rx=0 tx=0).stop 2023-06-24T01:49:14.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.399+0000 7f155939d700 1 -- 172.21.15.136:0/3580334306 shutdown_connections 2023-06-24T01:49:14.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.399+0000 7f155939d700 1 --2- 172.21.15.136:0/3580334306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540af5c0 0x7f15540afa40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:14.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.400+0000 7f155939d700 1 --2- 172.21.15.136:0/3580334306 >> v2:172.21.15.136:3300/0 conn(0x7f15541458c0 0x7f155406bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:14.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.400+0000 7f155939d700 1 -- 172.21.15.136:0/3580334306 >> 172.21.15.136:0/3580334306 conn(0x7f1554071f40 msgr2=0x7f155409bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:14.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.400+0000 7f155939d700 1 -- 172.21.15.136:0/3580334306 shutdown_connections 2023-06-24T01:49:14.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.400+0000 7f155939d700 1 -- 172.21.15.136:0/3580334306 wait complete. 2023-06-24T01:49:14.414 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.411+0000 7f155939d700 1 Processor -- start 2023-06-24T01:49:14.415 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.412+0000 7f155939d700 1 -- start start 2023-06-24T01:49:14.418 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.415+0000 7f155939d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15540af5c0 0x7f155415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:14.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.416+0000 7f1553fff700 1 -- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15540af5c0 msgr2=0x7f155415e570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.136:3300/0 2023-06-24T01:49:14.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.416+0000 7f1553fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15540af5c0 0x7f155415e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-24T01:49:14.419 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.416+0000 7f155939d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540d0500 0x7f155409fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:14.420 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.417+0000 7f155939d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15541458c0 0x7f155414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:14.420 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.417+0000 7f15537fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540d0500 0x7f155409fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:14.420 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.417+0000 7f15537fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540d0500 0x7f155409fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.136:37464/0 (socket says 172.21.15.136:37464) 2023-06-24T01:49:14.421 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.417+0000 7f1558b9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15541458c0 0x7f155414b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:14.421 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.417+0000 7f1558b9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15541458c0 0x7f155414b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.136:33072/0 (socket says 172.21.15.136:33072) 2023-06-24T01:49:14.421 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.418+0000 7f15537fe700 1 -- 172.21.15.136:0/2056211778 learned_addr learned my addr 172.21.15.136:0/2056211778 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-06-24T01:49:14.421 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.418+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155414c6b0 con 0x7f15540af5c0 2023-06-24T01:49:14.422 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.418+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540c6600 con 0x7f15541458c0 2023-06-24T01:49:14.422 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.418+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540c68e0 con 0x7f15540d0500 2023-06-24T01:49:14.426 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.422+0000 7f15537fe700 1 -- 172.21.15.136:0/2056211778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15541458c0 msgr2=0x7f155414b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:14.426 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.422+0000 7f15537fe700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15541458c0 0x7f155414b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:14.426 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.422+0000 7f15537fe700 1 -- 172.21.15.136:0/2056211778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15540af5c0 msgr2=0x7f155415e570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-24T01:49:14.426 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.422+0000 7f15537fe700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15540af5c0 0x7f155415e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:14.426 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.422+0000 7f15537fe700 1 -- 172.21.15.136:0/2056211778 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c009a70 con 0x7f15540d0500 2023-06-24T01:49:14.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.423+0000 7f1558b9c700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15541458c0 0x7f155414b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-24T01:49:14.427 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.423+0000 7f15537fe700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540d0500 0x7f155409fec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f154800b580 tx=0x7f154800b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:14.479 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.476+0000 7f1550ff9700 1 -- 172.21.15.136:0/2056211778 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548003e50 con 0x7f15540d0500 2023-06-24T01:49:14.480 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.476+0000 7f1550ff9700 1 -- 172.21.15.136:0/2056211778 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1548005070 con 0x7f15540d0500 2023-06-24T01:49:14.480 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.476+0000 7f1550ff9700 1 -- 172.21.15.136:0/2056211778 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548005420 con 0x7f15540d0500 2023-06-24T01:49:14.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.476+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15540c6bc0 con 0x7f15540d0500 2023-06-24T01:49:14.482 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.476+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155415be10 con 0x7f15540d0500 2023-06-24T01:49:14.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.493+0000 7f1550ff9700 1 -- 172.21.15.136:0/2056211778 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1548005580 con 0x7f15540d0500 2023-06-24T01:49:14.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.494+0000 7f1550ff9700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f153806ad80 0x7f153806d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-24T01:49:14.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.494+0000 7f1550ff9700 1 -- 172.21.15.136:0/2056211778 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f1548088980 con 0x7f15540d0500 2023-06-24T01:49:14.499 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.495+0000 7f1553fff700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f153806ad80 0x7f153806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-24T01:49:14.500 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.497+0000 7f1553fff700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f153806ad80 0x7f153806d230 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f15440048a0 tx=0x7f1544007bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-24T01:49:14.562 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.559+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15300052f0 con 0x7f15540d0500 2023-06-24T01:49:14.570 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:14.567+0000 7f1550ff9700 1 -- 172.21.15.136:0/2056211778 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15480573b0 con 0x7f15540d0500 2023-06-24T01:49:15.377 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.374+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1530005b20 con 0x7f15540d0500 2023-06-24T01:49:15.378 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.375+0000 7f1550ff9700 1 -- 172.21.15.136:0/2056211778 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1548009350 con 0x7f15540d0500 2023-06-24T01:49:15.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.378+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f153806ad80 msgr2=0x7f153806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:15.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.378+0000 7f155939d700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f153806ad80 0x7f153806d230 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f15440048a0 tx=0x7f1544007bb0 comp rx=0 tx=0).stop 2023-06-24T01:49:15.381 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.378+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540d0500 msgr2=0x7f155409fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-24T01:49:15.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.378+0000 7f155939d700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540d0500 0x7f155409fec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f154800b580 tx=0x7f154800b890 comp rx=0 tx=0).stop 2023-06-24T01:49:15.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.379+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 shutdown_connections 2023-06-24T01:49:15.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.379+0000 7f155939d700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.136:6832/2653877961,v1:172.21.15.136:6833/2653877961] conn(0x7f153806ad80 0x7f153806d230 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:15.382 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.379+0000 7f155939d700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15541458c0 0x7f155414b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:15.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.379+0000 7f155939d700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15540af5c0 0x7f155415e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:15.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.379+0000 7f155939d700 1 --2- 172.21.15.136:0/2056211778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15540d0500 0x7f155409fec0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-24T01:49:15.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.379+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 >> 172.21.15.136:0/2056211778 conn(0x7f1554071f40 msgr2=0x7f15540b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-24T01:49:15.383 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.379+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 shutdown_connections 2023-06-24T01:49:15.384 INFO:teuthology.orchestra.run.smithi136.stderr:2023-06-24T01:49:15.379+0000 7f155939d700 1 -- 172.21.15.136:0/2056211778 wait complete. 2023-06-24T01:49:15.384 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2023-06-24T01:49:15.435 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-24T01:49:15.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-24T01:49:15.436 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-24T01:49:17.666 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2023-06-24T01:49:17.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-24T01:49:17.666 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-24T01:49:17.828 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-06-24T01:49:17.829 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-24T01:49:18.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345680k,nr_inodes=4086420,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.136:6789:/test /tmp/tmp.4pZPdhEOtdtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=ad363bec-53b9-481a-9d11-1e4839eb0e65,acl 0 0 2023-06-24T01:49:18.388 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2023-06-24T01:49:18.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-24T01:49:18.389 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-24T01:49:18.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T01:49:18.444 INFO:teuthology.orchestra.run.smithi136.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-24T01:49:18.445 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-24T01:49:18.445 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-24T01:49:18.506 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345640k,nr_inodes=4086410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=32,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3274992k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-24T01:49:18.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2023-06-24T01:49:18.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-24T01:49:18.507 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-24T01:49:18.597 INFO:teuthology.orchestra.run.smithi178.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-06-24T01:49:18.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T01:49:18.598 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-06-24T01:49:18.599 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-24T01:49:18.645 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345640k,nr_inodes=4086410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=32,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3274992k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-24T01:49:18.646 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2023-06-24T01:49:18.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-24T01:49:18.646 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-24T01:49:18.730 INFO:teuthology.orchestra.run.smithi178.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-24T01:49:18.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T01:49:20.342 INFO:tasks.ceph.osd.0:Sent signal 15 2023-06-24T01:49:20.343 INFO:tasks.ceph.osd.1:Sent signal 15 2023-06-24T01:49:20.344 INFO:tasks.ceph.osd.2:Sent signal 15 2023-06-24T01:49:20.344 INFO:tasks.ceph.osd.3:Sent signal 15 2023-06-24T01:49:20.344 INFO:tasks.ceph.osd.4:Sent signal 15 2023-06-24T01:49:20.345 INFO:tasks.ceph.osd.5:Sent signal 15 2023-06-24T01:49:20.345 INFO:tasks.ceph.osd.6:Sent signal 15 2023-06-24T01:49:20.345 INFO:tasks.ceph.osd.7:Sent signal 15 2023-06-24T01:49:20.346 INFO:tasks.ceph.mds.a:Sent signal 15 2023-06-24T01:49:20.346 INFO:tasks.ceph.mds.c:Sent signal 15 2023-06-24T01:49:20.346 INFO:tasks.ceph.mds.b:Sent signal 15 2023-06-24T01:49:20.346 INFO:tasks.ceph.mds.d:Sent signal 15 2023-06-24T01:49:20.347 INFO:tasks.ceph.mon.b:Sent signal 15 2023-06-24T01:49:20.347 INFO:tasks.ceph.mon.c:Sent signal 15 2023-06-24T01:49:20.347 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-06-24T01:49:20.348 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-06-24T01:49:20.348 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T01:49:20.341+0000 7f6f7dbf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 129959) UID: 0 2023-06-24T01:49:20.348 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T01:49:20.341+0000 7f6f7dbf9700 -1 osd.4 46 *** Got signal Terminated *** 2023-06-24T01:49:20.349 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-06-24T01:49:20.341+0000 7f6f7dbf9700 -1 osd.4 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-24T01:49:20.349 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T01:49:20.342+0000 7fea081f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 129961) UID: 0 2023-06-24T01:49:20.349 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T01:49:20.342+0000 7fea081f9700 -1 osd.5 46 *** Got signal Terminated *** 2023-06-24T01:49:20.349 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-06-24T01:49:20.342+0000 7fea081f9700 -1 osd.5 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-24T01:49:20.350 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T01:49:20.342+0000 7f5eba7f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 129966) UID: 0 2023-06-24T01:49:20.350 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T01:49:20.342+0000 7f5eba7f9700 -1 osd.6 46 *** Got signal Terminated *** 2023-06-24T01:49:20.350 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-06-24T01:49:20.342+0000 7f5eba7f9700 -1 osd.6 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-24T01:49:20.351 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T01:49:20.342+0000 7fa4689f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 129965) UID: 0 2023-06-24T01:49:20.351 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T01:49:20.342+0000 7fa4689f9700 -1 osd.7 46 *** Got signal Terminated *** 2023-06-24T01:49:20.351 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-06-24T01:49:20.342+0000 7fa4689f9700 -1 osd.7 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-24T01:49:20.351 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-24T01:49:20.343+0000 7f113b1f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 136313) UID: 0 2023-06-24T01:49:20.352 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-06-24T01:49:20.343+0000 7f113b1f9700 -1 mds.b *** got signal Terminated *** 2023-06-24T01:49:20.352 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-24T01:49:20.344+0000 7f535adf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 136312) UID: 0 2023-06-24T01:49:20.352 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-06-24T01:49:20.344+0000 7f535adf9700 -1 mds.d *** got signal Terminated *** 2023-06-24T01:49:20.353 INFO:tasks.ceph.mon.c.smithi178.stderr:2023-06-24T01:49:20.344+0000 7f3285fff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 127653) UID: 0 2023-06-24T01:49:20.353 INFO:tasks.ceph.mon.c.smithi178.stderr:2023-06-24T01:49:20.344+0000 7f3285fff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-06-24T01:49:20.353 INFO:tasks.ceph.mon.b.smithi178.stderr:2023-06-24T01:49:20.344+0000 7f3d1d3ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 127651) UID: 0 2023-06-24T01:49:20.353 INFO:tasks.ceph.mon.b.smithi178.stderr:2023-06-24T01:49:20.344+0000 7f3d1d3ff700 -1 mon.b@1(leader) e1 *** Got Signal Terminated *** 2023-06-24T01:49:20.359 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T01:49:20.342+0000 7f494e1f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 129747) UID: 0 2023-06-24T01:49:20.359 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T01:49:20.342+0000 7f494e1f9700 -1 osd.2 46 *** Got signal Terminated *** 2023-06-24T01:49:20.359 INFO:tasks.ceph.osd.2.smithi136.stderr:2023-06-24T01:49:20.342+0000 7f494e1f9700 -1 osd.2 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-24T01:49:20.368 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T01:49:20.341+0000 7f91d13f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 129734) UID: 0 2023-06-24T01:49:20.368 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T01:49:20.341+0000 7f91d13f9700 -1 osd.0 46 *** Got signal Terminated *** 2023-06-24T01:49:20.368 INFO:tasks.ceph.osd.0.smithi136.stderr:2023-06-24T01:49:20.341+0000 7f91d13f9700 -1 osd.0 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-24T01:49:20.369 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T01:49:20.356+0000 7fe8a6ff9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 129748) UID: 0 2023-06-24T01:49:20.369 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T01:49:20.356+0000 7fe8a6ff9700 -1 osd.3 46 *** Got signal Terminated *** 2023-06-24T01:49:20.369 INFO:tasks.ceph.osd.3.smithi136.stderr:2023-06-24T01:49:20.356+0000 7fe8a6ff9700 -1 osd.3 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-24T01:49:20.381 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T01:49:20.342+0000 7f2405df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 129740) UID: 0 2023-06-24T01:49:20.382 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T01:49:20.342+0000 7f2405df9700 -1 osd.1 46 *** Got signal Terminated *** 2023-06-24T01:49:20.382 INFO:tasks.ceph.osd.1.smithi136.stderr:2023-06-24T01:49:20.342+0000 7f2405df9700 -1 osd.1 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-24T01:49:20.391 INFO:tasks.ceph.mds.a.smithi136.stderr:2023-06-24T01:49:20.375+0000 7fdc067f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 144402) UID: 0 2023-06-24T01:49:20.391 INFO:tasks.ceph.mds.a.smithi136.stderr:2023-06-24T01:49:20.387+0000 7fdc067f9700 -1 mds.a *** got signal Terminated *** 2023-06-24T01:49:20.391 INFO:tasks.ceph.mds.c.smithi136.stderr:2023-06-24T01:49:20.369+0000 7f1396df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 144403) UID: 0 2023-06-24T01:49:20.392 INFO:tasks.ceph.mds.c.smithi136.stderr:2023-06-24T01:49:20.387+0000 7f1396df9700 -1 mds.c *** got signal Terminated *** 2023-06-24T01:49:20.549 INFO:tasks.ceph.mgr.x.smithi178.stderr:daemon-helper: command crashed with signal 15 2023-06-24T01:49:37.948 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:49:37.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:08.252 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:08.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:38.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:38.471 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:08.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:08.789 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:39.064 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:39.073 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:09.218 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:09.228 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:39.470 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:39.479 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:09.701 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:09.711 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:39.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:39.973 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:10.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:10.269 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:40.504 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:40.514 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:10.688 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:10.699 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:41.004 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:41.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:11.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:11.250 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:41.461 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:41.537 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:11.954 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:11.964 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:42.203 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:42.212 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:12.354 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:12.362 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:42.478 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:42.486 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:12.668 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:12.678 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:42.886 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:42.895 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:13.019 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:13.028 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:43.265 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:43.273 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:13.495 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:13.504 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:43.648 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:43.657 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:13.873 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:13.880 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:44.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:44.106 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:14.227 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:14.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:44.518 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:44.525 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:14.705 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:14.712 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:44.900 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:44.909 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:15.267 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:15.276 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:45.564 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:45.570 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:15.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:15.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:45.988 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:45.996 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:16.202 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:16.208 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:46.537 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:46.545 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:16.758 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:16.765 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:46.990 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:46.995 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:17.124 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:17.133 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:47.378 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:47.386 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:17.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:17.599 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:47.794 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:47.803 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:17.965 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:17.975 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:48.205 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:48.213 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:18.416 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:18.427 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:48.671 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:48.680 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:18.843 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:18.851 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:49.062 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:49.072 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:19.302 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:19.310 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:49.454 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:49.463 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:19.704 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:19.710 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:49.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:49.986 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:20.222 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:20.231 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:50.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:50.422 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:20.957 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:20.966 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:51.279 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:51.289 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:21.499 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:21.508 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:51.685 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:51.691 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:21.885 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:21.895 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:52.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:52.115 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:22.347 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:22.358 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:52.584 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:52.592 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:22.789 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:22.798 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:53.019 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:53.029 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:23.314 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:23.323 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:53.490 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:53.496 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:23.673 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:23.684 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:53.965 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:53.975 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:24.213 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:24.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:54.509 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:54.518 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:24.895 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:24.901 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:55.174 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:55.181 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:25.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:25.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:55.684 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:55.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:25.926 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:25.933 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:56.146 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:56.163 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:26.325 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:26.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:56.584 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:56.593 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:26.953 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:26.962 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:57.224 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:57.231 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:27.518 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:27.525 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:57.734 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:57.744 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:27.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:27.873 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:58.176 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:58.186 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:28.445 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:28.456 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:58.648 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:58.654 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:28.979 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:28.986 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:59.288 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:59.297 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:29.479 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:29.489 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:59.731 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:59.740 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:35:29.877 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:35:29.886 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:00.106 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:00.113 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:30.341 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:30.352 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:00.570 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:00.580 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:30.827 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:30.834 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:01.055 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:01.062 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:31.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:31.282 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:01.501 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:01.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:31.754 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:31.766 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:02.079 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:02.090 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:32.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:32.405 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:02.782 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:02.792 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:33.116 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:33.127 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:03.466 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:03.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:33.724 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:33.733 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:03.928 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:03.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:34.189 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:34.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:04.610 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:04.620 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:34.853 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:34.862 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:05.107 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:05.113 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:35.288 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:35.297 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:05.457 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:05.464 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:35.644 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:35.655 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:05.880 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:05.887 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:36.118 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:36.129 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:06.308 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:06.315 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:36.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:36.472 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:06.783 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:06.793 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:37.095 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:37.104 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:07.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:07.322 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:37.602 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:37.611 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:07.891 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:07.901 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:38.066 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:38.073 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:08.330 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:08.339 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:38.568 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:38.578 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:08.806 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:08.815 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:39.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:39.017 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:09.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:09.217 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:39.424 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:39.431 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:09.650 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:09.658 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:39.889 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:39.895 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:10.166 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:10.176 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:40.494 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:40.501 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:57:10.757 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:57:10.764 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:57:41.088 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:57:41.097 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:11.347 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:11.354 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:41.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:41.567 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:11.736 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:11.746 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:41.957 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:41.967 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:12.199 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:12.209 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:42.461 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:42.467 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:12.713 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:12.722 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:43.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:43.192 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:13.365 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:13.374 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:43.607 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:43.616 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:13.738 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:13.749 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:43.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:43.987 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:14.186 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:14.195 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:44.407 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:44.412 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:14.595 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:14.604 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:44.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:44.805 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:14.984 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:14.995 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:45.290 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:45.299 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:15.502 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:15.511 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:45.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:45.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:16.045 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:16.060 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:46.347 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:46.357 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:16.640 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:16.649 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:46.930 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:46.941 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:17.127 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:17.132 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:47.325 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:47.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:17.566 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:17.576 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:47.828 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:47.839 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:18.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:18.165 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:48.473 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:48.483 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:18.706 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:18.716 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:48.908 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:48.918 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:19.139 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:19.148 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:49.434 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:49.440 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:19.660 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:19.665 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:49.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:49.878 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:20.083 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:20.094 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:50.400 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:50.406 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:20.515 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:20.526 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:50.775 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:50.784 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:20.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:20.987 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:51.254 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:51.260 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:21.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:21.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:51.673 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:51.681 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:21.886 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:21.896 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:52.206 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:52.216 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:22.501 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:22.508 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:52.788 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:52.795 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:23.088 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:23.098 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:53.379 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:53.389 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:23.574 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:23.580 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:53.768 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:53.779 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:24.076 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:24.084 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:54.371 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:54.378 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:24.630 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:24.640 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:54.887 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:54.897 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:25.199 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:25.206 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:55.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:55.405 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:25.672 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:25.682 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:55.893 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:55.904 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:26.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:26.221 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:56.464 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:56.475 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:26.788 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:26.793 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:57.007 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:57.017 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:27.309 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:27.318 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:57.528 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:57.535 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:27.726 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:27.732 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:57.929 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:57.935 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:28.108 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:28.113 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:58.371 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:58.381 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:28.638 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:28.648 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:58.929 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:58.939 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:29.181 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:29.192 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:59.645 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:59.654 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:35:29.820 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:35:29.827 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:00.135 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:00.146 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:30.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:30.411 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:00.617 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:00.627 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:30.862 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:30.873 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:01.100 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:01.110 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:31.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:31.327 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:01.632 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:01.642 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:31.866 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:31.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:02.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:02.091 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:32.294 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:32.300 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:02.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:02.605 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:32.893 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:32.904 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:03.129 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:03.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:33.341 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:33.348 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:03.687 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:03.692 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:33.808 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:33.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:04.053 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:04.064 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:34.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:34.331 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:04.628 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:04.638 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:34.919 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:34.929 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:05.142 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:05.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:35.335 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:35.342 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:05.557 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:05.567 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:35.791 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:35.799 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:05.985 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:05.992 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:36.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:36.213 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:06.505 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:06.513 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:36.697 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:36.706 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:06.951 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:06.961 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:37.233 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:37.239 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:07.433 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:07.440 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:37.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:37.657 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:07.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:07.875 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:38.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:38.119 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:08.290 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:08.307 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:38.494 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:38.504 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:08.780 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:08.790 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:39.026 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:39.035 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:09.191 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:09.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:39.457 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:39.468 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:09.722 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:09.730 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:39.951 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:39.963 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:10.270 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:10.281 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:40.497 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:40.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:10.742 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:10.748 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:40.916 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:40.923 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:11.194 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:11.203 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:41.381 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:41.386 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:11.581 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:11.591 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:41.886 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:41.896 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:12.292 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:12.303 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:42.492 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:42.499 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:12.782 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:12.792 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:43.220 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:43.227 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:13.406 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:13.416 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:43.608 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:43.617 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:13.864 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:13.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:44.102 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:44.111 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:14.409 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:14.418 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:44.624 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:44.634 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:14.928 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:14.939 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:45.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:45.167 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:15.565 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:15.576 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:45.864 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:45.875 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:16.015 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:16.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:46.246 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:46.253 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:16.467 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:16.475 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:46.626 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:46.637 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:16.957 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:16.967 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:47.226 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:47.235 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:17.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:17.435 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:47.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:47.628 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:17.905 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:17.915 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:48.396 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:48.403 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:18.610 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:18.616 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:48.833 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:48.839 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:19.023 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:19.029 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:49.303 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:49.308 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:19.506 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:19.512 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:49.703 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:49.708 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:19.906 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:19.912 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:50.212 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:50.222 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:20.402 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:20.413 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:50.944 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:50.952 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:21.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:21.165 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:51.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:51.412 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:21.714 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:21.724 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:51.936 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:51.947 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:22.150 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:22.159 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:52.351 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:52.357 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:22.577 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:22.586 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:52.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:52.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:23.110 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:23.116 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:53.368 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:53.375 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:23.656 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:23.666 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:53.861 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:53.870 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:24.050 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:24.059 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:54.254 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:54.264 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:24.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:24.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:54.722 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:54.728 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:26:24.909 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:26:24.919 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:26:55.179 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:26:55.189 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:25.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:25.444 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:55.581 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:55.588 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:25.868 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:25.878 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:56.154 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:56.161 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:26.317 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:26.324 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:56.604 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:56.610 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:26.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:26.802 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:57.052 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:57.058 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:27.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:27.292 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:57.526 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:57.536 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:27.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:27.753 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:57.967 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:57.976 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:28.161 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:28.170 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:58.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:58.422 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:28.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:28.687 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:58.997 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:59.007 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:29.298 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:29.308 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:59.527 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:59.537 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:36:29.809 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:36:29.816 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:00.003 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:00.013 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:30.307 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:30.317 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:00.560 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:00.570 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:30.803 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:30.813 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:01.009 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:01.016 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:31.219 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:31.229 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:01.536 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:01.546 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:31.809 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:31.814 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:02.011 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:02.016 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:32.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:32.218 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:02.429 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:02.440 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:32.675 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:32.681 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:02.868 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:02.877 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:33.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:33.061 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:03.348 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:03.357 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:33.658 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:33.669 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:03.914 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:03.919 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:34.135 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:34.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:04.322 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:04.331 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:34.547 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:34.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:04.817 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:04.826 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:34.956 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:34.966 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:05.278 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:05.288 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:35.599 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:35.608 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:05.777 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:05.785 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:35.954 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:35.965 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:06.226 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:06.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:36.538 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:36.545 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:06.830 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:06.840 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:37.059 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:37.068 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:07.279 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:07.289 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:37.583 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:37.592 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:07.829 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:07.839 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:38.202 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:38.209 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:08.689 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:08.699 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:38.982 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:38.991 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:09.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:09.206 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:39.476 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:39.487 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:09.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:09.753 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:39.970 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:39.979 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:10.203 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:10.213 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:40.441 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:40.450 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:10.633 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:10.642 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:40.769 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:40.780 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:10.956 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:10.967 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:41.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:41.193 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:11.364 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:11.370 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:41.527 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:41.535 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:11.671 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:11.680 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:41.866 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:41.876 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:11.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:12.006 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:42.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:42.211 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:12.439 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:12.444 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:42.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:42.605 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:12.821 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:12.828 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:43.050 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:43.059 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:13.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:13.297 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:43.605 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:43.616 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:13.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:13.884 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:44.140 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:44.150 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:14.393 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:14.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:44.606 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:44.616 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:14.818 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:14.829 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:45.072 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:45.081 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:15.246 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:15.257 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:45.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:45.489 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:15.661 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:15.667 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:45.873 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:45.883 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:16.115 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:16.125 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:46.297 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:46.303 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:16.501 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:16.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:46.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:46.726 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:16.948 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:16.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:47.151 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:47.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:17.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:17.345 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:47.559 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:47.569 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:17.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:17.787 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:47.991 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:48.001 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:18.186 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:18.196 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:48.408 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:48.418 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:18.618 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:18.628 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:48.830 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:48.837 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:19.047 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:19.056 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:49.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:49.285 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:19.505 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:19.515 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:49.709 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:49.715 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:19.979 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:19.986 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:50.220 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:50.228 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:20.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:20.421 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:50.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:50.669 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:20.997 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:21.007 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:51.280 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:51.292 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:21.505 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:21.514 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:51.766 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:51.771 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:21.932 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:21.941 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:52.152 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:52.163 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:22.394 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:22.399 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:52.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:52.612 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:22.823 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:22.832 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:53.028 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:53.033 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:23.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:23.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:53.420 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:53.433 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:23.708 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:23.713 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:53.916 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:53.922 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:24.102 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:24.108 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:54.386 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:54.397 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:24.602 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:24.613 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:54.844 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:54.861 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:25.119 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:25.130 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:55.426 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:55.436 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:25.726 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:25.735 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:55.940 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:55.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:26.184 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:26.193 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:56.545 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:56.552 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:26.908 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:26.919 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:57.199 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:57.209 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:27.503 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:27.508 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:57.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:57.703 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:27.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:27.848 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:58.013 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:58.021 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:28.182 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:28.192 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:58.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:58.426 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:28.655 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:28.665 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:58.971 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:58.979 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:29.164 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:29.171 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:59.426 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:59.433 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:29.613 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:29.623 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:59.852 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:59.859 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:41:30.009 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:41:30.019 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:00.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:00.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:30.450 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:30.460 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:00.638 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:00.648 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:30.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:30.878 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:01.108 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:01.118 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:31.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:31.326 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:01.592 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:01.597 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:31.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:31.738 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:01.894 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:01.903 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:32.059 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:32.073 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:02.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:02.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:32.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:32.477 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:02.646 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:02.655 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:32.879 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:32.888 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:03.099 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:03.109 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:33.273 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:33.282 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:03.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:03.472 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:33.657 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:33.667 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:03.849 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:03.856 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:34.036 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:34.047 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:04.250 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:04.261 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:34.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:34.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:04.624 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:04.635 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:34.828 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:34.838 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:54:05.117 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:54:05.122 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:54:35.275 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:54:35.287 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:55:05.499 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:55:05.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:55:35.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:55:35.822 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:06.034 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:06.043 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:36.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:36.248 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:06.422 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:06.432 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:36.647 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:36.656 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:06.792 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:06.799 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:37.013 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:37.020 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:07.328 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:07.333 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:37.546 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:37.557 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:07.785 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:07.794 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:37.958 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:37.967 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:08.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:08.194 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:38.434 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:38.440 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:08.630 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:08.638 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:38.860 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:38.870 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:09.266 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:09.273 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:39.516 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:39.527 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:09.832 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:09.839 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:40.128 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:40.139 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:10.418 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:10.427 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:40.624 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:40.633 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:10.845 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:10.855 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:41.083 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:41.092 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:11.303 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:11.313 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:41.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:41.559 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:11.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:11.764 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:42.031 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:42.043 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:12.251 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:12.258 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:42.556 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:42.566 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:12.763 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:12.772 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:42.961 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:42.972 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:13.209 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:13.214 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:43.409 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:43.415 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:13.665 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:13.673 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:43.864 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:43.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:14.039 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:14.064 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:44.360 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:44.370 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:14.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:14.631 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:44.790 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:44.799 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:14.973 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:14.979 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:45.159 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:45.164 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:15.355 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:15.364 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:45.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:45.560 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:15.845 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:15.855 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:46.081 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:46.090 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:16.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:16.287 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:46.547 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:46.557 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:16.835 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:16.846 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:47.047 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:47.061 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:17.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:17.301 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:47.493 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:47.502 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:17.680 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:17.689 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:47.874 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:47.885 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:18.065 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:18.073 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:48.274 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:48.284 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:18.514 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:18.524 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:48.714 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:48.720 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:18.944 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:18.953 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:49.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:49.155 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:19.341 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:19.351 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:49.535 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:49.542 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:19.731 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:19.741 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:49.965 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:49.974 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:27:20.155 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:27:20.164 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:27:50.366 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:27:50.376 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:28:20.553 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:28:20.563 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:28:50.763 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:28:50.772 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:29:20.943 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:29:20.953 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:29:51.263 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:29:51.271 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:30:21.790 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:30:21.797 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:30:51.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:30:52.005 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:31:22.224 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:31:22.235 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:31:52.504 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:31:52.514 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:32:22.705 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:32:22.716 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:32:52.915 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:32:52.927 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:33:23.206 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:33:23.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:33:53.414 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:33:53.424 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:34:23.755 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:34:23.760 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:34:54.002 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:34:54.009 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:35:24.209 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:35:24.217 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:35:54.415 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:35:54.424 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:36:24.623 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:36:24.634 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:36:54.856 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:36:54.865 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:37:25.074 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:37:25.081 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:37:55.293 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:37:55.303 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:38:25.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:38:25.492 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:38:55.687 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:38:55.695 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:39:25.896 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:39:25.903 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:39:37.575 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-24T06:39:37.576 DEBUG:teuthology.task.console_log:Killing console logger for smithi136 2023-06-24T06:39:37.578 DEBUG:teuthology.task.console_log:Killing console logger for smithi178 2023-06-24T06:39:37.579 DEBUG:teuthology.exit:Finished running handlers